CFP last date
21 July 2025
Reseach Article

Developing a Scalable AI Framework for Moderating Social Media Content

by Anusha Musunuri
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 187 - Number 12
Year of Publication: 2025
Authors: Anusha Musunuri
10.5120/ijca2025925156

Anusha Musunuri . Developing a Scalable AI Framework for Moderating Social Media Content. International Journal of Computer Applications. 187, 12 ( Jun 2025), 43-48. DOI=10.5120/ijca2025925156

@article{ 10.5120/ijca2025925156,
author = { Anusha Musunuri },
title = { Developing a Scalable AI Framework for Moderating Social Media Content },
journal = { International Journal of Computer Applications },
issue_date = { Jun 2025 },
volume = { 187 },
number = { 12 },
month = { Jun },
year = { 2025 },
issn = { 0975-8887 },
pages = { 43-48 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume187/number12/developing-a-scalable-ai-framework-for-moderating-social-media-content/ },
doi = { 10.5120/ijca2025925156 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2025-06-21T01:56:52.789781+05:30
%A Anusha Musunuri
%T Developing a Scalable AI Framework for Moderating Social Media Content
%J International Journal of Computer Applications
%@ 0975-8887
%V 187
%N 12
%P 43-48
%D 2025
%I Foundation of Computer Science (FCS), NY, USA
Abstract

As social media platforms continue to grow in scale and influence, they are increasingly used to spread not only positive content but also harmful and inappropriate material. Traditional content moderation methods, which rely heavily on manual review, are often expensive, time-consuming, and lack the scalability required to keep up with the volume of user-generated content. This has prompted a shift toward automated, AI-driven moderation systems. In this work, presented is a technical overview of an AI-powered framework designed to moderate user content on social platforms efficiently. The process begins with collecting large volumes of data from various social media sources, which is then stored in a centralized database for further processing and analysis. The next stage involves preprocessing this raw data to eliminate irrelevant or noisy content, such as advertisements, bot-generated text, and unrelated user comments. This cleaning step ensures that only high-quality, relevant data is used to train the machine learning models. Once prepared, the dataset is used to train deep learning models capable of identifying patterns and features associated with harmful or policy-violating content. These models are trained to recognize multiple categories of toxic content, including but not limited to hate speech, spam, and explicit imagery. Importantly, the system incorporates contextual and cultural sensitivity to reduce false positives and improve classification accuracy across diverse user bases. Following training, the models are integrated into a post-level classification pipeline. When a new post is submitted, it is evaluated by the system and assigned likelihood scores across different content categories. If the score for any harmful category surpasses a predefined threshold, the content is flagged for further action, either for automated removal or human review, depending on severity and confidence levels. This framework not only enhances moderation efficiency but also supports real-time response to violations, helping platforms maintain safer and more respectful online environments at scale.

References
  1. Parycek, P., Schmid, V., & Novak, A. S. (2024). Artificial Intelligence (AI) and automation in administrative procedures: Potentials, limitations, and framework conditions. Journal of the Knowledge Economy, 15(2), 8390-8415.
  2. Tatineni, S., & Boppana, V. R. (2021). AI-Powered DevOps and MLOps Frameworks: Enhancing Collaboration, Automation, and Scalability in Machine Learning Pipelines. Journal of Artificial Intelligence Research and Applications, 1(2), 58-88.
  3. Ding, W. Liang, W., Tadesse, G. A., Ho, D., Fei-Fei, L., Zaharia, M., Zhang, C., & Zou, J. (2022). Advances, challenges and opportunities in creating data for trustworthy AI. Nature Machine Intelligence, 4(8), 669-677.
  4. Wang, D., Weisz, J. D., Muller, M., Ram, P., Geyer, W., Dugan, C., ... & Gray, A. (2019). Human-AI collaboration in data science: Exploring data scientists' perceptions of automated AI. Proceedings of the ACM on human-computer interaction, 3(CSCW), 1-24.
  5. Marchionini, Sarker, I. H. (2022). AI-based modeling: techniques, applications and research issues towards automation, intelligent and smart systems. SN Computer Science, 3(2), 158.
  6. Pattyam, S. P. (2021). AI-Driven Data Science for Environmental Monitoring: Techniques for Data Collection, Analysis, and Predictive Modeling. Australian Journal of Machine Learning Research & Applications, 1(1), 132-169.
  7. Yang, Y., Zhuang, Y., & Pan, Y. (2021). Multiple knowledge representation for big data artificial intelligence: framework, applications, and case studies. Frontiers of Information Technology & Electronic Engineering, 22(12), 1551-1558.
  8. Plate, Tatineni, S., & Allam, K. (2022). Implementing AI-Enhanced Continuous Testing in DevOps Pipelines: Strategies for Automated Test Generation, Execution, and Analysis. Blockchain Technology and Distributed Systems, 2(1), 46-81.
  9. Cui, Z., Jing, X., Zhao, P., Zhang, W., & Chen, J. (2021). A new subspace clustering strategy for AI-based data analysis in IoT systems. IEEE Internet of Things Journal, 8(16), 12540-12549.
  10. Mohamed, A., Najafabadi, M. K., Wah, Y. B., Zaman, E. A. K., & Maskat, R. (2020). The state of the art and taxonomy of big data analytics: view from new big data framework. Artificial intelligence review, 53, 989-1037.
  11. Ellefsen, A. P. T., Oleśków-Szłapka, J., Pawłowski, G., & Toboła, A. (2019). Striving for excellence in AI implementation: AI maturity model framework and preliminary research results. LogForum, 15(3).
  12. Tyagi, A. K., Fernandez, T. F., Mishra, S., & Kumari, S. (2020, December). Intelligent automation systems at the core of industry 4.0. In International conference on intelligent systems design and applications (pp. 1-18). Cham: Springer International Publishing.
  13. Alam, G., Ihsanullah, I., Naushad, M., & Sillanpää, M. (2022). Applications of artificial intelligence in water treatment for optimization and automation of adsorption processes: Recent advances and prospects. Chemical Engineering Journal, 427, 130011.
  14. Khan, Z. F., & Alotaibi, S. R. (2020). Applications of artificial intelligence and big data analytics in m‐health: A healthcare system perspective. Journal of healthcare engineering, 2020(1), 8894694.
  15. Osman, A. M. S. (2019). A novel big data analytics framework for smart cities. Future Generation Computer Systems, 91, 620-633.
  16. Dash, R., McMurtrey, M., Rebman, C., & Kar, U. K. (2019). Application of artificial intelligence in automation of supply chain management. Journal of Strategic Innovation and Sustainability, 14(3).
  17. Ng, K. K., Chen, C. H., Lee, C. K., Jiao, J. R., & Yang, Z. X. (2021). A systematic literature review on intelligent automation: Aligning concepts from theory, practice, and future perspectives. Advanced Engineering Informatics, 47, 101246.
  18. Huang, M. H., & Rust, R. T. (2021). A strategic framework for artificial intelligence in marketing. Journal of the Academy of Marketing Science, 49, 30-50.
  19. Meduri, K., Nadella, G. S., Gonaygunta, H., & Meduri, S. S. (2023). Developing a Fog Computing-based AI Framework for Real-time Traffic Management and Optimization. International Journal of Sustainable Development in Computing Science, 5(4), 1-24.
  20. Brem, A., Giones, F., & Werle, M. (2021). The AI digital revolution in innovation: A conceptual framework of artificial intelligence technologies for the management of innovation. IEEE Transactions on Engineering Management, 70(2), 770-776.
Index Terms

Computer Science
Information Sciences

Keywords

Machine Learning Classification Advertisements Traditional Data Collection