{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T18:49:52Z","timestamp":1773082192359,"version":"3.50.1"},"reference-count":96,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,3,24]],"date-time":"2023-03-24T00:00:00Z","timestamp":1679616000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>Sentiment Analysis, also known as opinion mining, is the area of Natural Language Processing that aims to extract human perceptions, thoughts, and beliefs from unstructured textual content. It has become a useful, attractive, and challenging research area concerning the emergence and rise of social media and the mass volume of individuals\u2019 reviews, comments, and feedback. One of the major problems, apparent and evident in social media, is the toxic online textual content. People from diverse cultural backgrounds and beliefs access Internet sites, concealing and disguising their identity under a cloud of anonymity. Due to users\u2019 freedom and anonymity, as well as a lack of regulation governed by social media, cyber toxicity and bullying speech are major issues that need an automated system to be detected and prevented. There is diverse research in different languages and approaches in this area, but the lack of a comprehensive study to investigate them from all aspects is tangible. In this manuscript, a comprehensive multi-lingual and systematic review of cyber-hate sentiment analysis is presented. It states the definition, properties, and taxonomy of cyberbullying and how often each type occurs. In addition, it presents the most recent popular cyberbullying benchmark datasets in different languages, showing their number of classes (Binary\/Multiple), discussing the applied algorithms, and how they were evaluated. It also provides the challenges, solutions, as well as future directions.<\/jats:p>","DOI":"10.3390\/bdcc7020058","type":"journal-article","created":{"date-parts":[[2023,3,24]],"date-time":"2023-03-24T06:34:07Z","timestamp":1679639647000},"page":"58","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Intelligent Multi-Lingual Cyber-Hate Detection in Online Social Networks: Taxonomy, Approaches, Datasets, and Open Challenges"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0740-3086","authenticated-orcid":false,"given":"Donia","family":"Gamal","sequence":"first","affiliation":[{"name":"Computer Science Department, Faculty of Computer and Information Sciences, Ain Shams University, Cairo 11566, Egypt"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0722-3218","authenticated-orcid":false,"given":"Marco","family":"Alfonse","sequence":"additional","affiliation":[{"name":"Computer Science Department, Faculty of Computer and Information Sciences, Ain Shams University, Cairo 11566, Egypt"},{"name":"Laboratoie Interdisciplinaire de l\u2019Universit\u00e9 Fran\u00e7aise d\u2019\u00c9gypte (UFEID LAB), Universit\u00e9 Fran\u00e7aise d\u2019\u00c9gypte, Cairo 11566, Egypt"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3274-8825","authenticated-orcid":false,"given":"Salud Mar\u00eda","family":"Jim\u00e9nez-Zafra","sequence":"additional","affiliation":[{"name":"Computer Science Department, SINAI, CEATIC, Universidad de Ja\u00e9n, 23071 Ja\u00e9n, Spain"}]},{"given":"Mostafa","family":"Aref","sequence":"additional","affiliation":[{"name":"Computer Science Department, Faculty of Computer and Information Sciences, Ain Shams University, Cairo 11566, Egypt"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/j.eij.2019.06.001","article-title":"A Comprehensive Study for Arabic Sentiment Analysis (Challenges and Applications)","volume":"21","author":"Alsayat","year":"2020","journal-title":"Egypt. Inform. J."},{"key":"ref_2","unstructured":"(2020, July 03). Available online: https:\/\/www.Statista.Com\/Statistics\/278414\/Number-of-Worldwide-Social-Network-Users\/."},{"key":"ref_3","unstructured":"(2020, July 03). Available online: https:\/\/www.Oberlo.Com\/Statistics\/How-Many-People-Use-Social-Media."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3377323","article-title":"A Multilingual Evaluation for Online Hate Speech Detection","volume":"20","author":"Corazza","year":"2020","journal-title":"ACM Trans. Internet Technol."},{"key":"ref_5","unstructured":"(2020, July 03). StopBullying.Gov, Available online: https:\/\/www.stopbullying.gov."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1007\/978-981-15-2740-1_17","article-title":"Detection of Hate Speech and Offensive Language in Twitter Data Using LSTM Model","volume":"1124","author":"Bisht","year":"2020","journal-title":"Recent Trends Image Signal Process. Comput. Vis."},{"key":"ref_7","first-page":"406","article-title":"Cyber Hate Speech on Twitter: Analyzing Disruptive Events from Social Media to Build a Violent Communication and Hate Speech Taxonomy","volume":"11","year":"2016","journal-title":"Des. Nat. Ecodynamics"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.avb.2018.05.006","article-title":"Cyberhate: A Review and Content Analysis of Intervention Strategies","volume":"45","author":"Blaya","year":"2018","journal-title":"Aggress. Violent Behav."},{"key":"ref_9","unstructured":"Namdeo, P., Pateriya, R.K., and Shrivastava, S. (2017, January 10\u201311). A Review of Cyber Bullying Detection in Social Networking. Proceedings of the Inventive Communication and Computational Technologies, Coimbatore, India."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Hang, O.C., and Dahlan, H.M. (2019, January 2\u20133). Cyberbullying Lexicon for Social Media. Proceedings of the Research and Innovation in Information Systems (ICRIIS), Johor Bahru, Malaysia.","DOI":"10.1109\/ICRIIS48246.2019.9073679"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1016\/j.procs.2020.06.036","article-title":"Denigration Bullying Resolution Using Wolf Search Optimized Online Reputation Rumour Detection","volume":"173","author":"Sangwan","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"21","DOI":"10.4995\/jclr.2019.11112","article-title":"Sampling Techniques to Overcome Class Imbalance in a Cyberbullying Context","volume":"3","author":"Colton","year":"2019","journal-title":"Comput. Linguist. Res."},{"key":"ref_13","first-page":"200","article-title":"Cyberbullying, Happiness, and Style of Humor among Perpetrators: Is There a Relationship?","volume":"7","author":"Qodir","year":"2019","journal-title":"Humanit. Soc. Sci. Rev."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"e01393","DOI":"10.1016\/j.heliyon.2019.e01393","article-title":"Cyberbullying and Its Influence on Academic, Social, and Emotional Development of Undergraduate Students","volume":"5","author":"Peled","year":"2019","journal-title":"Heliyon"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/s10551-017-3697-x","article-title":"Defining Objectives for Preventing Cyberstalking","volume":"157","author":"Dhillon","year":"2019","journal-title":"Bus. Ethics"},{"key":"ref_16","unstructured":"la Vega, D., Mojica, L.G., and Ng, V. (2018, January 7\u201312). Modeling Trolling in Social Media Conversations. Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC), Miyazaki, Japan."},{"key":"ref_17","unstructured":"Hassan, S., Yacob, M.I., Nguyen, T., and Zambri, S. (2018, January 25\u201327). Social Media Influencer and Cyberbullying: A Lesson Learned from Preliminary Findings. Proceedings of the 9th Knowledge Management International Conference (KMICe), Miri, Sarawak, Malaysia."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Raisi, E., and Huang, B. (2018, January 28\u201331). Weakly Supervised Cyberbullying Detection Using Co-Trained Ensembles of Embedding Models. Proceedings of the Advances in Social Networks Analysis and Mining (ASONAM), Barcelona, Spain.","DOI":"10.1109\/ASONAM.2018.8508240"},{"key":"ref_19","unstructured":"Willard, N.E. (2007). Cyberbullying and Cyberthreats: Responding to the Challenge of Online Social Aggression, Threats, and Distress, Research Press."},{"key":"ref_20","unstructured":"(2020, July 03). Available online: https:\/\/www.Pewresearch.Org\/Internet\/2021\/01\/13\/Personal-Experiences-with-Online-Harassment\/."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Mangaonkar, A., Hayrapetian, A., and Raje, R. (2015, January 21\u201323). Collaborative Detection of Cyberbullying Behavior in Twitter Data. Proceedings of the Electro\/Information technology (EIT), Dekalb, IL, USA.","DOI":"10.1109\/EIT.2015.7293405"},{"key":"ref_22","unstructured":"Van Hee, C., Lefever, E., Verhoeven, B., Mennes, J., Desmet, B., De Pauw, G., Daelemans, W., and Hoste, V. (2015, January 1\u20138). Detection and Fine-Grained Classification of Cyberbullying Events. Proceedings of the Recent Advances in Natural Language Processing (RANLP), Hissar, Bulgaria."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Waseem, Z., and Hovy, D. (2016, January 1). Hateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter. Proceedings of the NAACL Student Research Workshop, San Diego, CA, USA.","DOI":"10.18653\/v1\/N16-2013"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhao, R., Zhou, A., and Mao, K. (2016, January 4). Automatic Detection of Cyberbullying on Social Networks Based on Bullying Features. Proceedings of the 17th International Conference on Distributed Computing and Networking, New York, NY, USA.","DOI":"10.1145\/2833312.2849567"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Singh, V.K., Huang, Q., and Atrey, P.K. (2016, January 18\u201321). Cyberbullying Detection Using Probabilistic Socio-Textual Information Fusion. Proceedings of the Advances in Social Networks Analysis and Mining (ASONAM), San Francisco, CA, USA.","DOI":"10.1109\/ASONAM.2016.7752342"},{"key":"ref_26","unstructured":"(2020, July 03). Available online: https:\/\/www.Ra.Ethz.Ch\/Cdstore\/Www2009\/Caw2.Barcelonamedia.Org\/Index.Html."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1016\/j.chb.2016.05.051","article-title":"Cybercrime Detection in Online Communications: The Experimental Case of Cyberbullying Detection in the Twitter Network","volume":"63","author":"Varathan","year":"2016","journal-title":"Comput. Hum. Behav."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hosseinmardi, H., Rafiq, R.I., Han, R., Lv, Q., and Mishra, S. (2016, January 18\u201321). Prediction of Cyberbullying Incidents in a Media-Based Social Network. Proceedings of the Advances in Social Networks Analysis and Mining (ASONAM), San Francisco, CA, USA.","DOI":"10.1109\/ASONAM.2016.7752233"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, X., Tong, J., Vishwamitra, N., Whittaker, E., Mazer, J.P., Kowalski, R., Hu, H., Luo, F., Macbeth, J., and Dillon, E. (2016, January 18\u201320). Cyberbullying Detection with a Pronunciation Based Convolutional Neural Network. Proceedings of the 15th IEEE International Conference on Machine Learning and Applications (ICMLA), Anaheim, CA, USA.","DOI":"10.1109\/ICMLA.2016.0132"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Wulczyn, E., Thain, N., and Dixon, L. (2017, January 3). Ex Machina: Personal Attacks Seen at Scale. Proceedings of the 26th International Conference on World Wide Web, Perth, Australia.","DOI":"10.1145\/3038912.3052591"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Haidar, B., Chamoun, M., and Serhrouchni, A. (2017, January 18\u201320). Multilingual Cyberbullying Detection System: Detecting Cyberbullying in Arabic Content. Proceedings of the 1st Cyber Security in Networking Conference (CSNet), Rio de Janeiro, Brazil.","DOI":"10.1109\/CSNET.2017.8242005"},{"key":"ref_32","first-page":"512","article-title":"Automated Hate Speech Detection and the Problem of Offensive Language","volume":"11","author":"Davidson","year":"2017","journal-title":"Int. AAAI Conf. Web Soc. Media"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Sprugnoli, R., Menini, S., Tonelli, S., Oncini, F., and Piras, E. (2018, January 31). Creating a Whatsapp Dataset to Study Pre-Teen Cyberbullying. Proceedings of the 2nd Workshop on Abusive Language Online (ALW2), Brussels, Belgium.","DOI":"10.18653\/v1\/W18-5107"},{"key":"ref_34","unstructured":"Bartalesi Lenzi, V., Moretti, G., and Sprugnoli, R. (2012, January 21\u201327). Cat: The Celct Annotation Tool. Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC\u201912), Istanbul, Turkey."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Founta, A.-M., Djouvas, C., Chatzakou, D., Leontiadis, I., Blackburn, J., Stringhini, G., Vakali, A., Sirivianos, M., and Kourtellis, N. (2018, January 25\u201328). Large Scale Crowdsourcing and Characterization of Twitter Abusive Behavior. Proceedings of the Weblogs and Social Media (ICWSM), Palo Alto, CA, USA.","DOI":"10.1609\/icwsm.v12i1.14991"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"de Gibert, O., Perez, N., Garc\u00eda-Pablos, A., and Cuadros, M. (2018, January 31). Hate Speech Dataset from a White Supremacy Forum. Proceedings of the 2nd Workshop on Abusive Language Online (ALW2), Brussels, Belgium.","DOI":"10.18653\/v1\/W18-5102"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Nurrahmi, H., and Nurjanah, D. (2018, January 6\u20137). Indonesian Twitter Cyberbullying Detection Using Text Classification and User Credibility. Proceedings of the Information and Communications Technology (ICOIACT), Yogyakarta, Indonesia.","DOI":"10.1109\/ICOIACT.2018.8350758"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Albadi, N., Kurdi, M., and Mishra, S. (2018, January 28\u201331). Are They Our Brothers? Analysis and Detection of Religious Hate Speech in the Arabic Twittersphere. Proceedings of the IEEE\/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), Barcelona, Spain.","DOI":"10.1109\/ASONAM.2018.8508247"},{"key":"ref_39","first-page":"1","article-title":"Overview of the Evalita 2018 Hate Speech Detection Task","volume":"2263","author":"Bosco","year":"2018","journal-title":"Ceur Workshop Proc."},{"key":"ref_40","unstructured":"Michele, C., Menini, S., Pinar, A., Sprugnoli, R., Elena, C., Tonelli, S., and Serena, V. (2018, January 21). Inriafbk at Germeval 2018: Identifying Offensive Tweets Using Recurrent Neural Networks. Proceedings of the Germ Eval Workshop, Vienna, Austria."},{"key":"ref_41","unstructured":"Mulki, H., Haddad, H., Ali, C.B., and Alshabani, H. (, January 1\u20132August). L-HSAB: A Levantine Twitter Dataset for Hate Speech and Abusive Language. Proceedings of the Third Workshop on Abusive Language Online, Florence, Italy."},{"key":"ref_42","unstructured":"Ptaszynski, M., Pieciukiewicz, A., and Dyba\u0142a, P. (2019, January 31). Results of the PolEval 2019 Shared Task 6: First Dataset and Open Shared Task for Automatic Cyberbullying Detection in Polish Twitter. Proceedings of the Pol Eval 2019 Workshop, Warsaw, Poland."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Ibrohim, M.O., and Budi, I. (2019, January 1\u20132). Multi-Label Hate Speech and Abusive Language Detection in Indonesian Twitter. Proceedings of the Third Workshop on Abusive Language Online, Florence, Italy.","DOI":"10.18653\/v1\/W19-3506"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Basile, V., Bosco, C., Fersini, E., Nozza, D., Patti, V., Pardo, F.M.R., Rosso, P., and Sanguinetti, M. (2019, January 6\u20137). Semeval-2019 Task 5: Multilingual Detection of Hate Speech against Immigrants and Women in Twitter. Proceedings of the 13th International Workshop on Semantic Evaluation, Minneapolis, MN, USA.","DOI":"10.18653\/v1\/S19-2007"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Banerjee, V., Telavane, J., Gaikwad, P., and Vartak, P. (2019, January 15). Detection of Cyberbullying Using Deep Neural Network. Proceedings of the 5th International Conference on Advanced Computing & Communication Systems (ICACCS), Piscataway, NJ, USA.","DOI":"10.1109\/ICACCS.2019.8728378"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/cpe.5627","article-title":"Cyberbullying Detection in Social Media Text Based on Character-level Convolutional Neural Network with Shortcuts","volume":"32","author":"Lu","year":"2020","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Moon, J., Cho, W.I., and Lee, J. (2020, January 10). BEEP! Korean Corpus of Online News Comments for Toxic Speech Detection. Proceedings of the Eighth International Workshop on Natural Language Processing for Social Media, Online.","DOI":"10.18653\/v1\/2020.socialnlp-1.4"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Romim, N., Ahmed, M., Talukder, H., and Islam, S. (2021, January 23\u201324). Hate Speech Detection in the Bengali Language: A Dataset and Its Baseline Evaluation. Proceedings of the International Joint Conference on Advances in Computational Intelligence, Singapore.","DOI":"10.1007\/978-981-16-0586-4_37"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Karim, M.R., Dey, S.K., Islam, T., Sarker, S., Menon, M.H., Hossain, K., Hossain, M.A., and Decker, S. (2021, January 6\u20139). Deephateexplainer: Explainable Hate Speech Detection in under-Resourced Bengali Language. Proceedings of the 2021 IEEE 8th International Conference on Data Science and Advanced Analytics (DSAA), Porto, Portugal.","DOI":"10.1109\/DSAA53316.2021.9564230"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Luu, S.T., Van Nguyen, K., and Nguyen, N.L.-T. (2021, January 19\u201322). A Large-Scale Dataset for Hate Speech Detection on Vietnamese Social Media Texts. Proceedings of the International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, Kitakyushu, Japan.","DOI":"10.1007\/978-3-030-79457-6_35"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.future.2020.07.050","article-title":"Aggression Detection through Deep Neural Model on Twitter","volume":"114","author":"Sadiq","year":"2021","journal-title":"Futur. Gener. Comput. Syst."},{"key":"ref_52","unstructured":"Beyhan, F., \u00c7ar\u0131k, B., \u0130nan\u00e7, A., Terzio\u011flu, A., Yanikoglu, B., and Yeniterzi, R. (2022, January 20\u201325). A Turkish Hate Speech Dataset and Detection System. Proceedings of the Thirteenth Language Resources and Evaluation Conference, Marseille, France."},{"key":"ref_53","unstructured":"Ollagnier, A., Cabrio, E., Villata, S., and Blaya, C. (2022, January 20\u201325). CyberAgressionAdo-v1: A Dataset of Annotated Online Aggressions in French Collected through a Role-Playing Game. Proceedings of the Thirteenth Language Resources and Evaluation Conference, Marseille, France."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"ALBayari, R., and Abdallah, S. (2022). Instagram-Based Benchmark Dataset for Cyberbullying Detection in Arabic Text. Data, 7.","DOI":"10.3390\/data7070083"},{"key":"ref_55","unstructured":"Patil, H., Velankar, A., and Joshi, R. (2022, January 17). L3cube-Mahahate: A Tweet-Based Marathi Hate Speech Detection Dataset and Bert Models. Proceedings of the Third Workshop on Threat, Aggression and Cyberbullying (TRAC 2022), Gyeongju, Republic of Korea."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1537","DOI":"10.1007\/s11280-021-00920-4","article-title":"A Bi-GRU with Attention and CapsNet Hybrid Model for Cyberbullying Detection on Social Media","volume":"25","author":"Kumar","year":"2022","journal-title":"World Wide Web"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Arai, K. (2023). Advances in Information and Communication, Springer Nature.","DOI":"10.1007\/978-3-031-28073-3"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"714","DOI":"10.1016\/j.procs.2022.12.188","article-title":"BERT Base Model for Toxic Comment Analysis on Indonesian Social Media","volume":"216","author":"Nabiilah","year":"2023","journal-title":"Procedia Comput. Sci."},{"key":"ref_59","unstructured":"(2020, August 09). Hate Speech Twitter Annotations. Available online: https:\/\/github.com\/ZeerakW\/hatespeech."},{"key":"ref_60","unstructured":"(2020, August 20). Wikipedia Detox. Available online: https:\/\/github.com\/ewulczyn\/wiki-detox."},{"key":"ref_61","unstructured":"(2023, February 16). Used a Crowd-Sourced Hate Speech Lexicon to Collect Tweets Containing Hate Speech Keywords. We Use Crowd-Sourcing to Label a Sample of These Tweets into Three Categories: Those Containing Hate Speech, Only Offensive Language, and Those with Neither. Available online: https:\/\/arxiv.org\/abs\/1703.04009."},{"key":"ref_62","unstructured":"(2020, August 18). WhatsApp-Dataset. Available online: https:\/\/github.com\/dhfbk\/WhatsApp-Dataset."},{"key":"ref_63","unstructured":"(2020, August 22). Hate and Abusive Speech on Twitter. Available online: https:\/\/github.com\/ENCASEH2020\/hatespeech-twitter."},{"key":"ref_64","unstructured":"(2022, November 18). Hate Speech Dataset from a White Supremacist Forum. Available online: https:\/\/github.com\/Vicomtech\/hate-speech-dataset."},{"key":"ref_65","unstructured":"(2022, November 18). Available online: https:\/\/Github.Com\/Nuhaalbadi\/Arabic_hatespeech."},{"key":"ref_66","unstructured":"(2022, November 18). L-HSAB Dataset: Context and Topics. Available online: https:\/\/github.com\/Hala-Mulki\/L-HSAB-First-Arabic-Levantine-HateSpeech-Dataset."},{"key":"ref_67","unstructured":"(2020, August 15). Dataset for Automatic Cyberbullying Detection in Polish Laguage. Available online: https:\/\/github.com\/ptaszynski\/cyberbullying-Polish."},{"key":"ref_68","unstructured":"(2022, February 06). Multi-Label Hate Speech and Abusive Language Detection in the Indonesian Twitter. Available online: https:\/\/github.com\/okkyibrohim\/id-multi-label-hate-speech-and-abusive-language-detection."},{"key":"ref_69","unstructured":"(2022, November 18). HatEval. Available online: http:\/\/hatespeech.di.unito.it\/hateval.html."},{"key":"ref_70","unstructured":"(2020, January 06). BullyDataset. Available online: https:\/\/github.com\/NijiaLu\/BullyDataset."},{"key":"ref_71","unstructured":"(2022, February 10). Korean HateSpeech Dataset. Available online: https:\/\/github.com\/kocohub\/korean-hate-speech."},{"key":"ref_72","unstructured":"(2022, February 10). Available online: https:\/\/www.Kaggle.Com\/Datasets\/Naurosromim\/Bengali-Hate-Speech-Dataset."},{"key":"ref_73","unstructured":"(2022, February 10). Available online: https:\/\/Github.Com\/Rezacsedu\/DeepHateExplainer."},{"key":"ref_74","unstructured":"(2022, February 10). Available online: https:\/\/Github.Com\/Sonlam1102\/Vihsd."},{"key":"ref_75","unstructured":"(2022, February 10). Available online: https:\/\/www.Kaggle.Com\/Datasets\/Dataturks\/Dataset-for-Detection-of-Cybertrolls."},{"key":"ref_76","unstructured":"(2022, February 10). Available online: https:\/\/Github.Com\/Verimsu\/Turkish-HS-Dataset."},{"key":"ref_77","unstructured":"(2022, February 10). CyberAgressionAdo-v1. Available online: https:\/\/Github.Com\/Aollagnier\/CyberAgressionAdo-V1."},{"key":"ref_78","unstructured":"(2022, February 10). Available online: https:\/\/Bit.Ly\/3Md8mj3."},{"key":"ref_79","unstructured":"(2022, February 10). Available online: https:\/\/Huggingface.Co\/L3cube-Pune\/Mahahate-Bert."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"711","DOI":"10.1080\/0144929X.2019.1607903","article-title":"Mapping Twitter Hate Speech towards Social and Sexual Minorities: A Lexicon-Based Approach to Semantic Content Analysis","volume":"39","author":"Lingiardi","year":"2019","journal-title":"Behav. Inf. Technol."},{"key":"ref_81","doi-asserted-by":"crossref","unstructured":"Alloghani, M., Al-Jumeily, D., Mustafina, J., Hussain, A., and Aljaaf, A.J. (2020). A Systematic Review on Supervised and Unsupervised Machine Learning Algorithms for Data Science, Springer.","DOI":"10.1007\/978-3-030-22475-2_1"},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Alsharif, M.H., Kelechi, A.H., Yahya, K., and Chaudhry, S.A. (2020). Machine Learning Algorithms for Smart Data Analysis in Internet of Things Environment: Taxonomies and Research Trends. Symmetry, 12.","DOI":"10.3390\/sym12010088"},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"1319","DOI":"10.1109\/ACCESS.2017.2655032","article-title":"Revisiting Semi-Supervised Learning for Online Deceptive Review Detection","volume":"5","author":"Rout","year":"2017","journal-title":"IEEE Access"},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"6939","DOI":"10.1007\/s11042-018-6445-z","article-title":"A Survey on Sentiment Analysis and Opinion Mining for Social Multimedia","volume":"78","author":"Li","year":"2019","journal-title":"Multimed. Tools Appl."},{"key":"ref_85","first-page":"1","article-title":"Evaluating Deep Learning Models for Sentiment Classification","volume":"30","author":"Talo","year":"2018","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Asghar, M.Z., Khan, A., Ahmad, S., Qasim, M., and Khan, I.A. (2017). Lexicon-Enhanced Sentiment Analysis Framework Using Rule-Based Classification Scheme. Peer-Rev. Open Access Sci. J. (PLoS ONE), 12.","DOI":"10.1371\/journal.pone.0171649"},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1007\/s10462-016-9496-4","article-title":"Lexicon Based Semantic Detection of Sentiments Using Expected Likelihood Estimate Smoothed Odds Ratio","volume":"48","author":"Khan","year":"2017","journal-title":"Artif. Intell. Rev."},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"14719","DOI":"10.1007\/s00521-020-04824-8","article-title":"Constructing Domain-Dependent Sentiment Dictionary for Sentiment Analysis","volume":"32","author":"Ahmed","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"Nandhini, B.S., and Sheeba, J.I. (2015, January 15\u201316). Cyberbullying Detection and Classification Using Information Retrieval Algorithm. Proceedings of the International Conference on Advanced Research in Computer Science Engineering & Technology (ICARCSET), Tamilnadu, India.","DOI":"10.1145\/2743065.2743085"},{"key":"ref_90","doi-asserted-by":"crossref","unstructured":"Reynolds, K., Kontostathis, A., and Edwards, L. (2011, January 18\u201321). Using Machine Learning to Detect Cyberbullying. Proceedings of the 2011 10th International Conference on Machine Learning and Applications and Workshops, NW Washington, DC, USA.","DOI":"10.1109\/ICMLA.2011.152"},{"key":"ref_91","doi-asserted-by":"crossref","unstructured":"Badjatiya, P., Gupta, S., Gupta, M., and Varma, V. (2017, January 3\u20137). Deep Learning for Hate Speech Detection in Tweets. Proceedings of the 26th International Conference on World Wide Web Companion, Republic and Canton of Geneva, Switzerland.","DOI":"10.1145\/3041021.3054223"},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Park, J.H., and Fung, P. (2017, January 4). One-Step and Two-Step Classification for Abusive Language Detection on Twitter. Proceedings of the First Workshop on Abusive Language Online, Vancouver, BC, Canada.","DOI":"10.18653\/v1\/W17-3006"},{"key":"ref_93","doi-asserted-by":"crossref","first-page":"13825","DOI":"10.1109\/ACCESS.2018.2806394","article-title":"Hate Speech on Twitter: A Pragmatic Approach to Collect Hateful and Offensive Expressions and Perform Hate Speech Detection","volume":"6","author":"Watanabe","year":"2018","journal-title":"IEEE Access"},{"key":"ref_94","doi-asserted-by":"crossref","unstructured":"Wang, W., Huang, J.-t., Wu, W., Zhang, J., Huang, Y., Li, S., He, P., and Lyu, M. (2023, January 14\u201320). MTTM: Metamorphic Testing for Textual Content Moderation Software. Proceedings of the International Conference on Software Engineering (ICSE), Lisbon, Portugal.","DOI":"10.1109\/ICSE48619.2023.00200"},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"204951","DOI":"10.1109\/ACCESS.2020.3037073","article-title":"A Framework for Hate Speech Detection Using Deep Convolutional Neural Network","volume":"8","author":"Roy","year":"2020","journal-title":"IEEE Access"},{"key":"ref_96","doi-asserted-by":"crossref","first-page":"4335","DOI":"10.1007\/s10462-019-09794-5","article-title":"Sentiment Analysis Using Deep Learning Architectures: A Review","volume":"53","author":"Yadav","year":"2020","journal-title":"Artif. Intell. Rev."}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/7\/2\/58\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:02:19Z","timestamp":1760122939000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/7\/2\/58"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,24]]},"references-count":96,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["bdcc7020058"],"URL":"https:\/\/doi.org\/10.3390\/bdcc7020058","relation":{},"ISSN":["2504-2289"],"issn-type":[{"value":"2504-2289","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,24]]}}}