{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T21:57:39Z","timestamp":1773525459994,"version":"3.50.1"},"reference-count":34,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2024,4,2]],"date-time":"2024-04-02T00:00:00Z","timestamp":1712016000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Intelligent &amp; Fuzzy Systems: Applications in Engineering and Technology"],"published-print":{"date-parts":[[2026,2]]},"abstract":"<jats:p>Twitter has experienced a tremendous surge in popularity over recent years, establishing itself as a prominent social media platform with a large user base. However, with this increased usage, there has been a concerning rise in the number of individuals resorting to derogatory language and expressing their opinions in a demeaning manner toward others. This surge in hate speech has drawn significant attention to the field of sentiment analysis, which aims to develop algorithms capable of detecting and analyzing emotions expressed in social networks using intuitive approaches. This paper focuses on addressing the complex task of detecting hate speech and aggressive behavior while performing target classification. We explored various deep-learning approaches, including LSTM, BiLSTM, CNN, and GRU. Each offers unique capabilities for capturing different aspects of the input data. We proposed an ensemble approach that combines the top three performing models. This ensemble approach benefits from the diverse strengths of each individual model showing F1 score of 0.85 for English-HS, 0.94 for English-TR, 0.92 for English-AB, 0.84 for Spanish-HS, 0.86 for Spanish-TR, 0.97 for Spanish-AB, 0.74 for multilingual-HS, 0.94 for multilingual-TR, and 0.88 for multilingual-AB.<\/jats:p>","DOI":"10.3233\/jifs-219350","type":"journal-article","created":{"date-parts":[[2024,4,2]],"date-time":"2024-04-02T13:58:18Z","timestamp":1712066298000},"page":"348-357","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":4,"title":["Detecting multilingual hate speech targeting immigrants and women on Twitter"],"prefix":"10.1177","volume":"50","author":[{"given":"Olga","family":"Kolesnikova","sequence":"first","affiliation":[{"name":"Centro de Investigaci\u00f3n en Computaci\u00f3n (CIC), Instituto Polit\u00e9cnico Nacional (IPN), Mexico City, Mexico"}]},{"given":"Mesay Gemeda","family":"Yigezu","sequence":"additional","affiliation":[{"name":"Centro de Investigaci\u00f3n en Computaci\u00f3n (CIC), Instituto Polit\u00e9cnico Nacional (IPN), Mexico City, Mexico"}]},{"given":"Alexander","family":"Gelbukh","sequence":"additional","affiliation":[{"name":"Centro de Investigaci\u00f3n en Computaci\u00f3n (CIC), Instituto Polit\u00e9cnico Nacional (IPN), Mexico City, Mexico"}]},{"given":"Selam","family":"Abitte","sequence":"additional","affiliation":[{"name":"Centro de Investigaci\u00f3n en Computaci\u00f3n (CIC), Instituto Polit\u00e9cnico Nacional (IPN), Mexico City, Mexico"}]},{"given":"Grigori","family":"Sidorov","sequence":"additional","affiliation":[{"name":"Centro de Investigaci\u00f3n en Computaci\u00f3n (CIC), Instituto Polit\u00e9cnico Nacional (IPN), Mexico City, Mexico"}]}],"member":"179","published-online":{"date-parts":[[2024,4,2]]},"reference":[{"issue":"2","key":"e_1_3_3_2_1","article-title":"Encyclopediaof the American constitution","volume":"3","author":"Nockleby J.T.","year":"2000","unstructured":"NocklebyJ.T.LevyL.W.KarstK.L.MahoneyD.J., Encyclopediaof the American constitution, Detroit, MI: Macmillan Reference3(2) (2000).","journal-title":"Detroit, MI: Macmillan Reference"},{"key":"e_1_3_3_3_1","unstructured":"YigezuM.G.KolesnikovaO.SidorovG.GelbukhA. Transformer-Based Hate Speech Detection for Multi-Class and Multi-Label Classification (2023)."},{"key":"e_1_3_3_4_1","unstructured":"BalouchzahiF.ShashirekhaH.L.SidorovG. HSSD: Hate speech spreader detection using N-grams and voting classifier in:CLEF(Working Notes) (2021) pp. 1829\u20131836."},{"key":"e_1_3_3_5_1","doi-asserted-by":"crossref","unstructured":"MossieZ.WangJ.-H. Social network HS detection for amharic language Computer Science & Information Technology (2018) 41\u201355.","DOI":"10.5121\/csit.2018.80604"},{"key":"e_1_3_3_6_1","unstructured":"YigezuM.G.KantaS.KolesnikovaO.SidorovG.GelbukhA. Habesha DravidianLangTech: Abusive comment detection using deep learning approach in: Proceedings of the Third Workshop on Speech and Language Technologies for Dravidian Languages (2023) pp. 244\u2013249."},{"issue":"2021","key":"e_1_3_3_7_1","first-page":"101608","article-title":"Internet, social media and online HS.Systematic review","volume":"58","author":"Casta\u00f1o-Pulgar\u00edn S.A.","unstructured":"Casta\u00f1o-Pulgar\u00ednS.A.Su\u00e1rez-BetancurN.VegaandL.M.T.L\u00f3pezH.M.H., Internet, social media and online HS.Systematic review, Aggression and Violent Behavior58(2021), 101608.","journal-title":"Aggression and Violent Behavior"},{"key":"e_1_3_3_8_1","doi-asserted-by":"crossref","unstructured":"YigezuM.G.MehamedM.A.KolesnikovaO.GugeT.K.GelbukhA.SidorovG. Evaluating the effectiveness of hybrid features in fake news detection on social media in: 2023 International Conference on Information and Communication Technology for Development for Africa (ICT4DA) (pp. 171\u2013175). IEEE (2023).","DOI":"10.1109\/ICT4DA59526.2023.10302243"},{"key":"e_1_3_3_9_1","doi-asserted-by":"crossref","unstructured":"SahaK.ChandrasekharanE.De ChoudhuryM. Prevalence and psychological effects of hateful speech in online college communities in: Proceedings of the 10th ACMConference on Web Science (2019) pp. 255\u2013264.","DOI":"10.1145\/3292522.3326032"},{"key":"e_1_3_3_10_1","unstructured":"EssedP. Naming the unnameable: Sense and sensibilities in researching racism Researching Race and Racism (2004) 119\u2013133."},{"key":"e_1_3_3_11_1","unstructured":"SimonP. Commission europ\u00e9enne contre le racisme etl\u2019intol\u00e9rance \u201cEthnic\u201d statistics and data protection in the Council of Europe countries: study report. Strasbourg: Council of Europe (2007)."},{"key":"e_1_3_3_12_1","unstructured":"YigezuM.G.KebedeT.KolesnikovaO.SidorovG.GelbukhA. Habesha@ DravidianLangTech: Utilizing deep and transfer learning approaches for sentiment analysis in: Proceedings of the Third Workshop on Speech and Language Technologies for Dravidian Languages (2023) pp. 239\u2013243."},{"key":"e_1_3_3_13_1","doi-asserted-by":"crossref","unstructured":"BalouchzahiF.GowdaA.ShashirekhaH.SidorovG. MUCIC@ TamilNLP-ACL2022: Abusive comment detection in tamil language using 1D Conv-LSTM in: Proceedings of the Second Workshop on Speech and Language Technologies for Dravidian Languages (2022) pp. 64\u201369.","DOI":"10.18653\/v1\/2022.dravidianlangtech-1.10"},{"key":"e_1_3_3_14_1","unstructured":"YigezuM.G.BadeG.Y.KolesnikovaO.SidorovG.GelbukhA. Multilingual Hope Speech Detection using Machine Learning (2023)."},{"key":"e_1_3_3_15_1","unstructured":"YigezuM.G.TonjaA.L.KolesnikovaO.TashM.S.SidorovG.GelbukhA. Word level language identification in code-mixed Kannada-English texts using deep learning approach in: Proceedings of the 19th International Conference on Natural Language Processing (ICON): Shared Task on Word Level Language Identification in Code-mixed Kannada-English Texts (2022) pp. 29\u201333."},{"key":"e_1_3_3_16_1","doi-asserted-by":"crossref","unstructured":"HasanA.SharmaT.KhanA.Hasan Ali Al-AbyadhM. Analysing HS against migrants and women through tweets using ensembled deep learning model Computational Intelligence and Neuroscience 2022 (2022).","DOI":"10.1155\/2022\/8153791"},{"key":"e_1_3_3_17_1","doi-asserted-by":"crossref","unstructured":"PenningtonJ.SocherR.ManningC.D. Glove: Global vectors for word representation in: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) (2014) pp. 1532\u20131543.","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_3_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2020.102262"},{"key":"e_1_3_3_19_1","unstructured":"ChirilP.BenamaraF.MoriceauV.Coulomb-GullyM.KumarA. Multilingual and multitarget HS detection in tweets in: Conference surle Traitement Automatique des Langues Naturelles (TALN-PFIA 2019) (pp. 351\u2013360). ATALA (2019)."},{"key":"e_1_3_3_20_1","doi-asserted-by":"publisher","DOI":"10.3390\/s19214654"},{"key":"e_1_3_3_21_1","doi-asserted-by":"crossref","unstructured":"AlonsoP.SainiR.Kov\u00e1csG. HS detection using transformer ensembles on the hasoc dataset in: International Conference on Speech and Computer (pp. 13\u201321). Cham: Springer International Publishing (2020).","DOI":"10.1007\/978-3-030-60276-5_2"},{"key":"e_1_3_3_22_1","unstructured":"LiuY.OttM.GoyalN.DuJ.JoshiM.ChenD.StoyanovV. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019)."},{"key":"e_1_3_3_23_1","doi-asserted-by":"crossref","unstructured":"ZampieriM.NakovP.RosenthalS.AtanasovaP.KaradzhovG.MubarakH.\u00c7\u00f6ltekin\u00c7. SemEval-2020 task 12: Multilingual offensive language identification in social media (OffensEval 2020). arXiv preprint arXiv:2006.07235 (2020).","DOI":"10.18653\/v1\/2020.semeval-1.188"},{"key":"e_1_3_3_24_1","doi-asserted-by":"crossref","unstructured":"MandlT.ModhaS.MajumderP.PatelD.DaveM.MandliaC.PatelA. Overview of the hasoc track at fire 2019: Hate speech and offensive content identification in indo-european languages in: Proceedings of the 11th Annual Meeting of the Forum for Information Retrieval Evaluation (2019) 14\u201317.","DOI":"10.1145\/3368567.3368584"},{"key":"e_1_3_3_25_1","article-title":"Simple and scalablepredictive uncertainty estimation using deep ensembles","volume":"30","author":"Lakshminarayanan B.","year":"2017","unstructured":"LakshminarayananB.PritzelA.BlundellC., Simple and scalablepredictive uncertainty estimation using deep ensembles, Advances in Neural Information Processing Systems30 (2017).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_26_1","doi-asserted-by":"crossref","unstructured":"BasileV.BoscoC.FersiniE.NozzaD.PattiV.PardoandF.M.R.SanguinettiM. Semeval-2019 task 5: Multilingual detection of HS against immigrants and women in twitter in: Proceedings of the 13th International Workshop on Semantic Evaluation (2019) pp. 54\u201363.","DOI":"10.18653\/v1\/S19-2007"},{"key":"e_1_3_3_27_1","first-page":"863","article-title":"SMOTE forlearning from imbalanced data: Progress and challenges, marking the15-year anniversary","volume":"61","author":"Fern\u00e1ndez A.","year":"2018","unstructured":"Fern\u00e1ndezA.GarciaS.HerreraF.ChawlaN.V., SMOTE forlearning from imbalanced data: Progress and challenges, marking the15-year anniversary, Journal of Artificial IntelligenceResearch61 (2018)863\u2013905.","journal-title":"Journal of Artificial IntelligenceResearch"},{"key":"e_1_3_3_28_1","doi-asserted-by":"crossref","unstructured":"MohammedR.RawashdehJ.AbdullahM. Machine learning with random over-sampling and random random under-sampling techniques: Overview study and experimental results in: 2020 11th international conference on information and communication systems (ICICS) (pp. 243\u2013248). IEEE (2020).","DOI":"10.1109\/ICICS49469.2020.239556"},{"key":"e_1_3_3_29_1","doi-asserted-by":"crossref","unstructured":"JunsomboonN.PhienthrakulT. Combining random over-sampling and random under-sampling techniques for imbalance dataset in: Proceedings of the 9th International Conference on Machine Learning and Computing (2017) pp. 243\u2013247.","DOI":"10.1145\/3055635.3056643"},{"key":"e_1_3_3_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2009.06.055"},{"key":"e_1_3_3_31_1","doi-asserted-by":"crossref","unstructured":"LiuX.Y.ZhouZ.H. Ensemble methods for class imbalance learning Imbalanced Learning: Foundations Algorithms and Applications (2013) 61\u201382.","DOI":"10.1002\/9781118646106.ch4"},{"key":"e_1_3_3_32_1","unstructured":"RongX. word2vec parameter learning explained. arXiv preprint arXiv:1411.2738 (2014)."},{"issue":"4","key":"e_1_3_3_33_1","first-page":"1","article-title":"Xgboost: extreme gradient boosting","volume":"1","author":"Chen T.","year":"2015","unstructured":"ChenT.HeT.BenestyM.KhotilovichV.TangY.ChoH.ZhouT., Xgboost: extreme gradient boosting, R Package VERSION0.4-21(4) (2015)1\u20134.","journal-title":"R Package VERSION0.4-2"},{"key":"e_1_3_3_34_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.953"},{"key":"e_1_3_3_35_1","doi-asserted-by":"crossref","unstructured":"HeH.BaiY.GarciaE.A.LiS. ADASYN: Adaptive synthetic sampling approach for imbalanced learning in: 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) (pp. 1322\u20131328). IEEE (2008).","DOI":"10.1109\/IJCNN.2008.4633969"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems: Applications in Engineering and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-219350","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/JIFS-219350","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-219350","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T21:47:30Z","timestamp":1773524850000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/JIFS-219350"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,2]]},"references-count":34,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,2]]}},"alternative-id":["10.3233\/JIFS-219350"],"URL":"https:\/\/doi.org\/10.3233\/jifs-219350","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,2]]}}}