{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T21:55:18Z","timestamp":1785362118021,"version":"3.55.0"},"reference-count":309,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2021,9,30]],"date-time":"2021-09-30T00:00:00Z","timestamp":1632960000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Trans. Soc. Comput."],"published-print":{"date-parts":[[2021,9,30]]},"abstract":"<jats:p>The automatic detection of conflictual languages (harmful, aggressive, abusive, and offensive languages) is essential to provide a healthy conversation environment on the Web. To design and develop detection systems that are capable of achieving satisfactory performance, a thorough understanding of the nature and properties of the targeted type of conflictual language is of great importance. The scientific communities investigating human psychology and social behavior have studied these languages in details, but their insights have only partially reached the computer science community.<\/jats:p><jats:p>In this survey, we aim both at systematically characterizing the conceptual properties of online conflictual languages, and at investigating the extent to which they are reflected in state-of-the-art automatic detection systems. Through an analysis of psychology literature, we provide a reconciled taxonomy that denotes the ensemble of conflictual languages typically studied in computer science. We then characterize the conceptual mismatches that can be observed in the main semantic and contextual properties of these languages and their treatment in computer science works; and systematically uncover resulting technical biases in the design of machine learning classification models and the dataset created for their training. Finally, we discuss diverse research opportunities for the computer science community and reflect on broader technical and structural issues.<\/jats:p>","DOI":"10.1145\/3479158","type":"journal-article","created":{"date-parts":[[2021,10,25]],"date-time":"2021-10-25T20:54:01Z","timestamp":1635195241000},"page":"1-56","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Automatic Identification of Harmful, Aggressive, Abusive, and Offensive Language on the Web: A Survey of Technical Biases Informed by Psychology Literature"],"prefix":"10.1145","volume":"4","author":[{"given":"Agathe","family":"Balayn","sequence":"first","affiliation":[{"name":"Delft University of Technology, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Yang","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zoltan","family":"Szlavik","sequence":"additional","affiliation":[{"name":"myTomorrows, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alessandro","family":"Bozzon","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,10,25]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3093241.3093281"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/EISIC.2016.032"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/EISIC.2016.032"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-76941-7_11"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.5121\/csit.2019.90208"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMAPP.2017.8079791"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICACSIS.2017.8355039"},{"key":"e_1_3_3_9_2","first-page":"33","volume-title":"Proceedings of the International Conference on Applied Human Factors and Ergonomics","author":"Alhujailli Ashraf","year":"2018","unstructured":"Ashraf Alhujailli and Waldemar Karwowski. 2018. Emotional and stress responses to cyberbullying. In Proceedings of the International Conference on Applied Human Factors and Ergonomics. Springer, 33\u201343."},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3324997"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP.2019.00042"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIS.2010.96"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-91947-8_6"},{"key":"e_1_3_3_14_2","volume-title":"Proceedings of the 3rd Workshop on Evaluation of Human Language Technologies for Iberian Languages","author":"Arag\u00f3n M. E.","year":"2018","unstructured":"M. E. Arag\u00f3n and A. P. L\u00f3pez-Monroy. 2018. Author profiling and aggressiveness detection in Spanish tweets: MEX-A3T 2018. In Proceedings of the 3rd Workshop on Evaluation of Human Language Technologies for Iberian Languages (IberEval)."},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331262"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1111\/japp.12048"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1207\/s15327957pspr0903_2"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v36i1.2564"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-72604-5"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.figlang-1.15"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1002\/casp.975"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313504"},{"key":"e_1_3_3_23_2","volume-title":"Proceedings of the 1st Workshop on Disentangling the Relation between Crowdsourcing and Bias Management","author":"Balayn A.","year":"2018","unstructured":"A. Balayn, P. Mavridis, A. Bozzon, B. Timmermans, and Z. Szl\u00e1vik. 2018. Characterising and mitigating aggregation-bias in crowdsourced toxicity annotations. In Proceedings of the 1st Workshop on Disentangling the Relation between Crowdsourcing and Bias Management. CEUR."},{"key":"e_1_3_3_24_2","first-page":"1937","volume-title":"Proceedings of the World Wide Web Conference","author":"Balayn Agathe","year":"2021","unstructured":"Agathe Balayn, Panagiotis Soilis, Christoph Lofi, Jie Yang, and Alessandro Bozzon. 2021. What do you mean? Interpreting image classification with crowdsourced concept extraction and analysis. In Proceedings of the World Wide Web Conference (WWW). Association for Computing Machinery, New York, NY, 1937\u20131948. https:\/\/doi.org\/10.1145\/3442381.3450069"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1298(200001\/02)10:1<17::AID-CASP526>3.0.CO;2-M"},{"key":"e_1_3_3_26_2","volume-title":"Proceedings of the AAAI Conference","author":"Bansal Gagan","year":"2018","unstructured":"Gagan Bansal and Daniel S. Weld. 2018. A coverage-based utility model for identifying unknown unknowns. In Proceedings of the AAAI Conference."},{"key":"e_1_3_3_27_2","article-title":"Code-switching patterns can be an effective route to improve performance of downstream NLP applications: A case study of humour, sarcasm and hate speech detection","author":"Bansal Srijan","year":"2020","unstructured":"Srijan Bansal, Vishal Garimella, Ayush Suhane, Jasabanta Patro, and Animesh Mukherjee. 2020. Code-switching patterns can be an effective route to improve performance of downstream NLP applications: A case study of humour, sarcasm and hate speech detection. arXiv preprint arXiv:2005.02295 (2020).","journal-title":"arXiv preprint arXiv:2005.02295"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300773"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S19-2007"},{"key":"e_1_3_3_30_2","first-page":"1","volume-title":"Proceedings of the 3rd International Web Science Conference","author":"Bayzick J.","year":"2011","unstructured":"J. Bayzick. 2011. Detecting the presence of cyberbullying using computer software. In Proceedings of the 3rd International Web Science Conference. 1\u20132."},{"key":"e_1_3_3_31_2","article-title":"AI fairness 360: An extensible toolkit for detecting, understanding, and mitigating unwanted algorithmic bias","author":"Bellamy Rachel K. E.","year":"2018","unstructured":"Rachel K. E. Bellamy, Kuntal Dey, Michael Hind, Samuel C. Hoffman, Stephanie Houde, Kalapriya Kannan, Pranay Lohia, Jacquelyn Martino, Sameep Mehta, Aleksandra Mojsilovic, et al. 2018. AI fairness 360: An extensible toolkit for detecting, understanding, and mitigating unwanted algorithmic bias. arXiv preprint arXiv:1810.01943 (2018).","journal-title":"arXiv preprint arXiv:1810.01943"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2014.11.052"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2018.3191256"},{"key":"e_1_3_3_34_2","article-title":"Are we done with ImageNet?","author":"Beyer Lucas","year":"2020","unstructured":"Lucas Beyer, Olivier J. H\u00e9naff, Alexander Kolesnikov, Xiaohua Zhai, and A\u00e4ron van den Oord. 2020. Are we done with ImageNet?arXiv preprint arXiv:2006.07159 (2020).","journal-title":"arXiv preprint arXiv:2006.07159"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-67256-4_32"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1080\/1369183X.2011.576195"},{"key":"e_1_3_3_37_2","article-title":"Language (technology) is power: A critical survey of \u201cbias\u201d in NLP","author":"Blodgett Su Lin","year":"2020","unstructured":"Su Lin Blodgett, Solon Barocas, Hal Daum\u00e9 III, and Hanna Wallach. 2020. Language (technology) is power: A critical survey of \u201cbias\u201d in NLP. arXiv preprint arXiv:2005.14050 (2020).","journal-title":"arXiv preprint arXiv:2005.14050"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1111\/1540-4560.00265"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-1105"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S19-2082"},{"key":"e_1_3_3_41_2","first-page":"4349","volume-title":"Proceedings of the International Conference on Advances in Neural Information Processing Systems","author":"Bolukbasi Tolga","year":"2016","unstructured":"Tolga Bolukbasi, Kai-Wei Chang, James Y. Zou, Venkatesh Saligrama, and Adam T. Kalai. 2016. Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. In Proceedings of the International Conference on Advances in Neural Information Processing Systems. 4349\u20134357."},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2012.678878"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2017.268"},{"key":"e_1_3_3_44_2","first-page":"803","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Brunet Marc-Etienne","year":"2019","unstructured":"Marc-Etienne Brunet, C. Alkalay-Houlihan, A. Anderson, and R. Zemel. 2019. Understanding the origins of bias in word embeddings. In Proceedings of the International Conference on Machine Learning. 803\u2013811."},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF01420987"},{"key":"e_1_3_3_46_2","article-title":"Hate speech, machine classification and statistical modelling of information flows on Twitter: Interpretation and communication for policy decision making","author":"Burnap P.","year":"2014","unstructured":"P. Burnap and M. L. Williams. 2014. Hate speech, machine classification and statistical modelling of information flows on Twitter: Interpretation and communication for policy decision making. Internet, Polic. Polit. (2014).","journal-title":"Internet, Polic. Polit."},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1002\/poi3.85"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1140\/epjds\/s13688-016-0072-6"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2017.22"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.aal4230"},{"key":"e_1_3_3_51_2","volume-title":"Proceedings of the 11th International Conference on Language Resources and Evaluation","author":"Calzolari Nicoletta","year":"2018","unstructured":"Nicoletta Calzolari, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, K\u00f4iti Hasida, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, H\u00e9l\u00e8ne Mazo, Asunci\u00f3n Moreno, Jan Odijk, Stelios Piperidis, and Takenobu Tokunaga (Eds.). 2018. In Proceedings of the 11th International Conference on Language Resources and Evaluation. European Language Resources Association (ELRA). http:\/\/www.lrec-conf.org\/lrec2018."},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.avb.2021.101608"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3041021.3053890"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3091478.3091487"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICACCI.2015.7275970"},{"key":"e_1_3_3_56_2","first-page":"258","volume-title":"Proceedings of the 25th Irish Conference on Artificial Intelligence and Cognitive Science, Dublin, Ireland, December 7\u20138, 2017","volume":"2086","author":"Chen Hao","year":"2017","unstructured":"Hao Chen, Susan McKeever, and Sarah Jane Delany. 2017. Abusive text detection using neural networks. In Proceedings of the 25th Irish Conference on Artificial Intelligence and Cognitive Science, Dublin, Ireland, December 7\u20138, 2017 (CEUR Workshop Proceedings), John McAuley and Susan McKeever (Eds.), Vol. 2086. CEUR-WS.org, 258\u2013260. http:\/\/ceur-ws.org\/Vol-2086\/AICS2017_paper_44.pdf."},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3106426.3106456"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01129-1_8"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/SocialCom-PASSAT.2012.55"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308560.3316503"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.avb.2018.05.003"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i01.5374"},{"key":"e_1_3_3_63_2","first-page":"6203","volume-title":"Proceedings of the 12th Language Resources and Evaluation Conference","author":"Chowdhury Shammur Absar","year":"2020","unstructured":"Shammur Absar Chowdhury, Hamdy Mubarak, Ahmed Abdelali, Soon-gyo Jung, Bernard J. Jansen, and Joni Salminen. 2020. A multi-platform Arabic news comment dataset for offensive language detection. In Proceedings of the 12th Language Resources and Evaluation Conference. 6203\u20136212."},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1271"},{"key":"e_1_3_3_65_2","first-page":"119","volume-title":"Proceedings of the 3rd Workshop on Evaluation of Human Language Technologies for Iberian Languages (IberEval 2018) co-located with 34th Conference of the Spanish Society for Natural Language Processing (SEPLN 2018), Sevilla, Spain, September 18th, 2018 (CEUR Workshop Proceedings)","volume":"2150","author":"Correa Sebasti\u00e1n","year":"2018","unstructured":"Sebasti\u00e1n Correa and Alberto Martin. 2018. Linguistic generalization of slang used in Mexican tweets, applied in aggressiveness detection. In Proceedings of the 3rd Workshop on Evaluation of Human Language Technologies for Iberian Languages (IberEval 2018) co-located with 34th Conference of the Spanish Society for Natural Language Processing (SEPLN 2018), Sevilla, Spain, September 18th, 2018 (CEUR Workshop Proceedings), Paolo Rosso, Julio Gonzalo, Raquel Mart\u00ednez, Soto Montalvo, and Jorge Carrillo de Albornoz (Eds.), Vol. 2150. CEUR-WS.org, 119\u2013127. http:\/\/ceur-ws.org\/Vol-2150\/MEX-A3T_paper5.pdf."},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/2809563.2809605"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1559-1816.1996.tb01854.x"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1111\/1471-6402.00110"},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1559-1816.2002.tb00213.x"},{"key":"e_1_3_3_70_2","article-title":"Excavating AI: The politics of images in machine learning training sets","author":"Crawford Kate","year":"2019","unstructured":"Kate Crawford and Trevor Paglen. 2019. Excavating AI: The politics of images in machine learning training sets. Excavating AI (2019), 1\u201312.","journal-title":"Excavating AI"},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.1037\/a0012967"},{"key":"e_1_3_3_72_2","volume-title":"Proceedings of the 12th Dutch-Belgian Information Retrieval Workshop","author":"Dadvar M.","year":"2012","unstructured":"M. Dadvar, F. M. G. de Jong, R. Ordelman, and D. Trieschnigg. 2012. Improved cyberbullying detection using gender information. In Proceedings of the 12th Dutch-Belgian Information Retrieval Workshop (DIR)."},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31178-9_34"},{"key":"e_1_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-06483-3_25"},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-36973-5_62"},{"key":"e_1_3_3_76_2","first-page":"arXiv\u20132004","article-title":"Kungfupanda at SemEval-2020 Task 12: BERT-based multi-task learning for offensive language detection","author":"Dai Wenliang","year":"2020","unstructured":"Wenliang Dai, Tiezheng Yu, Zihan Liu, and Pascale Fung. 2020. Kungfupanda at SemEval-2020 Task 12: BERT-based multi-task learning for offensive language detection. arXiv (2020), arXiv\u20132004.","journal-title":"arXiv"},{"key":"e_1_3_3_77_2","article-title":"Underspecification presents challenges for credibility in modern machine learning","author":"D\u2019Amour Alexander","year":"2020","unstructured":"Alexander D\u2019Amour, K. Heller, D. Moldovan, B. Adlam, B. Alipanahi, A. Beutel, C. Chen, J. Deaton, J. Eisenstein, M. D. Hoffman, et al. 2020. Underspecification presents challenges for credibility in modern machine learning. arXiv preprint arXiv:2011.03395 (2020).","journal-title":"arXiv preprint arXiv:2011.03395"},{"key":"e_1_3_3_78_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-71249-9_4"},{"key":"e_1_3_3_79_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-3504"},{"key":"e_1_3_3_80_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5102"},{"key":"e_1_3_3_82_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-13647-9_21"},{"key":"e_1_3_3_83_2","first-page":"86","volume-title":"Proceedings of the 1st Italian Conference on Cybersecurity","author":"Del Vigna Fabio","year":"2017","unstructured":"Fabio Del Vigna, Andrea Cimino, Felice Dell\u2019Orletta, Marinella Petrocchi, and Maurizio Tesconi. 2017. Hate me, hate me not: Hate speech detection on Facebook. In Proceedings of the 1st Italian Conference on Cybersecurity (ITASEC). 86\u201395."},{"issue":"4","key":"e_1_3_3_84_2","article-title":"A lexicon-based approach for hate speech detection","volume":"10","author":"Dennis-Gitari N.","year":"2015","unstructured":"N. Dennis-Gitari, Z. Zuping, H. Damien, and J. Long. 2015. A lexicon-based approach for hate speech detection. Int. J. Multimed. Ubiq. Eng. 10, 4 (2015). https:\/\/doi.org\/10.14257\/ijmue.2015.10.4.21","journal-title":"Int. J. Multimed. Ubiq. Eng."},{"key":"e_1_3_3_85_2","first-page":"4171","volume-title":"Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 4171\u20134186."},{"key":"e_1_3_3_86_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2016.7899672"},{"key":"e_1_3_3_87_2","article-title":"All prejudices are not created equal: Different responses to subtle versus blatant expressions of prejudice","author":"Dickson K. R.","year":"2012","unstructured":"K. R. Dickson. 2012. All prejudices are not created equal: Different responses to subtle versus blatant expressions of prejudice. Electronic Thesis and Dissertation Repository. Retrieved from https:\/\/ir.lib.uwo.ca\/etd\/704.","journal-title":"Electronic Thesis and Dissertation Repository."},{"key":"e_1_3_3_88_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-41932-9_28"},{"key":"e_1_3_3_89_2","doi-asserted-by":"publisher","DOI":"10.1145\/2362394.2362400"},{"issue":"02","key":"e_1_3_3_90_2","article-title":"Modeling the detection of textual cyberbullying.","volume":"11","author":"Dinakar K.","year":"2011","unstructured":"K. Dinakar, R. Reichart, and H. Lieberman. 2011. Modeling the detection of textual cyberbullying.Soc. Mob. Web 11, 02 (2011). http:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/ICWSM11\/paper\/download\/3841\/4384.","journal-title":"Soc. Mob. Web"},{"key":"e_1_3_3_91_2","doi-asserted-by":"crossref","unstructured":"Emily Dinan Samuel Humeau Bharath Chintagunta and Jason Weston. 2019. Build It Break It Fix It for Dialogue Safety: Robustness from Adversarial Human Attack. arxiv:cs.CL\/1908.06083.","DOI":"10.18653\/v1\/D19-1461"},{"key":"e_1_3_3_92_2","article-title":"An effective approach for cyberbullying detection and avoidance","volume":"14","author":"Divyashree Vinutha H.","year":"2016","unstructured":"Vinutha H. Divyashree and N. S. Deepashree. 2016. An effective approach for cyberbullying detection and avoidance. Int. J. Innov. Res. Comput. Commun. Eng. 14 (2016).","journal-title":"Int. J. Innov. Res. Comput. Commun. Eng."},{"key":"e_1_3_3_93_2","doi-asserted-by":"publisher","DOI":"10.1145\/2740908.2742760"},{"key":"e_1_3_3_94_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1559-1816.2012.00902.x"},{"key":"e_1_3_3_95_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-3513"},{"key":"e_1_3_3_96_2","article-title":"Hate lingo: A target-based linguistic analysis of hate speech in social media","author":"ElSherief Mai","year":"2018","unstructured":"Mai ElSherief, Vivek Kulkarni, Dana Nguyen, William Yang Wang, and Elizabeth Belding. 2018. Hate lingo: A target-based linguistic analysis of hate speech in social media. arXiv preprint arXiv:1804.04257 (2018).","journal-title":"arXiv preprint arXiv:1804.04257"},{"key":"e_1_3_3_97_2","article-title":"Peer to peer hate: Hate speech instigators and their targets","author":"ElSherief Mai","year":"2018","unstructured":"Mai ElSherief, Shirin Nilizadeh, Dana Nguyen, Giovanni Vigna, and Elizabeth Belding. 2018. Peer to peer hate: Hate speech instigators and their targets. arXiv preprint arXiv:1804.04649 (2018).","journal-title":"arXiv preprint arXiv:1804.04649"},{"key":"e_1_3_3_98_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCITECHN.2017.8281787"},{"key":"e_1_3_3_99_2","doi-asserted-by":"publisher","DOI":"10.3390\/app10124180"},{"key":"e_1_3_3_100_2","doi-asserted-by":"publisher","DOI":"10.1109\/EISIC.2017.43"},{"key":"e_1_3_3_101_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2018.08.008"},{"key":"e_1_3_3_102_2","doi-asserted-by":"publisher","DOI":"10.1145\/3232676"},{"key":"e_1_3_3_103_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292522.3326028"},{"key":"e_1_3_3_104_2","volume-title":"Proceedings of the 12th International AAAI Conference on Web and Social Media","author":"Founta Antigoni Maria","year":"2018","unstructured":"Antigoni Maria Founta, Constantinos Djouvas, Despoina Chatzakou, Ilias Leontiadis, Jeremy Blackburn, Gianluca Stringhini, Athena Vakali, Michael Sirivianos, and Nicolas Kourtellis. 2018. Large scale crowdsourcing and characterization of Twitter abusive behavior. In Proceedings of the 12th International AAAI Conference on Web and Social Media."},{"key":"e_1_3_3_105_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287589"},{"key":"e_1_3_3_106_2","volume-title":"Countering Online Hate Speech","author":"Gagliardone Iginio","year":"2015","unstructured":"Iginio Gagliardone, Danit Gal, Thiago Alves, and Gabriela Martinez. 2015. Countering Online Hate Speech. Unesco Publishing."},{"key":"e_1_3_3_107_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-3013"},{"key":"e_1_3_3_108_2","doi-asserted-by":"publisher","DOI":"10.1109\/WACV45572.2020.9093454"},{"key":"e_1_3_3_109_2","doi-asserted-by":"publisher","DOI":"10.26615\/978-954-452-049-6_036"},{"key":"e_1_3_3_110_2","first-page":"774","volume-title":"Proceedings of the 8th International Joint Conference on Natural Language Processing","volume":"1","author":"Gao L.","year":"2017","unstructured":"L. Gao, A. Kuppersmith, and R. Huang. 2017. Recognizing explicit and implicit hate speech using a weakly supervised two-path bootstrapping approach. In Proceedings of the 8th International Joint Conference on Natural Language Processing, Vol. 1. 774\u2013782."},{"key":"e_1_3_3_111_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-47072-6_6"},{"key":"e_1_3_3_112_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1720347115"},{"key":"e_1_3_3_113_2","volume-title":"Proceedings of the 5th Workshop on Fairness, Accountability, and Transparency in Machine Learning","author":"Gebru Timnit","year":"2018","unstructured":"Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna M. Wallach, Hal Daum\u00e9 III, and Kate Crawford. 2018. Datasheets for datasets. In Proceedings of the 5th Workshop on Fairness, Accountability, and Transparency in Machine Learning."},{"key":"e_1_3_3_114_2","doi-asserted-by":"publisher","DOI":"10.1145\/3200947.3208069"},{"key":"e_1_3_3_115_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1559-1816.1992.tb01535.x"},{"key":"e_1_3_3_116_2","first-page":"33","volume-title":"Proceedings of the 5th Workshop on Making Sense of Microposts co-located with the 24th International World Wide Web Conference","author":"Giglietto Fabio","year":"2015","unstructured":"Fabio Giglietto and Yenn Lee. 2015. To be or not to be Charlie: Twitter hashtags as a discourse and counter-discourse in the aftermath of the 2015 Charlie Hebdo shooting in France. In Proceedings of the 5th Workshop on Making Sense of Microposts co-located with the 24th International World Wide Web Conference. 33\u201337."},{"key":"e_1_3_3_117_2","doi-asserted-by":"publisher","DOI":"10.1145\/3091478.3091509"},{"key":"e_1_3_3_118_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58526-6_20"},{"key":"e_1_3_3_119_2","doi-asserted-by":"publisher","DOI":"10.1177\/2053951719897945"},{"key":"e_1_3_3_120_2","doi-asserted-by":"publisher","DOI":"10.1145\/3270101.3270103"},{"key":"e_1_3_3_121_2","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2017.267"},{"key":"e_1_3_3_122_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11406-017-9858-4"},{"key":"e_1_3_3_123_2","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210058"},{"key":"e_1_3_3_124_2","volume-title":"Proceedings of the 4th Workshop on Open-source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection","author":"Haddad Bushr","year":"2020","unstructured":"Bushr Haddad, Zoher Orabe, Anas Al-Abood, and Nada Ghneim. 2020. Arabic offensive language detection with attention-based deep neural networks. In Proceedings of the 4th Workshop on Open-source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection."},{"key":"e_1_3_3_125_2","first-page":"926","volume-title":"Proceedings of the 8th International Joint Conference on Natural Language Processing","author":"Hasanuzzaman M.","year":"2017","unstructured":"M. Hasanuzzaman, G. Dias, and A. Way. 2017. Demographic word embeddings for racism detection on Twitter. In Proceedings of the 8th International Joint Conference on Natural Language Processing. 926\u2013936. https:\/\/aclanthology.info\/papers\/I17-1093\/i17-1093."},{"key":"e_1_3_3_126_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Hendrycks Dan","year":"2018","unstructured":"Dan Hendrycks and Thomas Dietterich. 2018. Benchmarking neural network robustness to common corruptions and perturbations. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_3_127_2","article-title":"The influence of target group status on the perception of the offensiveness of group-based slurs","volume":"53","author":"Henry P. J.","year":"2014","unstructured":"P. J. Henry, S. E. Butler, and M. J. Brandt. 2014. The influence of target group status on the perception of the offensiveness of group-based slurs. J. Experim. Soc. Psychol. 53 (2014).","journal-title":"J. Experim. Soc. Psychol."},{"key":"e_1_3_3_128_2","doi-asserted-by":"publisher","DOI":"10.1145\/2908131.2908183"},{"key":"e_1_3_3_129_2","volume-title":"Proceedings of the PASCAL Challenge Workshop in ECCV","author":"Hoiem Derek","year":"2009","unstructured":"Derek Hoiem, Santosh K. Divvala, and James H. Hays. 2009. Pascal VOC 2008 challenge. In Proceedings of the PASCAL Challenge Workshop in ECCV. Citeseer."},{"key":"e_1_3_3_130_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-27433-1_4"},{"key":"e_1_3_3_131_2","unstructured":"H. Hosseinmardi S. A. Mattson R. I. Rafiq R. Han Q. Lv and S. Mishra. 2015. Detection of cyberbullying incidents on the Instagram social network. (Mar. 2015). arxiv:1503.03909. http:\/\/arxiv.org\/abs\/1503.03909."},{"key":"e_1_3_3_132_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASONAM.2016.7752233"},{"key":"e_1_3_3_133_2","doi-asserted-by":"publisher","DOI":"10.1145\/2661126.2661133"},{"key":"e_1_3_3_134_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2018.08.169"},{"key":"e_1_3_3_135_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-64955-9_15"},{"key":"e_1_3_3_136_2","doi-asserted-by":"publisher","DOI":"10.23919\/ISTAFRICA.2017.8102355"},{"key":"e_1_3_3_137_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-2902"},{"key":"e_1_3_3_138_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1357"},{"key":"e_1_3_3_139_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASONAM.2016.7752342"},{"key":"e_1_3_3_140_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33019951"},{"key":"e_1_3_3_141_2","article-title":"Contextualizing hate speech classifiers with post hoc explanation","author":"Kennedy Brendan","year":"2020","unstructured":"Brendan Kennedy, X. Jin, A. M. Davani, M. Dehghani, and X. Ren. 2020. Contextualizing hate speech classifiers with post hoc explanation. arXiv preprint arXiv:2005.02439 (2020).","journal-title":"arXiv preprint arXiv:2005.02439"},{"key":"e_1_3_3_142_2","article-title":"Intersectional bias in hate speech and abusive language datasets","author":"Kim Jae Yeon","year":"2020","unstructured":"Jae Yeon Kim, Carlos Ortiz, Sarah Nam, Sarah Santiago, and Vivek Datta. 2020. Intersectional bias in hate speech and abusive language datasets. arXiv preprint arXiv:2005.05921 (2020).","journal-title":"arXiv preprint arXiv:2005.05921"},{"key":"e_1_3_3_143_2","first-page":"1598","article-title":"The new governors: The people, rules and processes governing online speech","volume":"131","author":"Klonick Kate","year":"2018","unstructured":"Kate Klonick. 2018. The new governors: The people, rules and processes governing online speech. Harv. Law Rev. 131 (2018), 1598.","journal-title":"Harv. Law Rev."},{"key":"e_1_3_3_144_2","volume-title":"Proceedings of the 4REAL Workshop on Replicability and Reproducibility of Research Results in Science and Technology of Language","author":"Klubi\u010dka F.","year":"2018","unstructured":"F. Klubi\u010dka and R. Fern\u00e1ndez. 2018. Examining a hate speech corpus for hate speech detection and popularity prediction. In Proceedings of the 4REAL Workshop on Replicability and Reproducibility of Research Results in Science and Technology of Language."},{"key":"e_1_3_3_145_2","doi-asserted-by":"publisher","DOI":"10.4324\/9780203082171"},{"key":"e_1_3_3_146_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5104"},{"key":"e_1_3_3_147_2","volume-title":"Proceedings of the International Conference on Machine Learning Workshop","author":"Kulynych Bogdan","year":"2020","unstructured":"Bogdan Kulynych, David Madras, Smitha Milli, Inioluwa Deborah Raji, Angela Zhou, and Richard Zemel. 2020. Participatory approaches to machine learning. In Proceedings of the International Conference on Machine Learning Workshop."},{"key":"e_1_3_3_148_2","first-page":"1","volume-title":"Proceedings of the 2nd Workshop on Trolling, Aggression and Cyberbullying","author":"Kumar Ritesh","year":"2020","unstructured":"Ritesh Kumar, Atul Kr Ojha, Shervin Malmasi, and Marcos Zampieri. 2020. Evaluating aggression identification in social media. In Proceedings of the 2nd Workshop on Trolling, Aggression and Cyberbullying. 1\u20135."},{"key":"e_1_3_3_149_2","volume-title":"Proceedings of the 11th International Conference on Language Resources and Evaluation","author":"Kumar Ritesh","year":"2018","unstructured":"Ritesh Kumar, Aishwarya N. Reganti, Akshit Bhatia, and Tushar Maheshwari. 2018. Aggression-annotated corpus of Hindi-English code-mixed data. In Proceedings of the 11th International Conference on Language Resources and Evaluation. European Language Resources Association (ELRA). http:\/\/www.lrec-conf.org\/proceedings\/lrec2018\/summaries\/861.html."},{"key":"e_1_3_3_150_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702529"},{"key":"e_1_3_3_151_2","first-page":"1621","volume-title":"Proceedings of the 27th AAAI Conference on Artificial Intelligence","author":"Kwok Irene","year":"2013","unstructured":"Irene Kwok and Yuzhou Wang. 2013. Locate the hate: Detecting tweets against blacks. In Proceedings of the 27th AAAI Conference on Artificial Intelligence. AAAI Press, 1621\u20131622."},{"key":"e_1_3_3_152_2","doi-asserted-by":"publisher","DOI":"10.1207\/s15327825mcs0703_2"},{"key":"e_1_3_3_153_2","doi-asserted-by":"publisher","DOI":"10.1145\/3209626.3209720"},{"issue":"5","key":"e_1_3_3_154_2","first-page":"1353","article-title":"Regulating online content moderation","volume":"106","author":"Langvardt Kyle","year":"2018","unstructured":"Kyle Langvardt. 2018. Regulating online content moderation. Georget. Law J. 106, 5 (2018), 1353\u20131389.","journal-title":"Georget. Law J."},{"key":"e_1_3_3_155_2","unstructured":"Issie Lapowsky. 2018. Mark Zuckerberg and the Tale of Two Hearings. Retrieved from https:\/\/www.wired.com\/story\/mark-zuckerberg-congress-day-two\/."},{"key":"e_1_3_3_156_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2018.06.009"},{"key":"e_1_3_3_157_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-72588-6_3"},{"key":"e_1_3_3_158_2","article-title":"Source magnification of cyberhate: Affective and cognitive effects of multiple-source hate messages on target group members","author":"Lee-Won Roselyn J.","year":"2019","unstructured":"Roselyn J. Lee-Won, Tiffany N. White, Hyunjin Song, Ji Young Lee, and Mikhail R. Smith. 2019. Source magnification of cyberhate: Affective and cognitive effects of multiple-source hate messages on target group members. Media Psychol. 23, 5 (2020), 603\u2013624.","journal-title":"Media Psychol."},{"key":"e_1_3_3_159_2","unstructured":"Sam Levin. 2017. Google to hire thousands of moderators after outcry over YouTube abuse videos. Retrieved from https:\/\/www.theguardian.com\/technology\/2017\/dec\/04\/google-youtube-hire-moderators-child-abuse-videos."},{"key":"e_1_3_3_160_2","doi-asserted-by":"publisher","DOI":"10.1145\/3011141.3011182"},{"key":"e_1_3_3_161_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2015.143"},{"key":"e_1_3_3_162_2","doi-asserted-by":"publisher","DOI":"10.1002\/ejsp.2420140405"},{"key":"e_1_3_3_163_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5112"},{"key":"e_1_3_3_164_2","doi-asserted-by":"publisher","DOI":"10.1145\/2905055.2905338"},{"key":"e_1_3_3_165_2","doi-asserted-by":"publisher","DOI":"10.1080\/0952813X.2017.1409284"},{"key":"e_1_3_3_166_2","doi-asserted-by":"publisher","DOI":"10.1109\/EIT.2015.7293405"},{"key":"e_1_3_3_167_2","doi-asserted-by":"publisher","DOI":"10.1109\/NetGames.2015.7382991"},{"key":"e_1_3_3_168_2","doi-asserted-by":"publisher","DOI":"10.1177\/1527476420982230"},{"key":"e_1_3_3_169_2","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v13i01.3237"},{"key":"e_1_3_3_170_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1813486116"},{"key":"e_1_3_3_171_2","doi-asserted-by":"publisher","DOI":"10.11613\/BM.2012.031"},{"key":"e_1_3_3_172_2","doi-asserted-by":"publisher","DOI":"10.1145\/2187836.2187862"},{"key":"e_1_3_3_173_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287596"},{"key":"e_1_3_3_174_2","doi-asserted-by":"publisher","DOI":"10.1145\/3078714.3078723"},{"key":"e_1_3_3_175_2","doi-asserted-by":"publisher","DOI":"10.1080\/13614568.2018.1489001"},{"key":"e_1_3_3_176_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0237861"},{"key":"e_1_3_3_177_2","article-title":"MNIST-C: A robustness benchmark for computer vision","author":"Mu Norman","year":"2019","unstructured":"Norman Mu and Justin Gilmer. 2019. MNIST-C: A robustness benchmark for computer vision. arXiv preprint arXiv:1906.02337 (2019).","journal-title":"arXiv preprint arXiv:1906.02337"},{"key":"e_1_3_3_178_2","doi-asserted-by":"publisher","DOI":"10.1207\/s15327957pspr0302_4"},{"key":"e_1_3_3_179_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISDA.2013.6920758"},{"key":"e_1_3_3_180_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.03.085"},{"key":"e_1_3_3_181_2","doi-asserted-by":"publisher","DOI":"10.1145\/2743065.2743085"},{"key":"e_1_3_3_182_2","volume-title":"Detecting cyberbullying entries on informal school websites based on category relevance maximization","author":"Nitta T.","year":"2013","unstructured":"T. Nitta, F. Masui, M. Ptaszynski, Y. Kimura, R. Rzepka, and K. Araki. 2013. Detecting cyberbullying entries on informal school websites based on category relevance maximization. In Proceedings of the Sixth International Joint Conference on Natural Language Processing."},{"key":"e_1_3_3_183_2","doi-asserted-by":"publisher","DOI":"10.1145\/2872427.2883062"},{"key":"e_1_3_3_184_2","first-page":"241","volume-title":"Proceedings of the 1st International Conference on Informatics and Computational Sciences","year":"2017","unstructured":"Noviantho, S. M. Isa, and L. Ashianti. 2017. Cyberbullying classification using text mining. In Proceedings of the 1st International Conference on Informatics and Computational Sciences (ICICoS). IEEE, 241\u2013246. https:\/\/doi.org\/10.1109\/ICICOS.2017.8276369"},{"key":"e_1_3_3_185_2","unstructured":"Ika Nurfarida and Laudetta Dianne Fitri. [n. d.]. Mapping and defining hate speech in Instagram\u2019s comments: A study of language use in social media. Prosiding: Seminar Bahasa dan Sastra Nasional 8 (SENABASTRA 8) di Prodi Sastra Inggris Fakultas Ilmu Sosial dan Ilmu Budaya Universitas Trunojoyo Madura ."},{"key":"e_1_3_3_186_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICOIACT.2018.8350758"},{"key":"e_1_3_3_187_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.langsci.2014.09.005"},{"key":"e_1_3_3_188_2","unstructured":"Council of Europe: European Commission against Racism and Intolerance (ECRI). [n. d.]. Hate speech and violence. Retrieved from https:\/\/www.coe.int\/en\/web\/european-commission-against-racism-and-intolerance\/hate-speech-and-violence."},{"key":"e_1_3_3_189_2","doi-asserted-by":"publisher","DOI":"10.1145\/3091478.3098871"},{"key":"e_1_3_3_190_2","article-title":"Questioning the assumptions behind fairness solutions","author":"Overdorf Rebekah","year":"2018","unstructured":"Rebekah Overdorf, Bogdan Kulynych, Ero Balsa, Carmela Troncoso, and Seda G\u00fcrses. 2018. Questioning the assumptions behind fairness solutions. arXiv preprint arXiv:1811.11293 (2018).","journal-title":"arXiv preprint arXiv:1811.11293"},{"key":"e_1_3_3_191_2","doi-asserted-by":"publisher","DOI":"10.1109\/SSCI.2016.7849868"},{"key":"e_1_3_3_192_2","doi-asserted-by":"publisher","DOI":"10.1109\/UBMK.2017.8093411"},{"key":"e_1_3_3_193_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-3006"},{"key":"e_1_3_3_194_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1302"},{"key":"e_1_3_3_195_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.0021-9029.2006.00117.x"},{"key":"e_1_3_3_196_2","doi-asserted-by":"publisher","DOI":"10.1145\/3371276"},{"key":"e_1_3_3_197_2","article-title":"Data and its (dis) contents: A survey of dataset development and use in machine learning research","author":"Paullada Amandalynne","year":"2020","unstructured":"Amandalynne Paullada, Inioluwa Deborah Raji, Emily M. Bender, Emily Denton, and Alex Hanna. 2020. Data and its (dis) contents: A survey of dataset development and use in machine learning research. arXiv preprint arXiv:2012.05345 (2020).","journal-title":"arXiv preprint arXiv:2012.05345"},{"key":"e_1_3_3_198_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1117"},{"key":"e_1_3_3_199_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-4209"},{"key":"e_1_3_3_200_2","article-title":"Toxicity detection: Does context really matter?","author":"Pavlopoulos John","year":"2020","unstructured":"John Pavlopoulos, Jeffrey Sorensen, Lucas Dixon, Nithum Thain, and Ion Androutsopoulos. 2020. Toxicity detection: Does context really matter?arXiv preprint arXiv:2006.00998 (2020).","journal-title":"arXiv preprint arXiv:2006.00998"},{"key":"e_1_3_3_201_2","doi-asserted-by":"publisher","DOI":"10.1145\/3243082.3243111"},{"key":"e_1_3_3_202_2","unstructured":"Billy Perrigo. 2019. Facebook Says It\u2019s Removing More Hate Speech Than Ever Before. But There\u2019s a Catch. Retrieved from https:\/\/time.com\/5739688\/facebook-hate-speech-languages\/."},{"key":"e_1_3_3_203_2","volume-title":"In the Name of Hate: Understanding Hate Crimes","author":"Perry Barbara","year":"2001","unstructured":"Barbara Perry et al. 2001. In the Name of Hate: Understanding Hate Crimes. Psychology Press."},{"key":"e_1_3_3_204_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1202"},{"key":"e_1_3_3_205_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1559-1816.1998.tb01661.x"},{"key":"e_1_3_3_206_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10489-018-1242-y"},{"key":"e_1_3_3_207_2","doi-asserted-by":"publisher","DOI":"10.1111\/jasp.12105"},{"key":"e_1_3_3_208_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12144-014-9215-8"},{"key":"e_1_3_3_209_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-020-09502-8"},{"key":"e_1_3_3_210_2","doi-asserted-by":"publisher","DOI":"10.4000\/books.aaccademia.2448"},{"key":"e_1_3_3_211_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2014.170"},{"key":"e_1_3_3_212_2","first-page":"7","volume-title":"Proceedings of the 36th Artificial Intelligence and Simulation of Behaviour Conference","author":"Ptaszynski Michal","year":"2010","unstructured":"Michal Ptaszynski, Pawel Dybala, Tatsuaki Matsuba, Fumito Masui, Rafal Rzepka, and Kenji Araki. 2010. Machine learning and affect analysis against cyber-bullying. In Proceedings of the 36th Artificial Intelligence and Simulation of Behaviour Conference. 7\u201316."},{"key":"e_1_3_3_213_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1482"},{"key":"e_1_3_3_214_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1391"},{"key":"e_1_3_3_215_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-2019"},{"key":"e_1_3_3_216_2","doi-asserted-by":"publisher","DOI":"10.1145\/3167132.3167317"},{"key":"e_1_3_3_217_2","doi-asserted-by":"publisher","DOI":"10.1145\/2808797.2809381"},{"key":"e_1_3_3_218_2","doi-asserted-by":"publisher","DOI":"10.1007\/s13278-018-0517-y"},{"key":"e_1_3_3_219_2","doi-asserted-by":"publisher","DOI":"10.1109\/IC3.2017.8284294"},{"key":"e_1_3_3_220_2","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1298(199706)7:3<181::AID-CASP416>3.0.CO;2-Y"},{"key":"e_1_3_3_221_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-13059-5_5"},{"key":"e_1_3_3_222_2","doi-asserted-by":"publisher","DOI":"10.1145\/3201064.3201103"},{"key":"e_1_3_3_223_2","volume-title":"Proceedings of WSDM Workshop on Misinformation and Misbehavior Mining on the Web","author":"Ribeiro M. H.","year":"2018","unstructured":"M. H. Ribeiro, P. H. Calais, Y. A. Santos, V. A. F. Almeida, and W. Meira. 2018. \u201cLike sheep among wolves\u201d: Characterizing hateful users on Twitter. In Proceedings of WSDM Workshop on Misinformation and Misbehavior Mining on the Web (MIS2). ACM. https:\/\/doi.org\/10.475\/123_4."},{"key":"e_1_3_3_224_2","first-page":"137","volume-title":"Proceedings of the 2nd Workshop on Trolling, Aggression and Cyberbullying","author":"Risch Julian","year":"2020","unstructured":"Julian Risch, Robin Ruff, and Ralf Krestel. 2020. Offensive language detection explained. In Proceedings of the 2nd Workshop on Trolling, Aggression and Cyberbullying. 137\u2013143."},{"key":"e_1_3_3_225_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-00350-0_40"},{"key":"e_1_3_3_226_2","doi-asserted-by":"publisher","DOI":"10.1145\/3032963"},{"key":"e_1_3_3_227_2","doi-asserted-by":"publisher","DOI":"10.1109\/FUZZ-IEEE.2018.8491557"},{"key":"e_1_3_3_228_2","first-page":"6","volume-title":"Proceedings of NLP4CMC III: 3rd Workshop on Natural Language Processing for Computer Mediated Communication, vol. 17","author":"Ross B.","year":"2016","unstructured":"B. Ross, M. Rist, G. Carbonell, B. Cabrera, N. Kurowsky, and M. Wojatzki. 2016. Measuring the reliability of hate speech annotations: The case of the European refugee crisis. In Proceedings of NLP4CMC III: 3rd Workshop on Natural Language Processing for Computer Mediated Communication, vol. 17, Beisswenger M., Wojatzki M., and Zesch T. (Eds.). Bochumer Linguistischer Arbeitsberichte, 6\u20139."},{"key":"e_1_3_3_229_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICHI.2018.00039"},{"key":"e_1_3_3_230_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-99626-4_29"},{"key":"e_1_3_3_231_2","article-title":"Hate speech in pixels: Detection of offensive memes towards automatic moderation","author":"Sabat Benet Oriol","year":"2019","unstructured":"Benet Oriol Sabat, Cristian Canton Ferrer, and Xavier Giro-i Nieto. 2019. Hate speech in pixels: Detection of offensive memes towards automatic moderation. arXiv preprint arXiv:1910.02334 (2019).","journal-title":"arXiv preprint arXiv:1910.02334"},{"key":"e_1_3_3_232_2","first-page":"484","volume-title":"Proceedings of the International Conference on Recent Developments in Science, Engineering and Technology","author":"Sahni Aastha","year":"2017","unstructured":"Aastha Sahni and Naveen Raja. 2017. Analyzation and detection of cyberbullying: A Twitter based Indian case study. In Proceedings of the International Conference on Recent Developments in Science, Engineering and Technology. Springer, 484\u2013497."},{"issue":"1","key":"e_1_3_3_233_2","first-page":"1","article-title":"Approaches to automated detection of cyberbullying: A survey","author":"Salawu S.","year":"2017","unstructured":"S. Salawu, Y. He, and J. Lumsden. 2017. Approaches to automated detection of cyberbullying: A survey. IEEE Trans. Affect. Comput.1 (2017), 1\u20131.","journal-title":"IEEE Trans. Affect. Comput."},{"key":"e_1_3_3_234_2","volume-title":"Proceedings of the 1st Workshop on Text Analytics for Cybersecurity and Online Safety at LREC 2016","author":"Saleem H. M.","year":"2016","unstructured":"H. M. Saleem, K. P. Dillon, S. Benesch, and D. Ruths. 2016. A web of hate: Tackling hateful speech in online social spaces. In Proceedings of the 1st Workshop on Text Analytics for Cybersecurity and Online Safety at LREC 2016."},{"key":"e_1_3_3_235_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICICCS.2016.7542319"},{"key":"e_1_3_3_236_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3026007"},{"key":"e_1_3_3_237_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1163"},{"key":"e_1_3_3_238_2","volume-title":"Language: An Introduction to the Study of Speech","author":"Sapir Edward","year":"2004","unstructured":"Edward Sapir. 2004. Language: An Introduction to the Study of Speech. Courier Corporation."},{"key":"e_1_3_3_239_2","article-title":"Automatic detection of cyberbullying from Twitter","volume":"6","author":"Saravanaraj A.","year":"2016","unstructured":"A. Saravanaraj, J. I. Sheeba, and S. Pradeep Devaneyan. 2016. Automatic detection of cyberbullying from Twitter. Int. J. Comput. Sci. Info. Technol. Secur 6 (2016).","journal-title":"Int. J. Comput. Sci. Info. Technol. Secur"},{"key":"e_1_3_3_240_2","article-title":"FairPrep: Promoting data to a first-class citizen in studies on fairness-enhancing interventions","author":"Schelter Sebastian","year":"2019","unstructured":"Sebastian Schelter, Yuxuan He, Jatin Khilnani, and Julia Stoyanovich. 2019. FairPrep: Promoting data to a first-class citizen in studies on fairness-enhancing interventions. arXiv preprint arXiv:1911.12587 (2019).","journal-title":"arXiv preprint arXiv:1911.12587"},{"key":"e_1_3_3_241_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-1101"},{"key":"e_1_3_3_242_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-99579-3_60"},{"key":"e_1_3_3_243_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287598"},{"key":"e_1_3_3_244_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-70096-0_55"},{"key":"e_1_3_3_245_2","first-page":"46","volume-title":"Proceedings of the Workshop on Widening NLP","author":"Sharifirad Sima","year":"2019","unstructured":"Sima Sharifirad and Stan Matwin. 2019. Using attention-based bidirectional LSTM to identify different categories of offensive language directed toward female celebrities. In Proceedings of the Workshop on Widening NLP. 46\u201348."},{"key":"e_1_3_3_246_2","first-page":"106","volume-title":"Proceedings of the 1st Workshop on Trolling, Aggression and Cyberbullying, TRAC@COLING 2018, Santa Fe, New Mexico, USA, August 25, 2018","author":"Sharma Sanjana","year":"2018","unstructured":"Sanjana Sharma, Saksham Agrawal, and Manish Shrivastava. 2018. Degree based classification of harmful speech using Twitter data. In Proceedings of the 1st Workshop on Trolling, Aggression and Cyberbullying, TRAC@COLING 2018, Santa Fe, New Mexico, USA, August 25, 2018, Ritesh Kumar, Atul Kr. Ojha, Marcos Zampieri, and Shervin Malmasi (Eds.). Association for Computational Linguistics, 106\u2013112. https:\/\/www.aclweb.org\/anthology\/W18-4413\/."},{"key":"e_1_3_3_247_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCIC.2013.6724124"},{"key":"e_1_3_3_248_2","doi-asserted-by":"publisher","DOI":"10.1177\/107621751003300206"},{"key":"e_1_3_3_249_2","first-page":"687","volume-title":"Proceedings of the 10th International AAAI Conference on Web and Social Media","author":"Silva Leandro","year":"2016","unstructured":"Leandro Silva, Mainack Mondal, Denzil Correa, Fabr\u00edcio Benevenuto, and Ingmar Weber. 2016. Analyzing the targets of hate in online social media. In Proceedings of the 10th International AAAI Conference on Web and Social Media. AAAI, 687\u2013690."},{"key":"e_1_3_3_250_2","doi-asserted-by":"publisher","DOI":"10.1145\/3341161.3342949"},{"key":"e_1_3_3_251_2","volume-title":"Proceedings of the 37th International Conference on Machine Learning","author":"Sloane M.","year":"2020","unstructured":"M. Sloane, E. Moss, O. Awomolo, and L. Forlano. 2020. Participation is not a design fix for machine learning. In Proceedings of the 37th International Conference on Machine Learning, Vienna, Austria, PMLR 119, 2020."},{"key":"e_1_3_3_252_2","doi-asserted-by":"publisher","DOI":"10.4324\/9780203799079"},{"key":"e_1_3_3_253_2","unstructured":"Olivia Solon. 2017. Facebook is hiring moderators. But is the job too gruesome to handle? Retrieved from https:\/\/www.theguardian.com\/technology\/2017\/may\/04\/facebook-content-moderators-ptsd-psychological-dangers."},{"key":"e_1_3_3_254_2","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208610"},{"key":"e_1_3_3_255_2","first-page":"06","volume-title":"Proceedings of the AAAI Spring Symposium: Wisdom of the Crowd","volume":"12","author":"Sood S. O.","year":"2012","unstructured":"S. O. Sood, J. Antin, and E. F. Churchill. 2012. Using crowdsourcing to improve profanity detection. In Proceedings of the AAAI Spring Symposium: Wisdom of the Crowd, Vol. 12. 06."},{"key":"e_1_3_3_256_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.21690"},{"key":"e_1_3_3_257_2","doi-asserted-by":"publisher","DOI":"10.1145\/2808797.2809398"},{"key":"e_1_3_3_258_2","doi-asserted-by":"publisher","DOI":"10.1002\/jts5.25"},{"key":"e_1_3_3_259_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISDA.2015.7489220"},{"key":"e_1_3_3_260_2","doi-asserted-by":"publisher","DOI":"10.1037\/1076-8971.10.3.250"},{"key":"e_1_3_3_261_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1159"},{"key":"e_1_3_3_262_2","article-title":"A framework for understanding unintended consequences of machine learning","author":"Suresh Harini","year":"2019","unstructured":"Harini Suresh and John V. Guttag. 2019. A framework for understanding unintended consequences of machine learning. arXiv preprint arXiv:1901.10002 (2019).","journal-title":"arXiv preprint arXiv:1901.10002"},{"key":"e_1_3_3_263_2","unstructured":"T. Davidson D. Warmsley M. Macy and I. Weber.2017. Automated hate speech detection and the problem of offensive language. (Mar. 2017). arxiv:1703.04009. http:\/\/arxiv.org\/abs\/1703.04009."},{"key":"e_1_3_3_264_2","article-title":"Challenges and future directions of automated cyberbullying detection","author":"Tahmasbi N.","year":"2018","unstructured":"N. Tahmasbi and A. Fuchsberger. 2018. Challenges and future directions of automated cyberbullying detection. AMCIS 2018 Proc. (Aug. 2018). https:\/\/aisel.aisnet.org\/amcis2018\/SocialComputing\/Presentations\/10.","journal-title":"AMCIS 2018 Proc."},{"key":"e_1_3_3_265_2","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2018.269"},{"key":"e_1_3_3_266_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1559-1816.1993.tb01082.x"},{"key":"e_1_3_3_267_2","doi-asserted-by":"publisher","DOI":"10.1145\/3193077.3193078"},{"key":"e_1_3_3_268_2","article-title":"Generating counter narratives against online hate speech: Data and strategies","author":"Tekiroglu Serra Sinem","year":"2020","unstructured":"Serra Sinem Tekiroglu, Yi-Ling Chung, and Marco Guerini. 2020. Generating counter narratives against online hate speech: Data and strategies. arXiv preprint arXiv:2004.04216 (2020).","journal-title":"arXiv preprint arXiv:2004.04216"},{"key":"e_1_3_3_269_2","first-page":"817","article-title":"Hate in cyberspace: Regulating hate speech on the Internet","volume":"38","author":"Tsesis A.","year":"2001","unstructured":"A. Tsesis. 2001. Hate in cyberspace: Regulating hate speech on the Internet. San Diego L. Rev. 38 (2001), 817.","journal-title":"San Diego L. Rev."},{"key":"e_1_3_3_270_2","article-title":"From ImageNet to image classification: Contextualizing progress on benchmarks","author":"Tsipras Dimitris","year":"2020","unstructured":"Dimitris Tsipras, Shibani Santurkar, Logan Engstrom, Andrew Ilyas, and Aleksander Madry. 2020. From ImageNet to image classification: Contextualizing progress on benchmarks. arXiv preprint arXiv:2005.11295 (2020).","journal-title":"arXiv preprint arXiv:2005.11295"},{"key":"e_1_3_3_271_2","first-page":"1","volume-title":"Proceedings of the 1st Workshop on Text Analytics for Cybersecurity and Online Safety","author":"Tulkens St\u00e9phan","year":"2016","unstructured":"St\u00e9phan Tulkens, Lisa Hilte, Elise Lodewyckx, Ben Verhoeven, and Walter Daelemans. 2016. A dictionary-based approach to racism detection in Dutch social media. In Proceedings of the 1st Workshop on Text Analytics for Cybersecurity and Online Safety. 1\u20137."},{"key":"e_1_3_3_272_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10676-019-09516-z"},{"key":"e_1_3_3_273_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5105"},{"key":"e_1_3_3_274_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0203794"},{"key":"e_1_3_3_275_2","volume-title":"Proceedings of the International Conference Recent Advances in Natural Language Processing","author":"Van Hee Cynthia","year":"2015","unstructured":"Cynthia Van Hee, Els Lefever, Ben Verhoeven, Julie Mennes, Bart Desmet, Guy De Pauw, Walter Daelemans, and V\u00e9ronique Hoste. 2015. Detection and fine-grained classification of cyberbullying events. In Proceedings of the International Conference Recent Advances in Natural Language Processing (RANLP)."},{"key":"e_1_3_3_276_2","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.2018.0083"},{"key":"e_1_3_3_277_2","doi-asserted-by":"publisher","DOI":"10.1145\/3194770.3194776"},{"key":"e_1_3_3_278_2","article-title":"Directions in abusive language training data: Garbage in, garbage out","author":"Vidgen Bertie","year":"2020","unstructured":"Bertie Vidgen and Leon Derczynski. 2020. Directions in abusive language training data: Garbage in, garbage out. arXiv preprint arXiv:2004.01670 (2020).","journal-title":"arXiv preprint arXiv:2004.01670"},{"key":"e_1_3_3_279_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-3509"},{"key":"e_1_3_3_280_2","doi-asserted-by":"publisher","DOI":"10.1080\/19331681.2019.1702607"},{"key":"e_1_3_3_281_2","doi-asserted-by":"publisher","DOI":"10.4159\/harvard.9780674065086"},{"key":"e_1_3_3_282_2","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531734"},{"key":"e_1_3_3_283_2","doi-asserted-by":"publisher","DOI":"10.5555\/2390374.2390377"},{"key":"e_1_3_3_284_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-5618"},{"key":"e_1_3_3_285_2","doi-asserted-by":"crossref","unstructured":"Z. Waseem T. Davidson D. Warmsley and I. Weber. 2017. Understanding Abuse: A Typology of Abusive Language Detection Subtasks. arxiv:1705.09899. http:\/\/aclweb.org\/anthology\/W17-3012. http:\/\/arxiv.org\/abs\/1705.09899.","DOI":"10.18653\/v1\/W17-3012"},{"key":"e_1_3_3_286_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-2013"},{"key":"e_1_3_3_287_2","article-title":"Metrology for AI: From benchmarks to instruments","author":"Welty Chris","year":"2019","unstructured":"Chris Welty, Praveen Paritosh, and Lora Aroyo. 2019. Metrology for AI: From benchmarks to instruments. arXiv preprint arXiv:1911.01875 (2019).","journal-title":"arXiv preprint arXiv:1911.01875"},{"key":"e_1_3_3_288_2","unstructured":"Mike Wendling. 2015. 2015: The year that angry won the internet. Retrieved from https:\/\/www.bbc.com\/news\/blogs-trending-35111707."},{"key":"e_1_3_3_289_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1095"},{"key":"e_1_3_3_290_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2016.05.067"},{"key":"e_1_3_3_291_2","first-page":"110","volume-title":"Proceedings of the 14th Conference on Natural Language Processing, KONVENS 2018, Vienna, Austria, September 19\u201321, 2018","author":"Wojatzki Michael","year":"2018","unstructured":"Michael Wojatzki, Tobias Horsmann, Darina Gold, and Torsten Zesch. 2018. Do women perceive hate differently: Examining the relationship between hate speech, gender, and agreement judgments. In Proceedings of the 14th Conference on Natural Language Processing, KONVENS 2018, Vienna, Austria, September 19\u201321, 2018, Adrien Barbaresi, Hanno Biber, Friedrich Neubarth, and Rainer Osswald (Eds.). \u00d6sterreichische Akademie der Wissenschaften, 110\u2013120. https:\/\/www.oeaw.ac.at\/fileadmin\/subsites\/academiaecorpora\/PDF\/konvens18_13.pdf."},{"key":"e_1_3_3_292_2","doi-asserted-by":"publisher","DOI":"10.1515\/humor-2015-0025"},{"key":"e_1_3_3_293_2","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052591"},{"key":"e_1_3_3_294_2","article-title":"Towards hate speech detection at large via deep generative modeling","author":"Wullach Tomer","year":"2020","unstructured":"Tomer Wullach, Amir Adler, and Einat Minkov. 2020. Towards hate speech detection at large via deep generative modeling. arXiv preprint arXiv:2005.06370 (2020).","journal-title":"arXiv preprint arXiv:2005.06370"},{"key":"e_1_3_3_295_2","doi-asserted-by":"crossref","unstructured":"Mengzhou Xia Anjalie Field and Yulia Tsvetkov. 2020. Demoting racial bias in hate speech detection. In Proceedings of the Eighth International Workshop on Natural Language Processing for Social Media . Association for Computational Linguistics 7\u201314. DOI:https:\/\/aclanthology.org\/2020.socialnlp-1.2","DOI":"10.18653\/v1\/2020.socialnlp-1.2"},{"key":"e_1_3_3_296_2","volume-title":"Learning from Bullying Traces in Social Media","author":"Xu J.-M.","year":"2012","unstructured":"J.-M. Xu, K.-S. Jun, X. Zhu, and A. Bellmore. 2012. Learning from Bullying Traces in Social Media. Association for Computational Linguistics. https:\/\/dl.acm.org\/citation.cfm?id=2382139."},{"key":"e_1_3_3_297_2","first-page":"1","volume-title":"Proceedings of the 7th Annual Collaboration, Electronic Messaging, Anti-abuse and Spam Conference","author":"Xu Z.","year":"2010","unstructured":"Z. Xu and S. Zhu. 2010. Filtering offensive language in online communities using grammatical relations. In Proceedings of the 7th Annual Collaboration, Electronic Messaging, Anti-abuse and Spam Conference. 1\u201310."},{"key":"e_1_3_3_298_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIIECS.2015.7193018"},{"key":"e_1_3_3_299_2","article-title":"Detection of harassment on web 2.0","volume":"2","author":"Yin Dawei","year":"2009","unstructured":"Dawei Yin, Zhenzhen Xue, Liangjie Hong, Brian D. Davison, April Kontostathis, and Lynne Edwards. 2009. Detection of harassment on web 2.0. Proc. Content Anal. WEB 2 (2009).","journal-title":"Proc. Content Anal. WEB"},{"key":"e_1_3_3_300_2","first-page":"1","volume-title":"Proceedings of the IEEE Symposium on Computational Intelligence in Big Data","author":"Yoshida S.","year":"2014","unstructured":"S. Yoshida, J. Kitazono, S. Ozawa, T. Sugawara, T. Haga, and S. Nakamura. 2014. Sentiment analysis for various SNS media using naive Bayes classifier and its application to flaming detection. In Proceedings of the IEEE Symposium on Computational Intelligence in Big Data (CIBD). IEEE, 1\u20136. https:\/\/doi.org\/10.1109\/CIBD.2014.7011523"},{"key":"e_1_3_3_301_2","doi-asserted-by":"publisher","DOI":"10.1109\/SCC.2016.125"},{"key":"e_1_3_3_302_2","article-title":"Demographics should not be the reason of toxicity: Mitigating discrimination in text classifications with instance weighting","author":"Zhang Guanhua","year":"2020","unstructured":"Guanhua Zhang, Bing Bai, Junqi Zhang, Kun Bai, Conghui Zhu, and Tiejun Zhao. 2020. Demographics should not be the reason of toxicity: Mitigating discrimination in text classifications with instance weighting. arXiv preprint arXiv:2004.14088 (2020).","journal-title":"arXiv preprint arXiv:2004.14088"},{"key":"e_1_3_3_303_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICMLA.2016.0132"},{"key":"e_1_3_3_304_2","doi-asserted-by":"publisher","DOI":"10.3233\/SW-180338"},{"key":"e_1_3_3_305_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-93417-4_48"},{"key":"e_1_3_3_306_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1064"},{"key":"e_1_3_3_307_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2016.2531682"},{"key":"e_1_3_3_308_2","doi-asserted-by":"publisher","DOI":"10.1145\/2833312.2849567"},{"key":"e_1_3_3_309_2","first-page":"3952","volume-title":"Proceedings of the 25th International Joint Conference on Artificial Intelligence","author":"Zhong H.","year":"2016","unstructured":"H. Zhong, H. Li, A. Squicciarini, S. Rajtmajer, C. Griffin, D. Miller, and C. Caragea. 2016. Content-driven detection of cyberbullying on the Instagram social network. In Proceedings of the 25th International Joint Conference on Artificial Intelligence. AAAI Press, 3952\u20133958."},{"key":"e_1_3_3_310_2","volume-title":"Proceedings of the 11th International Conference on Language Resources and Evaluation","author":"Zimmerman Steven","year":"2018","unstructured":"Steven Zimmerman, Udo Kruschwitz, and Chris Fox. 2018. Improving hate speech detection with deep learning ensembles. In Proceedings of the 11th International Conference on Language Resources and Evaluation. European Language Resources Association (ELRA). http:\/\/www.lrec-conf.org\/proceedings\/lrec2018\/summaries\/292.html."},{"key":"e_1_3_3_311_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2018.8462092"}],"container-title":["ACM Transactions on Social Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3479158","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3479158","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:38Z","timestamp":1750191518000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3479158"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,30]]},"references-count":309,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,9,30]]}},"alternative-id":["10.1145\/3479158"],"URL":"https:\/\/doi.org\/10.1145\/3479158","relation":{},"ISSN":["2469-7818","2469-7826"],"issn-type":[{"value":"2469-7818","type":"print"},{"value":"2469-7826","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,30]]},"assertion":[{"value":"2020-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-10-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}