{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,12]],"date-time":"2025-12-12T13:41:44Z","timestamp":1765546904413,"version":"3.37.3"},"reference-count":68,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,2,14]],"date-time":"2022-02-14T00:00:00Z","timestamp":1644796800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,2,14]],"date-time":"2022-02-14T00:00:00Z","timestamp":1644796800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/T001569\/1"],"award-info":[{"award-number":["EP\/T001569\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["EPJ Data Sci."],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Online hate is a growing concern on many social media platforms, making them unwelcoming and unsafe. To combat this, technology companies are increasingly developing techniques to automatically identify and sanction hateful users. However, accurate detection of such users remains a challenge due to the contextual nature of speech, whose meaning depends on the social setting in which it is used. This contextual nature of speech has also led to minoritized users, especially African\u2013Americans, to be unfairly detected as \u2018hateful\u2019 by the very algorithms designed to protect them. To resolve this problem of inaccurate and unfair hate detection, research has focused on developing machine learning (ML) systems that better understand textual context. Incorporating social networks of hateful users has not received as much attention, despite social science research suggesting it provides rich contextual information. We present a system for more accurately and fairly detecting hateful users by incorporating social network information through geometric deep learning. Geometric deep learning is a ML technique that dynamically learns information-rich network representations. We make two main contributions: first, we demonstrate that adding network information with geometric deep learning produces a more accurate classifier compared with other techniques that either exclude network information entirely or incorporate it through manual feature engineering. Our best performing model achieves an AUC score of 90.8% on a previously released hateful user dataset. Second, we show that such information also leads to fairer outcomes: using the \u2018predictive equality\u2019 fairness criteria, we compare the false positive rates of our geometric learning algorithm to other ML techniques and find that our best-performing classifier has no false positives among a subset of African\u2013American users. A neural network without network information has the largest number of false positives at 26, while a neural network incorporating manual network features has 13 false positives among African\u2013American users. The system we present highlights the importance of effectively incorporating social network features in automated hateful user detection, raising new opportunities to improve how online hate is tackled.<\/jats:p>","DOI":"10.1140\/epjds\/s13688-022-00319-9","type":"journal-article","created":{"date-parts":[[2022,2,14]],"date-time":"2022-02-14T13:37:16Z","timestamp":1644845836000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Tackling racial bias in automated online hate detection: Towards fair and accurate detection of hateful users with geometric deep learning"],"prefix":"10.1140","volume":"11","author":[{"given":"Zo","family":"Ahmed","sequence":"first","affiliation":[]},{"given":"Bertie","family":"Vidgen","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6894-4951","authenticated-orcid":false,"given":"Scott A.","family":"Hale","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,2,14]]},"reference":[{"key":"319_CR1","doi-asserted-by":"publisher","unstructured":"Alorainy W, Burnap P, Liu H, Williams ML (2019) \u201cThe enemy among us\u201d: detecting cyber hate speech with threats-based othering language embeddings. ACM Trans Web 13(3). https:\/\/doi.org\/10.1145\/3324997","DOI":"10.1145\/3324997"},{"key":"319_CR2","unstructured":"Barocas S, Hardt M (2017) NIPS 2017 Tutorial: fairness in machine learning. https:\/\/arxiv.org\/abs\/2005.03909"},{"key":"319_CR3","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/d16-1120","volume-title":"EMNLP 2016\u2014conference on empirical methods in natural language processing, proceedings","author":"SL Blodgett","year":"2016","unstructured":"Blodgett SL, Green L, O\u2019Connor B (2016) Demographic dialectal variation in social media: a case study of African\u2013American English. In: EMNLP 2016\u2014conference on empirical methods in natural language processing, proceedings. https:\/\/doi.org\/10.18653\/v1\/d16-1120"},{"key":"319_CR4","unstructured":"Bordes A, Usunier N, Garcia-Dur\u00e1n A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. In: Advances in Neural Information Processing Systems, Neural Information Processing Systems Foundation"},{"issue":"11","key":"319_CR5","doi-asserted-by":"publisher","first-page":"989","DOI":"10.1080\/10576100903259951","volume":"32","author":"L Bowman-Grieve","year":"2009","unstructured":"Bowman-Grieve L (2009) Exploring stormfront: a virtual community of the radical right. Stud Confl Terrorism 32(11):989\u20131007. https:\/\/doi.org\/10.1080\/10576100903259951","journal-title":"Stud Confl Terrorism"},{"issue":"2","key":"319_CR6","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1002\/poi3.85","volume":"7","author":"P Burnap","year":"2015","unstructured":"Burnap P, Williams ML (2015) Cyber hate speech on Twitter: an application of machine classification and statistical modeling for policy and decision making. Policy Internet 7(2):223\u2013242. https:\/\/doi.org\/10.1002\/poi3.85","journal-title":"Policy Internet"},{"key":"319_CR7","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1145\/3091478.3091487","volume-title":"WebSci 2017\u2014proceedings of the 2017 ACM web science conference,association for computing machinery","author":"D Chatzakou","year":"2017","unstructured":"Chatzakou D, Kourtellis N, Blackburn J, De Cristofaro E, Stringhini G, Vakali A (2017) Mean birds: detecting aggression and bullying on Twitter. In: WebSci 2017\u2014proceedings of the 2017 ACM web science conference,association for computing machinery, pp\u00a013\u201322. https:\/\/doi.org\/10.1145\/3091478.3091487"},{"key":"319_CR8","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1007\/s12559-021-09862-5","volume":"14","author":"P Chiril","year":"2022","unstructured":"Chiril P, Pamungkas EW, Benamara F, Moriceau V, Patti V (2022) Emotionally informed hate speech detection: a\u00a0multi-target perspective. Cogn Comput 14:322\u2013352","journal-title":"Cogn Comput"},{"key":"319_CR9","doi-asserted-by":"publisher","unstructured":"Christ O, Schmid K, Lolliot S, Swart H, Stolle D, Tausch N, Al Ramiah A, Wagner U, Vertovec S, Hewstone M (2014) Contextual effect of positive intergroup contact on outgroup prejudice. In: Proceedings of the National Academy of Sciences of the United States of America 111. https:\/\/doi.org\/10.1073\/pnas.1320901111","DOI":"10.1073\/pnas.1320901111"},{"key":"319_CR10","unstructured":"Chung A (2019) How automated tools discriminate against black language. https:\/\/onezero.medium.com\/how-automated-tools-discriminate-against-black-language-2ac8eab8d6db"},{"key":"319_CR11","doi-asserted-by":"publisher","first-page":"25","DOI":"10.18653\/v1\/W19-3504","volume-title":"Proceedings of the third workshop on abusive language online, association for computational linguistics","author":"T Davidson","year":"2019","unstructured":"Davidson T, Bhattacharya D, Weber I (2019) Racial bias in hate speech and abusive language detection datasets. In: Proceedings of the third workshop on abusive language online, association for computational linguistics, Florence, Italy, pp\u00a025\u201335. https:\/\/doi.org\/10.18653\/v1\/W19-3504"},{"key":"319_CR12","volume-title":"Proceedings of the 11th international conference on web and social media, ICWSM 2017","author":"T Davidson","year":"2017","unstructured":"Davidson T, Warmsley D, Macy M, Weber I (2017) Automated hate speech detection and the problem of offensive language. In: Proceedings of the 11th international conference on web and social media, ICWSM 2017"},{"key":"319_CR13","unstructured":"Day E (2018) The application of machine learning, big data techniques, and criminology to the analysis of racist tweets. PhD thesis, Canterbury Christ Church University"},{"key":"319_CR14","doi-asserted-by":"publisher","DOI":"10.1145\/3278721.3278729","volume-title":"AIES 2018\u2014proceedings of the 2018 AAAI\/ACM conference on AI, ethics, and society","author":"L Dixon","year":"2018","unstructured":"Dixon L, Li J, Sorensen J, Thain N, Vasserman L (2018) Measuring and mitigating unintended bias in text classification. In: AIES 2018\u2014proceedings of the 2018 AAAI\/ACM conference on AI, ethics, and society. https:\/\/doi.org\/10.1145\/3278721.3278729"},{"key":"319_CR15","doi-asserted-by":"publisher","first-page":"41","DOI":"10.5130\/ccs.v10.i3.6026","volume":"10","author":"N Eckstrand","year":"2018","unstructured":"Eckstrand N (2018) The ugliness of trolls: comparing the methodologies of the alt-right and the Ku Klux Klan. Cosmopolitan civil societies. Interdiscip J 10:41\u201362. https:\/\/doi.org\/10.5130\/ccs.v10.i3.6026","journal-title":"Interdiscip J"},{"key":"319_CR16","doi-asserted-by":"publisher","unstructured":"Fawcett T (2006) An introduction to ROC analysis. Pattern Recognit Lett 27(8). https:\/\/doi.org\/10.1016\/j.patrec.2005.10.010","DOI":"10.1016\/j.patrec.2005.10.010"},{"key":"319_CR17","doi-asserted-by":"publisher","first-page":"75","DOI":"10.18653\/v1\/W18-5110","volume-title":"Proceedings of the 2nd workshop on abusive language online (ALW2), association for computational linguistics","author":"E Fehn Unsv\u00e5g","year":"2018","unstructured":"Fehn Unsv\u00e5g E, Gamb\u00e4ck B (2018) The effects of user features on Twitter hate speech detection. In: Proceedings of the 2nd workshop on abusive language online (ALW2), association for computational linguistics, Brussels, Belgium, pp\u00a075\u201385. https:\/\/doi.org\/10.18653\/v1\/W18-5110"},{"key":"319_CR18","doi-asserted-by":"publisher","DOI":"10.1017\/cbo9780511800306","volume-title":"African American English","author":"LJ Green","year":"2002","unstructured":"Green LJ (2002) African American English. Cambridge University Press, Cambridge. https:\/\/doi.org\/10.1017\/cbo9780511800306"},{"key":"319_CR19","doi-asserted-by":"publisher","unstructured":"Grover A, Leskovec J (2016) Node2vec: scalable feature learning for networks. In: Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, vol 13, 17-August-2016. https:\/\/doi.org\/10.1145\/2939672.2939754","DOI":"10.1145\/2939672.2939754"},{"key":"319_CR20","doi-asserted-by":"publisher","first-page":"833","DOI":"10.1145\/2556288.2557203","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems CHI\u201914","author":"SA Hale","year":"2014","unstructured":"Hale SA (2014) Global connectivity and multilinguals in the Twitter network. In: Proceedings of the SIGCHI conference on human factors in computing systems CHI\u201914. ACM, New York, pp\u00a0833\u2013842. https:\/\/doi.org\/10.1145\/2556288.2557203"},{"key":"319_CR21","unstructured":"Hamilton WL, Ying R, Leskovec J (2017) Inductive representation learning on large graphs. In: Advances in Neural Information Processing Systems, vol 2017-December"},{"key":"319_CR22","unstructured":"Hardt M, Price E, Srebro N (2016) Equality of opportunity in supervised learning. arXiv e-prints 1610.02413"},{"key":"319_CR23","series-title":"Springer series in statistics","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-21606-5","volume-title":"The elements of statistical learning","author":"T Hastie","year":"2001","unstructured":"Hastie T, Tibshirani R, Friedman J (2001) The elements of statistical learning. Springer series in statistics. Springer, New York"},{"key":"319_CR24","unstructured":"Irani D, Wrat A, Amir S (2021) Early detection of online hate speech spreaders with learned user representations. In: Faggioli G, Ferro N, Joly A, Maistro M, Piroi F (eds) Proceedings of the working notes of CLEF 2021\u2014conference and labs of the evaluation forum, Bucharest, Romania, September 21st-to-24th. CEUR workshop proceedings, vol\u00a02936. CEUR-WS.org, pp\u00a02004\u20132010. http:\/\/ceur-ws.org\/Vol-2936\/paper-174.pdf"},{"key":"319_CR25","doi-asserted-by":"publisher","first-page":"1561","DOI":"10.1145\/3038912.3052695","volume-title":"Proceedings of the 26th international conference on world wide web, international world wide web conferences steering committee, Republic and Canton of Geneva, CHE, WWW\u201917","author":"J Jia","year":"2017","unstructured":"Jia J, Wang B, Zhang L, Gong NZ (2017) Attriinfer: inferring user attributes in online social networks using Markov random fields. In: Proceedings of the 26th international conference on world wide web, international world wide web conferences steering committee, Republic and Canton of Geneva, CHE, WWW\u201917, pp\u00a01561\u20131569. https:\/\/doi.org\/10.1145\/3038912.3052695"},{"key":"319_CR26","doi-asserted-by":"publisher","unstructured":"Johnson NF, Leahy R, Restrepo NJ, Velasquez N, Zheng M, Manrique P, Devkota P, Wuchty S (2019) Hidden resilience and adaptive dynamics of the global online hate ecology. https:\/\/doi.org\/10.1038\/s41586-019-1494-7","DOI":"10.1038\/s41586-019-1494-7"},{"key":"319_CR27","doi-asserted-by":"publisher","unstructured":"Jones C, Trott V, Wright S (2019) Sluts and soyboys: mgtow and the production of misogynistic online harassment. New Media Soc 19. https:\/\/doi.org\/10.1177\/1461444819887141","DOI":"10.1177\/1461444819887141"},{"key":"319_CR28","first-page":"4039","volume-title":"Proceedings of the AAAI conference on artificial intelligence, association for the advancement of artificial intelligence","author":"B Juba","year":"2019","unstructured":"Juba B, Le HS (2019) Precision-recall versus accuracy and the role of large data sets. In: Proceedings of the AAAI conference on artificial intelligence, association for the advancement of artificial intelligence, pp\u00a04039\u20134048"},{"key":"319_CR29","unstructured":"Kiela D, Firooz H, Mohan A, Goswami V, Singh A, Ringshia P, Testuggine D (2020) The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes. 2005.04790"},{"key":"319_CR30","unstructured":"Kleinberg JM, Mullainathan S, Raghavan M (2016) Inherent trade-offs in the fair determination of risk scores. CoRR 1609.05807"},{"key":"319_CR31","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-88146-1","volume-title":"Statistical analysis of network data: methods and models","author":"ED Kolaczyk","year":"2009","unstructured":"Kolaczyk ED (2009) Statistical analysis of network data: methods and models, 1st edn. Springer, Berlin","edition":"1"},{"key":"319_CR32","unstructured":"Lahoti P, Beutel A, Chen J, Lee K, Prost F, Thain N, Wang X, Chi EH (2020) Fairness without demographics through adversarially reweighted learning. arXiv e-prints arXiv:2006.13114"},{"key":"319_CR33","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1145\/3375627.3375808","volume-title":"Proceedings of the AAAI\/ACM conference on AI, ethics, and society, AIES\u201920","author":"D Leben","year":"2020","unstructured":"Leben D (2020) Normative principles for evaluating fairness in machine learning. In: Proceedings of the AAAI\/ACM conference on AI, ethics, and society, AIES\u201920 Association for Computing Machinery, New York, pp\u00a086\u201392. https:\/\/doi.org\/10.1145\/3375627.3375808"},{"key":"319_CR34","unstructured":"Leskovec J (2019). Lecture: graph neural networks"},{"issue":"1","key":"319_CR35","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1073\/pnas.1109739109","volume":"109","author":"K Lewis","year":"2012","unstructured":"Lewis K, Gonzalez M, Kaufman J (2012) Social selection and peer influence in an online social network. Proc Natl Acad Sci 109(1):68\u201372. https:\/\/doi.org\/10.1073\/pnas.1109739109","journal-title":"Proc Natl Acad Sci"},{"key":"319_CR36","doi-asserted-by":"publisher","first-page":"87","DOI":"10.18653\/v1\/S19-2011","volume-title":"Proceedings of the 13th international workshop on semantic evaluation, association for computational linguistics","author":"P Liu","year":"2019","unstructured":"Liu P, Li W, Zou L (2019) NULI at SemEval-2019 task 6: transfer learning for offensive language detection using bidirectional transformers. In: Proceedings of the 13th international workshop on semantic evaluation, association for computational linguistics, Minneapolis, Minnesota, USA, pp\u00a087\u201391. https:\/\/doi.org\/10.18653\/v1\/S19-2011"},{"issue":"8","key":"319_CR37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0221152","volume":"14","author":"S MacAvaney","year":"2019","unstructured":"MacAvaney S, Yao HR, Yang E, Russell K, Goharian N, Frieder O (2019) Hate speech detection: challenges and solutions. PLoS ONE 14(8):1\u201316. https:\/\/doi.org\/10.1371\/journal.pone.0221152","journal-title":"PLoS ONE"},{"key":"319_CR38","unstructured":"Marwick A, Reidenberg JR, Russell NC (2014) Online harassment, defamation, and hateful speech: a primer of the legal landscape clip study advisors. Fordham Center on Law and Information Policy Report (July 2013)"},{"key":"319_CR39","unstructured":"Mehrabi N, Morstatter F, Saxena N, Lerman K, Galstyan A (2019) A survey on bias and fairness in machine learning. arXiv e-prints arXiv:1908.09635"},{"key":"319_CR40","unstructured":"Mikolov T, Sutskever I, Chen K, Corrado G, Dean J (2013) Distributed representations ofwords and phrases and their compositionality. In: Advances in Neural Information Processing Systems"},{"key":"319_CR41","first-page":"1088","volume-title":"Proceedings of the 27th international conference on computational linguistics, association for computational linguistics","author":"P Mishra","year":"2018","unstructured":"Mishra P, Del Tredici M, Yannakoudakis H, Shutova E (2018) Author profiling for abuse detection. In: Proceedings of the 27th international conference on computational linguistics, association for computational linguistics, Santa Fe, New Mexico, USA, pp\u00a01088\u20131098. https:\/\/www.aclweb.org\/anthology\/C18-1093"},{"key":"319_CR42","unstructured":"Mishra P, Tredici MD, Yannakoudakis H, Shutova E (2019) Abusive language detection with graph convolutional networks. CoRR 1904.04073"},{"key":"319_CR43","doi-asserted-by":"publisher","DOI":"10.1007\/s42979-021-00455-5","volume":"2","author":"S Mishra","year":"2021","unstructured":"Mishra S, Prasad S, Mishra S (2021) Exploring multi-task multi-lingual learning of transformer models for hate speech and offensive speech identification in social media. SN Comput Sci 2:72. https:\/\/doi.org\/10.1007\/s42979-021-00455-5","journal-title":"SN Comput Sci"},{"key":"319_CR44","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1145\/3078714.3078723","volume-title":"Proceedings of the 28th ACM conference on hypertext and social media, association for computing machinery, HT\u201917","author":"M Mondal","year":"2017","unstructured":"Mondal M, Silva LA, Benevenuto F (2017) A measurement study of hate speech in social media. In: Proceedings of the 28th ACM conference on hypertext and social media, association for computing machinery, HT\u201917. Association for Computing Machinery, New York, pp\u00a085\u201394. https:\/\/doi.org\/10.1145\/3078714.3078723"},{"key":"319_CR45","doi-asserted-by":"crossref","unstructured":"Mozafari M, Farahbakhsh R, Crespi N (2019) A BERT-based transfer learning approach for hate speech detection in online social media. arXiv e-prints arXiv:1910.12574","DOI":"10.1007\/978-3-030-36687-2_77"},{"issue":"88","key":"319_CR46","doi-asserted-by":"publisher","first-page":"364","DOI":"10.1109\/ACCESS.2021.3089515","volume":"9","author":"NS Mullah","year":"2021","unstructured":"Mullah NS, Zainon WMNW (2021) Advances in machine learning algorithms for hate speech detection in social media: a review. IEEE Access 9(88):364\u2013388. https:\/\/doi.org\/10.1109\/ACCESS.2021.3089515","journal-title":"IEEE Access"},{"key":"319_CR47","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1145\/3091478.3098871","volume-title":"Proceedings of the 2017 ACM on web science conference","author":"A Olteanu","year":"2017","unstructured":"Olteanu A, Talamadupula K, Varshney KR (2017) The limits of abstract evaluation metrics: the case of hate speech detection. In: Proceedings of the 2017 ACM on web science conference. Association for Computing Machinery, New York, pp\u00a0405\u2013406. https:\/\/doi.org\/10.1145\/3091478.3098871"},{"key":"319_CR48","doi-asserted-by":"crossref","unstructured":"Pavlopoulos J, Sorensen J, Dixon L, Thain N, Androutsopoulos I (2020) Toxicity detection: does context really matter? arXiv e-prints arXiv:2006.00998","DOI":"10.18653\/v1\/2020.acl-main.396"},{"key":"319_CR49","unstructured":"Pitsilis GK, Ramampiaro H, Langseth H (2018) Detecting offensive language in tweets using deep learning. arXiv e-prints 1801.04433"},{"key":"319_CR50","volume-title":"Proceedings of the 27th international conference on computational linguistics","author":"D Preot","year":"2018","unstructured":"Preot D, Ungar L (2018) User-level race and ethnicity predictors from Twitter text. In: Proceedings of the 27th international conference on computational linguistics"},{"key":"319_CR51","unstructured":"Rangel F, Sarrac\u00e9n G, Chulvi B, Fersini E, Rosso P (2021) Profiling hate speech spreaders on Twitter task at pan 2021. In: Faggioli G, Ferro N, Joly A, Maistro M, Piroi F (eds) Proceedings of the working notes of CLEF 2021\u2014conference and labs of the evaluation forum. Bucharest, Romania, September 21st-to-24th. CEUR workshop proceedings, vol\u00a02936. CEUR-WS.org, pp\u00a02004\u20132010. http:\/\/ceur-ws.org\/Vol-2936\/paper-149.pdf"},{"key":"319_CR52","doi-asserted-by":"publisher","DOI":"10.1109\/INFCOM.2012.6195540","volume-title":"Proceedings\u2014IEEE INFOCOM","author":"B Ribeiro","year":"2012","unstructured":"Ribeiro B, Wang P, Murai F, Towsley D (2012) Sampling directed graphs with random walks. In: Proceedings\u2014IEEE INFOCOM. https:\/\/doi.org\/10.1109\/INFCOM.2012.6195540"},{"key":"319_CR53","doi-asserted-by":"crossref","unstructured":"Ribeiro M, Calais P, Santos Y, Almeida V, Wagner M (2018) Characterizing and detecting hateful users on Twitter. arXiv e-prints 1803.08977","DOI":"10.1609\/icwsm.v12i1.15057"},{"issue":"3","key":"319_CR54","doi-asserted-by":"publisher","first-page":"456","DOI":"10.1111\/kykl.12145","volume":"70","author":"F Sabatini","year":"2017","unstructured":"Sabatini F, Sarracino F (2017) Online networks and subjective well-being. Kyklos 70(3):456\u2013480. https:\/\/doi.org\/10.1111\/kykl.12145","journal-title":"Kyklos"},{"key":"319_CR55","doi-asserted-by":"publisher","unstructured":"Sap M, Card D, Gabriel S, Choi Y, Smith NA (2019) The risk of racial bias in hate speech detection. https:\/\/doi.org\/10.18653\/v1\/p19-1163","DOI":"10.18653\/v1\/p19-1163"},{"key":"319_CR56","unstructured":"Statt N (2017) YouTube is facing a full-scale advertising boycott over hate speech"},{"key":"319_CR57","doi-asserted-by":"publisher","first-page":"7486","DOI":"10.18653\/v1\/2020.emnlp-main.606","volume-title":"Proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP), association for computational linguistics, online","author":"T Tran","year":"2020","unstructured":"Tran T, Hu Y, Hu C, Yen K, Tan F, Lee K, Park SR (2020) HABERTOR: an efficient and effective deep hatespeech detector. In: Proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP), association for computational linguistics, online, pp\u00a07486\u20137502. https:\/\/doi.org\/10.18653\/v1\/2020.emnlp-main.606"},{"key":"319_CR58","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3194770.3194776","volume-title":"Proceedings of the international workshop on software fairness, FairWare\u201918","author":"S Verma","year":"2018","unstructured":"Verma S, Rubin J (2018) Fairness definitions explained. In: Proceedings of the international workshop on software fairness, FairWare\u201918. Association for Computing Machinery, New York, pp\u00a01\u20137. https:\/\/doi.org\/10.1145\/3194770.3194776"},{"key":"319_CR59","doi-asserted-by":"publisher","first-page":"162","DOI":"10.18653\/v1\/2020.alw-1.19","volume-title":"Proceedings of the fourth workshop on online abuse and harms, association for computational linguistics, online","author":"B Vidgen","year":"2020","unstructured":"Vidgen B, Hale S, Guest E, Margetts H, Broniatowski D, Waseem Z, Botelho A, Hall M, Tromble R (2020) Detecting East Asian prejudice on social media. In: Proceedings of the fourth workshop on online abuse and harms, association for computational linguistics, online, pp\u00a0162\u2013172. https:\/\/doi.org\/10.18653\/v1\/2020.alw-1.19"},{"key":"319_CR60","doi-asserted-by":"publisher","first-page":"80","DOI":"10.18653\/v1\/W19-3509","volume-title":"Proceedings of the third workshop on abusive language online, association for computational linguistics","author":"B Vidgen","year":"2019","unstructured":"Vidgen B, Harris A, Nguyen D, Tromble R, Hale S, Margetts H (2019) Challenges and frontiers in abusive content detection. In: Proceedings of the third workshop on abusive language online, association for computational linguistics, Florence, Italy, pp\u00a080\u201393. https:\/\/doi.org\/10.18653\/v1\/W19-3509"},{"key":"319_CR61","doi-asserted-by":"crossref","unstructured":"Vidgen B, Thrush T, Waseem Z, Kiela D (2020) Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detection. 2012.15761","DOI":"10.18653\/v1\/2021.acl-long.132"},{"key":"319_CR62","doi-asserted-by":"crossref","unstructured":"Vidgen B, Yasseri T (2018) Detecting weak and strong Islamophobic hate speech on social media. arXiv e-prints arXiv:1812.10400","DOI":"10.1080\/19331681.2019.1702607"},{"key":"319_CR63","doi-asserted-by":"publisher","first-page":"2056","DOI":"10.1145\/3308558.3313684","volume-title":"The world wide web conference, WWW\u201919","author":"Z Wang","year":"2019","unstructured":"Wang Z, Hale S, Adelani DI, Grabowicz P, Hartman T, Fl\u00f6ck F, Jurgens D (2019) Demographic inference and representative population estimates from multilingual social media data. In: The world wide web conference, WWW\u201919. Association for Computing Machinery, New York, pp\u00a02056\u20132067. https:\/\/doi.org\/10.1145\/3308558.3313684"},{"key":"319_CR64","doi-asserted-by":"publisher","unstructured":"Waseem Z, Hovy D (2016) Hateful symbols or hateful people? predictive features for hate speech detection on Twitter. https:\/\/doi.org\/10.18653\/v1\/n16-2013","DOI":"10.18653\/v1\/n16-2013"},{"key":"319_CR65","first-page":"8783","volume-title":"Advances in neural information processing systems","author":"M Wick","year":"2019","unstructured":"Wick M, Panda S, Tristan JB (2019) Unlocking fairness: a trade-off revisited. In: Wallach H, Larochelle H, Beygelzimer A, d\u2019Alch\u00e9 Buc F, Fox E, Garnett R (eds) Advances in neural information processing systems, vol\u00a032. Curran Associates, Red Hook, pp\u00a08783\u20138792. http:\/\/papers.nips.cc\/paper\/9082-unlocking-fairness-a-trade-off-revisited.pdf"},{"issue":"2","key":"319_CR66","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1086\/653658","volume":"116","author":"A Wimmer","year":"2010","unstructured":"Wimmer A, Lewis K (2010) Beyond and below racial homophily: Erg models of a friendship network documented on Facebook. Am J Sociol 116(2):583\u2013642. http:\/\/www.jstor.org\/stable\/10.1086\/653658","journal-title":"Am J Sociol"},{"key":"319_CR67","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/tnnls.2020.2978386","volume-title":"IEEE transactions on neural networks and learning systems","author":"Z Wu","year":"2020","unstructured":"Wu Z, Pan S, Chen F, Long G, Zhang C, Yu PS (2020) A comprehensive survey on graph neural networks. In: IEEE transactions on neural networks and learning systems, pp\u00a01\u201321. https:\/\/doi.org\/10.1109\/tnnls.2020.2978386"},{"key":"319_CR68","doi-asserted-by":"crossref","unstructured":"Zampieri M, Nakov P, Rosenthal S, Atanasova P, Karadzhov G, Mubarak H, Derczynski L, Pitenis Z, \u00c7\u00f6ltekin \u00c7 (2020) SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020). arXiv preprint 2006.07235","DOI":"10.18653\/v1\/2020.semeval-1.188"}],"container-title":["EPJ Data Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1140\/epjds\/s13688-022-00319-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1140\/epjds\/s13688-022-00319-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1140\/epjds\/s13688-022-00319-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,26]],"date-time":"2023-01-26T21:24:12Z","timestamp":1674768252000},"score":1,"resource":{"primary":{"URL":"https:\/\/epjdatascience.springeropen.com\/articles\/10.1140\/epjds\/s13688-022-00319-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,14]]},"references-count":68,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["319"],"URL":"https:\/\/doi.org\/10.1140\/epjds\/s13688-022-00319-9","relation":{},"ISSN":["2193-1127"],"issn-type":[{"type":"electronic","value":"2193-1127"}],"subject":[],"published":{"date-parts":[[2022,2,14]]},"assertion":[{"value":"10 May 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 January 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 February 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"8"}}