{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T19:03:45Z","timestamp":1782327825743,"version":"3.54.5"},"reference-count":51,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,11,9]],"date-time":"2022-11-09T00:00:00Z","timestamp":1667952000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,11,9]],"date-time":"2022-11-09T00:00:00Z","timestamp":1667952000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Soc. Netw. Anal. Min."],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>\u201cMisogynoir\u201d is a term that refers to the anti-Black forms of misogyny that Black women experience. To explore how current automated hate speech detection approaches perform in detecting this type of hate, we evaluated the performance of two state-of-the-art detection tools, HateSonar and Google\u2019s Perspective API, on a balanced dataset of 300 tweets, half of which are examples of misogynoir and half of which are examples of supporting Black women and an imbalanced dataset of 3138 tweets of which 162 tweets are examples of misogynoir and 2976 tweets are examples of allyship tweets. We aim to determine if these tools flag these messages under any of their classifications of hateful speech (e.g. \u201chate speech\u201d, \u201coffensive language\u201d, \u201ctoxicity\u201d etc.). Close analysis of the classifications and errors shows that current hate speech detection tools are ineffective in detecting misogynoir. They lack sensitivity to context, which is an essential component for misogynoir detection. We found that tweets likely to be classified as hate speech explicitly reference racism or sexism or use profane or aggressive words. Subtle tweets without references to these topics are more challenging to classify. We find that the lack of sensitivity to context may make such tools not only ineffective but potentially harmful to Black women.<\/jats:p>","DOI":"10.1007\/s13278-022-00993-7","type":"journal-article","created":{"date-parts":[[2022,11,9]],"date-time":"2022-11-09T09:06:04Z","timestamp":1667984764000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Misogynoir: challenges in detecting intersectional hate"],"prefix":"10.1007","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6576-5678","authenticated-orcid":false,"given":"Joseph","family":"Kwarteng","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Serena Coppolino","family":"Perfumi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tracie","family":"Farrell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aisling","family":"Third","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Miriam","family":"Fernandez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,11,9]]},"reference":[{"key":"993_CR1","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1017\/S1358246118000565","volume":"84","author":"A Bailey","year":"2018","unstructured":"Bailey A (2018) On anger, silence, and epistemic injustice. Royal Instit Philos Suppl 84:93\u2013115","journal-title":"Royal Instit Philos Suppl"},{"issue":"4","key":"993_CR2","doi-asserted-by":"publisher","first-page":"762","DOI":"10.1080\/14680777.2018.1447395","volume":"18","author":"M Bailey","year":"2018","unstructured":"Bailey M, Trudy R (2018) On misogynoir: citation, erasure, and plagiarism. Fem Med Stud 18(4):762\u2013768","journal-title":"Fem Med Stud"},{"issue":"7294","key":"993_CR3","doi-asserted-by":"publisher","first-page":"1115","DOI":"10.1136\/bmj.322.7294.1115","volume":"322","author":"RS Barbour","year":"2001","unstructured":"Barbour RS (2001) Checklists for improving rigour in qualitative research: a case of the tail wagging the dog? BMJ 322(7294):1115\u20131117","journal-title":"BMJ"},{"issue":"4","key":"993_CR4","doi-asserted-by":"publisher","first-page":"778","DOI":"10.1177\/0309132519863479","volume":"44","author":"A Bonds","year":"2020","unstructured":"Bonds A (2020) Race and ethnicity ii: white women and the possessive geographies of white supremacy. Prog Hum Geogr 44(4):778\u2013788","journal-title":"Prog Hum Geogr"},{"key":"993_CR5","doi-asserted-by":"crossref","unstructured":"Cao R, Lee RK-W, Hoang T-A (2020) Deephate: Hate speech detection via multi-faceted text representations. In: 12th ACM conference on web science pp. 11\u201320","DOI":"10.1145\/3394231.3397890"},{"key":"993_CR6","doi-asserted-by":"publisher","unstructured":"Chandra M, Pailla D, Bhatia H, Sanchawala A, Gupta M, Shrivastava M, Kumaraguru P (2021) \u201cSubverting the Jewtocracy\u201d: online antisemitism detection using multimodal deep learning. pp. 148\u2013157. Association for Computing Machinery (ACM). Retrieved from https:\/\/arxiv-org.libezproxy.open.ac.uk\/abs\/2104.05947v3https:\/\/doi.org\/10.1145\/3447535.3462502","DOI":"10.1145\/3447535.3462502"},{"key":"993_CR7","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctv11hpkdj","volume-title":"Intersectionality as critical social theory","author":"PH Collins","year":"2019","unstructured":"Collins PH (2019) Intersectionality as critical social theory. Duke University Press, USA"},{"key":"993_CR8","unstructured":"Crenshaw KW (2017) On intersectionality: essential writings. The New Press"},{"key":"993_CR9","doi-asserted-by":"crossref","unstructured":"Davidson T, Bhattacharya D, Weber I (2019) Racial bias in hate speech and abusive language detection datasets. arXiv preprint arXiv:1905.12516","DOI":"10.18653\/v1\/W19-3504"},{"key":"993_CR10","doi-asserted-by":"crossref","unstructured":"Davidson T, Warmsley D, Macy M, Weber I (2017) Automated hate speech detection and the problem of offensive language. 11(1)","DOI":"10.1609\/icwsm.v11i1.14955"},{"issue":"1","key":"993_CR11","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1037\/cdp0000041","volume":"22","author":"S Douglass","year":"2016","unstructured":"Douglass S, Mirpuri S, English D, Yip T (2016) They were just making jokes: ethnic\/racial teasing and discrimination among adolescents. Cult Divers Ethnic Minority Psychol 22(1):69","journal-title":"Cult Divers Ethnic Minority Psychol"},{"key":"993_CR12","volume-title":"Why i\u2019m no longer talking to white people about race","author":"R Eddo-Lodge","year":"2020","unstructured":"Eddo-Lodge R (2020) Why i\u2019m no longer talking to white people about race. Bloomsbury Publishing, UK"},{"key":"993_CR13","doi-asserted-by":"crossref","unstructured":"ElSherief M, Kulkarni V, Nguyen D, Wang WY, Belding E (2018) Hate lingo: A target-based linguistic analysis of hate speech in social media. In: Proceedings of the international AAAI conference on web and social media Vol. 12","DOI":"10.1609\/icwsm.v12i1.15041"},{"key":"993_CR14","doi-asserted-by":"crossref","unstructured":"Epstein R, Blake J, Gonz\u00e1lez T (2017) Girlhood interrupted: The erasure of black girls\u2019 childhood. Available at SSRN 3000695","DOI":"10.2139\/ssrn.3000695"},{"key":"993_CR15","doi-asserted-by":"crossref","unstructured":"Farrell T, Fernandez M, Novotny J, Alani H (2019) Exploring misogyny across the manosphere in reddit. In: Proceedings of the 10th ACM conference on web science pp. 87\u201396","DOI":"10.1145\/3292522.3326045"},{"issue":"1","key":"993_CR16","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1177\/160940690600500107","volume":"5","author":"J Fereday","year":"2006","unstructured":"Fereday J, Muir-Cochrane E (2006) Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods 5(1):80\u201392","journal-title":"Int J Qual Methods"},{"key":"993_CR17","unstructured":"Fitzsimons A (2022) Intersectional identities and machine learning: illuminating language biases in twitter algorithms. Hicss pp. 1\u201310)"},{"issue":"4","key":"993_CR18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3232676","volume":"51","author":"P Fortuna","year":"2018","unstructured":"Fortuna P, Nunes S (2018) A survey on automatic detection of hate speech in text. ACM Computing Surveys (CSUR) 51(4):1\u201330","journal-title":"ACM Computing Surveys (CSUR)"},{"key":"993_CR19","unstructured":"Gomez R, Gibert J, G\u00f3mez L, Karatzas D (2019) Exploring hate speech detection in multimodal publications. CoRR, abs\/1910.03814 . Retrieved from http:\/\/arxiv.org\/abs\/1910.03814arXiv:1910.03814"},{"key":"993_CR20","unstructured":"Gorrell G, Bakir ME, Greenwood MA, Roberts I, Bontcheva K (2019) Race and religion in online abuse towards UK politicians. arXiv preprint arXiv:1910.00920"},{"issue":"1","key":"993_CR21","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1140\/epjds\/s13688-020-00236-9","volume":"9","author":"G Gorrell","year":"2020","unstructured":"Gorrell G, Bakir ME, Roberts I, Greenwood MA, Bontcheva K (2020) Which politicians receive abuse? four factors illuminated in the UK general election 2019. EPJ Data Sci 9(1):18","journal-title":"EPJ Data Sci"},{"key":"993_CR22","doi-asserted-by":"crossref","unstructured":"Jurgens D, Chandrasekharan E, Hemphill L (2019) A just and comprehensive strategy for using NLP to address online abuse. arXiv preprint arXiv:1906.01738","DOI":"10.18653\/v1\/P19-1357"},{"key":"993_CR23","doi-asserted-by":"publisher","DOI":"10.1016\/j.osnem.2021.100180","volume":"27","author":"J Kim","year":"2022","unstructured":"Kim J, Wohn DY, Cha M (2022) Understanding and identifying the use of emotes in toxic chat on twitch. Online Social Netw Media 27:100180","journal-title":"Online Social Netw Media"},{"key":"993_CR24","doi-asserted-by":"publisher","unstructured":"Kim JY, Ortiz C, Nam S, Santiago S, Datta V (2020) Intersectional bias in hate speech and abusive language datasets. Retrieved from https:\/\/arxiv-org.libezproxy.open.ac.uk\/abs\/2005.05921v3arXiv:2005.05921, https:\/\/doi.org\/10.48550\/arxiv.2005.05921","DOI":"10.48550\/arxiv.2005.05921"},{"key":"993_CR25","doi-asserted-by":"crossref","unstructured":"Kshirsagar R, Cukuvac T, McKeown K, McGregor S (2018) Predictive embeddings for hate speech detection on twitter. arXiv preprint arXiv:1809.10644","DOI":"10.18653\/v1\/W18-5104"},{"key":"993_CR26","unstructured":"Kumar D, Mason J, Bailey M, Gage P, Consolvo KS, Bursztein E, Thomas K (n.d.) This paper is included in the Proceedings of the 17th symposium on usable privacy and security. Designing toxic content classification for a diversity of perspectives designing toxic content classification for a diversity of perspectives. Retrieved from https:\/\/data.esrg.stanford.edu\/study\/toxicity-perspectives"},{"key":"993_CR27","doi-asserted-by":"crossref","unstructured":"Kwarteng J, Perfumi SC, Farrell T, Fernandez M (2021) Misogynoir: public online response towards self-reported misogynoir. In: Proceedings of the 2021 IEEE\/ACM international conference on advances in social networks analysis and mining pp. 228\u2013235","DOI":"10.1145\/3487351.3488342"},{"issue":"8","key":"993_CR28","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0221152","volume":"14","author":"S MacAvaney","year":"2019","unstructured":"MacAvaney S, Yao H-R, Yang E, Russell K, Goharian N, Frieder O (2019) Hate speech detection: challenges and solutions. PLoS ONE 14(8):e0221152","journal-title":"PLoS ONE"},{"key":"993_CR29","doi-asserted-by":"crossref","unstructured":"Madden S, Janoske M, Winkler RB, Edgar AN (2018) Mediated misogynoir: intersecting race and gender in online harassment. Mediating misogyny, Springer, pp. 71\u201390","DOI":"10.1007\/978-3-319-72917-6_4"},{"key":"993_CR30","doi-asserted-by":"crossref","unstructured":"Magu R, Joshi K, Luo J (2017) Detecting the hate code on social media. In: Proceedings of the international AAAI conference on web and social media Vol. 11","DOI":"10.1609\/icwsm.v11i1.14921"},{"key":"993_CR31","doi-asserted-by":"publisher","unstructured":"Maronikolakis A, Baader P, Sch\u00fctze H (2022) Analyzing hate speech data along racial, gender and intersectional axes. pp. 1\u2013 7. Association for Computational Linguistics (ACL). Retrieved from https:\/\/arxiv-org.libezproxy.open.ac.uk\/abs\/2205.06621v2, https:\/\/doi.org\/10.18653\/v1\/2022.gebnlp-1.1","DOI":"10.18653\/v1\/2022.gebnlp-1.1"},{"key":"993_CR32","doi-asserted-by":"crossref","unstructured":"Mathew B, Saha P, Yimam SM, Biemann C, Goyal P, Mukherjee A (2021) HateXplain: A benchmark dataset for explainable hate speech detection. In: 35th AAAI conference on artificial intelligence, AAAI 2021 Vol. 17A, pp. 14867\u201314875. Retrieved from https:\/\/github.com\/punyajoy\/HateXplain","DOI":"10.1609\/aaai.v35i17.17745"},{"issue":"13","key":"993_CR33","doi-asserted-by":"publisher","first-page":"1789","DOI":"10.1177\/0002764219842619","volume":"63","author":"S Mayorga-Gallo","year":"2019","unstructured":"Mayorga-Gallo S (2019) The white-centering logic of diversity ideology. Am Behav Sci 63(13):1789\u20131809","journal-title":"Am Behav Sci"},{"issue":"4","key":"993_CR34","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1080\/07370008.2017.1355211","volume":"35","author":"EO McGee","year":"2017","unstructured":"McGee EO, Bentley L (2017) The troubled success of black women in stem. Cogn Instr 35(4):265\u2013289","journal-title":"Cogn Instr"},{"key":"993_CR35","doi-asserted-by":"crossref","unstructured":"Nobata C, Tetreault J, Thomas A, Mehdad Y, Chang Y (2016) Abusive language detection in online user content. In: Proceedings of the 25th international conference on world wide web pp. 145\u2013153","DOI":"10.1145\/2872427.2883062"},{"key":"993_CR36","volume-title":"Technological elites, the meritocracy, and postracial myths in silicon valley","author":"S Noble","year":"2019","unstructured":"Noble S, Roberts S (2019) Technological elites, the meritocracy, and postracial myths in silicon valley. Duke University Press, UK"},{"issue":"2","key":"993_CR37","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1080\/1041794X.2018.1505940","volume":"84","author":"AK Nuru","year":"2019","unstructured":"Nuru AK, Arendt CE (2019) Not so safe a space: women activists of color\u2019s responses to racial microaggressions by white women allies. South Commun J 84(2):85\u201398","journal-title":"South Commun J"},{"key":"993_CR38","volume-title":"So you want to talk about race","author":"I Oluo","year":"2019","unstructured":"Oluo I (2019) So you want to talk about race. Hachette, UK"},{"key":"993_CR39","doi-asserted-by":"crossref","unstructured":"Park JH, Shin J, Fung P (2018) Reducing gender bias in abusive language detection. pp. 2799\u20132804. Retrieved from arXiv:abs\/1808.07231","DOI":"10.18653\/v1\/D18-1302"},{"key":"993_CR40","doi-asserted-by":"crossref","unstructured":"Rankin YA, Thomas JO (2020) The intersectional experiences of black women in computing. In: Proceedings of the 51st ACM technical symposium on computer science education pp. 199\u2013205","DOI":"10.1145\/3328778.3366873"},{"key":"993_CR41","doi-asserted-by":"publisher","first-page":"219563","DOI":"10.1109\/ACCESS.2020.3042604","volume":"8","author":"F Rodr\u00edguez-S\u00e1nchez","year":"2020","unstructured":"Rodr\u00edguez-S\u00e1nchez F, Carrillo-de Albornoz J, Plaza L (2020) Automatic classification of sexism in social networks: an empirical study on twitter data. IEEE Access 8:219563\u2013219576","journal-title":"IEEE Access"},{"key":"993_CR42","unstructured":"Saleem HM, Dillon KP, Benesch S, Ruths D (2017) A web of hate: Tackling hateful speech in online social spaces. arXiv preprint arXiv:1709.10159"},{"key":"993_CR43","doi-asserted-by":"crossref","unstructured":"Sap M, Card D, Gabriel S, Choi Y, Smith NA (2019) The risk of racial bias in hate speech detection. In: Proceedings of the 57th annual meeting of the association for computational linguistics pp. 1668\u20131678","DOI":"10.18653\/v1\/P19-1163"},{"key":"993_CR44","doi-asserted-by":"crossref","unstructured":"Schmidt A, Wiegand M (2017) A survey on hate speech detection using natural language processing. In: Proceedings of the 5th international workshop on natural language processing for social media pp. 1\u201310","DOI":"10.18653\/v1\/W17-1101"},{"key":"993_CR45","doi-asserted-by":"crossref","unstructured":"Seliya N, Khoshgoftaar TM, Van Hulse J (2009) A study on the relationships of classifier performance metrics. In: 2009 21st IEEE international conference on tools with artificial intelligence pp. 59\u201366","DOI":"10.1109\/ICTAI.2009.25"},{"key":"993_CR46","doi-asserted-by":"crossref","unstructured":"Silva L, Mondal M, Correa D, Benevenuto F, Weber I (2016) Analyzing the targets of hate in online social media. In: 10th international AAAI conference on web and social media","DOI":"10.1609\/icwsm.v10i1.14811"},{"key":"993_CR47","unstructured":"Tan YC, Celis LE (2019) Assessing social and intersectional biases in contextualized word representations. Advances in neural information processing systems pp. 13230\u201313241"},{"key":"993_CR48","unstructured":"Trudy (2014) Explanation of misogynoir. Gradient Lair"},{"key":"993_CR49","doi-asserted-by":"publisher","unstructured":"Waseem Z (2016) Are You a Racist or Am I Seeing Things? annotator influence on hate speech detection on twitter. In: NLP + CSS 2016 - emnlp 2016 workshop on natural language processing and computational social science, proceedings of the workshop pp. 138\u2013142. Retrieved from www.spacy.io, https:\/\/doi.org\/10.18653\/v1\/w16-5618","DOI":"10.18653\/v1\/w16-5618"},{"key":"993_CR50","doi-asserted-by":"publisher","unstructured":"Waseem Z, Hovy D (2016) Hateful symbols or hateful people? predictive features for hate speech detection on twitter. In: Proceedings of the NAACL student research workshop pp. 88\u201393. Stroudsburg, PA, USA: Association for Computational Linguistics. Retrieved from http:\/\/aclweb.org\/anthology\/N16-2013, https:\/\/doi.org\/10.18653\/v1\/N16-2013","DOI":"10.18653\/v1\/N16-2013"},{"key":"993_CR51","doi-asserted-by":"crossref","unstructured":"Zannettou S, ElSherief M, Belding E, Nilizadeh S, Stringhini G (2020) Measuring and characterizing hate speech on news websites. In: 12th ACM conference on web science pp. 125\u2013134","DOI":"10.1145\/3394231.3397902"}],"updated-by":[{"DOI":"10.1007\/s13278-022-01008-1","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2022,12,3]],"date-time":"2022-12-03T00:00:00Z","timestamp":1670025600000}}],"container-title":["Social Network Analysis and Mining"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13278-022-00993-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s13278-022-00993-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13278-022-00993-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,2]],"date-time":"2023-01-02T13:45:28Z","timestamp":1672667128000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s13278-022-00993-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,9]]},"references-count":51,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["993"],"URL":"https:\/\/doi.org\/10.1007\/s13278-022-00993-7","relation":{"correction":[{"id-type":"doi","id":"10.1007\/s13278-022-01008-1","asserted-by":"object"}]},"ISSN":["1869-5450","1869-5469"],"issn-type":[{"value":"1869-5450","type":"print"},{"value":"1869-5469","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,9]]},"assertion":[{"value":"14 March 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 October 2022","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 October 2022","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 November 2022","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 December 2022","order":5,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Update","order":6,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The original article is revised to update table 4.","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 December 2022","order":8,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":9,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":10,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s13278-022-01008-1","URL":"https:\/\/doi.org\/10.1007\/s13278-022-01008-1","order":11,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that no commercial or financial ties existed that might be interpreted as a possible conflict of interest while conducting the study.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"166"}}