{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,19]],"date-time":"2026-04-19T03:36:43Z","timestamp":1776569803482,"version":"3.51.2"},"reference-count":80,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2018,7,31]],"date-time":"2018-07-31T00:00:00Z","timestamp":1532995200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"FourEyes, a research line within project TEC4Growth\u2014Pervasive Intelligence"},{"name":"North Portugal Regional Operational Programme"},{"DOI":"10.13039\/501100008530","name":"European Regional Development Fund","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100008530","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Enhancers and Proofs of Concept with Industrial","award":["Impact\/NORTE-01- 0145-FEDER-000020"],"award-info":[{"award-number":["Impact\/NORTE-01- 0145-FEDER-000020"]}]},{"name":"PORTUGAL 2020 Partnership Agreement"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2019,7,31]]},"abstract":"<jats:p>The scientific study of hate speech, from a computer science point of view, is recent. This survey organizes and describes the current state of the field, providing a structured overview of previous approaches, including core algorithms, methods, and main features used. This work also discusses the complexity of the concept of hate speech, defined in many platforms and contexts, and provides a unifying definition. This area has an unquestionable potential for societal impact, particularly in online communities and digital media platforms. The development and systematization of shared resources, such as guidelines, annotated datasets in multiple languages, and algorithms, is a crucial step in advancing the automatic detection of hate speech.<\/jats:p>","DOI":"10.1145\/3232676","type":"journal-article","created":{"date-parts":[[2018,7,31]],"date-time":"2018-07-31T19:41:18Z","timestamp":1533066078000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":653,"title":["A Survey on Automatic Detection of Hate Speech in Text"],"prefix":"10.1145","volume":"51","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2306-9276","authenticated-orcid":false,"given":"Paula","family":"Fortuna","sequence":"first","affiliation":[{"name":"INESC TEC"}]},{"given":"S\u00e9rgio","family":"Nunes","sequence":"additional","affiliation":[{"name":"INESC TEC and Faculty of Engineering, University of Porto, Portugal"}]}],"member":"320","published-online":{"date-parts":[[2018,7,31]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"ALW1: 1st workshop on abusive language online.","author":"ACL."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-14977-6_47"},{"key":"e_1_2_1_3_1","volume-title":"Characterizing linguistic attributes for automatic classification of intent based racist\/radicalized posts on tumblr micro-blogging website. arXiv Preprint arXiv:1701.04931","author":"Agarwal Swati","year":"2017"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3041021.3054223"},{"key":"e_1_2_1_5_1","unstructured":"Tanvi Banerjee Amir H. Yazdavar Andrew Hampton Hemant Purohit Valerie L. Shalin and Amit P. Sheth. Identifying pragmatic functions in social media indicative of gender-based violence beliefs. Manuscript Submitted for Publication.  Tanvi Banerjee Amir H. Yazdavar Andrew Hampton Hemant Purohit Valerie L. Shalin and Amit P. Sheth. Identifying pragmatic functions in social media indicative of gender-based violence beliefs. Manuscript Submitted for Publication."},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the Conference on the Internet, Policy 8 Politics. 1--18","author":"Burnap Peter"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1002\/poi3.85"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1140\/epjds\/s13688-016-0072-6"},{"key":"e_1_2_1_11_1","unstructured":"CHI2017. 2017. 2017 Workshop on online harassment. Retrieved from http:\/\/social.umd.edu\/woh\/.  CHI2017. 2017. 2017 Workshop on online harassment. Retrieved from http:\/\/social.umd.edu\/woh\/."},{"key":"e_1_2_1_12_1","unstructured":"CLiPS. 2016. HADES. Retrieved from https:\/\/github.com\/clips\/hades.  CLiPS. 2016. HADES. Retrieved from https:\/\/github.com\/clips\/hades."},{"key":"e_1_2_1_13_1","volume-title":"Interdisciplinary conference on Hate speech. Definitions, Interpretations and Practices.","author":"CONTACT.","year":"2017"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2809563.2809605"},{"key":"e_1_2_1_15_1","unstructured":"CrowdFlower. 2017. Data for everyone. Retrieved from https:\/\/www.crowdflower.com\/data-for-everyone\/.  CrowdFlower. 2017. Data for everyone. Retrieved from https:\/\/www.crowdflower.com\/data-for-everyone\/."},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the 12th Dutch-Belgian Information Retrieval Workshop","author":"Dadvar Maral","year":"2012"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tele.2014.08.007"},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Thomas Davidson. 2017. Automated hate speech detection and the problem of offensive language. Retrieved from https:\/\/github.com\/t-davidson\/hate-speech-and-offensive-language.  Thomas Davidson. 2017. Automated hate speech detection and the problem of offensive language. Retrieved from https:\/\/github.com\/t-davidson\/hate-speech-and-offensive-language.","DOI":"10.1609\/icwsm.v11i1.14955"},{"key":"e_1_2_1_19_1","volume-title":"Automated hate speech detection and the problem of offensive language. arXiv Preprint arXiv:1703.04009","author":"Davidson Thomas","year":"2017"},{"key":"e_1_2_1_20_1","volume-title":"Manning","author":"De Marneffe Marie-Catherine","year":"2008"},{"key":"e_1_2_1_21_1","volume-title":"First workshop on text analytics for cybersecurity and online safety (TA-COS","author":"Pauw Guy De","year":"2016"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the 1st Italian Conference on Cybersecurity. 86--95","author":"Vigna Fabio Del","year":"2017"},{"key":"e_1_2_1_23_1","unstructured":"Cambridge Dictionary. 2017. Profanity. Retrieved from https:\/\/dictionary.cambridge.org\/dictionary\/english\/profanity.  Cambridge Dictionary. 2017. Profanity. Retrieved from https:\/\/dictionary.cambridge.org\/dictionary\/english\/profanity."},{"key":"e_1_2_1_24_1","volume-title":"Modeling the detection of textual cyberbullying. Soc. Mobile Web 11, 02","author":"Dinakar Karthik","year":"2011"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2740908.2742760"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1037\/cdp0000041"},{"key":"e_1_2_1_27_1","unstructured":"Eyspahn. 2016. Online hate speech modeling using Python and reddit comment data. Retrieved from https:\/\/github.com\/eyspahn\/OnlineHateSpeech_PyLadiesSea.  Eyspahn. 2016. Online hate speech modeling using Python and reddit comment data. Retrieved from https:\/\/github.com\/eyspahn\/OnlineHateSpeech_PyLadiesSea."},{"key":"e_1_2_1_28_1","unstructured":"Facebook. 2013. What does Facebook consider to be hate speech? Retrieved from https:\/\/www.facebook.com\/help\/135402139904490.  Facebook. 2013. What does Facebook consider to be hate speech? Retrieved from https:\/\/www.facebook.com\/help\/135402139904490."},{"key":"e_1_2_1_29_1","unstructured":"FBI. 2015. 2015 hate crime statistics. Retrieved from https:\/\/ucr.fbi.gov\/hate-crime\/.  FBI. 2015. 2015 hate crime statistics. Retrieved from https:\/\/ucr.fbi.gov\/hate-crime\/."},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the 4th Workshop on Making Sense of Microposts (#Microposts\u201914)","author":"Giblietto Fabio","year":"2015"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.14257\/ijmue.2015.10.4.21"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1008992.1009074"},{"key":"e_1_2_1_34_1","unstructured":"Stanford NLP Group. 2017. The Stanford NLP Group. Retrieved from http:\/\/nlp.stanford.edu\/.  Stanford NLP Group. 2017. The Stanford NLP Group. Retrieved from http:\/\/nlp.stanford.edu\/."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/SITIS.2007.137"},{"key":"e_1_2_1_36_1","volume-title":"Text classification using association rules, dependency pruning and hyperonymization. arXiv Preprint arXiv:1407.7357","author":"Haralambous Yannis","year":"2014"},{"key":"e_1_2_1_37_1","unstructured":"Reporting Hate. 2017. Hate speech conference I.H.D.I.P. Retrieved from http:\/\/reportinghate.eu\/contact2017\/.  Reporting Hate. 2017. Hate speech conference I.H.D.I.P. Retrieved from http:\/\/reportinghate.eu\/contact2017\/."},{"key":"e_1_2_1_38_1","unstructured":"No hate speech movement. 2017. No hate speech movement. Retrieved from https:\/\/www.nohatespeechmovement.org\/.  No hate speech movement. 2017. No hate speech movement. Retrieved from https:\/\/www.nohatespeechmovement.org\/."},{"key":"e_1_2_1_39_1","unstructured":"Hatebase. 2017. Hatebase. Retrieved from https:\/\/www.hatebase.org\/.  Hatebase. 2017. Hatebase. Retrieved from https:\/\/www.hatebase.org\/."},{"key":"e_1_2_1_40_1","unstructured":"Alex Hern. 2016. Facebook YouTube Twitter and Microsoft sign EU hate speech code. Retrieved from https:\/\/www.theguardian.com\/technology\/2016\/may\/31\/facebook-youtube-twitter-microsoft-eu-hate-speech-code.  Alex Hern. 2016. Facebook YouTube Twitter and Microsoft sign EU hate speech code. Retrieved from https:\/\/www.theguardian.com\/technology\/2016\/may\/31\/facebook-youtube-twitter-microsoft-eu-hate-speech-code."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2908131.2908183"},{"key":"e_1_2_1_42_1","unstructured":"ILGA. 2016. Hate crime and hate speech. Retrieved from http:\/\/www.ilga-europe.org\/what-we-do\/our-advocacy-work\/hate-crime-hate-speech.  ILGA. 2016. Hate crime and hate speech. Retrieved from http:\/\/www.ilga-europe.org\/what-we-do\/our-advocacy-work\/hate-crime-hate-speech."},{"key":"e_1_2_1_43_1","unstructured":"Jigsaw. 2017. Perspective API. Retrieved from https:\/\/www.perspectiveapi.com\/.  Jigsaw. 2017. Perspective API. Retrieved from https:\/\/www.perspectiveapi.com\/."},{"key":"e_1_2_1_44_1","unstructured":"Kaggle. 2013. Detecting insults in social commentary. Retrieved from https:\/\/www.kaggle.com\/c\/detecting-insults-in-social-commentary\/data.  Kaggle. 2013. Detecting insults in social commentary. Retrieved from https:\/\/www.kaggle.com\/c\/detecting-insults-in-social-commentary\/data."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1080\/13504630.2016.1207513"},{"key":"e_1_2_1_46_1","unstructured":"Ivana Kottasov\u00e1. 2017. Europe says Twitter is failing to remove hate speech. Retrieved from http:\/\/money.cnn.com\/2017\/06\/01\/technology\/twitter-facebook-hate-speech-europe\/index.html.  Ivana Kottasov\u00e1. 2017. Europe says Twitter is failing to remove hate speech. Retrieved from http:\/\/money.cnn.com\/2017\/06\/01\/technology\/twitter-facebook-hate-speech-europe\/index.html."},{"key":"e_1_2_1_47_1","unstructured":"Till Krause and Hannes Grassegger. 2016. Facebook\u2019s secret rules of deletion. Retrieved from http:\/\/international.sueddeutsche.de\/post\/154543271930\/facebooks-secret-rules-of-deletion.  Till Krause and Hannes Grassegger. 2016. Facebook\u2019s secret rules of deletion. Retrieved from http:\/\/international.sueddeutsche.de\/post\/154543271930\/facebooks-secret-rules-of-deletion."},{"key":"e_1_2_1_48_1","volume-title":"Content Analysis: An Introduction to Its Methodology","author":"Krippendorff Klaus","year":"2004"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1515\/humor-2016-0013"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the Association for the Advancement of Artificial Intelligence.","author":"Kwok Irene","year":"2013"},{"key":"e_1_2_1_51_1","unstructured":"Anti-Defamation League. 2015. The trap of masculinity: how sexism impacts boys and men. Retrieved from https:\/\/www.adl.org\/sites\/default\/files\/documents\/assets\/pdf\/education-outreach\/trap-of-masculinity.pdf.  Anti-Defamation League. 2015. The trap of masculinity: how sexism impacts boys and men. Retrieved from https:\/\/www.adl.org\/sites\/default\/files\/documents\/assets\/pdf\/education-outreach\/trap-of-masculinity.pdf."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.5220\/0005170305300537"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.5220\/0005636704870495"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1080\/03637751003758227"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-3638"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2743065.2743085"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872427.2883062"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/IC3e.2014.7081252"},{"key":"e_1_2_1_60_1","unstructured":"United Nations Alliance of Civilizations (UNAOC). 2017. #SpreadNoHate: A global dialogue on hate speech against migrants and refugees in the media. Retrieved from https:\/\/www.unaoc.org\/what-we-do\/projects\/hate-speech\/.  United Nations Alliance of Civilizations (UNAOC). 2017. #SpreadNoHate: A global dialogue on hate speech against migrants and refugees in the media. Retrieved from https:\/\/www.unaoc.org\/what-we-do\/projects\/hate-speech\/."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13042-011-0012-5"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10796-010-9272-y"},{"key":"e_1_2_1_63_1","volume-title":"Cyberbullying identification using participant-vocabulary consistency. arXiv Preprint arXiv:1606.08084","author":"Raisi Elaheh","year":"2016"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.2989\/16073610209486308"},{"key":"e_1_2_1_65_1","volume-title":"Measuring the reliability of hate speech annotations: The case of the european refugee crisis. arXiv Preprint arXiv:1701.08118","author":"Ross Bjorn","year":"2017"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-1101"},{"key":"e_1_2_1_67_1","volume-title":"Analyzing the targets of hate in online social media. arXiv Preprint arXiv:1603.07709","author":"Silva Leandro","year":"2016"},{"key":"e_1_2_1_68_1","unstructured":"Natalya Tarasova. 2016. Classification of Hate Tweets and Their Reasons using SVM. Master\u2019s thesis. Uppsala Universitet.  Natalya Tarasova. 2016. Classification of Hate Tweets and Their Reasons using SVM. Master\u2019s thesis. Uppsala Universitet."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-137-58666-7"},{"key":"e_1_2_1_70_1","unstructured":"Annie Thorburn. 2016. Hate Speech ML. Retrieved from https:\/\/github.com\/anniethorburn\/Hate-Speech-ML.  Annie Thorburn. 2016. Hate Speech ML. Retrieved from https:\/\/github.com\/anniethorburn\/Hate-Speech-ML."},{"key":"e_1_2_1_71_1","volume-title":"A dictionary-based approach to racism detection in dutch social media. arXiv Preprint arXiv:1608.08738","author":"Tulkens St\u00e9phan","year":"2016"},{"key":"e_1_2_1_72_1","unstructured":"Twitter. 2017. The Twitter Rules. Retrieved from https:\/\/support.twitter.com\/articles\/.  Twitter. 2017. The Twitter Rules. Retrieved from https:\/\/support.twitter.com\/articles\/."},{"key":"e_1_2_1_73_1","unstructured":"UCSM. 2016. IWG hatespeech public. Retrieved from https:\/\/github.com\/UCSM-DUE\/.  UCSM. 2016. IWG hatespeech public. Retrieved from https:\/\/github.com\/UCSM-DUE\/."},{"key":"e_1_2_1_74_1","volume-title":"Proceedings of the Second Workshop on Language in Social Media. Association for Computational Linguistics, 19--26","author":"Warner William","year":"2012"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-5618"},{"key":"e_1_2_1_76_1","unstructured":"Zeerak Waseem. 2016. Hate speech Twitter annotations. Retrieved from https:\/\/github.com\/ZeerakW\/hatespeech.  Zeerak Waseem. 2016. Hate speech Twitter annotations. Retrieved from https:\/\/github.com\/ZeerakW\/hatespeech."},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-2013"},{"key":"e_1_2_1_78_1","unstructured":"Mike Wendling. 2015. 2015: The year that angry won the internet. Retrieved from http:\/\/www.bbc.com\/news\/blogs-trending-35111707.  Mike Wendling. 2015. 2015: The year that angry won the internet. Retrieved from http:\/\/www.bbc.com\/news\/blogs-trending-35111707."},{"key":"e_1_2_1_79_1","unstructured":"Christian Wigand and Melanie Voin. 2017. Speech by Commissioner Jourov\u00e1\u201410 years of the EU Fundamental Rights Agency: A call to action in defence of fundamental rights democracy and the rule of law. Retrieved from http:\/\/europa.eu\/rapid\/press-release_SPEECH-17-403_en.htm.  Christian Wigand and Melanie Voin. 2017. Speech by Commissioner Jourov\u00e1\u201410 years of the EU Fundamental Rights Agency: A call to action in defence of fundamental rights democracy and the rule of law. Retrieved from http:\/\/europa.eu\/rapid\/press-release_SPEECH-17-403_en.htm."},{"key":"e_1_2_1_80_1","unstructured":"Yahoo! 2017. Webscope datasets. Retrieved from https:\/\/webscope.sandbox.yahoo.com\/.  Yahoo! 2017. Webscope datasets. Retrieved from https:\/\/webscope.sandbox.yahoo.com\/."},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.3115\/981732.981745"},{"key":"e_1_2_1_82_1","unstructured":"Youtube. 2017. Hate speech. Retrieved from https:\/\/support.google.com\/youtube\/answer\/2801939?hl=en.  Youtube. 2017. Hate speech. Retrieved from https:\/\/support.google.com\/youtube\/answer\/2801939?hl=en."},{"key":"e_1_2_1_83_1","volume-title":"Proceedings of the International Conference on Extending Database Technology. 696--697","author":"Yuan Shuhan","year":"2016"},{"key":"e_1_2_1_84_1","unstructured":"Matthew Zook. 2012. Mapping racist tweets in response to President Obama\u2019s re-election. Retrieved from https:\/\/www.theguardian.com\/news\/datablog\/2012\/nov\/09\/mapping-racist-tweets-president-obama-reelection.  Matthew Zook. 2012. Mapping racist tweets in response to President Obama\u2019s re-election. Retrieved from https:\/\/www.theguardian.com\/news\/datablog\/2012\/nov\/09\/mapping-racist-tweets-president-obama-reelection."}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3232676","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3232676","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:41:32Z","timestamp":1750282892000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3232676"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,31]]},"references-count":80,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2019,7,31]]}},"alternative-id":["10.1145\/3232676"],"URL":"https:\/\/doi.org\/10.1145\/3232676","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,31]]},"assertion":[{"value":"2017-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-07-31","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}