{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,1]],"date-time":"2026-11-01T10:37:13Z","timestamp":1793529433998,"version":"4.5.0"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,10,30]],"date-time":"2020-10-30T00:00:00Z","timestamp":1604016000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,10,30]],"date-time":"2020-10-30T00:00:00Z","timestamp":1604016000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005874","name":"Universit\u00e0 degli Studi G. D'Annunzio Chieti Pescara","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005874","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The exponential growth of social media has brought with it an increasing propagation of hate speech and hate based propaganda. Hate speech is commonly defined as any communication that disparages a person or a group on the basis of some characteristics such as race, colour, ethnicity, gender, sexual orientation, nationality, religion. Online hate diffusion has now developed into a serious problem and this has led to a number of international initiatives being proposed, aimed at qualifying the problem and developing effective counter-measures. The aim of this paper is to analyse the knowledge structure of hate speech literature and the evolution of related topics. We apply co-word analysis methods to identify different topics treated in the field. The analysed database was downloaded from Scopus, focusing on a number of publications during the last thirty years. Topic and network analyses of literature showed that the main research topics can be divided into three areas: \u201cgeneral debate hate speech versus freedom of expression\u201d,\u201chate-speech automatic detection and classification by machine-learning strategies\u201d, and \u201cgendered hate speech and cyberbullying\u201d. The understanding of how research fronts interact led to stress the relevance of machine learning approaches to correctly assess hatred forms of online speech.<\/jats:p>","DOI":"10.1007\/s11192-020-03737-6","type":"journal-article","created":{"date-parts":[[2020,10,30]],"date-time":"2020-10-30T08:02:35Z","timestamp":1604044955000},"page":"157-179","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":98,"title":["Thirty years of research into hate speech: topics of interest and their evolution"],"prefix":"10.1007","volume":"126","author":[{"given":"Alice","family":"Tontodimamma","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eugenia","family":"Nissi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Annalina","family":"Sarra","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lara","family":"Fontanella","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,10,30]]},"reference":[{"issue":"1","key":"3737_CR1","doi-asserted-by":"publisher","first-page":"147","DOI":"10.14569\/IJACSA.2015.060121","volume":"6","author":"R Alghamdi","year":"2015","unstructured":"Alghamdi, R., & Alfalqi, K. (2015). A survey of topic modeling in text mining. International Journal of Advanced Computer Science and Applications, 6(1), 147\u2013153. https:\/\/doi.org\/10.14569\/IJACSA.2015.060121.","journal-title":"International Journal of Advanced Computer Science and Applications"},{"key":"3737_CR2","doi-asserted-by":"publisher","unstructured":"Arango, A., P\u00e9rez, J., & Poblete, B. (2019). Hate speech detection is not as easy as you may think: A closer look at model validation. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, New York, NY, pp. 45\u201354, https:\/\/doi.org\/10.1145\/3331184.3331262.","DOI":"10.1145\/3331184.3331262"},{"issue":"4","key":"3737_CR3","doi-asserted-by":"publisher","first-page":"959","DOI":"10.1016\/j.joi.2017.08.007","volume":"11","author":"M Aria","year":"2017","unstructured":"Aria, M., & Cuccurullo, C. (2017). Bibliometrix: an R-tool for comprehensive science mapping analysis. Journal of Informetrics, 11(4), 959\u2013975. https:\/\/doi.org\/10.1016\/j.joi.2017.08.007.","journal-title":"Journal of Informetrics"},{"issue":"3","key":"3737_CR4","doi-asserted-by":"publisher","first-page":"619","DOI":"10.1007\/s10664-012-9231-y","volume":"19","author":"A Barua","year":"2014","unstructured":"Barua, A., Thomas, S., & Hassan, A. (2014). What are developers talking about? An analysis of topics and trends in stack overflow. Empirical Software Engineering, 19(3), 619\u2013654. https:\/\/doi.org\/10.1007\/s10664-012-9231-y.","journal-title":"Empirical Software Engineering"},{"issue":"7","key":"3737_CR5","first-page":"2101","volume":"60","author":"LE Beausoleil","year":"2019","unstructured":"Beausoleil, L. E. (2019). Free, hateful, and posted: rethinking first amendment protection of hate speech in a social media world. Boston College Law Review, 60(7), 2101\u20132144.","journal-title":"Boston College Law Review"},{"issue":"4","key":"3737_CR6","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1145\/2133806.2133826","volume":"55","author":"DM Blei","year":"2012","unstructured":"Blei, D. M. (2012). Probabilistic topic models. Communications of the ACM, 55(4), 77\u201384. https:\/\/doi.org\/10.1145\/2133806.2133826.","journal-title":"Communications of the ACM"},{"issue":"1","key":"3737_CR7","doi-asserted-by":"publisher","first-page":"993","DOI":"10.1162\/jmlr.2003.3.4-5.993","volume":"3","author":"DM Blei","year":"2003","unstructured":"Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet allocation. Journal of Machine Learning Research, 3(1), 993\u20131022. https:\/\/doi.org\/10.1162\/jmlr.2003.3.4-5.993.","journal-title":"Journal of Machine Learning Research"},{"issue":"2","key":"3737_CR8","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1080\/0022250X.2001.9990249","volume":"25","author":"U Brandes","year":"2001","unstructured":"Brandes, U. (2001). A faster algorithm for betweenness centrality. The Journal of Mathematical Sociology, 25(2), 163\u2013177. https:\/\/doi.org\/10.1080\/0022250X.2001.9990249.","journal-title":"The Journal of Mathematical Sociology"},{"key":"3737_CR9","first-page":"603","volume":"107","author":"C Brettschneider","year":"2013","unstructured":"Brettschneider, C. (2013). Value democracy as the basis for viewpoint neutrality: A theory of free speech and its implications for the state speech and limited public forum doctrines. Northwestern University Law Review, 107, 603\u2013646.","journal-title":"Northwestern University Law Review"},{"issue":"1","key":"3737_CR10","first-page":"77","volume":"6","author":"R Cohen-Almagor","year":"2016","unstructured":"Cohen-Almagor, R. (2016). Hate and racist speech in the United States: A critique. Philosophy and Public Issues, 6(1), 77\u2013123.","journal-title":"Philosophy and Public Issues"},{"issue":"1\u20132","key":"3737_CR11","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1080\/21689725.2019.1601579","volume":"53","author":"R Cohen-Almagor","year":"2019","unstructured":"Cohen-Almagor, R. (2019). Racism and hate speech: A critique of Scanlon\u2019s contractual theory. First Amendment Studies, 53(1\u20132), 41\u201366. https:\/\/doi.org\/10.1080\/21689725.2019.1601579.","journal-title":"First Amendment Studies"},{"key":"3737_CR12","unstructured":"Csardi, G., & Nepusz, C. (2006). The igraph software package for complex network research. Inter Journal Complex Systems :1695, http:\/\/igraph.org"},{"issue":"6","key":"3737_CR13","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1002\/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9","volume":"41","author":"S Deerwester","year":"1990","unstructured":"Deerwester, S., Dumais, S., Furnas, G., Landauer, T., & Harshman, R. (1990). Indexing by latent semantic analysis. Journal of the American society for information science, 41(6), 391\u2013407.","journal-title":"Journal of the American society for information science"},{"key":"3737_CR14","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0133061","author":"A Ebadi","year":"2015","unstructured":"Ebadi, A., & Schiffauerova, A. (2015). How to receive more funding for your research? get connected to the right people. PloS One,. https:\/\/doi.org\/10.1371\/journal.pone.0133061.","journal-title":"PloS One"},{"key":"3737_CR15","doi-asserted-by":"publisher","DOI":"10.1145\/3232676","author":"P Fortuna","year":"2018","unstructured":"Fortuna, P., & Nunes, S. (2018). A survey on automatic detection of hate speech in text. ACM Computing Surveys (CSUR),. https:\/\/doi.org\/10.1145\/3232676.","journal-title":"ACM Computing Surveys (CSUR)"},{"key":"3737_CR16","volume-title":"Countering Online Hate Speech","author":"I Gagliardone","year":"2015","unstructured":"Gagliardone, I., Gal, D., Alves, T., & Martinez, G. (2015). Countering Online Hate Speech. Paris: UNESCO Publishing."},{"key":"3737_CR17","doi-asserted-by":"publisher","DOI":"10.1201\/9781420011319","volume-title":"Multiple Correspondence Analysis and Related Methods","author":"M Greenacre","year":"2006","unstructured":"Greenacre, M., & Blasius, J. (2006). Multiple Correspondence Analysis and Related Methods. New York: Chapman and Hall\/CRC. https:\/\/doi.org\/10.1201\/9781420011319."},{"issue":"4","key":"3737_CR18","doi-asserted-by":"publisher","first-page":"746","DOI":"10.1111\/1468-2230.12283","volume":"80","author":"AR Greene","year":"2017","unstructured":"Greene, A. R., & Simpson, R. M. (2017). Tolerating hate in the name of democracy. The Modern Law Review, 80(4), 746\u2013765. https:\/\/doi.org\/10.1111\/1468-2230.12283.","journal-title":"The Modern Law Review"},{"key":"3737_CR19","doi-asserted-by":"publisher","unstructured":"Hofmann, T. (1999). Probabilistic latent semantic indexing. In: Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, pp. 50\u201357, https:\/\/doi.org\/10.1145\/312624.312649.","DOI":"10.1145\/312624.312649"},{"key":"3737_CR20","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0221152","author":"S MacAvaney","year":"2019","unstructured":"MacAvaney, S., Yao, H. R., Yang, E., Russell, K., Goharian, N., & Frieder, O. (2019). Hate speech detection: Challenges and solutions. PloS one,. https:\/\/doi.org\/10.1371\/journal.pone.0221152.","journal-title":"PloS one"},{"key":"3737_CR21","unstructured":"MATLAB (2018). version 9.5.0.944444 (R2018b). The MathWorks Inc., Natick, Massachusetts."},{"issue":"7","key":"3737_CR22","doi-asserted-by":"publisher","first-page":"5","DOI":"10.22215\/timreview\/1087","volume":"7","author":"C McPhee","year":"2017","unstructured":"McPhee, C., Santonen, T., Shah, A., & Nazari, A. (2017). Reflecting on 10 years of the TIM review. Technology Innovation Management Review, 7(7), 5\u201320. 10.22215\/timreview\/1087.","journal-title":"Technology Innovation Management Review"},{"key":"3737_CR23","doi-asserted-by":"publisher","DOI":"10.7312\/pric91844","volume-title":"Little Science, Big Science","author":"DJ Price","year":"1963","unstructured":"Price, D. J. (1963). Little Science, Big Science. New York: Columbia University Press."},{"key":"3737_CR24","doi-asserted-by":"publisher","unstructured":"Salminen, J., Veronesi, F., Almerekhi, H., Jun, S., & Jansen, BJ. (2018). Online Hate Interpretation Varies by Country, But More by Individual: A Statistical Analysis Using Crowdsourced Ratings. In: 2018 Fifth International Conference on Social Networks Analysis, Management and Security (SNAMS), pp. 88\u201394, https:\/\/doi.org\/10.1109\/SNAMS.2018.8554954.","DOI":"10.1109\/SNAMS.2018.8554954"},{"key":"3737_CR25","doi-asserted-by":"publisher","unstructured":"Salminen, J., Almerekhi, H., Kamel, AM., Jung, S., & Jansen, BJ. (2019). Online Hate Ratings Vary by Extremes: A Statistical Analysis. In: CHIIR \u201919: Proceedings of the 2019 Conference on Human Information Interaction and Retrieval, Association for Computing Machinery, New York, NY, USA, pp. 213\u2013217, https:\/\/doi.org\/10.1145\/3295750.3298954.","DOI":"10.1145\/3295750.3298954"},{"key":"3737_CR26","doi-asserted-by":"publisher","unstructured":"Schmidt, A., & Wiegand, M. (2017). A survey on hate speech detection using natural language processing. In: Proceedings of the Fifth International Workshop on Natural Language Processing for Social Media, Association for Computational Linguistics, pp. 1\u201310, https:\/\/doi.org\/10.18653\/v1\/W17-1101.","DOI":"10.18653\/v1\/W17-1101"},{"key":"3737_CR27","doi-asserted-by":"publisher","unstructured":"Sellars, AF, (2016). Defining Hate Speech. Berkman Klein Center Research Publication No. 2016-20 Paper No. 16-48, Boston University School of Law, Public Law Research, Boston University School of Law, Public Law Research, available at SSRN: https:\/\/doi.org\/10.2139\/ssrn.2882244.","DOI":"10.2139\/ssrn.2882244"},{"key":"3737_CR28","volume-title":"Social Media and Democracy: The State of the Field","author":"AA Siegel","year":"2020","unstructured":"Siegel, A. A. (2020). Online hate speech. In J. Tucker & N. Persily (Eds.), Social Media and Democracy: The State of the Field. Cambridge: Cambridge University Press."},{"key":"3737_CR29","volume-title":"Latent Semantic Analysis: A Road to Meaning","author":"M Steyvers","year":"2006","unstructured":"Steyvers, M., & Griffiths, T. (2006). Probabilistic topic models. In T. Landauer, D. McNamara, S. Dennis, & W. Kintsch (Eds.), Latent Semantic Analysis: A Road to Meaning. New Jersey: Lawrence Erlbaum."},{"issue":"1","key":"3737_CR30","first-page":"185","volume":"25","author":"N Strossen","year":"2016","unstructured":"Strossen, N. (2016). Freedom of speech and equality: Do we have to choose? Journal of Law and Policy, 25(1), 185\u2013225.","journal-title":"Journal of Law and Policy"},{"key":"3737_CR31","volume-title":"HATE: Why We Should Resist it With Free Speech, Not Censorship (Inalienable Rights)","author":"N Strossen","year":"2018","unstructured":"Strossen, N. (2018). HATE: Why We Should Resist it With Free Speech, Not Censorship (Inalienable Rights). New York: Oxford University Press."},{"key":"3737_CR32","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23596","author":"A Suominen","year":"2016","unstructured":"Suominen, A., & Toivanen, H. (2016). Map of science with topic modeling: Comparison of unsupervised learning and human-assigned subject classification. Journal of the Association for Information Science and Technology,. https:\/\/doi.org\/10.1002\/asi.23596.","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"3737_CR33","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0222194","author":"A Waqas","year":"2019","unstructured":"Waqas, A., Salminen, J., Jung, Sg, Almerekhi, H., & Jansen, B. (2019). Mapping online hate: A scientometric analysis on research trends and hotspots in research on online hate. PLoS One,. https:\/\/doi.org\/10.1371\/journal.pone.0222194.","journal-title":"PLoS One"},{"key":"3737_CR34","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-014-1321-8","author":"C Yau","year":"2014","unstructured":"Yau, C., Porter, A., Newman, N., & Suominen, A. (2014). Clustering scientific documents with topic modeling. Scientometrics,. https:\/\/doi.org\/10.1007\/s11192-014-1321-8.","journal-title":"Scientometrics"},{"key":"3737_CR35","doi-asserted-by":"publisher","unstructured":"Zhang, J., & Luo, Y. (2017). Degree Centrality, Betweenness Centrality, and Closeness Centrality in Social Network. In: Proceedings of the 2017 2nd International Conference on Modelling, Simulation and Applied Mathematics (MSAM2017), Advances in Intelligent Systems Research, pp. 300\u2013303, https:\/\/doi.org\/10.2991\/msam-17.2017.68.","DOI":"10.2991\/msam-17.2017.68"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-020-03737-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-020-03737-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-020-03737-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,1,21]],"date-time":"2021-01-21T19:16:55Z","timestamp":1611256615000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-020-03737-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,30]]},"references-count":35,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["3737"],"URL":"https:\/\/doi.org\/10.1007\/s11192-020-03737-6","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,30]]},"assertion":[{"value":"28 January 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 October 2020","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}