{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T19:48:40Z","timestamp":1770061720338,"version":"3.49.0"},"reference-count":74,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2024,12,19]],"date-time":"2024-12-19T00:00:00Z","timestamp":1734566400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,12,19]],"date-time":"2024-12-19T00:00:00Z","timestamp":1734566400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Lang Resources &amp; Evaluation"],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Stereotypes have been studied extensively in the fields of social psychology and, especially with the recent advances in technology, in computational linguistics. Stereotypes have also gained even more attention nowadays because of a notable rise in their dissemination due to demographic changes and world events. This paper focuses on ethnic stereotypes related to immigration and presents the S<jats:sc>tereo<\/jats:sc>H<jats:sc>oax<\/jats:sc> corpus, a multilingual dataset of 17,814 tweets in French, Italian, and Spanish. The corpus includes conversational threads reporting on and responding to racial hoaxes about immigrants, which we define as false claims of unlawful actions attributed to specific ethnic groups. This work describes the data collection process and the fine-grained annotation scheme we used, which is based mainly on the Stereotype Content Model adapted to the study applied to immigrants of Bosco et al. (2023). Quantitative and qualitative analyses show the distribution and correlation of annotated categories across languages, revealing, for instance, intercultural differences in the expression of stereotypes through forms of discredit. To validate our data, we performed four machine learning experiments using pre-trained BERT-like models in order to lay a foundation for automatic stereotype detection research. Leveraging the S<jats:sc>tereo<\/jats:sc>H<jats:sc>oax<\/jats:sc> corpus, we gained crucial insights into the importance of context, especially in relation to the detection of implicit stereotypes. Overall, we believe that the S<jats:sc>tereo<\/jats:sc>H<jats:sc>oax<\/jats:sc> corpus will prove to be a valuable resource for the automatic detection of stereotypes regarding immigrants and the study of the linguistic and psychological patterns associated with their dissemination.<\/jats:p>","DOI":"10.1007\/s10579-024-09791-3","type":"journal-article","created":{"date-parts":[[2024,12,19]],"date-time":"2024-12-19T07:31:44Z","timestamp":1734593504000},"page":"2031-2069","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Stereohoax: a multilingual corpus of racial hoaxes and social media reactions annotated for stereotypes"],"prefix":"10.1007","volume":"59","author":[{"given":"Wolfgang S.","family":"Schmeisser-Nieto","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alessandra Teresa","family":"Cignarella","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tom","family":"Bourgeade","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Simona","family":"Frenda","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alejandro","family":"Ariza-Casabona","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mario","family":"Laurent","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paolo Giovanni","family":"Cicirelli","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrea","family":"Marra","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giuseppe","family":"Corbelli","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Farah","family":"Benamara","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cristina","family":"Bosco","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"V\u00e9ronique","family":"Moriceau","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marinella","family":"Paciello","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Viviana","family":"Patti","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mariona","family":"Taul\u00e9","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Francesca","family":"D\u2019Errico","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,12,19]]},"reference":[{"key":"9791_CR1","doi-asserted-by":"publisher","unstructured":"Abele, A. E., Hauke, N., Peters, K., Louvet, E., Szymkow, A., & Duan, Y. (2016). Facets of the fundamental content dimensions: agency with competence and assertiveness-communion with warmth and morality. Frontiers in Psychology. https:\/\/doi.org\/10.3389\/fpsyg.2016.01810. http:\/\/journal.frontiersin.org\/article\/10.3389\/fpsyg.2016.01810\/full","DOI":"10.3389\/fpsyg.2016.01810"},{"key":"9791_CR2","unstructured":"Allport, G. W. (1935). Attitudes. In A handbook of social psychology (pp. 798\u2013844). CA Murchinson."},{"key":"9791_CR3","unstructured":"Allport, G. W., Clark, K., & Pettigrew, T. (1954). The nature of prejudice. Addison-Wesley Reading."},{"key":"9791_CR4","unstructured":"Arcuri, L. (2015). Due pesi due misure. Come gli immigrati e gli italiani sono descritti dai media. Giunti Editore."},{"key":"9791_CR5","first-page":"217","volume":"69","author":"A Ariza-Casabona","year":"2022","unstructured":"Ariza-Casabona, A., Schmeisser-Nieto, W. S., Nofre, M., Taul\u00e9, M., Amig\u00f3, E., Chulvi, B., & Rosso, P. (2022). Overview of DETESTS at IberLEF 2022: DETEction and classification of racial STereotypes in Spanish. Procesamiento del Lenguaje Natural, 69, 217\u2013228.","journal-title":"Procesamiento del Lenguaje Natural"},{"issue":"2","key":"9791_CR6","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1080\/0305724022014322","volume":"31","author":"A Bandura","year":"2002","unstructured":"Bandura, A. (2002). Selective moral disengagement in the exercise of moral agency. Journal of Moral Education, 31(2), 101\u201319.","journal-title":"Journal of Moral Education"},{"key":"9791_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.12840\/issn.2255-4165.017","volume":"7","author":"CJ Beukeboom","year":"2019","unstructured":"Beukeboom, C. J., & Burgers, C. (2019). How stereotypes are shared through language: A review and introduction of the social categories and stereotypes communication (SCSC) framework. Review of Communication Research, 7, 1\u201337.","journal-title":"Review of Communication Research"},{"issue":"6","key":"9791_CR8","doi-asserted-by":"publisher","first-page":"978","DOI":"10.1037\/a0020861","volume":"99","author":"CJ Beukeboom","year":"2010","unstructured":"Beukeboom, C. J., Finkenauer, C., & Wigboldus, D. H. J. (2010). The negation bias: When negations signal stereotypic expectancies. Journal of Personality and Social Psychology, 99(6), 978\u201399. https:\/\/doi.org\/10.1037\/a0020861","journal-title":"Journal of Personality and Social Psychology"},{"key":"9791_CR9","unstructured":"Biewald, L. (2020). Experiment tracking with weights and biases. https:\/\/www.wandb.com\/, software available from wandb.com."},{"key":"9791_CR10","first-page":"4349","volume":"29","author":"T Bolukbasi","year":"2016","unstructured":"Bolukbasi, T., Chang, K. W., Zou, J. Y., Saligrama, V., & Kalai, A. T. (2016). Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. Advances in Neural Information Processing Systems, 29, 4349\u20134357.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9791_CR11","doi-asserted-by":"publisher","unstructured":"Bosco, C., Patti, V., Frenda, S., Cignarella, A. T., Paciello, M., & D\u2019Errico, F. (2023). Detecting racial stereotypes: An Italian social media corpus where psychology meets NLP. Information Processing & Management,60(1), 103118. https:\/\/doi.org\/10.1016\/j.ipm.2022.103118. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0306457322002199.","DOI":"10.1016\/j.ipm.2022.103118"},{"key":"9791_CR12","doi-asserted-by":"crossref","unstructured":"Bourgeade, T., Cignarella, A. T., Frenda, S., Laurent, M., Schmeisser-Nieto, W. S., Benamara, F., Bosco, C., Moriceau, V., Patti, V., & Taul\u00e9, M. (2023) A multilingual dataset of racial stereotypes in social media conversational threads. In Proceedings of the 17th conference of the European chapter of the association for computational linguistics (EACL 2023). In Press.","DOI":"10.18653\/v1\/2023.findings-eacl.51"},{"key":"9791_CR13","doi-asserted-by":"publisher","unstructured":"Bye, H. H. (2020). Intergroup relations during the refugee crisis: individual and cultural stereotypes and prejudices and their relationship with behavior toward asylum seekers. Frontiers in Psychology, 11, 612267. https:\/\/doi.org\/10.3389\/fpsyg.2020.612267. https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2020.612267\/full.","DOI":"10.3389\/fpsyg.2020.612267"},{"key":"9791_CR14","unstructured":"Ca\u00f1ete, J., Chaperon, G., Fuentes, R., Ho, J.-H., Kang, H., & P\u00e9rez, J. (2020) Spanish pre-trained Bert model and evaluation data. In PML4DC at ICLR 2020."},{"key":"9791_CR15","doi-asserted-by":"publisher","unstructured":"Cao, Y. T., Sotnikova, A., Daum\u00e9\u00a0III, H., Rudinger, R., & Zou, L. (2022) Theory-grounded measurement of U.S. social stereotypes in English language models. In Carpuat, M., de\u00a0Marneffe, M. C., Meza\u00a0Ruiz, IV (Eds.), Proceedings of the 2022 conference of the North American chapter of the association for computational linguistics: Human language technologies. association for computational linguistics, Seattle, USA (pp. 1276\u20131295). https:\/\/doi.org\/10.18653\/v1\/2022.naacl-main.92. https:\/\/aclanthology.org\/2022.naacl-main.92.","DOI":"10.18653\/v1\/2022.naacl-main.92"},{"key":"9791_CR16","doi-asserted-by":"crossref","unstructured":"Card, D., Gross, J. H., Boydstun, A., & Smith N. A. (2016). Analyzing framing through the casts of characters in the news. In Proceedings of the 2016 conference on empirical methods in natural language processing (pp. 1410\u20131420).","DOI":"10.18653\/v1\/D16-1148"},{"key":"9791_CR17","unstructured":"Cardellino, C. (2019). Spanish billion words corpus and embeddings. https:\/\/crscardellino.github.io\/SBWCE\/."},{"key":"9791_CR18","doi-asserted-by":"crossref","unstructured":"Castelfranchi, C. (2023). The nature of power and its complex dynamics. In A Theory of Tutelary Relationships (pp. 59\u2013109). Springer.","DOI":"10.1007\/978-3-031-20573-6_4"},{"key":"9791_CR19","doi-asserted-by":"crossref","unstructured":"Cerase, A., & Santoro, C. (2018). From racial hoaxes to media hypes: Fake news\u2019 real consequences. In P. Vasterman (Ed.), rom media hype to twitter storm: new explosions and their impact on issues, crises, and public opinion (pp. 333\u2013354).","DOI":"10.2307\/j.ctt21215m0.20"},{"key":"9791_CR20","doi-asserted-by":"publisher","unstructured":"Cercas\u00a0Curry, A., Abercrombie, G., & Rieser, V. (2021). ConvAbuse: data, analysis, and benchmarks for nuanced abuse detection in conversational AI. In Proceedings of the 2021 conference on empirical methods in natural language Processing. Association for computational linguistics, online (pp. 7388\u20137403). https:\/\/doi.org\/10.18653\/v1\/2021.emnlp-main.587. https:\/\/aclanthology.org\/2021.emnlp-main.587.","DOI":"10.18653\/v1\/2021.emnlp-main.587"},{"issue":"1","key":"9791_CR21","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1037\/a0030398","volume":"104","author":"JT Cheng","year":"2013","unstructured":"Cheng, J. T., Tracy, J. L., Foulsham, T., Kingstone, A., & Henrich, J. (2013). Two ways to the top: Evidence that dominance and prestige are distinct yet viable avenues to social rank and influence. Journal of Personality and Social Psychology, 104(1), 103.","journal-title":"Journal of Personality and Social Psychology"},{"key":"9791_CR22","doi-asserted-by":"publisher","unstructured":"Chiril, P., Benamara, F., & Moriceau, V. (2021). \u201cBe nice to your wife! the restaurants are closed\u201d: Can gender stereotype detection improve sexism classification? In Findings of the association for computational linguistics: EMNLP 2021. Association for computational linguistics (pp. 2833\u20132844). https:\/\/doi.org\/10.18653\/v1\/2021.findings-emnlp.242. https:\/\/aclanthology.org\/2021.findings-emnlp.242.","DOI":"10.18653\/v1\/2021.findings-emnlp.242"},{"issue":"4","key":"9791_CR23","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1177\/0261927X12446611","volume":"31","author":"KA Collins","year":"2012","unstructured":"Collins, K. A., & Cl\u00e9ment, R. (2012). Language and prejudice: Direct and moderated effects. Journal of Language and Social Psychology, 31(4), 376\u2013396. https:\/\/doi.org\/10.1177\/0261927X12446611","journal-title":"Journal of Language and Social Psychology"},{"key":"9791_CR24","doi-asserted-by":"publisher","unstructured":"D\u2019Errico, F., & Paciello, M. (2018). Online moral disengagement and hostile emotions in discussions on hosting immigrants. Internet Research,28(5), 1313\u20131335. https:\/\/doi.org\/10.1108\/IntR-03-2017-0119. https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IntR-03-2017-0119\/full\/html.","DOI":"10.1108\/IntR-03-2017-0119"},{"key":"9791_CR25","doi-asserted-by":"publisher","unstructured":"D\u2019Errico, F., Corbelli, G., Papapicco, C., & Paciello, M. (2022). How personal values count in misleading news sharing wh moral content. Behavioral Sciences, 12(9), 302. https:\/\/doi.org\/10.3390\/bs12090302. https:\/\/www.mdpi.com\/2076-328X\/12\/9\/302.","DOI":"10.3390\/bs12090302"},{"key":"9791_CR27","doi-asserted-by":"publisher","unstructured":"D\u2019Errico, F., Papapicco, C., & Taul\u00e9 Delor, M. (2022). \u2018Immigrants, hell on board\u2019: Stereotypes and prejudice emerging from racial hoaxes through a psycho-linguistic analysis. Journal of Language and Discrimination. https:\/\/doi.org\/10.1558\/jld.21228. https:\/\/journal.equinoxpub.com\/JLD\/article\/view\/21228.","DOI":"10.1558\/jld.21228"},{"key":"9791_CR100","doi-asserted-by":"crossref","unstructured":"D\u2019Errico, F., & Poggi, I. (2014). Acidity. The hidden face of conflictual and stressful situations. Cognitive Computation, 6, 661\u2013676.","DOI":"10.1007\/s12559-014-9280-1"},{"key":"9791_CR29","doi-asserted-by":"crossref","unstructured":"Dev, S., Li, T., Phillips, J.M., & Srikumar, V. (2020). On measuring and mitigating biased inferences of word embeddings. In Proceedings of the AAAI conference on artificial intelligence (pp. 7659\u20137666).","DOI":"10.1609\/aaai.v34i05.6267"},{"key":"9791_CR30","doi-asserted-by":"publisher","unstructured":"Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies (long and short papers) (Vol. 1, pp 4171\u20134186). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/N19-1423. https:\/\/www.aclweb.org\/anthology\/N19-1423.","DOI":"10.18653\/v1\/N19-1423"},{"issue":"3","key":"9791_CR31","doi-asserted-by":"publisher","first-page":"518","DOI":"10.1111\/josi.12027","volume":"69","author":"VM Esses","year":"2013","unstructured":"Esses, V. M., Medianu, S., & Lawson, A. S. (2013). Uncertainty, threat, and the role of the media in promoting the dehumanization of immigrants and refugees: Dehumanization of immigrants and refugees. Journal of Social Issues, 69(3), 518\u2013536. https:\/\/doi.org\/10.1111\/josi.12027","journal-title":"Journal of Social Issues"},{"key":"9791_CR32","doi-asserted-by":"crossref","unstructured":"Fersini, E., Nozza, D., & Rosso, P. (2020). AMI @ EVALITA2020: automatic misogyny identification. In: Basile, V., Croce, D., Maro, M. D., Lucia C. P. (Eds.), Proceedings of the 7th evaluation campaign of natural language processing and speech tools for Italian. Final workshop (EVALITA 2020), Online event, December 17th, 2020, CEUR workshop proceedings (Vol. 2765). CEUR-WS.org. http:\/\/ceur-ws.org\/Vol-2765\/paper161.pdf.","DOI":"10.4000\/books.aaccademia.6764"},{"key":"9791_CR33","doi-asserted-by":"publisher","first-page":"59","DOI":"10.4000\/books.aaccademia.4497","volume":"12","author":"E Fersini","year":"2018","unstructured":"Fersini, E., Nozza, D., & Rosso, P. (2018). Overview of the Evalita 2018 task on automatic misogyny identification (AMI). EVALITA Evaluation of NLP and Speech Tools for Italian, 12, 59.","journal-title":"EVALITA Evaluation of NLP and Speech Tools for Italian"},{"key":"9791_CR34","unstructured":"Fiske, S. (1998). Stereotyping, prejudice, and discrimination. In: Gilbert, D. T., Fiske, S. T. & Lindzey, G. (Eds.). The handbook of social psychology (pp. 357\u2013411)."},{"key":"9791_CR35","doi-asserted-by":"publisher","unstructured":"Fiske, S. T., Cuddy, A. J., & Glick, P. (2007). Universal dimensions of social cognition: warmth and competence. Trends in Cognitive Sciences, 11(2), 77\u201383. https:\/\/doi.org\/10.1016\/j.tics.2006.11.005. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1364661306003299.","DOI":"10.1016\/j.tics.2006.11.005"},{"issue":"2","key":"9791_CR36","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1177\/0963721417738825","volume":"27","author":"ST Fiske","year":"2018","unstructured":"Fiske, S. T. (2018). Stereotype content: Warmth and competence endure. Current Directions in Psychological Science, 27(2), 67\u201373.","journal-title":"Current Directions in Psychological Science"},{"issue":"6","key":"9791_CR37","doi-asserted-by":"publisher","first-page":"878","DOI":"10.1037\/0022-3514.82.6.878","volume":"82","author":"ST Fiske","year":"2002","unstructured":"Fiske, S. T., Cuddy, A. J. C., Glick, P., & Xu, J. (2002). A model of (Often mixed) stereotype content: Competence and warmth respectively follow from perceived status and competition. Journal of Personality and Social Psychology, 82(6), 878\u2013902. https:\/\/doi.org\/10.1037\/0022-3514.82.6.878","journal-title":"Journal of Personality and Social Psychology"},{"key":"9791_CR38","unstructured":"Fokkens, A., Ruigrok, N., Beukeboom, C, Sarah, G., & Van Atteveldt, W. (2018). Studying Muslim stereotyping through microportrait extraction. In Proceedings of the 11th international conference on language resources and evaluation (LREC 2018) (pp. 3734\u20133741)."},{"key":"9791_CR39","doi-asserted-by":"crossref","unstructured":"Fraser, K. C., Kiritchenko, S., & Nejadgholi, I. (2022a). Computational modeling of stereotype content in text. Frontiers in Artificial Intelligence, 5.","DOI":"10.3389\/frai.2022.826207"},{"key":"9791_CR40","unstructured":"Fraser, K. C., Kiritchenko, S., & Nejadgholi, I. (2022b). Extracting age-related stereotypes from social media texts. In: Calzolari, N., B\u00e9chet, F., Blache, P., Choukri, K., Cieri, C., Declerck, T., Goggi, S., Isahara, H., Maegaard, B., Mariani, J., Mazo, H., Odijk, J., & Piperidis, S. (Eds.), Proceedings of the 13th language resources and evaluation conference (pp. 3183\u20133194). European Language Resources Association. https:\/\/aclanthology.org\/2022.lrec-1.341."},{"key":"9791_CR41","doi-asserted-by":"crossref","unstructured":"Fraser, K. C., Kiritchenko, S., & Nejadgholi, I. (2024). How does stereotype content differ across data sources? In Proceedings of the 13th joint conference on lexical and computational semantics (*SEM 2024) (pp. 18\u201334).","DOI":"10.18653\/v1\/2024.starsem-1.2"},{"key":"9791_CR42","doi-asserted-by":"publisher","first-page":"252","DOI":"10.1207\/s15327957pspr1003_4","volume":"10","author":"N Haslam","year":"2006","unstructured":"Haslam, N. (2006). Dehumanization: An integrative review. Personality and Social Psychology Review, 10, 252\u201364.","journal-title":"Personality and Social Psychology Review"},{"key":"9791_CR43","doi-asserted-by":"publisher","unstructured":"Herold, B., Waller, J., & Kushalnagar, R. (2022). Applying the stereotype content model to assess disability bias in popular pre-trained NLP models underlying AI-based assistive technologies. In Ebling, S., Prud\u2019hommeaux, E., & Vaidyanathan, P. (Eds.), 9th Workshop On Speech And Language Processing For Assistive Technologies (slpat-2022) (pp. 58\u201365). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/2022.slpat-1.8. https:\/\/aclanthology.org\/2022.slpat-1.8.","DOI":"10.18653\/v1\/2022.slpat-1.8"},{"issue":"5","key":"9791_CR44","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1037\/pspa0000046","volume":"110","author":"A Koch","year":"2016","unstructured":"Koch, A., Imhoff, R., Dotsch, R., Unkelbach, C., & Alves, H. (2016). The abc of stereotypes about groups: Agency\/socioeconomic success, conservative-progressive beliefs, and communion. Journal of Personality and Social Psychology, 110(5), 675.","journal-title":"Journal of Personality and Social Psychology"},{"key":"9791_CR45","doi-asserted-by":"publisher","unstructured":"Lee, T. L., & Fiske, S. T. (2006). Not an outgroup, not yet an ingroup: immigrants in the stereotype content model. International Journal of Intercultural Relations, 30(6), 751\u2013768. https:\/\/doi.org\/10.1016\/j.ijintrel.2006.06.005. https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0147176706000526.","DOI":"10.1016\/j.ijintrel.2006.06.005"},{"issue":"5","key":"9791_CR46","doi-asserted-by":"publisher","first-page":"734","DOI":"10.1037\/0022-3514.90.5.734","volume":"90","author":"A Maass","year":"2006","unstructured":"Maass, A., Karasawa, M., Politi, F., & Suga, S. (2006). Do verbs and adjectives play different roles in different cultures? A cross-linguistic analysis of person representation. Journal of Personality & Social Psychology, 90(5), 734\u2013750.","journal-title":"Journal of Personality & Social Psychology"},{"key":"9791_CR47","unstructured":"Markov, I., & Daelemans, W. (2022). The role of context in detecting the target of hate speech. In Proceedings of the 3rd workshop on threat, aggression and cyberbullying (TRAC 2022) (pp. 37\u201342). Association for Computational Linguistics. https:\/\/aclanthology.org\/2022.trac-1.5."},{"issue":"4","key":"9791_CR48","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1111\/josi.12298","volume":"74","author":"SR Marshall","year":"2018","unstructured":"Marshall, S. R., & Shapiro, J. R. (2018). When \u201cscurry\u2019\u2019 vs. \u201churry\u2019\u2019 makes the difference: Vermin metaphors, disgust, and anti-immigrant attitudes. Journal of Social Issues, 74(4), 774\u2013789.","journal-title":"Journal of Social Issues"},{"key":"9791_CR49","doi-asserted-by":"publisher","unstructured":"Martin, L., Muller, B., Ortiz\u00a0Su\u00e1rez, P. J., Dupont, Y., Romary, L., de la Clergerie, \u00c9., Seddah, D., & Sagot, B. (2020). CamemBERT: A tasty French language model. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 7203\u20137219). Association for Computational Linguistics, Online. https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.645. https:\/\/aclanthology.org\/2020.acl-main.645.","DOI":"10.18653\/v1\/2020.acl-main.645"},{"key":"9791_CR50","doi-asserted-by":"publisher","unstructured":"Menini, S., Aprosio, A. P., & Tonelli, S. (2021). Abuse is contextual, What about NLP? The role of context in abusive language annotation and detection. https:\/\/doi.org\/10.48550\/arXiv.2103.14916.","DOI":"10.48550\/arXiv.2103.14916"},{"key":"9791_CR51","unstructured":"Mina, M., Falc\u00e3o, J., & Gonzalez-Agirre, A. (2024). Exploring the relationship between intrinsic stigma in masked language models and training data using the stereotype content model. In Kokkinakis, D., Fraser, K. C., Themistocleous, C. K, Fors, K. L., Tsanas, A., & Ohman, F. (Eds.), Proceedings of the 5th workshop on resources and processing of linguistic, para-linguistic and extra-linguistic Data from people with various forms of cognitive\/psychiatric\/developmental impairments @LREC-COLING 2024 (pp. 54\u201367). ELRA and ICCL, Torino, Italia. https:\/\/aclanthology.org\/2024.rapid-1.7."},{"issue":"1","key":"9791_CR52","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1002\/ejsp.2724","volume":"51","author":"G Nicolas","year":"2021","unstructured":"Nicolas, G., Bai, X., & Fiske, S. T. (2021). Comprehensive stereotype content dictionaries using a semi-automated method. European Journal of Social Psychology, 51(1), 178\u2013196.","journal-title":"European Journal of Social Psychology"},{"key":"9791_CR53","doi-asserted-by":"publisher","unstructured":"Pavlopoulos, J., Sorensen, J., Dixon, L., Thain, N., & Androutsopoulos, I. (2020). Toxicity detection: Does context really matter? In Proceedings of the 58th annual meeting of the association for computational linguistics (pp. 4296\u20134305). Association for Computational Linguistics, Online. https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.396. https:\/\/aclanthology.org\/2020.acl-main.396.","DOI":"10.18653\/v1\/2020.acl-main.396"},{"issue":"1","key":"9791_CR54","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1002\/ejsp.2420250106","volume":"25","author":"TF Pettigrew","year":"1995","unstructured":"Pettigrew, T. F., & Meertens, R. W. (1995). Subtle and blatant prejudice in western Europe. European Journal of Social Psychology, 25(1), 57\u201375. https:\/\/doi.org\/10.1002\/ejsp.2420250106","journal-title":"European Journal of Social Psychology"},{"key":"9791_CR55","doi-asserted-by":"publisher","unstructured":"Poggi, I., & D\u2019Errico, F. (2010). Dominance signals in debates. In Salah, A. A., Gevers, T., Sebe, N., et\u00a0al. (Eds.), Human behavior understanding (Vol. 6219, pp. 163\u2013174). Springer, Berlin, Heidelberg. https:\/\/doi.org\/10.1007\/978-3-642-14715-9_16.","DOI":"10.1007\/978-3-642-14715-9_16"},{"key":"9791_CR101","doi-asserted-by":"crossref","unstructured":"Poggi, I., D\u2019Errico, F., & Vincze, L. (2011a). Agreement and its multimodal communication in debates: A qualitative analysis. Cognitive Computation, 3, 466\u2013479.","DOI":"10.1007\/s12559-010-9068-x"},{"key":"9791_CR102","unstructured":"Poggi, I., D\u2019Errico, F., & Vincze, L. (2011b). Discrediting moves in political debate. In Proceedings of second international workshop on user models for motivational systems: The affective and the rational routes to persuasion (UMMS 2011)(Girona) Springer LNCS (pp. 84\u201399)."},{"key":"9791_CR57","unstructured":"Rodr\u00edguez-S\u00e1nchez, F., de\u00a0Albornoz, J. C., Plaza, L., Gonzalo, J., Rosso, P., Comet, M., & Donoso,T. (2021) Overview of EXIST 2021: Sexism identification in social networks. Procesamiento del Lenguaje Natural, 67, 195\u2013207. http:\/\/journal.sepln.org\/sepln\/ojs\/ojs\/index.php\/pln\/article\/view\/6389."},{"key":"9791_CR58","unstructured":"Rodr\u00edguez-S\u00e1nchez, F., de\u00a0Albornoz, J. C., Plaza, L., Mendieta-Aragn, A., Marco-Remn, G., Makeienko, M., Plaza, M., Gonzalo, J., Spina, J., Rosso, P. (2022) Overview of EXIST 2022: Sexism identification in social networks. Procesamiento del Lenguaje Natural, 69, 229\u2013240. http:\/\/journal.sepln.org\/sepln\/ojs\/ojs\/index.php\/pln\/article\/view\/6443."},{"key":"9791_CR59","unstructured":"Russell, K. K. (1998). The color of crime: Racial hoaxes, white fear, black protectionism, police harassment, and other macroaggressions. New York University Press."},{"key":"9791_CR60","doi-asserted-by":"publisher","unstructured":"S\u00e1nchez-Junquera, J. J., Chulvi, B., Rosso, P., & Ponzetto, S. P. (2021a) How do you speak about immigrants? Taxonomy and stereoimmigrants dataset for identifying stereotypes about immigrants. Applied Sciences. https:\/\/doi.org\/10.3390\/app11083610. https:\/\/www.mdpi.com\/2076-3417\/11\/8\/3610.","DOI":"10.3390\/app11083610"},{"key":"9791_CR61","unstructured":"S\u00e1nchez-Junquera, J. J., Rosso, P., Montes, M., Chulvi, B., & others. (2021). Masking and BERT-based models for stereotype identication. Procesamiento del Lenguaje Natural, 67, 83\u201394."},{"key":"9791_CR62","doi-asserted-by":"crossref","unstructured":"Sanguinetti, M., Comandini, G., di Nuovo, E., Frenda, S., Stranisci, M., Bosco, C., Caselli, T., Patti,V., & Russo, I. (2020) Haspeede 2 @ EVALITA2020: Overview of the EVALITA 2020 hate speech detection task. In: Basile, V., Croce, D., Di Maro, M., & Passaro, L. C. (Eds.), Proceedings of the 7th evaluation campaign of natural language processing and speech tools for Italian. Final workshop (EVALITA 2020). CEUR workshop proceedings (CEUR-WS.org), conference, 17 Dec 2020 (Vol. 2765).","DOI":"10.4000\/books.aaccademia.6897"},{"key":"9791_CR63","doi-asserted-by":"crossref","unstructured":"Sap, M., Gabriel, S., Qin, L., Jurafsky, D.,Smith, N. A., & Choi, Y. (2020) Social bias frames: Reasoning about social and power implications of language. arXiv:1911.03891.","DOI":"10.18653\/v1\/2020.acl-main.486"},{"key":"9791_CR64","unstructured":"Schmeisser-Nieto, W. S., Nofre, M., & Taul\u00e9, M. (2022). Criteria for the annotation of implicit stereotypes. In Proceedings of the 13th language resources and evaluation conference (LREC 2022) (pp. 753\u2013762)."},{"key":"9791_CR65","doi-asserted-by":"publisher","unstructured":"Su\u00e1rez, P. J. O., Sagot, B., & Romary, L. (2019). Asynchronous pipeline for processing huge corpora on medium to low resource infrastructures. In 7th workshop on the challenges in the management of large corpora (CMLC-7). Leibniz-Institut f\u00fcr Deutsche Sprache. https:\/\/doi.org\/10.14618\/IDS-PUB-9021. https:\/\/hal.inria.fr\/hal-02148693.","DOI":"10.14618\/IDS-PUB-9021"},{"key":"9791_CR66","unstructured":"Tiedemann, J. (2012). Parallel data, tools and interfaces in OPUS. In Proceedings of the 8th International Conference on Language Resources and Evaluation (LREC\u201912) (pp. 2214\u20132218). European Language Resources Association (ELRA). http:\/\/www.lrec-conf.org\/proceedings\/lrec2012\/pdf\/463_Paper.pdf."},{"key":"9791_CR67","doi-asserted-by":"crossref","unstructured":"Ungless, E. L., Rafferty, A., Nag, H., & Ross, B. (2022). A robust bias mitigation procedure based on the stereotype content model. In Proceedings of the 5th workshop on natural language processing and computational social science (NLP+CSS) (pp. 207\u2013217).","DOI":"10.18653\/v1\/2022.nlpcss-1.23"},{"issue":"2","key":"9791_CR68","doi-asserted-by":"publisher","first-page":"440","DOI":"10.1177\/1065912917744897","volume":"71","author":"SM Utych","year":"2018","unstructured":"Utych, S. M. (2018). How dehumanization influences attitudes toward immigrants. Political Research Quarterly, 71(2), 440\u2013452.","journal-title":"Political Research Quarterly"},{"key":"9791_CR69","doi-asserted-by":"crossref","unstructured":"Vaes, J., Latrofa, M., Suitner, C., & Arcuri, L. (2017). They are all armed and dangerous! Journal of Media Psychology, 31.","DOI":"10.1027\/1864-1105\/a000216"},{"key":"9791_CR70","doi-asserted-by":"crossref","unstructured":"Vargas, F., Carvalho, I., H\u00fcrriyeto\u011flu, A., Pardo, T., & Benevenuto, F. (2023). Socially responsible hate speech detection: Can classifiers reflect social stereotypes? In Mitkov, R., Angelova, G. (Eds.), Proceedings of the 14th international conference on recent advances in natural language processing (pp. 1187\u20131196). INCOMA Ltd. https:\/\/aclanthology.org\/2023.ranlp-1.126.","DOI":"10.26615\/978-954-452-092-2_126"},{"key":"9791_CR71","unstructured":"Wardle, Derakhshan. H. (2018). Thinking about \u2018information disorder\u2019: Formats of misinformation, disinformation, and mal-information. In Journalism, \u2018fake news\u2019 & disinformation. Unesco."},{"key":"9791_CR72","unstructured":"Wenzek, G., Lachaux, M. A., Conneau A., Chaudhary, V., Guzm\u00e1n, F., Joulin, A., & Grave, E. (2020) CCNet: Extracting high quality monolingual datasets from web crawl data. In Proceedings of the 12th language resources and evaluation conference (pp. 4003\u20134012). European Language Resources Association. https:\/\/aclanthology.org\/2020.lrec-1.494."},{"issue":"4","key":"9791_CR73","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1080\/10646175.2020.1810180","volume":"32","author":"C Wright","year":"2021","unstructured":"Wright, C., Brinklow-Vaughn, R., Johannes, K., & Rodriguez, F. (2021). Media portrayals of immigration and refugees in hard and fake news and their impact on consumer attitudes. Howard Journal of Communications, 32(4), 331\u2013351. https:\/\/doi.org\/10.1080\/10646175.2020.1810180","journal-title":"Howard Journal of Communications"},{"key":"9791_CR74","unstructured":"Ybarra, O. J., & Stephan, W. G. (1994). Perceived threat as a predictor of stereotypes and prejudice: Americans\u2019 reactions to Mexican immigrants. Boletin de Psicologia, 42."}],"container-title":["Language Resources and Evaluation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-024-09791-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10579-024-09791-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-024-09791-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,6]],"date-time":"2025-09-06T03:59:22Z","timestamp":1757131162000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10579-024-09791-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,19]]},"references-count":74,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,9]]}},"alternative-id":["9791"],"URL":"https:\/\/doi.org\/10.1007\/s10579-024-09791-3","relation":{},"ISSN":["1574-020X","1574-0218"],"issn-type":[{"value":"1574-020X","type":"print"},{"value":"1574-0218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,19]]},"assertion":[{"value":"29 October 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 December 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare they have no financial interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"All the authors have given explicit consent to submit this work.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}]}}