{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,17]],"date-time":"2026-08-17T15:14:33Z","timestamp":1786979673431,"version":"build-2736575974"},"reference-count":48,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2025,11,6]],"date-time":"2025-11-06T00:00:00Z","timestamp":1762387200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,11,6]],"date-time":"2025-11-06T00:00:00Z","timestamp":1762387200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Europa-Universit\u00e4t Viadrina Frankfurt (Oder)"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI &amp; Soc"],"published-print":{"date-parts":[[2026,4]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Understanding how AI and constructions of race intersect and which new ethical dilemmas arise in this context has become pressing. In this article, we introduce a university pedagogical project centred on collective explorations of raciolinguistic biases in Large Language Models. The project aimed at the development of Critical AI Language Literacy. It approached raciolinguistic biases from linguistic anthropological perspectives, where \u2018race\u2019 is understood as a linguistic and discursive construction (Alim et al. 2020). To inspect whether and how raciolinguistic biases are to be found in Large Language Models, a group of graduate students collected output of ChatGPT in different languages and subsequently engaged in discussions around the output\u2019s potentially racially biased language or content. Prompts were entered by ten different individuals, in different ChatGPT accounts and in different languages. The results of these prompting experiments contributed to discussions on the factors that may influence the presence and degree of biased output in ChatGPT. These include the data set, the use history of the account, choice of language or language variety, and explicit sensitivity of the topic. The possible impact of debiasing techniques was also discussed. The project helped students to understand that LLMs are not neutral technologies but cultural artefacts in which biased data and cultural histories are embedded. We argue that the approach has the potential to support a critical awareness in LLM use and to therefore foster Critical AI Language Literacy.<\/jats:p>","DOI":"10.1007\/s00146-025-02727-7","type":"journal-article","created":{"date-parts":[[2025,11,6]],"date-time":"2025-11-06T17:37:59Z","timestamp":1762450679000},"page":"3015-3026","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Developing Critical AI Language Literacy\u2014prompting experiments on raciolinguistic bias to understand large language models as cultural artefacts"],"prefix":"10.1007","volume":"41","author":[{"given":"Britta","family":"Schneider","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Milene","family":"Oliveira","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,11,6]]},"reference":[{"key":"2727_CR1","volume-title":"The Oxford handbook of language and race","year":"2020","unstructured":"Alim HS, Reyes A, Kroskrity PV (eds) (2020) The Oxford handbook of language and race. Oxford University Press, Oxford"},{"key":"2727_CR2","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1017\/9781108559249.002","volume-title":"The Cambridge handbook of language standardization","author":"W Ayres-Bennett","year":"2021","unstructured":"Ayres-Bennett W (2021) Modelling language standardization. In: Ayres-Bennett W, Bellamy J (eds) The Cambridge handbook of language standardization. Cambridge University Press, Cambridge, pp 27\u201363"},{"key":"2727_CR3","doi-asserted-by":"publisher","unstructured":"Bender E, McMillan-Major A, Gebru T, Shmitchell S (2021) On the dangers of stochastic parrots: can language models be too big? FAccT \u201921, March 3\u201310, 2021, Virtual Event, Canada. https:\/\/doi.org\/10.1145\/3442188.3445922","DOI":"10.1145\/3442188.3445922"},{"key":"2727_CR4","unstructured":"Blodgett SL, O\u2019Connor B (2017) Racial disparity in Natural Language Processing: a case study of social media African-American English. Fairness, Accountability, and Transparency in Machine Learning (FAT\/ML) Workshop, KDD. https:\/\/arxiv.org\/abs\/1707.00061v1"},{"key":"2727_CR5","unstructured":"Bolukbasi T et al (2016) Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. In: 30th Conference on neural information processing systems (NIPS 2016)"},{"key":"2727_CR6","volume-title":"Ce que parler veut dire: l\u2019\u00e9conomie des \u00e9changes linguistiques","author":"P Bourdieu","year":"1982","unstructured":"Bourdieu P (1982) Ce que parler veut dire: l\u2019\u00e9conomie des \u00e9changes linguistiques. Fayard, Paris"},{"key":"2727_CR48","unstructured":"Crawford, Kate. 2021. Atlas of AI. New Haven: Yale University Press."},{"key":"2727_CR7","doi-asserted-by":"publisher","unstructured":"Dai DW, Hua Z, Chen G (2025) How does interaction with LLM powered chatbots shape human understanding of culture? The need for Critical Interactional Competence (CritIC). In: Annual review of applied linguistics, pp 1\u201322. https:\/\/doi.org\/10.1017\/S0267190525000054","DOI":"10.1017\/S0267190525000054"},{"key":"2727_CR8","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1146\/annurev-anthro-092611-145828","volume":"41","author":"P Eckert","year":"2012","unstructured":"Eckert P (2012) Three waves of variation study: the emergence of meaning in the study of sociolinguistic variation. Annu Rev Anthropol 41:87\u2013100","journal-title":"Annu Rev Anthropol"},{"key":"2727_CR9","volume-title":"Linguistics in a colonial world. A story of language, meaning and power","author":"J Errington","year":"2008","unstructured":"Errington J (2008) Linguistics in a colonial world. A story of language, meaning and power. Blackwell, Malden, Mass."},{"key":"2727_CR46","unstructured":"Fleisig, Genevieve S, Madeline B, et al (2024) Linguistic bias in ChatGPT: Language models reinforce dialect discrimination. https:\/\/arxiv.org\/html\/2406.08818v1"},{"key":"2727_CR10","doi-asserted-by":"publisher","unstructured":"Gonen H, Goldberg Y (2019) Lipstick on a pig: debiasing methods cover up systematic gender biases in word embeddings but do not remove them. In: Proceedings of the 2019 conference of the north. Association for Computational Linguistics, pp 609\u2013614. https:\/\/doi.org\/10.18653\/v1\/n19-1061","DOI":"10.18653\/v1\/n19-1061"},{"key":"2727_CR11","unstructured":"Hao K (2025) Empire of AI. Dreams and nightmares in Sam Altman\u2019s Open AI. Penguin Press"},{"key":"2727_CR12","doi-asserted-by":"crossref","unstructured":"Harvey E, Kizilcec RF, Koenecke A (2025) A framework for auditing chatbots for dialect-based quality-of-service harms. Preprint at https:\/\/arxiv.org\/abs\/2506.04419v1","DOI":"10.1145\/3715275.3732137"},{"key":"2727_CR13","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-024-07856-5","author":"V Hofmann","year":"2024","unstructured":"Hofmann V, Kalluri PR, Jurafsky D, King S (2024) AI generates covertly racist decisions about people based on their dialect. Nature. https:\/\/doi.org\/10.1038\/s41586-024-07856-5","journal-title":"Nature"},{"key":"2727_CR14","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1093\/oxfordhb\/9780190845995.013.10","volume-title":"The Oxford handbook of language and race","author":"A Ibrahim","year":"2020","unstructured":"Ibrahim A (2020) Immigration, language, and racial becoming. In: Alim HS, Reyes A, Kroskrity PV (eds) The Oxford handbook of language and race. Oxford University Press, New York, pp 167\u2013185"},{"key":"2727_CR15","first-page":"1","volume-title":"The discourse reader","author":"A Jaworski","year":"2006","unstructured":"Jaworski A, Coupland N (2006) Introduction. Perspectives on discourse analysis. In: Jaworski A, Coupland N (eds) The discourse reader. Routledge, London, pp 1\u201337"},{"key":"2727_CR16","doi-asserted-by":"publisher","DOI":"10.4324\/9780429328480","volume-title":"Innovations and challenges in digital literacies: literacies of repair","author":"RH Jones","year":"2025","unstructured":"Jones RH (2025) Innovations and challenges in digital literacies: literacies of repair. Routledge. https:\/\/doi.org\/10.4324\/9780429328480"},{"key":"2727_CR45","doi-asserted-by":"crossref","unstructured":"Keane E (2024) Animals, robots, gods. Adventures in the moral imagination. Allen Lane, Milton Keynes","DOI":"10.1515\/9780691270944"},{"key":"2727_CR17","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1093\/oxfordhb\/9780190845995.013.19","volume-title":"The Oxford handbook of language and race","author":"K Khan","year":"2020","unstructured":"Khan K (2020) What does a terrorist sound like? Language and racialized representations of Muslims. In: Alim HS, Reyes A, Kroskrity PV (eds) The Oxford handbook of language and race. Oxford University Press, New York, pp 398\u2013422"},{"key":"2727_CR18","doi-asserted-by":"publisher","first-page":"7684","DOI":"10.1073\/pnas.1915768117","volume":"117","author":"A Koenecke","year":"2020","unstructured":"Koenecke A et al (2020) Racial disparities in automated speech recognition. Proc Natl Acad Sci U S A 117:7684\u20137689","journal-title":"Proc Natl Acad Sci U S A"},{"key":"2727_CR19","volume-title":"Sociolinguistic patterns","author":"W Labov","year":"1972","unstructured":"Labov W (1972) Sociolinguistic patterns. University of Pennsylvania Press, Washington D.C"},{"key":"2727_CR20","unstructured":"Lambert N (2025) Reinforcement learning from human feedback. A short introduction to RLHF and post-training focused on language models. Preprint at https:\/\/arxiv.org\/abs\/2504.12501v2"},{"key":"2727_CR21","doi-asserted-by":"publisher","DOI":"10.1111\/josl.12681","author":"I Maly","year":"2024","unstructured":"Maly I (2024) AI, power and sociolinguistics. J Sociolinguist. https:\/\/doi.org\/10.1111\/josl.12681","journal-title":"J Sociolinguist"},{"key":"2727_CR22","doi-asserted-by":"publisher","unstructured":"Markl N (2022a) Language variation and algorithmic bias: understanding algorithmic bias in British English automatic speech recognition. In: ACM conference on fairness, accountability, and transparency. FAccT \u201922, pp 521\u2013534. https:\/\/doi.org\/10.1145\/3531146.3533117","DOI":"10.1145\/3531146.3533117"},{"key":"2727_CR23","doi-asserted-by":"crossref","unstructured":"Markl N (2022b) Mind the data gap(s): investigating power in speech and language datasets. In: Proceedings of the second workshop on language technology for equality, diversity and inclusion, pp 1\u201312","DOI":"10.18653\/v1\/2022.ltedi-1.1"},{"key":"2727_CR24","unstructured":"Markl N, McNulty SJ (2022) Language technology practitioners as language managers: arbitrating data bias and predictive bias in ASR. In: Proceedings of the 13th conference on language resources and evaluation (LREC 2022), pp 6328\u20136339"},{"key":"2727_CR25","doi-asserted-by":"publisher","unstructured":"Markl N, Wallington E, Klejch O, Reitmaier T, Bailey G, Pearson J, Jones M, Robinson S, Bell P (2023) Automatic transcription and (de)standardisation. Edinburgh Research Explorer. https:\/\/doi.org\/10.21437\/SIGUL.2023-20","DOI":"10.21437\/SIGUL.2023-20"},{"key":"2727_CR26","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1093\/oxfordhb\/9780190845995.013.8","volume-title":"The Oxford handbook of language and race","author":"B McElhinny","year":"2020","unstructured":"McElhinny B, Heller M (2020) The linguistic intimacy of five continents: racializing language in empire. In: Alim HS, Reyes A, Kroskrity PV (eds) The Oxford handbook of language and race. Oxford University Press, Oxford, pp 130\u2013152. https:\/\/doi.org\/10.1093\/oxfordhb\/9780190845995.013.8"},{"key":"2727_CR27","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1093\/oxfordhb\/9780190845995.013.13","volume-title":"The Oxford handbook of language and race","author":"M Morgan","year":"2020","unstructured":"Morgan M (2020) \u2018We don\u2019t play\u2019: black women\u2019s linguistic authority across race, class, and gender. In: Alim HS, Reyes A, Kroskrity PV (eds) The Oxford handbook of language and race. Oxford University Press, New York, pp 261\u2013290"},{"key":"2727_CR28","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24859","author":"R Morrison","year":"2023","unstructured":"Morrison R (2023) Making the invisible visible: critical discourse analysis as a tool for search engine research. J Assoc Inf Sci Technol. https:\/\/doi.org\/10.1002\/asi.24859","journal-title":"J Assoc Inf Sci Technol"},{"key":"2727_CR29","unstructured":"Nascimento A (2016) O genoc\u00eddio do negro brasileiro: processo de um racismo mascarado. Editora Perspectiva SA"},{"key":"2727_CR30","first-page":"157","volume-title":"Rethinking language use in digital Africa","author":"AY Ofemile","year":"2021","unstructured":"Ofemile AY (2021) Human\u2013agent interaction: L1-mode intelligent software agents instructing Nigerian L2 speakers of English during assembly tasks. In: Makalela L, White G (eds) Rethinking language use in digital Africa. Multilingual Matters, Bristol, pp 157\u2013187"},{"key":"2727_CR31","doi-asserted-by":"publisher","first-page":"4955","DOI":"10.1177\/14614448241251797","volume":"26","author":"W Orr","year":"2024","unstructured":"Orr W, Crawford K (2024) The social construction of datasets: on the practices, processes, and challenges of dataset creation for machine learning. New Media Soc 26:4955\u20134972","journal-title":"New Media Soc"},{"key":"2727_CR32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1207\/s15427595cils0101_1","volume":"1","author":"A Pennycook","year":"2004","unstructured":"Pennycook A (2004) Performativity and language studies. Crit Inq Lang Stud 1:1\u201319","journal-title":"Crit Inq Lang Stud"},{"issue":"2","key":"2727_CR33","doi-asserted-by":"publisher","first-page":"46","DOI":"10.5007\/1984-8420.2016v17n2p46","volume":"17","author":"WD Pincerati","year":"2016","unstructured":"Pincerati WD (2016) Negro \u00e9 o inferno! Um ensaio sobre as cores dos homens, dos dem\u00f4nios e dos deuses. Working Papers Em Lingu\u00edstica 17(2):46\u201371","journal-title":"Working Papers Em Lingu\u00edstica"},{"issue":"5","key":"2727_CR34","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1111\/josl.12685","volume":"28","author":"B Rampton","year":"2024","unstructured":"Rampton B (2024) Existential challenges and interactional sociolinguistics\/linguistic ethnography. J Sociolinguist 28(5):38\u201343","journal-title":"J Sociolinguist"},{"key":"2727_CR35","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1093\/oxfordhb\/9780190845995.013.3","volume-title":"The Oxford handbook of language and race","author":"J Rosa","year":"2020","unstructured":"Rosa J, Flores N (2020) Reimagining race and language. From raciolinguistic ideologies to a raciolinguistic perspective. In: Alim HS, Reyes A, Kroskrity PV (eds) The Oxford handbook of language and race. Oxford University Press, New York, pp 90\u2013107"},{"key":"2727_CR36","doi-asserted-by":"publisher","first-page":"845","DOI":"10.1162\/tacl_a_00401","volume":"9","author":"B Savoldi","year":"2021","unstructured":"Savoldi B, Gaido M, Bentivogli L, Negri M, Turchi M (2021) Gender bias in machine translation. Trans Assoc Comput Linguist 9:845\u2013874","journal-title":"Trans Assoc Comput Linguist"},{"key":"2727_CR37","doi-asserted-by":"publisher","DOI":"10.1086\/721757","author":"B Schneider","year":"2022","unstructured":"Schneider B (2022) Multilingualism and AI \u2013 the regimentation of language in the age of digital capitalism. Signs Soc. https:\/\/doi.org\/10.1086\/721757","journal-title":"Signs Soc"},{"key":"2727_CR38","doi-asserted-by":"crossref","unstructured":"Sheng E, Chang K-W, Natarajan P, Peng N (2020) Towards controllable biases in language generation. In: Findings of the Association for Computational Linguistics: EMNLP 2020, pp 3239\u20133254","DOI":"10.18653\/v1\/2020.findings-emnlp.291"},{"issue":"4","key":"2727_CR39","doi-asserted-by":"publisher","first-page":"1345","DOI":"10.1515\/applirev-2022-0066","volume":"15","author":"DN Silva","year":"2024","unstructured":"Silva DN (2024) Transidiomatic favela: language resources and embodied resistance in Brazilian and South African peripheries. Appl Linguist Rev 15(4):1345\u20131368","journal-title":"Appl Linguist Rev"},{"key":"2727_CR47","unstructured":"Smith G, Fleisig E, Bossi M, et al (2024) Standard language ideology in AI-generated language. https:\/\/arxiv.org\/abs\/2406.08726v1"},{"key":"2727_CR40","doi-asserted-by":"crossref","unstructured":"Waseem Z (2016) Are you a racist or am I seeing things? Annotator influence on hate speech detection on Twitter. In: Proceedings of 2016 EMNLP workshop on natural language processing and computational social science, pp 138\u2013142, https:\/\/aclanthology.org\/W16-5618.pdf","DOI":"10.18653\/v1\/W16-5618"},{"key":"2727_CR41","doi-asserted-by":"crossref","unstructured":"Waseem Z, Hovy D (2016) Hateful symbols or hateful people? Predictive features for hate speech detection on Twitter. In: Proceedings of NAACL-HLT 2016, pp 88\u201393. https:\/\/aclanthology.org\/N16-2013.pdf","DOI":"10.18653\/v1\/N16-2013"},{"key":"2727_CR42","unstructured":"Wiese H (2014) Voices of linguistic outrage: standard language constructs and the discourse on new urban dialects. Working Papers in Urban Language and Literacies 120"},{"key":"2727_CR43","doi-asserted-by":"crossref","unstructured":"Xu A et al (2021) Detoxifying language models risks marginalizing minority voices. In: Proceedings of the 2021 conference of the North American chapter of the association for computational linguistics, pp 2390\u20132397. https:\/\/arxiv.org\/pdf\/2104.06390.pdf","DOI":"10.18653\/v1\/2021.naacl-main.190"},{"key":"2727_CR44","doi-asserted-by":"publisher","DOI":"10.1515\/applirev-2024-0186","author":"H Zhu","year":"2024","unstructured":"Zhu H et al (2024) Exploring AI for intercultural communication: open conversation. Appl Linguist Rev. https:\/\/doi.org\/10.1515\/applirev-2024-0186","journal-title":"Appl Linguist Rev"}],"container-title":["AI &amp; SOCIETY"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-025-02727-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00146-025-02727-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-025-02727-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T03:58:02Z","timestamp":1777348682000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00146-025-02727-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,6]]},"references-count":48,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2026,4]]}},"alternative-id":["2727"],"URL":"https:\/\/doi.org\/10.1007\/s00146-025-02727-7","relation":{},"ISSN":["0951-5666","1435-5655"],"issn-type":[{"value":"0951-5666","type":"print"},{"value":"1435-5655","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,6]]},"assertion":[{"value":"9 May 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 October 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 November 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}