{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T06:13:42Z","timestamp":1782800022571,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":83,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,8,8]],"date-time":"2023-08-08T00:00:00Z","timestamp":1691452800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,8,8]]},"DOI":"10.1145\/3600211.3604666","type":"proceedings-article","created":{"date-parts":[[2023,8,29]],"date-time":"2023-08-29T18:41:37Z","timestamp":1693334497000},"page":"542-553","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["Evaluating Biased Attitude Associations of Language Models in an Intersectional Context"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8637-8685","authenticated-orcid":false,"given":"Shiva","family":"Omrani Sabbaghi","sequence":"first","affiliation":[{"name":"Department of Computer Science, George Washington University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7133-695X","authenticated-orcid":false,"given":"Robert","family":"Wolfe","sequence":"additional","affiliation":[{"name":"Information School, University of Washington, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7154-8629","authenticated-orcid":false,"given":"Aylin","family":"Caliskan","sequence":"additional","affiliation":[{"name":"Information School, University of Washington, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,8,29]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Evaluating the Underlying Gender Bias in Contextualized Word Embeddings. CoRR abs\/1904.08783","author":"Basta Christine","year":"2019","unstructured":"Christine Basta, Marta\u00a0Ruiz Costa-juss\u00e0, and Noe Casas. 2019. Evaluating the Underlying Gender Bias in Contextualized Word Embeddings. CoRR abs\/1904.08783 (2019). arxiv:1904.08783http:\/\/arxiv.org\/abs\/1904.08783"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03204403"},{"key":"e_1_3_2_1_3_1","volume-title":"A neural probabilistic language model. The journal of machine learning research 3","author":"Bengio Yoshua","year":"2003","unstructured":"Yoshua Bengio, R\u00e9jean Ducharme, Pascal Vincent, and Christian Janvin. 2003. A neural probabilistic language model. The journal of machine learning research 3 (2003), 1137\u20131155."},{"key":"e_1_3_2_1_4_1","volume-title":"Multimodal datasets: misogyny, pornography, and malignant stereotypes. arXiv preprint arXiv:2110.01963","author":"Birhane Abeba","year":"2021","unstructured":"Abeba Birhane, Vinay\u00a0Uday Prabhu, and Emmanuel Kahembwe. 2021. Multimodal datasets: misogyny, pornography, and malignant stereotypes. arXiv preprint arXiv:2110.01963 (2021)."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","unstructured":"Sid Black Leo Gao Phil Wang Connor Leahy and Stella Biderman. 2021. GPT-Neo: Large Scale Autoregressive Language Modeling with Mesh-Tensorflow. https:\/\/doi.org\/10.5281\/zenodo.5297715","DOI":"10.5281\/zenodo.5297715"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Piotr Bojanowski Edouard Grave Armand Joulin and Tomas Mikolov. 2017. Enriching Word Vectors with Subword Information. arxiv:1607.04606\u00a0[cs.CL]","DOI":"10.1162\/tacl_a_00051"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/3157382.3157584"},{"key":"e_1_3_2_1_8_1","unstructured":"Margaret\u00a0M. Bradley and Peter\u00a0J. Lang. 1999. Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings."},{"key":"e_1_3_2_1_9_1","volume-title":"Advances in Neural Information Processing Systems, H.\u00a0Larochelle, M.\u00a0Ranzato, R.\u00a0Hadsell, M.\u00a0F. Balcan, and H.\u00a0Lin (Eds.). Vol.\u00a033. Curran Associates","author":"Brown Tom","year":"1877","unstructured":"Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared\u00a0D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Advances in Neural Information Processing Systems, H.\u00a0Larochelle, M.\u00a0Ranzato, R.\u00a0Hadsell, M.\u00a0F. Balcan, and H.\u00a0Lin (Eds.). Vol.\u00a033. Curran Associates, Inc., 1877\u20131901. https:\/\/proceedings.neurips.cc\/paper\/2020\/file\/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf"},{"key":"e_1_3_2_1_10_1","volume-title":"Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC\u201914)","author":"Buck Christian","year":"2014","unstructured":"Christian Buck, Kenneth Heafield, and Bas Van\u00a0Ooyen. 2014. N-gram counts and language models from the common crawl. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC\u201914). 3579\u20133584."},{"key":"e_1_3_2_1_11_1","volume-title":"Detecting and mitigating bias in natural language processing. Brookings Institution","author":"Caliskan Aylin","year":"2021","unstructured":"Aylin Caliskan. 2021. Detecting and mitigating bias in natural language processing. Brookings Institution (2021)."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.aal4230"},{"key":"e_1_3_2_1_13_1","unstructured":"Aylin Caliskan and Molly Lewis. [n.d.]. Social biases in word embeddings and their relation to human cognition. ([n. d.])."},{"key":"e_1_3_2_1_14_1","unstructured":"Jamie Callan Mark Hoy Changkuk Yoo and Le Zhao. 2009. Clueweb09 data set."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2121798119"},{"key":"e_1_3_2_1_16_1","volume-title":"Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Models. arxiv:2305.18189\u00a0[cs.CL]","author":"Cheng Myra","year":"2023","unstructured":"Myra Cheng, Esin Durmus, and Dan Jurafsky. 2023. Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Models. arxiv:2305.18189\u00a0[cs.CL]"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1177\/0146167289154008"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1080\/14792779543000002"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1471-6402.1991.tb00792.x"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1006\/jesp.1994.1006"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1"},{"key":"e_1_3_2_1_23_1","volume-title":"The Pile: An 800GB Dataset of Diverse Text for Language Modeling. arXiv preprint arXiv:2101.00027","author":"Gao Leo","year":"2020","unstructured":"Leo Gao, Stella Biderman, Sid Black, Laurence Golding, Travis Hoppe, Charles Foster, Jason Phang, Horace He, Anish Thite, Noa Nabeshima, 2020. The Pile: An 800GB Dataset of Diverse Text for Language Modeling. arXiv preprint arXiv:2101.00027 (2020)."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1720347115"},{"key":"e_1_3_2_1_25_1","volume-title":"ChatGPT Perpetuates Gender Bias in Machine Translation and Ignores Non-Gendered Pronouns: Findings across Bengali and Five other Low-Resource Languages. arXiv preprint arXiv:2305.10510","author":"Ghosh Sourojit","year":"2023","unstructured":"Sourojit Ghosh and Aylin Caliskan. 2023. ChatGPT Perpetuates Gender Bias in Machine Translation and Ignores Non-Gendered Pronouns: Findings across Bengali and Five other Low-Resource Languages. arXiv preprint arXiv:2305.10510 (2023)."},{"key":"e_1_3_2_1_26_1","unstructured":"Aaron Gokaslan and Vanya Cohen. 2019. OpenWebText Corpus. http:\/\/Skylion007.github.io\/OpenWebTextCorpus."},{"key":"e_1_3_2_1_27_1","volume-title":"Proceedings of NAACL-HLT.","author":"Gonen Hila","year":"2019","unstructured":"Hila Gonen and Yoav Goldberg. 2019. Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Them. In Proceedings of NAACL-HLT."},{"key":"e_1_3_2_1_28_1","volume-title":"Measuring individual differences in implicit cognition: the implicit association test.Journal of personality and social psychology 74, 6","author":"Greenwald G","year":"1998","unstructured":"Anthony\u00a0G Greenwald, Debbie\u00a0E McGhee, and Jordan\u00a0LK Schwartz. 1998. Measuring individual differences in implicit cognition: the implicit association test.Journal of personality and social psychology 74, 6 (1998), 1464."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462536"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1141"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1093\/geronj\/49.4.P149"},{"key":"e_1_3_2_1_32_1","volume-title":"Hogg and Dominic Abrams","author":"A.","year":"2007","unstructured":"Michael\u00a0A. Hogg and Dominic Abrams. 2007. Social cognition and attitudes. In Psychology. Third Edition, G.\u00a0Neil Martin, Neil\u00a0R. Carlson, and William Buskist (Eds.). Pearson Education Limited, 684\u2013721. https:\/\/kar.kent.ac.uk\/23659\/"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.2307\/1420326"},{"key":"e_1_3_2_1_34_1","volume-title":"Principal component analysis","author":"Jolliffe T.","unstructured":"I.\u00a0T. Jolliffe. 1986. Principal component analysis. Springer-Verlag, New York."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1177\/0003122419877135"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Keita Kurita Nidhi Vyas Ayush Pareek Alan\u00a0W Black and Yulia Tsvetkov. 2019. Measuring Bias in Contextualized Word Representations. arxiv:1906.07337\u00a0[cs.CL]","DOI":"10.18653\/v1\/W19-3823"},{"key":"e_1_3_2_1_37_1","volume-title":"Albert: A lite bert for self-supervised learning of language representations. arXiv preprint arXiv:1909.11942","author":"Lan Zhenzhong","year":"2019","unstructured":"Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. 2019. Albert: A lite bert for self-supervised learning of language representations. arXiv preprint arXiv:1909.11942 (2019)."},{"key":"e_1_3_2_1_38_1","unstructured":"Klas Leino Emily Black Matt Fredrikson Shayak Sen and Anupam Datta. 2019. Feature-Wise Bias Amplification. arxiv:1812.08999\u00a0[cs.LG]"},{"key":"e_1_3_2_1_39_1","volume-title":"Gender stereotypes are reflected in the distributional structure of 25 languages. Nature human behaviour 4, 10","author":"Lewis Molly","year":"2020","unstructured":"Molly Lewis and Gary Lupyan. 2020. Gender stereotypes are reflected in the distributional structure of 25 languages. Nature human behaviour 4, 10 (2020), 1021\u20131028."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.488"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.5555\/2390470.2390499"},{"key":"e_1_3_2_1_42_1","volume-title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR abs\/1907.11692","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR abs\/1907.11692 (2019). arxiv:1907.11692http:\/\/arxiv.org\/abs\/1907.11692"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1062"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1063"},{"key":"e_1_3_2_1_45_1","volume-title":"An approach to environmental psychology","author":"Mehrabian Albert","year":"1974","unstructured":"Albert Mehrabian and James\u00a0A. Russell. 1974. An approach to environmental psychology. The MIT Press, Cambridge, MA, US. xii, 266 pages. ID: 1974-22049-000."},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3594109"},{"key":"e_1_3_2_1_47_1","volume-title":"Proceedings of the International Conference on Language Resources and Evaluation (LREC","author":"Mikolov Tomas","year":"2018","unstructured":"Tomas Mikolov, Edouard Grave, Piotr Bojanowski, Christian Puhrsch, and Armand Joulin. 2018. Advances in Pre-Training Distributed Word Representations. In Proceedings of the International Conference on Language Resources and Evaluation (LREC 2018)."},{"key":"e_1_3_2_1_48_1","unstructured":"Tomas Mikolov Ilya Sutskever Kai Chen Greg Corrado and Jeffrey Dean. 2013. Distributed Representations of Words and Phrases and their Compositionality. arxiv:1310.4546\u00a0[cs.CL]"},{"key":"e_1_3_2_1_49_1","volume-title":"Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics","author":"Mikolov Tomas","year":"2013","unstructured":"Tomas Mikolov, Wen-tau Yih, and Geoffrey Zweig. 2013. Linguistic Regularities in Continuous Space Word Representations. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, Atlanta, Georgia, 746\u2013751. https:\/\/aclanthology.org\/N13-1090"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1017"},{"key":"e_1_3_2_1_51_1","volume-title":"Stereoset: Measuring stereotypical bias in pretrained language models. arXiv preprint arXiv:2004.09456","author":"Nadeem Moin","year":"2020","unstructured":"Moin Nadeem, Anna Bethke, and Siva Reddy. 2020. Stereoset: Measuring stereotypical bias in pretrained language models. arXiv preprint arXiv:2004.09456 (2020)."},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514094.3534176"},{"key":"e_1_3_2_1_53_1","unstructured":"C.E. Osgood G.J. Suci and P.H. Tannenbaum. 1957. The Measurement of Meaning. University of Illinois Press. https:\/\/books.google.com\/books?id=Qj8GeUrKZdAC"},{"key":"e_1_3_2_1_54_1","volume-title":"The measurement of meaning. Univer","author":"Osgood E.","year":"1958","unstructured":"Charles\u00a0E. Osgood, George\u00a0J. Suci, and Percy\u00a0H. Tannenbaum. 1957. The measurement of meaning. Univer. Illinois Press, Oxford, England. 342 pages. ID: 1958-01561-000."},{"key":"e_1_3_2_1_55_1","volume-title":"English gigaword","author":"Parker Robert","year":"2011","unstructured":"Robert Parker, David Graff, Junbo Kong, Ke Chen, and Kazuaki Maeda. 2011. English gigaword fifth edition, linguistic data consortium. Google Scholar (2011)."},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"crossref","unstructured":"Matthew\u00a0E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee and Luke Zettlemoyer. 2018. Deep contextualized word representations. arxiv:1802.05365\u00a0[cs.CL]","DOI":"10.18653\/v1\/N18-1202"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1"},{"key":"e_1_3_2_1_59_1","unstructured":"Alec Radford and Karthik Narasimhan. 2018. Improving Language Understanding by Generative Pre-Training."},{"key":"e_1_3_2_1_60_1","unstructured":"Alec Radford Jeff Wu Rewon Child David Luan Dario Amodei and Ilya Sutskever. 2019. Language Models are Unsupervised Multitask Learners. (2019)."},{"key":"e_1_3_2_1_61_1","first-page":"1","article-title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","volume":"21","author":"Raffel Colin","year":"2020","unstructured":"Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter\u00a0J. Liu. 2020. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. Journal of Machine Learning Research 21, 140 (2020), 1\u201367. http:\/\/jmlr.org\/papers\/v21\/20-074.html","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.647"},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1339"},{"key":"e_1_3_2_1_64_1","volume-title":"Polysemy Level and Partitionability into Senses. Transactions of the Association for Computational Linguistics (TACL)","author":"Soler Aina\u00a0Gari","year":"2021","unstructured":"Aina\u00a0Gari Soler and Marianna Apidianaki. 2021. Let\u2019s Play Mono-Poly: BERT Can Reveal Words\u2019 Polysemy Level and Partitionability into Senses. Transactions of the Association for Computational Linguistics (TACL) (2021)."},{"key":"e_1_3_2_1_65_1","volume-title":"Mark\u00a0DM Leiserson, and Adam\u00a0Tauman Kalai.","author":"Swinger Nathaniel","year":"2019","unstructured":"Nathaniel Swinger, Maria De-Arteaga, Neil Thomas Heffernan\u00a0IV au2, Mark\u00a0DM Leiserson, and Adam\u00a0Tauman Kalai. 2019. What are the biases in my word embedding?arxiv:1812.08769\u00a0[cs.CL]"},{"key":"e_1_3_2_1_66_1","volume-title":"Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems","author":"Tan Yi\u00a0Chern","year":"2019","unstructured":"Yi\u00a0Chern Tan and L.\u00a0Elisa Celis. 2019. Assessing Social and Intersectional Biases in Contextualized Word Representations. In Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada, Hanna\u00a0M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d\u2019Alch\u00e9-Buc, Emily\u00a0B. Fox, and Roman Garnett (Eds.). 13209\u201313220. https:\/\/proceedings.neurips.cc\/paper\/2019\/hash\/201d546992726352471cfea6b0df0a48-Abstract.html"},{"key":"e_1_3_2_1_67_1","volume-title":"Structures of mood and personality and their relevance to assessing anxiety, with an emphasis on self-report","author":"Tellegen Auke","year":"1985","unstructured":"Auke Tellegen. 1985. Structures of mood and personality and their relevance to assessing anxiety, with an emphasis on self-report. Lawrence Erlbaum Associates, Inc, Hillsdale, NJ, US, 681\u2013706. ID: 1985-97708-037."},{"key":"e_1_3_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.372"},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"crossref","unstructured":"Autumn Toney and Aylin Caliskan. 2020. ValNorm Quantifies Semantics to Reveal Consistent Valence Biases Across Languages and Over Centuries. arxiv:2006.03950\u00a0[cs.CY]","DOI":"10.18653\/v1\/2021.emnlp-main.574"},{"key":"e_1_3_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSC50631.2021.00019"},{"key":"e_1_3_2_1_71_1","volume-title":"A simple method for commonsense reasoning. arXiv preprint arXiv:1806.02847","author":"Trinh H","year":"2018","unstructured":"Trieu\u00a0H Trinh and Quoc\u00a0V Le. 2018. A simple method for commonsense reasoning. arXiv preprint arXiv:1806.02847 (2018)."},{"key":"e_1_3_2_1_72_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan\u00a0N Gomez \u0141ukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998\u20136008."},{"key":"e_1_3_2_1_73_1","volume-title":"Norms of valence, arousal, and dominance for 13,915 English lemmas. Behavior research methods 45, 4","author":"Warriner Amy\u00a0Beth","year":"2013","unstructured":"Amy\u00a0Beth Warriner, Victor Kuperman, and Marc Brysbaert. 2013. Norms of valence, arousal, and dominance for 13,915 English lemmas. Behavior research methods 45, 4 (2013), 1191\u20131207."},{"key":"e_1_3_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"e_1_3_2_1_75_1","doi-asserted-by":"crossref","unstructured":"Robert Wolfe and Aylin Caliskan. 2021. Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models. arxiv:2110.00672\u00a0[cs.CY]","DOI":"10.18653\/v1\/2021.emnlp-main.41"},{"key":"e_1_3_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514094.3534136"},{"key":"e_1_3_2_1_77_1","volume-title":"Detecting Emerging Associations and Behaviors With Regional and Diachronic Word Embeddings. In 2022 IEEE 16th International Conference on Semantic Computing (ICSC). IEEE, 91\u201398","author":"Wolfe Robert","year":"2022","unstructured":"Robert Wolfe and Aylin Caliskan. 2022. Detecting Emerging Associations and Behaviors With Regional and Diachronic Word Embeddings. In 2022 IEEE 16th International Conference on Semantic Computing (ICSC). IEEE, 91\u201398."},{"key":"e_1_3_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533183"},{"key":"e_1_3_2_1_79_1","volume-title":"VAST: The Valence-Assessing Semantics Test for Contextualizing Language Models","author":"Wolfe Robert","year":"2022","unstructured":"Robert Wolfe and Aylin Caliskan. 2022. VAST: The Valence-Assessing Semantics Test for Contextualizing Language Models. Association for the Advancement of Artificial Intelligence (AAAI) (2022)."},{"key":"e_1_3_2_1_80_1","volume-title":"Advances in Neural Information Processing Systems, H.\u00a0Wallach, H.\u00a0Larochelle, A.\u00a0Beygelzimer, F.\u00a0d'Alch\u00e9-Buc, E.\u00a0Fox, and R.\u00a0Garnett (Eds.). Vol.\u00a032. Curran Associates","author":"Yang Zhilin","year":"2019","unstructured":"Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ\u00a0R Salakhutdinov, and Quoc\u00a0V Le. 2019. XLNet: Generalized Autoregressive Pretraining for Language Understanding. In Advances in Neural Information Processing Systems, H.\u00a0Wallach, H.\u00a0Larochelle, A.\u00a0Beygelzimer, F.\u00a0d'Alch\u00e9-Buc, E.\u00a0Fox, and R.\u00a0Garnett (Eds.). Vol.\u00a032. Curran Associates, Inc.https:\/\/proceedings.neurips.cc\/paper\/2019\/file\/dc6a7e655d7e5840e66733e9ee67cc69-Paper.pdf"},{"key":"e_1_3_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1064"},{"key":"e_1_3_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1323"},{"key":"e_1_3_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.11"}],"event":{"name":"AIES '23: AAAI\/ACM Conference on AI, Ethics, and Society","location":"Montr\u00e9al QC Canada","acronym":"AIES '23","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence"]},"container-title":["Proceedings of the 2023 AAAI\/ACM Conference on AI, Ethics, and Society"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3600211.3604666","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3600211.3604666","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:39Z","timestamp":1750178259000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3600211.3604666"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,8]]},"references-count":83,"alternative-id":["10.1145\/3600211.3604666","10.1145\/3600211"],"URL":"https:\/\/doi.org\/10.1145\/3600211.3604666","relation":{},"subject":[],"published":{"date-parts":[[2023,8,8]]},"assertion":[{"value":"2023-08-29","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}