{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T13:33:41Z","timestamp":1773840821614,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":66,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,7,26]],"date-time":"2022-07-26T00:00:00Z","timestamp":1658793600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,7,26]]},"DOI":"10.1145\/3514094.3534176","type":"proceedings-article","created":{"date-parts":[[2022,7,27]],"date-time":"2022-07-27T22:25:13Z","timestamp":1658960713000},"page":"518-531","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Measuring Gender Bias in Word Embeddings of Gendered Languages Requires Disentangling Grammatical Gender Signals"],"prefix":"10.1145","author":[{"given":"Shiva","family":"Omrani Sabbaghi","sequence":"first","affiliation":[{"name":"George Washington University, Washington, DC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aylin","family":"Caliskan","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,7,27]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"French grammar","author":"Arragon Jean-Claude","unstructured":"Jean-Claude Arragon . 1992. French grammar ( 2 nd ed.). NTC Publishing Group , Lincolnwood (Chicago), Illinoise. Jean-Claude Arragon. 1992. French grammar (2nd ed.). NTC Publishing Group, Lincolnwood (Chicago), Illinoise.","edition":"2"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1162\/0898929052880101"},{"key":"e_1_3_2_2_3_1","volume-title":"Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC","author":"Barzegar Siamak","year":"2018","unstructured":"Siamak Barzegar , Brian Davis , Manel Zarrouk , Siegfried Handschuh , and Andre Freitas . 2018 . SemR-11: A Multi-Lingual Gold-Standard for Semantic Similarity and Relatedness for Eleven Languages . In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018). European Language Resources Association (ELRA), Miyazaki, Japan. https: \/\/www.aclweb.org\/anthology\/L18--1618 Siamak Barzegar, Brian Davis, Manel Zarrouk, Siegfried Handschuh, and Andre Freitas. 2018. SemR-11: A Multi-Lingual Gold-Standard for Semantic Similarity and Relatedness for Eleven Languages. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018). European Language Resources Association (ELRA), Miyazaki, Japan. https: \/\/www.aclweb.org\/anthology\/L18--1618"},{"key":"e_1_3_2_2_4_1","unstructured":"Giacomo Berardi Andrea Esuli and Diego Marcheggiani. 2015. Word Embeddings Go to Italy: A Comparison of Models and Training Datasets.. In IIR.  Giacomo Berardi Andrea Esuli and Diego Marcheggiani. 2015. Word Embeddings Go to Italy: A Comparison of Models and Training Datasets.. In IIR."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.4324\/9780203147214"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00051"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/3157382.3157584"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-8006"},{"key":"e_1_3_2_2_9_1","volume-title":"Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse. Association for Computational Linguistics","author":"Bosco Cristina","year":"2013","unstructured":"Cristina Bosco , Simonetta Montemagni , and Maria Simi . 2013 . Converting Italian Treebanks: Towards an Italian Stanford Dependency Treebank . In Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse. Association for Computational Linguistics , Sofia, Bulgaria, 61--69. https:\/\/aclanthology.org\/W13-2308 Cristina Bosco, Simonetta Montemagni, and Maria Simi. 2013. Converting Italian Treebanks: Towards an Italian Stanford Dependency Treebank. In Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse. Association for Computational Linguistics, Sofia, Bulgaria, 61--69. https:\/\/aclanthology.org\/W13-2308"},{"key":"e_1_3_2_2_10_1","volume-title":"Proceedings of the 2022 AAAI\/ACM Conference on AI, Ethics, and Society.","author":"Caliskan Aylin","unstructured":"Aylin Caliskan , Pimparkar Parth Ajay , Tessa Charlesworth , Robert Wolfe , and Mahzarin R. Banaji . 2022. Gender Bias in Word Embeddings: A Comprehensive Analysis of Frequency, Syntax, and Semantics . In Proceedings of the 2022 AAAI\/ACM Conference on AI, Ethics, and Society. Aylin Caliskan, Pimparkar Parth Ajay, Tessa Charlesworth, Robert Wolfe, and Mahzarin R. Banaji. 2022. Gender Bias in Word Embeddings: A Comprehensive Analysis of Frequency, Syntax, and Semantics. In Proceedings of the 2022 AAAI\/ACM Conference on AI, Ethics, and Society."},{"key":"e_1_3_2_2_11_1","volume-title":"Seman- tics derived automatically from language corpora contain human-like biases. Science 356, 6334","author":"Caliskan Aylin","year":"2017","unstructured":"Aylin Caliskan , Joanna J. Bryson , and Arvind Narayanan . 2017. Seman- tics derived automatically from language corpora contain human-like biases. Science 356, 6334 ( 2017 ), 183--186. https:\/\/doi.org\/10.1126\/science.aal4230 arXiv:https:\/\/science.sciencemag.org\/content\/356\/6334\/183.full.pdf 10.1126\/science.aal4230 Aylin Caliskan, Joanna J. Bryson, and Arvind Narayanan. 2017. Seman- tics derived automatically from language corpora contain human-like biases. Science 356, 6334 (2017), 183--186. https:\/\/doi.org\/10.1126\/science.aal4230 arXiv:https:\/\/science.sciencemag.org\/content\/356\/6334\/183.full.pdf"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"crossref","unstructured":"Aylin Caliskan and Molly Lewis. 2020. Social biases in word embeddings and their relation to human cognition. (2020).  Aylin Caliskan and Molly Lewis. 2020. Social biases in word embeddings and their relation to human cognition. (2020).","DOI":"10.31234\/osf.io\/d84kg"},{"key":"e_1_3_2_2_13_1","unstructured":"Cristian Cardellino. 2019. Spanish Billion Words Corpus and Embeddings. https: \/\/crscardellino.github.io\/SBWCE\/  Cristian Cardellino. 2019. Spanish Billion Words Corpus and Embeddings. https: \/\/crscardellino.github.io\/SBWCE\/"},{"key":"e_1_3_2_2_14_1","volume-title":"Gender Bias and Under-Representation in Natural Language Processing Across Human Languages","author":"Chen Yan","unstructured":"Yan Chen , Christopher Mahoney , Isabella Grasso , Esma Wali , Abigail Matthews , Thomas Middleton , Mariama Njie , and Jeanna Matthews . 2021. Gender Bias and Under-Representation in Natural Language Processing Across Human Languages . Association for Computing Machinery , New York, NY, USA , 24--34. https:\/\/doi. org\/10.1145\/3461702.3462530 Yan Chen, Christopher Mahoney, Isabella Grasso, Esma Wali, Abigail Matthews, Thomas Middleton, Mariama Njie, and Jeanna Matthews. 2021. Gender Bias and Under-Representation in Natural Language Processing Across Human Languages. Association for Computing Machinery, New York, NY, USA, 24--34. https:\/\/doi. org\/10.1145\/3461702.3462530"},{"key":"e_1_3_2_2_15_1","volume-title":"The Cambridge encyclopedia of language (3. ed. ed.)","author":"Crystal David","unstructured":"David Crystal . 2010. The Cambridge encyclopedia of language (3. ed. ed.) . Cambridge Univ. Press , Cambridge [u.a.]. David Crystal. 2010. The Cambridge encyclopedia of language (3. ed. ed.). Cambridge Univ. Press, Cambridge [u.a.]."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9"},{"key":"e_1_3_2_2_17_1","volume-title":"Understanding undesirable word embedding associations. arXiv preprint arXiv:1908.06361","author":"Ethayarajh Kawin","year":"2019","unstructured":"Kawin Ethayarajh , David Duvenaud , and Graeme Hirst . 2019. Understanding undesirable word embedding associations. arXiv preprint arXiv:1908.06361 ( 2019 ). Kawin Ethayarajh, David Duvenaud, and Graeme Hirst. 2019. Understanding undesirable word embedding associations. arXiv preprint arXiv:1908.06361 (2019)."},{"key":"e_1_3_2_2_18_1","volume-title":"Proceedings of the 21st Nordic Conference on Computational Linguistics. Association for Computational Linguistics","author":"Fares Murhaf","year":"2017","unstructured":"Murhaf Fares , Andrey Kutuzov , Stephan Oepen , and Erik Velldal . 2017 . Word vectors, reuse, and replicability: Towards a community repository of large-text resources . In Proceedings of the 21st Nordic Conference on Computational Linguistics. Association for Computational Linguistics , Gothenburg, Sweden, 271--276. https:\/\/www.aclweb.org\/anthology\/W17-0237 Murhaf Fares, Andrey Kutuzov, Stephan Oepen, and Erik Velldal. 2017. Word vectors, reuse, and replicability: Towards a community repository of large-text resources. In Proceedings of the 21st Nordic Conference on Computational Linguistics. Association for Computational Linguistics, Gothenburg, Sweden, 271--276. https:\/\/www.aclweb.org\/anthology\/W17-0237"},{"key":"e_1_3_2_2_19_1","volume-title":"Studies in Linguistic Analysis","author":"Firth John R.","year":"1968","unstructured":"John R. Firth . 1957. A Synopsis of Linguistic Theory 1930--1955 . In Studies in Linguistic Analysis . Philological Society , Oxford . reprinted in Palmer, F. (ed. 1968 ) Selected Papers of J. R. Firth, Longman, Harlow.. John R. Firth. 1957. A Synopsis of Linguistic Theory 1930--1955. In Studies in Linguistic Analysis. Philological Society, Oxford. reprinted in Palmer, F. (ed. 1968) Selected Papers of J. R. Firth, Longman, Harlow.."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-1809.1936.tb02137.x"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1720347115"},{"key":"e_1_3_2_2_22_1","volume-title":"Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL). Association for Computational Linguistics","author":"Gonen Hila","year":"2019","unstructured":"Hila Gonen , Yova Kementchedjhieva , and Yoav Goldberg . 2019 . How Does Gram- matical Gender Affect Noun Representations in Gender-Marking Languages? . In Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL). Association for Computational Linguistics , Hong Kong, China, 463--471. https:\/\/doi.org\/10. 18653\/v1\/K19--1043 10.18653\/v1 Hila Gonen, Yova Kementchedjhieva, and Yoav Goldberg. 2019. How Does Gram- matical Gender Affect Noun Representations in Gender-Marking Languages?. In Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL). Association for Computational Linguistics, Hong Kong, China, 463--471. https:\/\/doi.org\/10.18653\/v1\/K19--1043"},{"key":"e_1_3_2_2_23_1","volume-title":"Proceedings of the 6th Global WordNet Conference (GWC","author":"Gonzalez-Agirre Aitor","year":"2012","unstructured":"Aitor Gonzalez-Agirre , Egoitz Laparra , and German Rigau . 2012 . Multilingual Central Repository version 3.0: upgrading a very large lexical knowledge base . In Proceedings of the 6th Global WordNet Conference (GWC 2012). Matsue. Aitor Gonzalez-Agirre, Egoitz Laparra, and German Rigau. 2012. Multilingual Central Repository version 3.0: upgrading a very large lexical knowledge base. In Proceedings of the 6th Global WordNet Conference (GWC 2012). Matsue."},{"key":"e_1_3_2_2_24_1","volume-title":"Proceedings of the International Conference on Language Resources and Evaluation (LREC","author":"Grave Edouard","year":"2018","unstructured":"Edouard Grave , Piotr Bojanowski , Prakhar Gupta , Armand Joulin , and Tomas Mikolov . 2018 . Learning Word Vectors for 157 Languages . In Proceedings of the International Conference on Language Resources and Evaluation (LREC 2018). Edouard Grave, Piotr Bojanowski, Prakhar Gupta, Armand Joulin, and Tomas Mikolov. 2018. Learning Word Vectors for 157 Languages. In Proceedings of the International Conference on Language Resources and Evaluation (LREC 2018)."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.74.6.1464"},{"key":"e_1_3_2_2_26_1","first-page":"71","article-title":"Conversion et am\u00e9liorations de corpus du fran\u00e7ais annot\u00e9s en Universal Dependencies","volume":"60","author":"Guillaume Bruno","year":"2019","unstructured":"Bruno Guillaume , Marie-Catherine de Marneffe , and Guy Perrier . 2019 . Conversion et am\u00e9liorations de corpus du fran\u00e7ais annot\u00e9s en Universal Dependencies . Revue TAL 60 , 2 (2019), 71 -- 95 . https:\/\/hal.inria.fr\/hal-02267418 Bruno Guillaume, Marie-Catherine de Marneffe, and Guy Perrier. 2019. Conversion et am\u00e9liorations de corpus du fran\u00e7ais annot\u00e9s en Universal Dependencies. Revue TAL 60, 2 (2019), 71--95. https:\/\/hal.inria.fr\/hal-02267418","journal-title":"Revue TAL"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1080\/00437956.1954.11659520"},{"key":"e_1_3_2_2_28_1","volume-title":"SimLex-999: Evaluat- ing Semantic Models With (Genuine) Similarity Estimation. Computational Linguistics 41, 4 (12","author":"Hill Felix","year":"2015","unstructured":"Felix Hill , Roi Reichart , and Anna Korhonen . 2015. SimLex-999: Evaluat- ing Semantic Models With (Genuine) Similarity Estimation. Computational Linguistics 41, 4 (12 2015 ), 665--695. https:\/\/doi.org\/10.1162\/COLI_a_00237 arXiv:https:\/\/direct.mit.edu\/coli\/article-pdf\/41\/4\/665\/1807389\/coli_a_00237.pdf 10.1162\/COLI_a_00237 Felix Hill, Roi Reichart, and Anna Korhonen. 2015. SimLex-999: Evaluat- ing Semantic Models With (Genuine) Similarity Estimation. Computational Linguistics 41, 4 (12 2015), 665--695. https:\/\/doi.org\/10.1162\/COLI_a_00237 arXiv:https:\/\/direct.mit.edu\/coli\/article-pdf\/41\/4\/665\/1807389\/coli_a_00237.pdf"},{"key":"e_1_3_2_2_29_1","volume-title":"Weinberger (Eds.)","volume":"27","author":"Irsoy Ozan","year":"2014","unstructured":"Ozan Irsoy and Claire Cardie . 2014 . Deep Recursive Neural Networks for Com- positionality in Language. In Advances in Neural Information Processing Systems, Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, and K. Q . Weinberger (Eds.) , Vol. 27 . Curran Associates, Inc. , 2096--2104. https:\/\/proceedings.neurips.cc\/paper\/ 2014\/file\/2cfd4560539f887a5e420412b370b361-Paper.pdf Ozan Irsoy and Claire Cardie. 2014. Deep Recursive Neural Networks for Com- positionality in Language. In Advances in Neural Information Processing Systems, Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, and K. Q. Weinberger (Eds.), Vol. 27. Curran Associates, Inc., 2096--2104. https:\/\/proceedings.neurips.cc\/paper\/ 2014\/file\/2cfd4560539f887a5e420412b370b361-Paper.pdf"},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00065"},{"key":"e_1_3_2_2_31_1","volume-title":"Proceedings of the 11th International Conference on Computational Semantics. Association for Computational Linguistics","author":"K\u00f6per Maximilian","year":"2015","unstructured":"Maximilian K\u00f6per , Christian Scheible , and Sabine Schulte im Walde . 2015 . Multilingual Reliability and ?Semantic\" Structure of Continuous Word Spaces . In Proceedings of the 11th International Conference on Computational Semantics. Association for Computational Linguistics , London, UK, 40--45. https: \/\/www.aclweb.org\/anthology\/W15-0105 Maximilian K\u00f6per, Christian Scheible, and Sabine Schulte im Walde. 2015. Multilingual Reliability and ?Semantic\" Structure of Continuous Word Spaces. In Proceedings of the 11th International Conference on Computational Semantics. Association for Computational Linguistics, London, UK, 40--45. https: \/\/www.aclweb.org\/anthology\/W15-0105"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.langsci.2013.10.004"},{"key":"e_1_3_2_2_33_1","unstructured":"Keita Kurita Nidhi Vyas Ayush Pareek Alan W Black and Yulia Tsvetkov.  Keita Kurita Nidhi Vyas Ayush Pareek Alan W Black and Yulia Tsvetkov."},{"key":"e_1_3_2_2_34_1","volume-title":"Quantifying Social Biases in Contextual Word Representations. 1st ACL Workshop on Gender Bias for Natural Language Processing ([n. d.]). https:\/\/par.nsf.gov\/biblio\/10098355","unstructured":". Quantifying Social Biases in Contextual Word Representations. 1st ACL Workshop on Gender Bias for Natural Language Processing ([n. d.]). https:\/\/par.nsf.gov\/biblio\/10098355 . Quantifying Social Biases in Contextual Word Representations. 1st ACL Workshop on Gender Bias for Natural Language Processing ([n. d.]). https:\/\/par.nsf.gov\/biblio\/10098355"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S19-1010"},{"key":"e_1_3_2_2_36_1","unstructured":"Ira Leviant and Roi Reichart. 2015. Separated by an Un-common Lan- guage: Towards Judgment Language Informed Vector Space Modeling. arXiv:1508.00106 [cs.CL]  Ira Leviant and Roi Reichart. 2015. Separated by an Un-common Lan- guage: Towards Judgment Language Informed Vector Space Modeling. arXiv:1508.00106 [cs.CL]"},{"key":"e_1_3_2_2_37_1","volume-title":"Gender stereotypes are reflected in the distributional structure of 25 languages. Nature human behaviour 4, 10 (October","author":"Lewis Molly","year":"2020","unstructured":"Molly Lewis and Gary Lupyan . 2020. Gender stereotypes are reflected in the distributional structure of 25 languages. Nature human behaviour 4, 10 (October 2020 ), 1021-1028. https:\/\/doi.org\/10.1038\/s41562-020-0918-6 10.1038\/s41562-020-0918-6 Molly Lewis and Gary Lupyan. 2020. Gender stereotypes are reflected in the distributional structure of 25 languages. Nature human behaviour 4, 10 (October 2020), 1021-1028. https:\/\/doi.org\/10.1038\/s41562-020-0918-6"},{"key":"e_1_3_2_2_38_1","volume-title":"Grammatical Gender Influences Semantic Categorization and Implicit Cognition in Polish. Frontiers in Psychology 10","author":"Maciuszek J\u00f3zef","year":"2019","unstructured":"J\u00f3zef Maciuszek , Mateusz Polak , and Natalia ?wiatkowska. 2019. Grammatical Gender Influences Semantic Categorization and Implicit Cognition in Polish. Frontiers in Psychology 10 ( 2019 ). https:\/\/doi.org\/10.3389\/fpsyg.2019.02208 10.3389\/fpsyg.2019.02208 J\u00f3zef Maciuszek, Mateusz Polak, and Natalia ?wiatkowska. 2019. Grammatical Gender Influences Semantic Categorization and Implicit Cognition in Polish. Frontiers in Psychology 10 (2019). https:\/\/doi.org\/10.3389\/fpsyg.2019.02208"},{"key":"e_1_3_2_2_39_1","volume-title":"Maiden and Cecilia Robustelli","author":"Martin","year":"2014","unstructured":"Martin P. Maiden and Cecilia Robustelli . 2014 . A Reference Grammar of Modern Italian. Taylor & Francis . https:\/\/books.google.com\/books?id=RszKAgAAQBAJ Martin P. Maiden and Cecilia Robustelli. 2014. A Reference Grammar of Modern Italian. Taylor & Francis. https:\/\/books.google.com\/books?id=RszKAgAAQBAJ"},{"key":"e_1_3_2_2_40_1","unstructured":"Michael P Maratsos. 1979. How to get from words to sentences.  Michael P Maratsos. 1979. How to get from words to sentences."},{"key":"e_1_3_2_2_41_1","volume-title":"Proceedings of the 6th Global Wordnet Conference","author":"Maziarz Marek","year":"2012","unstructured":"Marek Maziarz , Maciej Piasecki , and Stanis\u00c5?aw Szpakowicz. 2012 . Approaching plWordNet 2.0 . In Proceedings of the 6th Global Wordnet Conference . Matsue, Japan. Marek Maziarz, Maciej Piasecki, and Stanis\u00c5?aw Szpakowicz. 2012. Approaching plWordNet 2.0. In Proceedings of the 6th Global Wordnet Conference. Matsue, Japan."},{"key":"e_1_3_2_2_42_1","unstructured":"Katherine McCurdy and Oguz Serbetci. 2020. Grammatical gender associations outweigh topical gender bias in crosslinguistic word embeddings. arXiv:2005.08864 [cs.CL]  Katherine McCurdy and Oguz Serbetci. 2020. Grammatical gender associations outweigh topical gender bias in crosslinguistic word embeddings. arXiv:2005.08864 [cs.CL]"},{"key":"e_1_3_2_2_43_1","unstructured":"Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013. Efficient Estimation of Word Representations in Vector Space. arXiv:1301.3781 [cs.CL]  Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013. Efficient Estimation of Word Representations in Vector Space. arXiv:1301.3781 [cs.CL]"},{"key":"e_1_3_2_2_44_1","volume-title":"Affective norms for French words (FAN). Behavior research methods 46, 4 (December","author":"Monnier Catherine","year":"2014","unstructured":"Catherine Monnier and Arielle Syssau . 2014. Affective norms for French words (FAN). Behavior research methods 46, 4 (December 2014 ), 1128-1137. https: \/\/doi.org\/10.3758\/s13428-013-0431-1 10.3758\/s13428-013-0431-1 Catherine Monnier and Arielle Syssau. 2014. Affective norms for French words (FAN). Behavior research methods 46, 4 (December 2014), 1128-1137. https: \/\/doi.org\/10.3758\/s13428-013-0431-1"},{"key":"e_1_3_2_2_45_1","volume-title":"The adaptation of the Affective Norms for English Words (ANEW) for Italian. Behavior research methods 46, 3 (September","author":"Montefinese Maria","year":"2014","unstructured":"Maria Montefinese , Ettore Ambrosini , Beth Fairfield , and Nicola Mammarella . 2014. The adaptation of the Affective Norms for English Words (ANEW) for Italian. Behavior research methods 46, 3 (September 2014 ), 887-903. https: \/\/doi.org\/10.3758\/s13428-013-0405-3 10.3758\/s13428-013-0405-3 Maria Montefinese, Ettore Ambrosini, Beth Fairfield, and Nicola Mammarella. 2014. The adaptation of the Affective Norms for English Words (ANEW) for Italian. Behavior research methods 46, 3 (September 2014), 887-903. https: \/\/doi.org\/10.3758\/s13428-013-0405-3"},{"key":"e_1_3_2_2_46_1","volume-title":"Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC","author":"Mykowiecka Agnieszka","year":"2018","unstructured":"Agnieszka Mykowiecka , Malgorzata Marciniak , and Piotr Rychlik . 2018 . SimLex-999 for Polish . In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Nicoletta Calzolari (Conference chair), Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Koiti Hasida, Hi- toshi Isahara, Bente Maegaard, Joseph Mariani, H\u00e9l\u00e8ne Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis, and Takenobu Tokunaga (Eds.). European Language Resources Association (ELRA), Miyazaki, Japan. Agnieszka Mykowiecka, Malgorzata Marciniak, and Piotr Rychlik. 2018. SimLex-999 for Polish. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Nicoletta Calzolari (Conference chair), Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Koiti Hasida, Hi- toshi Isahara, Bente Maegaard, Joseph Mariani, H\u00e9l\u00e8ne Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis, and Takenobu Tokunaga (Eds.). European Language Resources Association (ELRA), Miyazaki, Japan."},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"crossref","unstructured":"Eric Nalisnick Bhaskar Mitra Nick Craswell and Rich Caruana. 2016. Improving Document Ranking with Dual Word Embeddings. In Proceedings of the 25th International Conference Companion on World Wide Web (Montr\u00e9al Qu\u00e9bec Canada) (WWW '16 Companion). International World Wide Web Conferences Steering Committee Republic and Canton of Geneva CHE 83--84. https:\/\/doi. org\/10.1145\/2872518.2889361  Eric Nalisnick Bhaskar Mitra Nick Craswell and Rich Caruana. 2016. Improving Document Ranking with Dual Word Embeddings. In Proceedings of the 25th International Conference Companion on World Wide Web (Montr\u00e9al Qu\u00e9bec Canada) (WWW '16 Companion). International World Wide Web Conferences Steering Committee Republic and Canton of Geneva CHE 83--84. https:\/\/doi. org\/10.1145\/2872518.2889361","DOI":"10.1145\/2872518.2889361"},{"key":"e_1_3_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0809921106"},{"key":"e_1_3_2_2_49_1","volume-title":"The Bias of Crowds: How Implicit Bias Bridges Personal and Systemic Prejudice. Psychological inquiry 28, 4","author":"Payne B. Keith","year":"2017","unstructured":"B. Keith Payne , Heidi A Vuletich , and Kristjen B Lundberg . 2017. The Bias of Crowds: How Implicit Bias Bridges Personal and Systemic Prejudice. Psychological inquiry 28, 4 ( 2017 ), 233--248. B. Keith Payne, Heidi A Vuletich, and Kristjen B Lundberg. 2017. The Bias of Crowds: How Implicit Bias Bridges Personal and Systemic Prejudice. Psychological inquiry 28, 4 (2017), 233--248."},{"key":"e_1_3_2_2_50_1","volume-title":"A Word- net from the Ground Up","author":"Piasecki Maciej","unstructured":"Maciej Piasecki , Stan Szpakowicz , and Bartosz Broda . 2009. A Word- net from the Ground Up . Wroclaw University of Technology Press . http:\/\/www.plwordnet.pwr.wroc.pl\/main\/content\/files\/publications\/A_ Wordnet_from_the_Ground_Up.pdf (ISBN 978-83-7493-476-3). Maciej Piasecki, Stan Szpakowicz, and Bartosz Broda. 2009. A Word- net from the Ground Up. Wroclaw University of Technology Press. http:\/\/www.plwordnet.pwr.wroc.pl\/main\/content\/files\/publications\/A_ Wordnet_from_the_Ground_Up.pdf (ISBN 978-83-7493-476-3)."},{"key":"e_1_3_2_2_51_1","unstructured":"Ewa Rudnicka Marek Maziarz Maciej Piasecki and Stanis\u00c5law Szpakowicz. 2012. Mapping plWordNet onto Princeton WordNet. (2012).  Ewa Rudnicka Marek Maziarz Maciej Piasecki and Stanis\u00c5law Szpakowicz. 2012. Mapping plWordNet onto Princeton WordNet. (2012)."},{"key":"e_1_3_2_2_52_1","volume-title":"Proceedings of the Sixth International Language Resources and Evaluation (LREC'08)","author":"Sagot Beno\u00eet","year":"2008","unstructured":"Beno\u00eet Sagot and Darja Fi?er. 2008 . Building a free French wordnet from multilin- gual resources . In Proceedings of the Sixth International Language Resources and Evaluation (LREC'08) , European Language Resources Association (ELRA) (Ed.). Marrakech, Morocco. Beno\u00eet Sagot and Darja Fi?er. 2008. Building a free French wordnet from multilin- gual resources. In Proceedings of the Sixth International Language Resources and Evaluation (LREC'08), European Language Resources Association (ELRA) (Ed.). Marrakech, Morocco."},{"key":"e_1_3_2_2_53_1","volume-title":"Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)","author":"Taul\u00e9 Mariona","year":"2008","unstructured":"Mariona Taul\u00e9 , M. Ant\u00f2nia Mart\u00ed , and Marta Recasens . 2008 . AnCora: Multilevel Annotated Corpora for Catalan and Spanish . In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08) . European Language Resources Association (ELRA), Marrakech, Morocco. http:\/\/www.lrec- conf.org\/proceedings\/lrec 2008\/pdf\/35_paper.pdf Mariona Taul\u00e9, M. Ant\u00f2nia Mart\u00ed, and Marta Recasens. 2008. AnCora: Multilevel Annotated Corpora for Catalan and Spanish. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08). European Language Resources Association (ELRA), Marrakech, Morocco. http:\/\/www.lrec- conf.org\/proceedings\/lrec2008\/pdf\/35_paper.pdf"},{"key":"e_1_3_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-020-0924-8"},{"key":"#cr-split#-e_1_3_2_2_55_1.1","unstructured":"Autumn Toney-Wails and Aylin Caliskan. 2020. ValNorm Quantifies Semantics to Reveal Consistent Valence Biases Across Languages and Over Centuries. (2020). https:\/\/doi.org\/10.48550\/ARXIV.2006.03950 10.48550\/ARXIV.2006.03950"},{"key":"#cr-split#-e_1_3_2_2_55_1.2","doi-asserted-by":"crossref","unstructured":"Autumn Toney-Wails and Aylin Caliskan. 2020. ValNorm Quantifies Semantics to Reveal Consistent Valence Biases Across Languages and Over Centuries. (2020). https:\/\/doi.org\/10.48550\/ARXIV.2006.03950","DOI":"10.18653\/v1\/2021.emnlp-main.574"},{"key":"e_1_3_2_2_56_1","volume-title":"Proceedings of the 5th International Conference of the Global WordNet Association (GWC-2010)","author":"Toral Antonio","year":"2010","unstructured":"Antonio Toral , Stefania Bracale , Monica Monachini , and Claudia Soria . 2010 . Rejuvenating the Italian WordNet: upgrading, standardising, extending . In Proceedings of the 5th International Conference of the Global WordNet Association (GWC-2010) . Mumbai. Antonio Toral, Stefania Bracale, Monica Monachini, and Claudia Soria. 2010. Rejuvenating the Italian WordNet: upgrading, standardising, extending. In Proceedings of the 5th International Conference of the Global WordNet Association (GWC-2010). Mumbai."},{"key":"e_1_3_2_2_57_1","volume-title":"Estimation of Dependences Based on Empirical Data","author":"Vapnik Vladimir","unstructured":"Vladimir Vapnik . 2006. Estimation of Dependences Based on Empirical Data . Springer New York . https:\/\/library.biblioboard.com\/viewer\/e50b6ad4-bee2--11ea-82fc-0a28bb48d135 Vladimir Vapnik. 2006. Estimation of Dependences Based on Empirical Data. Springer New York. https:\/\/library.biblioboard.com\/viewer\/e50b6ad4-bee2--11ea-82fc-0a28bb48d135"},{"key":"e_1_3_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-6020"},{"key":"e_1_3_2_2_59_1","volume-title":"Emily Umansky, Mahzarin R Banaji, Nicole Lofaro, Colin Smith, Jordan Axt, and et al.","author":"Xu Kaiyuan","year":"2021","unstructured":"Kaiyuan Xu , Brian A Nosek , Anthony G Greenwald , Kate A Ratliff , Yoav Bar- Anan , Emily Umansky, Mahzarin R Banaji, Nicole Lofaro, Colin Smith, Jordan Axt, and et al. 2021 . Project Implicit Demo Website Datasets . https:\/\/doi.org\/10. 17605\/OSF.IO\/Y9HIQ Kaiyuan Xu, Brian A Nosek, Anthony G Greenwald, Kate A Ratliff, Yoav Bar- Anan, Emily Umansky, Mahzarin R Banaji, Nicole Lofaro, Colin Smith, Jordan Axt, and et al. 2021. Project Implicit Demo Website Datasets. https:\/\/doi.org\/10. 17605\/OSF.IO\/Y9HIQ"},{"key":"e_1_3_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.260"},{"key":"e_1_3_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1323"},{"key":"e_1_3_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-2003"},{"key":"e_1_3_2_2_63_1","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Zhou Pei","year":"1865","unstructured":"Pei Zhou , Weijia Shi , Jieyu Zhao , Kuan-Hao Huang , Muhao Chen , Ryan Cotterell , and Kai-Wei Chang . 2019. Examining Gender Bias in Languages with Grammatical Gender . In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) . Association for Computational Linguistics , Hong Kong , China, 5276--5284. https:\/\/doi.org\/10. 1865 3\/v1\/D19-1531 10.18653\/v1 Pei Zhou, Weijia Shi, Jieyu Zhao, Kuan-Hao Huang, Muhao Chen, Ryan Cotterell, and Kai-Wei Chang. 2019. Examining Gender Bias in Languages with Grammatical Gender. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, Hong Kong, China, 5276--5284. https:\/\/doi.org\/10.18653\/v1\/D19-1531"},{"key":"e_1_3_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1161"},{"key":"e_1_3_2_2_65_1","volume-title":"Zubin and Klaus-Michael K\u00f6pcke","author":"David","year":"1986","unstructured":"David A. Zubin and Klaus-Michael K\u00f6pcke . 1986 . Gender and Folk Taxonomy: The Indexical Relation between Grammatical and Lexical Categorization. Benjamins , 139--180. http:\/\/gateway.proquest.com\/openurl?ctx_ver=Z39.88-2003&xri:pqil:res_ver=0.2&res_id=xri:ilcs-us&rft_id=xri:ilcs:rec:abell:R02576772 David A. Zubin and Klaus-Michael K\u00f6pcke. 1986. Gender and Folk Taxonomy: The Indexical Relation between Grammatical and Lexical Categorization. Benjamins, 139--180. http:\/\/gateway.proquest.com\/openurl?ctx_ver=Z39.88-2003&xri:pqil:res_ver=0.2&res_id=xri:ilcs-us&rft_id=xri:ilcs:rec:abell:R02576772"}],"event":{"name":"AIES '22: AAAI\/ACM Conference on AI, Ethics, and Society","location":"Oxford United Kingdom","acronym":"AIES '22","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","AAAI"]},"container-title":["Proceedings of the 2022 AAAI\/ACM Conference on AI, Ethics, and Society"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514094.3534176","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3514094.3534176","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:36Z","timestamp":1750186956000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514094.3534176"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,26]]},"references-count":66,"alternative-id":["10.1145\/3514094.3534176","10.1145\/3514094"],"URL":"https:\/\/doi.org\/10.1145\/3514094.3534176","relation":{},"subject":[],"published":{"date-parts":[[2022,7,26]]},"assertion":[{"value":"2022-07-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}