{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T02:16:50Z","timestamp":1790821010412,"version":"4.1.0"},"reference-count":233,"publisher":"MIT Press","license":[{"start":{"date-parts":[[2021,8,19]],"date-time":"2021-08-19T00:00:00Z","timestamp":1629331200000},"content-version":"vor","delay-in-days":230,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,18]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Machine translation (MT) technology has facilitated our daily tasks by providing accessible shortcuts for gathering, processing, and communicating information. However, it can suffer from biases that harm users and society at large. As a relatively new field of inquiry, studies of gender bias in MT still lack cohesion. This advocates for a unified framework to ease future research. To this end, we: i) critically review current conceptualizations of bias in light of theoretical insights from related disciplines, ii) summarize previous analyses aimed at assessing gender bias in MT, iii) discuss the mitigating strategies proposed so far, and iv) point toward potential directions for future work.<\/jats:p>","DOI":"10.1162\/tacl_a_00401","type":"journal-article","created":{"date-parts":[[2021,9,20]],"date-time":"2021-09-20T15:30:25Z","timestamp":1632151825000},"page":"845-874","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":105,"title":["Gender Bias in Machine Translation"],"prefix":"10.1162","volume":"9","author":[{"given":"Beatrice","family":"Savoldi","sequence":"first","affiliation":[{"name":"University of Trento, Italy"},{"name":"Fondazione Bruno Kessler, Italy. bsavoldi@fbk.eu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marco","family":"Gaido","sequence":"additional","affiliation":[{"name":"University of Trento, Italy"},{"name":"Fondazione Bruno Kessler, Italy. mgaido@fbk.eu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luisa","family":"Bentivogli","sequence":"additional","affiliation":[{"name":"Fondazione Bruno Kessler, Italy. bentivo@fbk.eu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matteo","family":"Negri","sequence":"additional","affiliation":[{"name":"Fondazione Bruno Kessler, Italy. negri@fbk.eu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marco","family":"Turchi","sequence":"additional","affiliation":[{"name":"Fondazione Bruno Kessler, Italy. turchi@fbk.eu"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2021,8,18]]},"reference":[{"key":"2021081914590010700_bib1","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1016\/j.procs.2017.10.095","article-title":"Errors and non-errors in english-arabic machine translation of gender-bound constructs in technical texts","volume":"117","author":"Abu-Ayyash","year":"2017","journal-title":"Procedia Computer Science"},{"key":"2021081914590010700_bib2","first-page":"139","article-title":"Gender-aware reinflection using linguistically enhanced neural models","volume-title":"Proceedings of the Second Workshop on Gender Bias in Natural Language Processing","author":"Alhafni","year":"2020"},{"issue":"1","key":"2021081914590010700_bib3","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1515\/pralin-2017-0031","article-title":"Linguistically motivated vocabulary reduction for neural machine translation from Turkish to English","volume":"108","author":"Ataman","year":"2017","journal-title":"The Prague Bulletin of Mathematical Linguistics"},{"issue":"2","key":"2021081914590010700_bib4","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1111\/josl.12080","article-title":"Gender identity and lexical variation in social media","volume":"18","author":"Bamman","year":"2014","journal-title":"Journal of Sociolinguistics"},{"key":"2021081914590010700_bib5","volume-title":"Fairness and Machine Learning","author":"Barocas","year":"2019"},{"key":"2021081914590010700_bib6","doi-asserted-by":"publisher","first-page":"99","DOI":"10.18653\/v1\/2020.winlp-1.25","article-title":"Towards mitigating gender bias in a decoder-based neural machine translation model by adding contextual information","volume-title":"Proceedings of the The Fourth Widening Natural Language Processing Workshop","author":"Basta","year":"2020"},{"key":"2021081914590010700_bib7","first-page":"490","article-title":"Investigating gender adaptation for speech translation","volume-title":"Proceedings of the 23\u00e8me Conf\u00e9rence sur le Traitement Automatique des Langues Naturelles","author":"Bawden","year":"2016"},{"issue":"1","key":"2021081914590010700_bib8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1162\/coli_a_00367","article-title":"On the linguistic representational power of neural machine translation models","volume":"46","author":"Belinkov","year":"2020","journal-title":"Computational Linguistics"},{"key":"2021081914590010700_bib9","article-title":"A typology of ethical risks in language technology with an eye towards where transparent documentation might help","volume-title":"CRAASH. The future of Artificial Intelligence: Language, Ethics, Technology","author":"Bender","year":"2019"},{"key":"2021081914590010700_bib10","doi-asserted-by":"publisher","first-page":"587","DOI":"10.1162\/tacl_a_00041","article-title":"Data statements for natural language processing: Toward mitigating system bias and enabling better science","volume":"6","author":"Bender","year":"2018","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2021081914590010700_bib11","doi-asserted-by":"publisher","first-page":"610","DOI":"10.1145\/3442188.3445922","article-title":"On the dangers of stochastic parrots: Can language models be too big?","volume-title":"Proceedings of the Conference on Fairness, Accountability, and Transparency (FAccT \u201921)","author":"Bender","year":"2021"},{"key":"2021081914590010700_bib12","doi-asserted-by":"publisher","first-page":"6923","DOI":"10.18653\/v1\/2020.acl-main.619","article-title":"Gender in danger? Evaluating speech translation technology on the MuST-SHE Corpus","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Bentivogli","year":"2020"},{"key":"2021081914590010700_bib13","volume-title":"Rethinking Language and Gender Research: Theory and Practice","author":"Bergvall","year":"1996"},{"key":"2021081914590010700_bib14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.12840\/issn.2255-4165.017","article-title":"How stereotypes are shared through language: A Review and Introduction of the Social Categories and Stereotypes Communication (SCSC) framework","volume":"7","author":"Beukeboom","year":"2019","journal-title":"Review of Communication Research"},{"key":"2021081914590010700_bib15","article-title":"The underlying values of machine learning research","volume-title":"Resistance AI Workshop @ NeurIPS","author":"Birhane","year":"2020"},{"key":"2021081914590010700_bib16","unstructured":"Su Lin Blodgett. 2021. Sociolinguistically Driven Approaches for Just Natural Language Processing. Doctoral Dissertation."},{"key":"2021081914590010700_bib17","doi-asserted-by":"crossref","first-page":"5454","DOI":"10.18653\/v1\/2020.acl-main.485","article-title":"Language (technology) is power: A critical survey of \u201cbias\u201d in NLP","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Blodgett","year":"2020"},{"key":"2021081914590010700_bib18","first-page":"4349","article-title":"Man is to computer programmer as woman is to homemaker? Debiasing word embeddings","volume-title":"Proceedings of the 30th Conference on Neural Information Processing Systems (NIPS 2016)","author":"Bolukbasi","year":"2016"},{"issue":"1","key":"2021081914590010700_bib19","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1002\/ejsp.2083","article-title":"When does it hurt? Intergroup permeability moderates the link between discrimination and self-esteem","volume":"45","author":"Bourguignon","year":"2015","journal-title":"European Journal of Social Psychology"},{"issue":"1","key":"2021081914590010700_bib20","doi-asserted-by":"publisher","first-page":"36","DOI":"10.3765\/plsa.v4i1.4542","article-title":"Singular \u2018they\u2019 and novel pronouns: gender-neutral, nonbinary, or both?","volume":"4","author":"Bradley","year":"2019","journal-title":"Proceedings of the Linguistic Society of America"},{"key":"2021081914590010700_bib21","volume-title":"Geschlecht im T\u00fcrkischen: Untersuchungen zum sprachlichen Umgang mit einer sozialen Kategorie","author":"Braun","year":"2000"},{"issue":"3\u20134","key":"2021081914590010700_bib22","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1023\/A:1024404812972","article-title":"Gender-linked linguistic behavior in television interviews","volume":"49","author":"Brownlow","year":"2003","journal-title":"Sex Roles"},{"key":"2021081914590010700_bib23","first-page":"77","article-title":"Gender shades: Intersectional accuracy disparities in commercial gender classification","volume-title":"Proceedings of the 1st Conference on Fairness, Accountability and Transparency","author":"Buolamwini","year":"2018"},{"key":"2021081914590010700_bib24","volume-title":"Gender Trouble: Feminism and the Subversion of Identity","author":"Butler","year":"1990"},{"issue":"6334","key":"2021081914590010700_bib25","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1126\/science.aal4230","article-title":"Semantics derived automatically from language corpora contain human-like biases","volume":"356","author":"Caliskan","year":"2017","journal-title":"Science"},{"key":"2021081914590010700_bib26","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1017\/S0267190503000266","article-title":"Gender issues in language change","volume":"23","author":"Cameron","year":"2003","journal-title":"Annual Review of Applied Linguistics"},{"key":"2021081914590010700_bib27","volume-title":"AI Now Report 2017","author":"Campolo","year":"2017"},{"key":"2021081914590010700_bib28","doi-asserted-by":"crossref","first-page":"4568","DOI":"10.18653\/v1\/2020.acl-main.418","article-title":"Toward gender-inclusive coreference resolution","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Cao","year":"2020"},{"key":"2021081914590010700_bib29","first-page":"3735","article-title":"On context span needed for machine translation evaluation","volume-title":"Proceedings of the 12th Language Resources and Evaluation Conference","author":"Castilho","year":"2020"},{"key":"2021081914590010700_bib30","doi-asserted-by":"publisher","first-page":"101155","DOI":"10.1016\/j.csl.2020.101155","article-title":"MuST-C: A multilingual corpus for end-to-end speech translation","volume":"66","author":"Cattoni","year":"2021","journal-title":"Computer Speech & Language"},{"key":"2021081914590010700_bib31","first-page":"72","article-title":"Conversational assistants and gender stereotypes: Public perceptions and desiderata for voice personas","volume-title":"Proceedings of the Second Workshop on Gender Bias in Natural Language Processing","author":"Cercas Curry","year":"2020"},{"issue":"3","key":"2021081914590010700_bib32","doi-asserted-by":"publisher","first-page":"454","DOI":"10.1086\/494428","article-title":"Gender and the metaphorics of translation","volume":"13","author":"Chamberlain","year":"1988","journal-title":"Signs: Journal of Women in Culture and Society"},{"key":"2021081914590010700_bib33","article-title":"Bias and fairness in natural language processing","author":"Chang","year":"2019"},{"key":"2021081914590010700_bib34","doi-asserted-by":"publisher","first-page":"173","DOI":"10.18653\/v1\/W19-3824","article-title":"On measuring gender bias in translation of gender-neutral pronouns","volume-title":"Proceedings of the First Workshop on Gender Bias in Natural Language Processing","author":"Cho","year":"2019"},{"issue":"1","key":"2021081914590010700_bib35","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/s11192-018-2667-0","article-title":"Bias against research on gender bias","volume":"115","author":"Cislak","year":"2018","journal-title":"Scientometrics"},{"key":"2021081914590010700_bib36","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1023\/A:1023212225540","article-title":"Grammatical gender systems: A linguist\u2019s assessment","volume":"28","author":"Comrie","year":"1999","journal-title":"Journal of Psycholinguistic Research"},{"key":"2021081914590010700_bib37","doi-asserted-by":"publisher","DOI":"10.1093\/oxfordhb\/9780190212926.013.63","article-title":"Pronouns and gender in language","volume-title":"The Oxford Handbook of Language and Sexuality","author":"Conrod","year":"2020"},{"key":"2021081914590010700_bib38","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139166119","volume-title":"Gender","author":"Corbett","year":"1991"},{"key":"2021081914590010700_bib39","doi-asserted-by":"crossref","DOI":"10.1515\/9783110307337","volume-title":"The Expression of Gender","author":"Corbett","year":"2013"},{"key":"2021081914590010700_bib40","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1038\/s42256-019-0105-5","article-title":"An analysis of gender bias studies in natural language processing","volume":"1","author":"Costa-juss\u00e0","year":"2019","journal-title":"Nature Machine Intelligence"},{"key":"2021081914590010700_bib41","article-title":"Evaluating gender bias in speech translation","author":"Costa-juss\u00e0","year":"2020","journal-title":"arXiv preprint arXiv:2010.14465"},{"key":"2021081914590010700_bib42","first-page":"26","article-title":"Fine-tuning neural machine translation on gender-balanced datasets","volume-title":"Proceedings of the Second Workshop on Gender Bias in Natural Language Processing","author":"Costa-juss\u00e0","year":"2020"},{"key":"2021081914590010700_bib43","article-title":"Gender bias in multilingual neural machine translation: The architecture matters","author":"Costa-juss\u00e0","year":"2020","journal-title":"arXiv preprint arXiv:2012.13176"},{"key":"2021081914590010700_bib44","first-page":"4081","article-title":"GeBioToolkit: Automatic extraction of gender-balanced multilingual corpus of Wikipedia biographies","volume-title":"Proceedings of the 12th Language Resources and Evaluation Conference","author":"Costa-juss\u00e0","year":"2020"},{"key":"2021081914590010700_bib45","first-page":"565","article-title":"Classifier languages","volume-title":"The Encyclopedia of Language and Linguistics","author":"Craig","year":"1994"},{"key":"2021081914590010700_bib46","article-title":"The trouble with bias","volume-title":"Conference on Neural Information Processing Systems (NIPS) \u2013 Keynote","author":"Crawford","year":"2017"},{"key":"2021081914590010700_bib47","first-page":"139","article-title":"Demarginalizing the intersection of race and sex: A Black feminist critique of antidiscrimination doctrine, feminist theory and antiracist politics","volume":"1989","author":"Crenshaw","year":"1989","journal-title":"University of Chicago Legal Forum"},{"key":"2021081914590010700_bib48","volume-title":"Invisible Women: Exposing Data Bias in a World Designed for Men","author":"Criado-Perez","year":"2019"},{"key":"2021081914590010700_bib49","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511486913","volume-title":"Gender Shifts in the History of English","author":"Curzan","year":"2003"},{"key":"2021081914590010700_bib50","article-title":"Amazon scraps secret AI recruiting tool that showed bias against women","author":"Dastin","year":"2018"},{"key":"2021081914590010700_bib51","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/978-3-030-04390-2_1","article-title":"Introduction: The potential of gender training in the translation classroom","volume-title":"Gender Approaches in the Translation Classroom: Training the Doers","author":"De Marco","year":"2019"},{"key":"2021081914590010700_bib52","article-title":"Ethical adversaries: Towards mitigating unfairness with adversarial machine learning","volume-title":"Informal Proceedings of the Bias and Fairness in AI Workshop at ECML-PKDD (BIAS 2020)","author":"Delobelle","year":"2020"},{"key":"2021081914590010700_bib53","first-page":"79","article-title":"Semi-supervised topic modeling for gender bias discovery in English and Swedish","volume-title":"Proceedings of the Second Workshop on Gender Bias in Natural Language Processing","author":"Devinney","year":"2020"},{"key":"2021081914590010700_bib54","doi-asserted-by":"publisher","DOI":"10.4324\/9781315158938-32","article-title":"Grammatical gender and translation: A cross-linguistic overview","volume-title":"The Routledge Handbook of Translation, Feminism and Gender","author":"Di Sabato","year":"2020"},{"key":"2021081914590010700_bib55","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/11805.001.0001","volume-title":"Data Feminism","author":"D\u2019Ignazio","year":"2020"},{"key":"2021081914590010700_bib56","doi-asserted-by":"publisher","first-page":"314","DOI":"10.18653\/v1\/2020.emnlp-main.23","article-title":"Multi-dimensional gender bias classification","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Dinan","year":"2020"},{"key":"2021081914590010700_bib57","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1145\/2090236.2090255","article-title":"Fairness through awareness","volume-title":"Proceedings of the 3rd Innovations in Theoretical Computer Science Conference, ITCS \u201912","author":"Dwork","year":"2012"},{"key":"2021081914590010700_bib58","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139245883","volume-title":"Language and Gender","author":"Eckert","year":"2013"},{"key":"2021081914590010700_bib59","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/ICNLSP.2018.8374387","article-title":"Gender aware spoken language translation applied to English-Arabic","volume-title":"Proceedings of the 2nd International Conference on Natural Language and Speech Processing (ICNLSP)","author":"Elaraby","year":"2018"},{"issue":"2","key":"2021081914590010700_bib60","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1525\/ae.1998.25.2.267","article-title":"Coming to terms with Navajo n\u00e1dleeh\u00ed: A critique of berdache, \u201cgay\u201d, \u201calternate gender\u201d, and \u201ctwo-spirit\u201d","volume":"25","author":"Epple","year":"1998","journal-title":"American Ethnologist"},{"key":"2021081914590010700_bib61","doi-asserted-by":"publisher","DOI":"10.1525\/ae.1998.25.2.267","article-title":"Multilingual machine translation: Closing the gap between shared and language-specific encoder-decoders","volume-title":"Proceedings of the 16th conference of the European Chapter of the Association for Computational Linguistics (EACL)","author":"Escolano","year":"2021"},{"key":"2021081914590010700_bib62","doi-asserted-by":"publisher","first-page":"147","DOI":"10.18653\/v1\/W19-3821","article-title":"Equalizing gender bias in neural machine translation with word embeddings techniques","volume-title":"Proceedings of the First Workshop on Gender Bias in Natural Language Processing","author":"Escud\u00e9 Font","year":"2019"},{"issue":"4\u20135","key":"2021081914590010700_bib63","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1080\/00224499.2019.1581883","article-title":"Gender\/sex, sexual orientation, and identity are in the body: How did they get there?","volume":"56","author":"Fausto-Sterling","year":"2019","journal-title":"The Journal of Sex Research"},{"key":"2021081914590010700_bib64","article-title":"Gender issues in machine translation","author":"Frank","year":"2004"},{"issue":"3","key":"2021081914590010700_bib65","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1017\/S1351324918000074","article-title":"Assessing multilingual multimodal image description: Studies of native speaker preferences and translator choices","volume":"24","author":"Frank","year":"2018","journal-title":"Natural Language Engineering"},{"issue":"3","key":"2021081914590010700_bib66","doi-asserted-by":"publisher","first-page":"330","DOI":"10.1145\/230538.230561","article-title":"Bias in computer systems","volume":"14","author":"Friedman","year":"1996","journal-title":"ACM Transactions on Information Systems (TOIS)"},{"key":"2021081914590010700_bib67","doi-asserted-by":"crossref","first-page":"3951","DOI":"10.18653\/v1\/2020.coling-main.350","article-title":"Breeding gender-aware direct speech translation systems","volume-title":"Proceedings of the 28th International Conference on Computational Linguistics","author":"Gaido","year":"2020"},{"key":"2021081914590010700_bib68","doi-asserted-by":"publisher","first-page":"3493","DOI":"10.18653\/v1\/P19-1339","article-title":"Women\u2019s syntactic resilience and men\u2019s grammatical luck: Gender-bias in part-of-speech tagging and dependency parsing","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Garimella","year":"2019"},{"key":"2021081914590010700_bib69","doi-asserted-by":"publisher","DOI":"10.1093\/oxfordhb\/9780190067397.013.16","article-title":"Race and gender","volume-title":"The Oxford Handbook of Ethics of AI","author":"Gebru","year":"2020"},{"issue":"11","key":"2021081914590010700_bib70","doi-asserted-by":"publisher","first-page":"665","DOI":"10.1038\/s42256-020-00257-z","article-title":"Shortcut learning in deep neural networks","volume":"2","author":"Geirhos","year":"2020","journal-title":"Nature Machine Intelligence"},{"key":"2021081914590010700_bib71","doi-asserted-by":"publisher","first-page":"1161","DOI":"10.18653\/v1\/D19-1107","article-title":"Are we modeling the task or the annotator? An investigation of annotator bias in natural language understanding datasets","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Geva","year":"2019"},{"key":"2021081914590010700_bib72","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/9302.001.0001","volume-title":"Raw Data is an Oxymoron","author":"Gitelman","year":"2013"},{"key":"2021081914590010700_bib73","article-title":"Measuring gender identity","author":"Glen","year":"2012"},{"key":"2021081914590010700_bib74","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1145\/3287560.3287573","article-title":"Measuring the biases that matter: The ethical and casual foundations for measures of fairness in algorithms","volume-title":"Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT* \u201919","author":"Glymour","year":"2019"},{"key":"2021081914590010700_bib75","article-title":"Intrinsic bias metrics do not correlate with application bias","author":"Goldfarb-Tarrant","year":"2020","journal-title":"arXiv preprint arXiv:2012.15859"},{"issue":"1","key":"2021081914590010700_bib76","first-page":"5","article-title":"The (un)equal treatment of women in language: A comparative study of Danish, English, and German","volume":"5","author":"Gomard","year":"1995","journal-title":"Working Papers on Language, Gender and Sexism"},{"key":"2021081914590010700_bib77","first-page":"609","article-title":"Lipstick on a pig: Debiasing methods cover up systematic gender biases in word embeddings but do not remove them","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Gonen","year":"2019"},{"key":"2021081914590010700_bib78","doi-asserted-by":"publisher","first-page":"1991","DOI":"10.18653\/v1\/2020.findings-emnlp.180","article-title":"Automatically identifying gender issues in machine translation using perturbations","volume-title":"Findings of the Association for Computational Linguistics: EMNLP 2020","author":"Gonen","year":"2020"},{"issue":"6","key":"2021081914590010700_bib79","doi-asserted-by":"publisher","first-page":"1464","DOI":"10.1037\/0022-3514.74.6.1464","article-title":"Measuring individual differences in implicit cognition: The implicit association test.","volume":"74","author":"Greenwald","year":"1998","journal-title":"Journal of Personality and Social Psychology"},{"key":"2021081914590010700_bib80","first-page":"1","article-title":"Improving pronoun translation for statistical machine translation","volume-title":"Proceedings of the Student Research Workshop at the 13th Conference of the European Chapter of the Association for Computational Linguistics","author":"Guillou","year":"2012"},{"key":"2021081914590010700_bib81","doi-asserted-by":"publisher","first-page":"1604","DOI":"10.3389\/fpsyg.2019.01604","article-title":"A language index of grammatical gender dimensions to study the impact of grammatical gender on the way we perceive women and men","volume":"10","author":"Gygax","year":"2019","journal-title":"Frontiers in Psychology"},{"key":"2021081914590010700_bib82","doi-asserted-by":"publisher","first-page":"464","DOI":"10.1080\/01690960701702035","article-title":"Generically intended, but specifically interpreted: When beauticians, musicians and mechanics are all men","volume":"23","author":"Gygax","year":"2008","journal-title":"Language and Cognitive Processes"},{"key":"2021081914590010700_bib83","doi-asserted-by":"publisher","first-page":"155","DOI":"10.18653\/v1\/W19-3822","article-title":"Automatic gender identification and reinflection in Arabic","volume-title":"Proceedings of the First Workshop on Gender Bias in Natural Language Processing","author":"Habash","year":"2019"},{"issue":"4","key":"2021081914590010700_bib84","doi-asserted-by":"crossref","first-page":"1143","DOI":"10.54648\/COLA2018095","article-title":"Teaching fairness to artificial intelligence: Existing and novel strategies against algorithmic discrimination under EU law","volume":"55","author":"Hacker","year":"2018","journal-title":"Common market law review"},{"key":"2021081914590010700_bib85","first-page":"228","article-title":"Shifting gender positions among Hindi-speaking hijras","author":"Hall","year":"2014","journal-title":"Rethinking language and gender research: Theory and practice"},{"key":"2021081914590010700_bib86","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3173574.3173582","article-title":"Gender recognition or gender reductionism? The social implications of embedded gender recognition systems","volume-title":"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI \u201918","author":"Hamidi","year":"2018"},{"issue":"11\u201312","key":"2021081914590010700_bib87","doi-asserted-by":"publisher","first-page":"785","DOI":"10.1007\/BF00288993","article-title":"Using masculine generics: Does generic he increase male bias in the user\u2019s imagery?","volume":"19","author":"Hamilton","year":"1988","journal-title":"Sex Roles"},{"issue":"3","key":"2021081914590010700_bib88","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1111\/j.1471-6402.1991.tb00415.x","article-title":"Masculine bias in the attribution of personhood: People = male, male = people","volume":"15","author":"Hamilton","year":"1991","journal-title":"Psychology of Women Quarterly"},{"key":"2021081914590010700_bib89","first-page":"560","article-title":"Towards accountability for machine learning datasets","volume-title":"Proceedings of the Conference on Fairness, Accountability, and Transparency (FAccT \u201921)","author":"Hanna","year":"2021"},{"key":"2021081914590010700_bib90","article-title":"How to write a bias statement: Recommendations for submissions to the workshop on gender bias in NLP","author":"Hardmeier","year":"2021","journal-title":"arXiv preprint arXiv:2104.03026"},{"key":"2021081914590010700_bib91","first-page":"283","article-title":"Modelling pronominal anaphora in statistical machine translation","volume-title":"Proceedings of the seventh International Workshop on Spoken Language Translation (IWSLT)","author":"Hardmeier","year":"2010"},{"key":"2021081914590010700_bib92","first-page":"107","article-title":"Situated data, situated systems: A methodology to engage with power relations in natural language processing research","volume-title":"Proceedings of the Second Workshop on Gender Bias in Natural Language Processing","author":"Havens","year":"2020"},{"key":"2021081914590010700_bib93","doi-asserted-by":"publisher","DOI":"10.1075\/impact.9.05hel","volume-title":"Gender across Languages: The Linguistic Representation of Women and Men","author":"Hellinger","year":"2001"},{"key":"2021081914590010700_bib94","doi-asserted-by":"publisher","DOI":"10.1075\/impact.10.05hel","volume-title":"Gender across Languages: The Linguistic Representation of Women and Men","author":"Hellinger","year":"2002"},{"key":"2021081914590010700_bib95","doi-asserted-by":"publisher","DOI":"10.1075\/impact.11.05hel","volume-title":"Gender across Languages: The Linguistic Representation of Women and Men","author":"Hellinger","year":"2003"},{"key":"2021081914590010700_bib96","doi-asserted-by":"publisher","DOI":"10.1075\/impact.36.01hel","volume-title":"Gender Across Languages: The Linguistic Representation of Women and Men","author":"Hellinger","year":"2015"},{"key":"2021081914590010700_bib97","doi-asserted-by":"publisher","first-page":"740","DOI":"10.1007\/978-3-030-01219-9_47","article-title":"Women also snowboard: Overcoming bias in captioning model","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV)","author":"Hendricks","year":"2018"},{"key":"2021081914590010700_bib98","first-page":"45","article-title":"Distributional techniques for philosophical enquiry","volume-title":"Proceedings of the 6th Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities","author":"Herbelot","year":"2012"},{"key":"2021081914590010700_bib99","doi-asserted-by":"publisher","first-page":"8","DOI":"10.18653\/v1\/W19-3802","article-title":"Proposed taxonomy for gender bias in text: A filtering methodology for the gender generalization subtype","volume-title":"Proceedings of the First Workshop on Gender Bias in Natural Language Processing","author":"Hitti","year":"2019"},{"key":"2021081914590010700_bib100","doi-asserted-by":"publisher","DOI":"10.1002\/9780470756942","volume-title":"The Handbook of Language and Gender","author":"Holmes","year":"2003"},{"issue":"1","key":"2021081914590010700_bib101","first-page":"4","article-title":"Bucking the linguistic binary: Gender neutral language in English, Swedish, French, and German","volume":"3","author":"Hord","year":"2016","journal-title":"Western Papers in Linguistics \/ Cahiers linguistiques de Western"},{"key":"2021081914590010700_bib102","doi-asserted-by":"publisher","first-page":"1686","DOI":"10.18653\/v1\/2020.acl-main.154","article-title":"\u201cYou sound just like your father\u201d: Commercial machine translation systems include stylistic biases","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Hovy","year":"2020"},{"key":"2021081914590010700_bib103","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1145\/2736277.2741141","article-title":"User review sites as a resource for large-scale sociolinguistic studies","volume-title":"Proceedings of the 24th International Conference on World Wide Web, WWW \u201915","author":"Hovy","year":"2015"},{"key":"2021081914590010700_bib104","doi-asserted-by":"publisher","first-page":"591","DOI":"10.18653\/v1\/P16-2096","article-title":"The social impact of natural language processing","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)","author":"Hovy","year":"2016"},{"issue":"6","key":"2021081914590010700_bib105","doi-asserted-by":"publisher","first-page":"581","DOI":"10.1037\/0003-066X.60.6.581","article-title":"The gender similarities hypothesis","volume":"60","author":"Hyde","year":"2005","journal-title":"American Psychologist"},{"key":"2021081914590010700_bib106","doi-asserted-by":"publisher","first-page":"6525","DOI":"10.18653\/v1\/P19-1653","article-title":"Distilling translations with visual awareness","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Ive","year":"2019"},{"key":"2021081914590010700_bib107","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1145\/3442188.3445901","article-title":"Measurement and fairness","volume-title":"Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, FAccT \u201921","author":"Jacobs","year":"2021"},{"key":"2021081914590010700_bib108","doi-asserted-by":"publisher","first-page":"706","DOI":"10.1145\/3351095.3375671","article-title":"The meaning and measurement of bias: Lessons from natural language processing","volume-title":"Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, FAT* \u201920","author":"Jacobs","year":"2020"},{"key":"2021081914590010700_bib109","doi-asserted-by":"publisher","first-page":"232","DOI":"10.4159\/harvard.9780674731615.c18","article-title":"On Linguistic Aspects of Translation","volume-title":"On translation","author":"Jakobson","year":"1959"},{"key":"2021081914590010700_bib110","first-page":"17","article-title":"Interdependencies of gender and race in contextualized word embeddings","volume-title":"Proceedings of the Second Workshop on Gender Bias in Natural Language Processing","author":"Jiang","year":"2020"},{"key":"2021081914590010700_bib111","doi-asserted-by":"publisher","first-page":"103","DOI":"10.18653\/v1\/K15-1011","article-title":"Cross-lingual syntactic variation over age and gender","volume-title":"Proceedings of the Nineteenth Conference on Computational Natural Language Learning","author":"Johannsen","year":"2015"},{"key":"2021081914590010700_bib112","article-title":"AI weekly: A deep learning pioneer\u2019s teachable moment on AI bias","author":"Johnson","year":"2020"},{"key":"2021081914590010700_bib113","article-title":"A scalable approach to reducing gender bias in Google Translate","author":"Johnson","year":"2020"},{"key":"2021081914590010700_bib114","doi-asserted-by":"publisher","first-page":"8706","DOI":"10.18653\/v1\/2020.acl-main.769","article-title":"End-to-end bias mitigation by modelling biases in corpora","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Karimi Mahabadi","year":"2020"},{"issue":"CSCW","key":"2021081914590010700_bib115","doi-asserted-by":"publisher","DOI":"10.1145\/3274357","article-title":"The misgendering machines: Trans\/HCI implications of automatic gender recognition","volume":"2","author":"Keyes","year":"2018","journal-title":"Proceedings of the ACM on Human-Computer Interaction"},{"issue":"CSCW","key":"2021081914590010700_bib116","doi-asserted-by":"publisher","DOI":"10.1145\/3449113","article-title":"You keep using that word: Ways of thinking about gender in computing research","volume":"5","author":"Keyes","year":"2021","journal-title":"Proceedings of the ACM on Human-Computer Interaction"},{"key":"2021081914590010700_bib117","doi-asserted-by":"publisher","first-page":"24","DOI":"10.18653\/v1\/D19-6503","article-title":"When and why is document-level context useful in neural machine translation?","volume-title":"Proceedings of the Fourth Workshop on Discourse in Machine Translation (DiscoMT 2019)","author":"Kim","year":"2019"},{"issue":"4","key":"2021081914590010700_bib118","doi-asserted-by":"publisher","first-page":"850","DOI":"10.1111\/flan.12500","article-title":"Le fran\u00e7ais non-binaire: Linguistic forms used by non-binary speakers of French","volume":"53","author":"Knisely","year":"2020","journal-title":"Foreign Language Annals"},{"key":"2021081914590010700_bib119","first-page":"79","article-title":"Europarl: A parallel corpus for statistical machine translation","volume-title":"Proceedings of the tenth Machine Translation Summit","author":"Koehn","year":"2005"},{"key":"2021081914590010700_bib120","doi-asserted-by":"publisher","first-page":"12","DOI":"10.18653\/v1\/W17-1602","article-title":"These are not the stereotypes you are looking for: Bias and fairness in authorial gender attribution","volume-title":"Proceedings of the First ACL Workshop on Ethics in Natural Language Processing","author":"Koolen","year":"2017"},{"key":"2021081914590010700_bib121","volume-title":"A feminist dictionary","author":"Kramarae","year":"1985"},{"issue":"3","key":"2021081914590010700_bib122","doi-asserted-by":"publisher","first-page":"1397","DOI":"10.1007\/s11192-016-2192-y","article-title":"Are all researchers male? Gender misattributions in citations","volume":"110","author":"Krawczyk","year":"2017","journal-title":"Scientometrics"},{"key":"2021081914590010700_bib123","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1016\/j.jml.2007.09.003","article-title":"Processing definitional and stereotypical gender in reference resolution: Evidence from eye-movements","volume":"58","author":"Kreiner","year":"2008","journal-title":"Journal of Memory and Language"},{"key":"2021081914590010700_bib124","article-title":"Reducing gender bias in Google Translate","author":"Kuczmarski","year":"2018"},{"key":"2021081914590010700_bib125","volume-title":"Sociolinguistic Patterns","author":"Labov","year":"1972"},{"key":"2021081914590010700_bib126","article-title":"New AI tools help writers be more clear, concise and inclusive in Office and across the Web","author":"Langston","year":"2020"},{"key":"2021081914590010700_bib127","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18653\/v1\/W17-1601","article-title":"Gender as a variable in natural-language processing: Ethical considerations","volume-title":"Proceedings of the First ACL Workshop on Ethics in Natural Language Processing","author":"Larson","year":"2017"},{"key":"2021081914590010700_bib128","first-page":"252","article-title":"Aiding pronoun translation with co-reference resolution","volume-title":"Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR","author":"Le Nagard","year":"2010"},{"key":"2021081914590010700_bib129","doi-asserted-by":"publisher","DOI":"10.4324\/9781315158938-33","article-title":"Le pr\u00e9sident est une femme: The challenges of translating gender in UN texts","volume-title":"The Routledge Handbook of Translation, Feminism and Gender","author":"Lessinger","year":"2020"},{"issue":"1","key":"2021081914590010700_bib130","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1016\/j.artint.2014.03.007","article-title":"On our best behaviour","volume":"212","author":"Levesque","year":"2014","journal-title":"Artificial Intelligence"},{"key":"2021081914590010700_bib131","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4419-1695-2_602","volume-title":"Sex Roles and Gender Roles","author":"Levesque","year":"2011"},{"issue":"10","key":"2021081914590010700_bib132","doi-asserted-by":"crossref","first-page":"1021","DOI":"10.1038\/s41562-020-0918-6","article-title":"Gender stereotypes are reflected in the distributional structure of 25 languages","volume":"4","author":"Lewis","year":"2020","journal-title":"Nature Human Behaviour"},{"key":"2021081914590010700_bib133","doi-asserted-by":"crossref","first-page":"25","DOI":"10.18653\/v1\/P18-2005","article-title":"Towards robust and privacy-preserving text representations","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)","author":"Li","year":"2018"},{"key":"2021081914590010700_bib134","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3313831.3376261","article-title":"Unmet needs and opportunities for mobile translation AI","volume-title":"Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, CHI \u201920","author":"Liebling","year":"2020"},{"issue":"1\u20132","key":"2021081914590010700_bib135","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1007\/s11199-018-0974-9","article-title":"Reducing a male bias in language? Establishing the efficiency of three different gender-fair language strategies","volume":"81","author":"Lindqvist","year":"2019","journal-title":"Sex Roles"},{"key":"2021081914590010700_bib136","first-page":"923","article-title":"OpenSubtitles2016: Extracting large parallel corpora from movie and TV Subtitles","volume-title":"Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC\u201916)","author":"Lison","year":"2016"},{"issue":"1","key":"2021081914590010700_bib137","doi-asserted-by":"publisher","first-page":"708","DOI":"10.18549\/PharmPract.2016.01.708","article-title":"Women\u2019s involvement in clinical trials: Historical perspective and future implications","volume":"14","author":"Liu","year":"2016","journal-title":"Pharmacy Practice"},{"key":"2021081914590010700_bib138","article-title":"T\u00fa, yo, elle y el lenguaje no binario","author":"L\u00f3pez","year":"2019"},{"key":"2021081914590010700_bib139","article-title":"Visibilizar o interpretar: Respuesta al Informe de la Real Academia Espaola sobre el lenguaje inclusivo y cuestiones conexas","author":"L\u00f3pez","year":"2020"},{"key":"2021081914590010700_bib140","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1007\/978-3-030-62077-6_14","article-title":"Gender bias in neural natural language processing","volume-title":"Logic, Language, and Security","author":"Lu","year":"2020"},{"key":"2021081914590010700_bib141","volume-title":"Semantics","author":"Lyons","year":"1977"},{"key":"2021081914590010700_bib142","doi-asserted-by":"publisher","first-page":"615","DOI":"10.18653\/v1\/N19-1062","article-title":"Black is to criminal as caucasian is to police: Detecting and removing multiclass bias in word embeddings","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Manzini","year":"2019"},{"key":"2021081914590010700_bib143","first-page":"13","article-title":"Fluency over adequacy: A pilot study in measuring user trust in imperfect MT","volume-title":"Proceedings of the 13th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track)","author":"Martindale","year":"2018"},{"key":"2021081914590010700_bib144","article-title":"Deconstructing gender prediction in NLP","volume-title":"Conference on Neural Information Processing Systems (NIPS) \u2013 Keynote","author":"May","year":"2019"},{"key":"2021081914590010700_bib145","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1515\/9783110307337.3","article-title":"Gender and its relation to sex: The myth of \u2018natural\u2019 gender","volume-title":"The Expression of Gender","author":"McConnell-Ginet","year":"2013"},{"key":"2021081914590010700_bib146","doi-asserted-by":"publisher","first-page":"3428","DOI":"10.18653\/v1\/P19-1334","article-title":"Right for the wrong reasons: Diagnosing syntactic heuristics in natural language inference","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"McCoy","year":"2019"},{"key":"2021081914590010700_bib147","article-title":"A survey on bias and fairness in machine learning","author":"Mehrabi","year":"2019"},{"key":"2021081914590010700_bib148","doi-asserted-by":"publisher","first-page":"1102","DOI":"10.18653\/v1\/D15-1130","article-title":"Motivating personality-aware machine translation","volume-title":"Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing","author":"Mirkin","year":"2015"},{"key":"2021081914590010700_bib149","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1145\/3375627.3375832","article-title":"Diversity and inclusion metrics in subset selection","volume-title":"Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society, AIES \u201920","author":"Mitchell","year":"2020"},{"key":"2021081914590010700_bib150","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1177\/007242030002005","article-title":"Gender differences in English syntax","volume":"30","author":"Mondorf","year":"2002","journal-title":"Journal of English Linguistics"},{"key":"2021081914590010700_bib151","first-page":"411","article-title":"Questioni di genere in traduzione automatica","volume":"139","author":"Monti","year":"2017","journal-title":"Al femminile. Scritti linguistici in onore di Cristina Vallini"},{"key":"2021081914590010700_bib152","doi-asserted-by":"publisher","first-page":"457","DOI":"10.4324\/9781315158938-39","article-title":"Gender issues in machine translation: An unsolved problem?","volume-title":"The Routledge Handbook of Translation, Feminism and Gender","author":"Monti","year":"2020"},{"key":"2021081914590010700_bib153","doi-asserted-by":"publisher","first-page":"49","DOI":"10.18653\/v1\/W19-3807","article-title":"Filling gender & number gaps in neural machine translation with black-box context injection","volume-title":"Proceedings of the First Workshop on Gender Bias in Natural Language Processing","author":"Moryossef","year":"2019"},{"issue":"3","key":"2021081914590010700_bib154","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1007\/s10993-013-9300-0","article-title":"Grammatical gender as a challenge for language policy: The (im)possibility of non-heteronormative language use in German versus English","volume":"13","author":"Motschenbacher","year":"2014","journal-title":"Language policy"},{"key":"2021081914590010700_bib155","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1111\/j.1468-2958.2001.tb00778.x","article-title":"Empirical support for the gender-as-culture hypothesis","volume":"27","author":"Mulac","year":"2001","journal-title":"Human Communication Research"},{"key":"2021081914590010700_bib156","article-title":"La RAE rechaza nuevamente el lenguaje inclusivo","author":"Mundo","year":"2018"},{"key":"2021081914590010700_bib157","doi-asserted-by":"publisher","first-page":"233","DOI":"10.2307\/25606143","article-title":"Who is Takat\u0101pui? M\u0101ori language, sexuality and identity in Aotearoa\/New Zealand","author":"Murray","year":"2003","journal-title":"Anthropologica"},{"key":"2021081914590010700_bib158","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1515\/9783110864281.171","article-title":"Its strength and the beauty of it: The standardization of the third person neuter possessive in early modern English","volume-title":"Towards a Standard English","author":"Nevalainen","year":"1993"},{"issue":"3","key":"2021081914590010700_bib159","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1080\/01638530802073712","article-title":"Gender differences in language use: An analysis of 14,000 text samples","volume":"45","author":"Newman","year":"2008","journal-title":"Discourse Processes"},{"issue":"3","key":"2021081914590010700_bib160","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1162\/COLI_a_00258","article-title":"Computational sociolinguistics: A survey","volume":"42","author":"Nguyen","year":"2016","journal-title":"Computational linguistics"},{"key":"2021081914590010700_bib161","first-page":"1828","article-title":"Pre-translation for neural machine translation","volume-title":"Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers","author":"Niehues","year":"2016"},{"issue":"2","key":"2021081914590010700_bib162","doi-asserted-by":"crossref","DOI":"10.13092\/lo.11.914","article-title":"Aspects of translating gender","volume":"11","author":"Nissen","year":"2002","journal-title":"Linguistik Online"},{"issue":"2","key":"2021081914590010700_bib163","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1162\/coli_a_00379","article-title":"Fair is better than sensational: Man is to doctor as woman is to doctor","volume":"46","author":"Nissim","year":"2020","journal-title":"Computational Linguistics"},{"key":"2021081914590010700_bib164","article-title":"The algorithm that helped google translate become sexist","author":"Olson","year":"2018"},{"key":"2021081914590010700_bib165","volume-title":"Gender-Neutral Language in the European Parliament","author":"Papadimoulis","year":"2018"},{"key":"2021081914590010700_bib166","volume-title":"Morphological Gender Innovations in Spanish of Genderqueer Speakers","author":"Papadopoulos","year":"2019"},{"key":"2021081914590010700_bib167","doi-asserted-by":"publisher","first-page":"311","DOI":"10.3115\/1073083.1073135","article-title":"BLEU: A method for automatic evaluation of machine translation","volume-title":"Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics","author":"Papineni","year":"2002"},{"key":"2021081914590010700_bib168","article-title":"Data and its (dis)contents: A survey of dataset development and use in machine learning research","volume-title":"NeurIPS 2020 Workshop: ML Retrospectives, Surveys & Meta-analyses (ML-RSA)","author":"Paullada","year":"2020"},{"key":"2021081914590010700_bib169","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1037\/0022-3514.85.2.291","article-title":"Words of wisdom: Language use over the life span","volume":"85","author":"Pennebaker","year":"2003","journal-title":"Journal of Personality and Social Psychology"},{"key":"2021081914590010700_bib170","first-page":"1","article-title":"Assessing gender bias in machine translation: A case study with Google Translate","author":"Prates","year":"2018","journal-title":"Neural Computing and Applications"},{"key":"2021081914590010700_bib171","first-page":"1074","article-title":"Personalized machine translation: preserving original author traits","volume-title":"Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers","author":"Rabinovich","year":"2017"},{"issue":"7753","key":"2021081914590010700_bib172","doi-asserted-by":"publisher","first-page":"477","DOI":"10.1038\/s41586-019-1138-y","article-title":"Machine behaviour","volume":"568","author":"Rahwan","year":"2019","journal-title":"Nature"},{"issue":"11","key":"2021081914590010700_bib173","doi-asserted-by":"publisher","first-page":"1171","DOI":"10.1038\/s41562-019-0686-3","article-title":"Committees with implicit biases promote fewer women when they do not believe gender bias exists","volume":"3","author":"R\u00e9gner","year":"2019","journal-title":"Nature Human Behaviour"},{"key":"2021081914590010700_bib174","first-page":"62","article-title":"A case study of natural gender phenomena in translation: A Comparison of Google Translate, Bing Microsoft Translator and DeepL for English to Italian, French and Spanish","volume-title":"Proceedings of the Workshop on the Impact of Machine Translation (iMpacT 2020)","author":"Rescigno","year":"2020"},{"issue":"4","key":"2021081914590010700_bib175","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1038\/s42256-019-0038-z","article-title":"Lessons for artificial intelligence from the study of natural stupidity","volume":"1","author":"Rich","year":"2019","journal-title":"Nature Machine Intelligence"},{"issue":"1","key":"2021081914590010700_bib176","doi-asserted-by":"publisher","first-page":"95","DOI":"10.3109\/09540261.2015.1106446","article-title":"Non-binary or genderqueer genders","volume":"28","author":"Richards","year":"2016","journal-title":"International Review of Psychiatry"},{"key":"2021081914590010700_bib177","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1007\/978-3-319-76333-0","article-title":"Gender as a Social Structure","volume-title":"Handbook of the Sociology of Gender","author":"Risman","year":"2018"},{"key":"2021081914590010700_bib178","article-title":"Decoding and diversity in machine translation","volume-title":"Proceedings of the Resistance AI Workshop at 34th Conference on Neural Information Processing Systems (NeurIPS 2020)","author":"Roberts","year":"2020"},{"key":"2021081914590010700_bib179","doi-asserted-by":"publisher","DOI":"10.4324\/9781410603852","volume-title":"Communicating Gender","author":"Romaine","year":"1999"},{"key":"2021081914590010700_bib180","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1075\/impact.9.12rom","article-title":"A corpus-based view of gender in British and American English","volume":"1","author":"Romaine","year":"2001","journal-title":"Gender across Languages"},{"key":"2021081914590010700_bib181","first-page":"8","article-title":"Gender bias in coreference resolution","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)","author":"Rudinger","year":"2018"},{"key":"2021081914590010700_bib182","article-title":"Machines Are Indifferent, We Are Not: Yann LeCuns Tweet Sparks ML bias debate","author":"Samar","year":"2020"},{"key":"2021081914590010700_bib183","article-title":"Todos\/Todas\/Todes. Interview with Megan Figueroa, host; Carrie Gillon, host","volume-title":"The Vocal Fries [Podcast]","author":"Santiago","year":"2018"},{"key":"2021081914590010700_bib184","doi-asserted-by":"crossref","first-page":"5477","DOI":"10.18653\/v1\/2020.acl-main.486","article-title":"Social bias frames: Reasoning about social and power implications of language","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Sap","year":"2020"},{"key":"2021081914590010700_bib185","doi-asserted-by":"publisher","first-page":"7724","DOI":"10.18653\/v1\/2020.acl-main.690","article-title":"Reducing gender bias in neural machine translation as a domain adaptation problem","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Saunders","year":"2020"},{"key":"2021081914590010700_bib186","first-page":"35","article-title":"Neural machine translation doesn\u2019t translate gender coreference right unless you make it","volume-title":"Proceedings of the Second Workshop on Gender Bias in Natural Language Processing","author":"Saunders","year":"2020"},{"issue":"9","key":"2021081914590010700_bib187","doi-asserted-by":"publisher","DOI":"10.1038\/507009a","article-title":"Scientific research must take gender into account","volume":"507","author":"Schiebinger","year":"2014","journal-title":"Nature"},{"key":"2021081914590010700_bib188","doi-asserted-by":"publisher","first-page":"5412","DOI":"10.1145\/3025453.3025766","article-title":"Intersectional HCI: Engaging identity through gender, race, and class","volume-title":"Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI \u201917","author":"Schlesinger","year":"2017"},{"key":"2021081914590010700_bib189","doi-asserted-by":"publisher","first-page":"2793","DOI":"10.18653\/v1\/D18-1301","article-title":"The Glass Ceiling in NLP","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Schluter","year":"2018"},{"key":"2021081914590010700_bib190","first-page":"64","article-title":"The semantic derogation of woman","volume-title":"Sex and Language. Difference and Dominance","author":"Schulz","year":"1975"},{"key":"2021081914590010700_bib191","doi-asserted-by":"publisher","first-page":"3419","DOI":"10.18653\/v1\/D19-1341","article-title":"Towards debiasing fact verification models","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Schuster","year":"2019"},{"key":"2021081914590010700_bib192","doi-asserted-by":"publisher","first-page":"103","DOI":"10.4324\/9780203703663-9","article-title":"Agency and communion: Their implications for gender stereotypes and gender identities","volume-title":"Agency and Communion in Social Psychology","author":"Sczesny","year":"2018"},{"key":"2021081914590010700_bib193","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1145\/3287560.3287598","article-title":"Fairness and abstraction in sociotechnical systems","volume-title":"Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT* \u201919","author":"Selbst","year":"2019"},{"key":"2021081914590010700_bib194","doi-asserted-by":"publisher","first-page":"376","DOI":"10.18653\/v1\/E17-2060","article-title":"How grammatical is character-level neural machine translation? Assessing MT quality with contrastive translation pairs","volume-title":"Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers","author":"Sennrich","year":"2017"},{"key":"2021081914590010700_bib195","doi-asserted-by":"publisher","first-page":"5248","DOI":"10.18653\/v1\/2020.acl-main.468","article-title":"Predictive biases in natural language processing models: A conceptual framework and overview","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Shah","year":"2020"},{"key":"2021081914590010700_bib196","article-title":"Innovations in gender-neutral French: Language practices of nonbinary French speakers on Twitter","author":"Shroy","year":"2016","journal-title":"Ms., University of California, Davis"},{"issue":"2\u20133","key":"2021081914590010700_bib197","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1016\/S0148-0685(80)92113-2","article-title":"Generic masculine words and thinking","volume":"3","author":"Silveira","year":"1980","journal-title":"Women\u2019s Studies International Quarterly"},{"issue":"6","key":"2021081914590010700_bib198","doi-asserted-by":"publisher","first-page":"967","DOI":"10.1016\/j.neuron.2019.08.034","article-title":"Engineering a less artificial intelligence","volume":"103","author":"Sinz","year":"2019","journal-title":"Neuron"},{"key":"2021081914590010700_bib199","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1075\/impact.11.12shi","article-title":"Gendered structures in Japanese","volume":"3","author":"Smith","year":"2003","journal-title":"Gender across Languages"},{"key":"2021081914590010700_bib200","first-page":"223","article-title":"A study of translation edit rate with targeted human annotation","volume-title":"Proceedings of the 7th Conference of the Association for Machine Translation in the Americas","author":"Snover","year":"2006"},{"key":"2021081914590010700_bib201","first-page":"629","article-title":"Mitigating gender bias in machine translation with target gender annotations","volume-title":"Proceedings of the Fifth Conference on Machine Translation","author":"Stafanovi\u010ds","year":"2020"},{"key":"2021081914590010700_bib202","first-page":"163","article-title":"Representation of the sexes in language","author":"Stahlberg","year":"2007","journal-title":"Social Communication"},{"key":"2021081914590010700_bib203","doi-asserted-by":"publisher","first-page":"1679","DOI":"10.18653\/v1\/P19-1164","article-title":"Evaluating gender bias in machine translation","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Stanovsky","year":"2019"},{"issue":"1","key":"2021081914590010700_bib204","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/1100000056","article-title":"Gender-inclusive HCI research and design: A conceptual review","volume":"13","author":"Stumpf","year":"2020","journal-title":"Foundations and Trends in Human\u2013Computer Interaction"},{"key":"2021081914590010700_bib205","doi-asserted-by":"publisher","first-page":"1630","DOI":"10.18653\/v1\/P19-1159","article-title":"Mitigating gender bias in natural language processing: Literature Review","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Sun","year":"2019"},{"key":"2021081914590010700_bib206","article-title":"They, them, theirs: Rewriting with gender-neutral English","author":"Sun","year":"2021","journal-title":"arXiv preprint arXiv:2102.06788"},{"key":"2021081914590010700_bib207","article-title":"A framework for understanding unintended consequences of machine learning","author":"Suresh","year":"2019","journal-title":"arXiv preprint arXiv:1901.10002"},{"key":"2021081914590010700_bib208","first-page":"44","article-title":"Can existing methods debias languages other than english? First attempt to analyze and mitigate Japanese Word Embeddings","volume-title":"Proceedings of the Second Workshop on Gender Bias in Natural Language Processing","author":"Takeshita","year":"2020"},{"key":"2021081914590010700_bib209","article-title":"A century of \u201cshrill\u201d: How bias in technology has hurt women\u2019s voices","author":"Tallon","year":"2019","journal-title":"The New Yorker"},{"key":"2021081914590010700_bib210","doi-asserted-by":"publisher","first-page":"53","DOI":"10.18653\/v1\/W17-1606","article-title":"Gender and dialect bias in youtube\u2019s automatic captions","volume-title":"Proceedings of the First ACL Workshop on Ethics in Natural Language Processing","author":"Tatman","year":"2017"},{"key":"2021081914590010700_bib211","volume-title":"Sociolinguistics: An Introduction to Language and Society","author":"Trudgill","year":"2000"},{"key":"2021081914590010700_bib212","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1016\/j.jbi.2014.10.005","article-title":"Modeling workflow to design machine translation applications for public health practice","volume":"53","author":"Turner","year":"2015","journal-title":"Journal of Biomedical Informatics"},{"issue":"2","key":"2021081914590010700_bib213","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1016\/0010-0285(73)90033-9","article-title":"Availability: A heuristic for judging frequency and probability","volume":"5","author":"Tversky","year":"1973","journal-title":"Cognitive Psychology"},{"issue":"4157","key":"2021081914590010700_bib214","doi-asserted-by":"publisher","first-page":"1124","DOI":"10.1126\/science.185.4157.1124","article-title":"Judgment under uncertainty: Heuristics and biases","volume":"185","author":"Tversky","year":"1974","journal-title":"Science"},{"key":"2021081914590010700_bib215","unstructured":"Emiel van Miltenburg. 2019. Pragmatic Factors in (Automatic) Image Description. Ph.D. thesis, Vrije Universiteit, Amsterdam, NL."},{"key":"2021081914590010700_bib216","doi-asserted-by":"crossref","first-page":"3003","DOI":"10.18653\/v1\/D18-1334","article-title":"Getting Gender Right in Neural Machine Translation","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Vanmassenhove","year":"2018"},{"key":"2021081914590010700_bib217","first-page":"2203","article-title":"Machine translationese: Effects of algorithmic bias on linguistic complexity in machine translation","volume-title":"Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume","author":"Vanmassenhove","year":"2021"},{"key":"2021081914590010700_bib218","first-page":"222","article-title":"Lost in translation: Loss and decay of linguistic richness in machine translation","volume-title":"Proceedings of Machine Translation Summit XVII Volume 1: Research Track","author":"Vanmassenhove","year":"2019"},{"key":"2021081914590010700_bib219","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3290605.3300283","article-title":"From gender biases to gender-inclusive design: An empirical investigation","volume-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI \u201919","author":"Vorvoreanu","year":"2019"},{"key":"2021081914590010700_bib220","article-title":"It\u2019s a man\u2019s Wikipedia? Assessing gender inequality in an online encyclopedia","volume-title":"Proceedings of the International AAAI Conference on Web and Social Media","author":"Wagner","year":"2015"},{"key":"2021081914590010700_bib221","volume-title":"Sprachen: Vergleichbar und Vnvergleichlich","author":"Wandruszka","year":"1969"},{"key":"2021081914590010700_bib222","doi-asserted-by":"publisher","first-page":"138","DOI":"10.18653\/v1\/W16-5618","article-title":"Are you a racist or am i seeing things? Annotator influence on hate speech detection on Twitter","volume-title":"Proceedings of the First Workshop on NLP and Computational Social Science","author":"Waseem","year":"2016"},{"key":"2021081914590010700_bib223","article-title":"Disembodied machine learning: On the illusion of objectivity in NLP","author":"Waseem","year":"2020"},{"key":"2021081914590010700_bib224","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18653\/v1\/W19-3801","article-title":"Gendered ambiguous pronoun (GAP) shared task at the gender bias in NLP workshop 2019","volume-title":"Proceedings of the First Workshop on Gender Bias in Natural Language Processing","author":"Webster","year":"2019"},{"issue":"6","key":"2021081914590010700_bib225","doi-asserted-by":"publisher","first-page":"681","DOI":"10.1080\/17405629.2016.1175343","article-title":"Gender role self-concept at school start and its impact on academic self-concept and performance in mathematics and reading","volume":"13","author":"Wolter","year":"2016","journal-title":"European Journal of Developmental Psychology"},{"key":"2021081914590010700_bib226","doi-asserted-by":"publisher","first-page":"2896","DOI":"10.18653\/v1\/2020.acl-main.260","article-title":"Gender bias in multilingual embeddings and cross-lingual transfer","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Zhao","year":"2020"},{"key":"2021081914590010700_bib227","doi-asserted-by":"publisher","first-page":"2979","DOI":"10.18653\/v1\/D17-1323","article-title":"Men also like shopping: Reducing gender bias amplification using corpus-level constraints","volume-title":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing","author":"Zhao","year":"2017"},{"key":"2021081914590010700_bib228","doi-asserted-by":"publisher","first-page":"15","DOI":"10.18653\/v1\/N18-2003","article-title":"Gender bias in coreference resolution: Evaluation and debiasing methods","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)","author":"Zhao","year":"2018"},{"key":"2021081914590010700_bib229","doi-asserted-by":"publisher","first-page":"4847","DOI":"10.18653\/v1\/D18-1521","article-title":"Learning gender-neutral word embeddings","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Zhao","year":"2018"},{"key":"2021081914590010700_bib230","doi-asserted-by":"publisher","first-page":"5276","DOI":"10.18653\/v1\/D19-1531","article-title":"Examining gender bias in languages with grammatical gender","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Zhou","year":"2019"},{"key":"2021081914590010700_bib231","doi-asserted-by":"publisher","DOI":"10.1093\/oxfordhb\/9780190212926.013.45","article-title":"Transgender language, transgender moment: Toward a trans linguistics","volume-title":"The Oxford Handbook of Language and Sexuality","author":"Zimman","year":"2020"},{"key":"2021081914590010700_bib232","first-page":"226","article-title":"Trans peoples linguistic self-determination and the dialogic nature of identity","author":"Zimman","year":"2017","journal-title":"Representing trans: Linguistic, legal and everyday perspectives"},{"key":"2021081914590010700_bib233","doi-asserted-by":"publisher","first-page":"1651","DOI":"10.18653\/v1\/P19-1161","article-title":"Counterfactual data augmentation for mitigating gender stereotypes in languages with rich morphology","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Zmigrod","year":"2019"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00401\/1957705\/tacl_a_00401.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00401\/1957705\/tacl_a_00401.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,9]],"date-time":"2023-01-09T14:29:18Z","timestamp":1673274558000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/doi\/10.1162\/tacl_a_00401\/106991\/Gender-Bias-in-Machine-Translation"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":233,"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00401","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021]]},"published":{"date-parts":[[2021]]}}}