{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T16:03:26Z","timestamp":1781798606163,"version":"3.54.5"},"reference-count":60,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2021,3,6]],"date-time":"2021-03-06T00:00:00Z","timestamp":1614988800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,3,6]],"date-time":"2021-03-06T00:00:00Z","timestamp":1614988800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"This research was funded by the Humanities and Social Change International Foundation"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ethics Inf Technol"],"published-print":{"date-parts":[[2021,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This article probes the practical ethical implications of AI system design by reconsidering the important topic of bias in the datasets used to train autonomous intelligent systems. The discussion draws on recent work concerning behaviour-guiding technologies, and it adopts a cautious form of technological utopianism by assuming it is potentially beneficial for society at large if AI systems are designed to be comparatively free from the biases that characterise human behaviour. However, the argument presented here critiques the common well-intentioned requirement that, in order to achieve this, all such datasets must be debiased <jats:italic>prior<\/jats:italic> to training. By focusing specifically on gender-bias in Neural Machine Translation (NMT) systems, three automated strategies for the removal of bias are considered \u2013 downsampling, upsampling, and counterfactual augmentation \u2013 and it is shown that systems trained on datasets debiased using these approaches all achieve general translation performance that is much worse than a baseline system. In addition, most of them also achieve worse performance in relation to metrics that quantify the degree of gender bias in the system outputs. By contrast, it is shown that the technique of domain adaptation can be effectively deployed to debias existing NMT systems <jats:italic>after<\/jats:italic> they have been fully trained. This enables them to produce translations that are quantitatively far less biased when analysed using gender-based metrics, but which also achieve state-of-the-art general performance. It is hoped that the discussion presented here will reinvigorate ongoing debates about how and why bias can be most effectively reduced in state-of-the-art AI systems.<\/jats:p>","DOI":"10.1007\/s10676-021-09583-1","type":"journal-article","created":{"date-parts":[[2021,3,6]],"date-time":"2021-03-06T10:02:50Z","timestamp":1615024970000},"page":"419-433","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["The practical ethics of bias reduction in machine translation: why domain adaptation is better than data debiasing"],"prefix":"10.1007","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6723-6075","authenticated-orcid":false,"given":"Marcus","family":"Tomalin","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bill","family":"Byrne","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shauna","family":"Concannon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Danielle","family":"Saunders","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefanie","family":"Ullmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,3,6]]},"reference":[{"key":"9583_CR1","doi-asserted-by":"publisher","DOI":"10.5334\/gjgl.721","author":"L Ackerman","year":"2019","unstructured":"Ackerman, L. (2019). Syntactic and cognitive issues in investigating gendered coreference. Glossa A Journal of General Linguistics. https:\/\/doi.org\/10.5334\/gjgl.721","journal-title":"Glossa A Journal of General Linguistics"},{"issue":"1","key":"9583_CR2","first-page":"94","volume":"29","author":"I Asimov","year":"1942","unstructured":"Asimov, I. (1942). Runaround. Astounding Science Fiction, 29(1), 94\u2013103.","journal-title":"Astounding Science Fiction"},{"issue":"4","key":"9583_CR3","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1177\/1088868318782848","volume":"23","author":"AH Bailey","year":"2018","unstructured":"Bailey, A. H., LaFrance, M., & Dovidio, J. F. (2018). Is man the measure of all things? A social cognitive account of Androcentrism. Personality and Social Psychology Review, 23(4), 307\u2013331.","journal-title":"Personality and Social Psychology Review"},{"key":"9583_CR4","doi-asserted-by":"crossref","unstructured":"Barrault, L., Bojar, O., Costa-juss\u00e0, M. R., Federmann, C., Fishel, M., Graham, Y., Haddow, B., Huck, M., Koehn, P., Malmasi, S. & Monz, C. (2019). Findings of the 2019 conference on machine translation (wmt19). In Proceedings of the Fourth Conference on Machine (pp. 1\u201361).","DOI":"10.18653\/v1\/W19-5301"},{"key":"9583_CR5","unstructured":"Best, S. (2017). Is Google translate sexist? Users report biased results when translating gender-neutral languages into English. The Daily Mail. Retrieved 28 Jan 2020 from https:\/\/www.dailymail.co.uk\/sciencetech\/article-5136607\/Is-Google-Translate-SEXIST.html."},{"key":"9583_CR100","doi-asserted-by":"crossref","unstructured":"Blodgett, S. L., Barocas, S. Daum\u00e9 III, H., & Wallach, H. (2020). Language (technology) is power: A critical survey of bias in NLP. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.","DOI":"10.18653\/v1\/2020.acl-main.485"},{"key":"9583_CR6","first-page":"4349","volume":"1","author":"T Bolukbasi","year":"2016","unstructured":"Bolukbasi, T., Chang, K. W., Zou, J. Y., Saligrama, V., & Kalai, A. T. (2016). Man is to computer programmer as woman is to homemaker? debiasing word embeddings. Advances in Neural Information Processing Systems, 1, 4349\u20134357.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9583_CR7","doi-asserted-by":"crossref","unstructured":"Cao, Y. T. & Daum\u00e9 III, H. (2020). Toward gender-inclusive coreference resolution. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.","DOI":"10.18653\/v1\/2020.acl-main.418"},{"key":"9583_CR8","doi-asserted-by":"crossref","unstructured":"Chinea-Rios, M., Peris, A., & Casacuberta, F. (2017). Adapting neural machine translation with parallel synthetic data. In Proceedings of the Second Conference on Machine Translation (pp. 138\u2013147).","DOI":"10.18653\/v1\/W17-4714"},{"key":"9583_CR9","unstructured":"Costa-juss\u00e0, M. R., & de Jorge, A. (2020). Fine-tuning Neural Machine Translation on Gender-Balanced Datasets. In Proceedings of the Second Workshop on Gender Bias in Natural Language Processing (pp. 26\u201334)."},{"key":"9583_CR10","unstructured":"Crawford, K. (2017). The trouble with bias. In Conference on Neural Information Processing Systems, invited speaker."},{"key":"9583_CR11","unstructured":"Edunov, S., Ott, M., Ranzato, M. A., & Auli, M. (2019). On the evaluation of machine translation systems trained with back-translation. arXiv preprint arXiv:1908.05204. Retrieved January 5, 2021, from https:\/\/arxiv.org\/pdf\/1908.05204.pdf."},{"issue":"3","key":"9583_CR12","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1002\/symb.316","volume":"40","author":"H Darwin","year":"2017","unstructured":"Darwin, H. (2017). Doing gender beyond the binary: A virtual ethnography. Symbolic Interaction, 40(3), 317\u2013334.","journal-title":"Symbolic Interaction"},{"key":"9583_CR13","doi-asserted-by":"crossref","unstructured":"Farajian, M. A., Turchi, M., Negri, M., & Federico, M. (2017). Multi-domain neural machine translation through unsupervised adaptation. In Proceedings of the Second Conference on Machine Translation (pp. 127\u2013137).","DOI":"10.18653\/v1\/W17-4713"},{"key":"9583_CR14","doi-asserted-by":"publisher","DOI":"10.1016\/B978-155860643-2\/50011-1","volume-title":"Persuasive technology: Using computers to change what we think and do","author":"BJ Fogg","year":"2003","unstructured":"Fogg, B. J. (2003). Persuasive technology: Using computers to change what we think and do. Burlington, MA: Morgan Kaufmann Publishers."},{"key":"9583_CR16","doi-asserted-by":"crossref","unstructured":"Font, J. E., & Costa-juss\u00e0, M. R. (2019). Equalizing gender bias in neural machine translation with word embeddings techniques. In Proceedings of the First Workshop on Gender Bias in Natural Language Processing (pp. 147\u2013154).","DOI":"10.18653\/v1\/W19-3821"},{"issue":"4","key":"9583_CR15","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1016\/S1364-6613(99)01294-2","volume":"3","author":"RM French","year":"1999","unstructured":"French, R. M. (1999). Catastrophic forgetting in connectionist networks. Trends in Cognitive Sciences, 3(4), 128\u2013135.","journal-title":"Trends in Cognitive Sciences"},{"key":"9583_CR17","unstructured":"Gonen, H., & Goldberg, Y. (2019). Lipstick on a Pig: Debiasing methods cover up systematic gender biases in word embeddings but do not remove them. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) (pp. 609\u2013614)."},{"key":"9583_CR18","unstructured":"Google AI. (2020). Artificial intelligence at Google: Our principles. Retrieved 28 Jan 2020 from https:\/\/ai.google\/principles."},{"key":"9583_CR19","unstructured":"Government Digital Service (GDS) and Office for Artificial Intelligence (OAI). (2019). Understanding artificial intelligence ethics and safety. Retrieved 28 Jan 2020 from https:\/\/www.gov.uk\/guidance\/understanding-artificial-intelligence-ethics-and-safety."},{"key":"9583_CR20","first-page":"13","volume-title":"Vortr\u00e4ge und Aufs\u00e4tze","author":"M Heidegger","year":"1954","unstructured":"Heidegger, M. (1954). Die frage nach der technik. Vortr\u00e4ge und Aufs\u00e4tze (pp. 13\u201314). Pfullingen: Neske."},{"key":"9583_CR21","unstructured":"HLEGAI (High Level Expert Group on Artificial Intelligence), European Commission. (2019). Ethics Guidelines for Trustworthy AI. https:\/\/ec.europa.eu\/digital-single-market\/en\/news\/ethics-guidelines-trustworthy-ai. Accessed 28 Jan 2020."},{"key":"9583_CR22","unstructured":"IEEE. (2020). Ethics in action: IEEE global initiative on ethics of autonomous and intelligent systems, Retrieved 3 Feb 2020 from https:\/\/ethicsinaction.ieee.org."},{"key":"9583_CR23","doi-asserted-by":"crossref","unstructured":"Kilgarriff, A., Baisa, V., Bu\u0161ta, J., Jakub\u00ed\u010dek, M., Kov\u00e1\u0159, V., Michelfeit, J., Rychl\u00fd, P & Suchomel, V. (2014). The sketch engine: Ten years on. Lexicography, 1(1), 7\u201336: Retrieved January 5, 2021, from http:\/\/www.sketchengine.eu.","DOI":"10.1007\/s40607-014-0009-9"},{"issue":"13","key":"9583_CR24","doi-asserted-by":"publisher","first-page":"3521","DOI":"10.1073\/pnas.1611835114","volume":"114","author":"J Kirkpatrick","year":"2017","unstructured":"Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., & Hassabis, D. (2017). Overcoming catastrophic forgetting in neural networks. Proceedings of the National Academy of Sciences, 114(13), 3521\u20133526.","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"9583_CR25","unstructured":"Kopetsch, T. (2010). Dem deutschen Gesundheitswesen gehen die \u00c4rzte aus. Studie zur Altersstruktur und Arztzahlentwicklung, 5, 1\u2013147. Retrieved January 5, 2021, from https:\/\/cdn.aerzteblatt.de\/download\/files\/2010\/09\/down148303.pdf."},{"key":"9583_CR26","doi-asserted-by":"crossref","unstructured":"Leslie, D. (2019). Understanding artificial intelligence ethics and safety: A guide for the responsible design and implementation of AI systems in the public sector. The Alan Turing Institute, 6. Retrieved January 5, 2021, from https:\/\/www.turing.ac.uk\/sites\/default\/files\/2019-06\/understanding_artificial_intelligence_ethics_and_safety.pdf.","DOI":"10.2139\/ssrn.3403301"},{"key":"9583_CR27","unstructured":"Lloyd, K. (2018). Bias amplification in artificial intelligence systems. arXiv preprint arXiv:1809.07842. Retrieved January 5, 2021, from https:\/\/arxiv.org\/ftp\/arxiv\/papers\/1809\/1809.07842.pdf."},{"key":"9583_CR28","doi-asserted-by":"crossref","unstructured":"Maudslay, R. H., Gonen, H., Cotterell, R., & Teufel, S. (2019). It\u2019s all in the name: Mitigating gender bias with name-based counterfactual data substitution. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) (pp. 5270\u20135278).","DOI":"10.18653\/v1\/D19-1530"},{"key":"9583_CR30","unstructured":"Merriam-Webster. (2019). Merriam-Webster\u2019s words of the year 2019. Retrieved July 14, 2020, from https:\/\/www.merriam-webster.com\/words-at-play\/word-of-the-year\/they."},{"key":"9583_CR31","doi-asserted-by":"crossref","unstructured":"Michel, P., & Neubig, G. (2018). Extreme adaptation for personalized neural machine translation. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) (pp. 312\u2013318).","DOI":"10.18653\/v1\/P18-2050"},{"key":"9583_CR32","unstructured":"Olson, P. (2018). The algorithm that made Google Translate sexist. Forbes. Retrieved 28 Jan 2020 from https:\/\/www.forbes.com\/sites\/parmyolson\/2018\/02\/15\/the-algorithm-that-helped-google-translate-become-sexist."},{"key":"9583_CR33","doi-asserted-by":"crossref","unstructured":"Papineni, K., Roukos, S., Ward, T., & Zhu, W. J. (2002). BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational linguistics (pp. 311\u2013318).","DOI":"10.3115\/1073083.1073135"},{"key":"9583_CR34","doi-asserted-by":"crossref","unstructured":"Post, M. (2018). A call for clarity in reporting BLEU scores. In Proceedings of the Third Conference on Machine Translation: Research Papers (pp. 186\u2013191).","DOI":"10.18653\/v1\/W18-6319"},{"issue":"10","key":"9583_CR35","first-page":"1","volume":"32","author":"MO Prates","year":"2019","unstructured":"Prates, M. O., Avelar, P. H., & Lamb, L. C. (2019). Assessing gender bias in machine translation: A case study with Google Translate. Neural Computing and Applications, 32(10), 1\u201319.","journal-title":"Neural Computing and Applications"},{"key":"9583_CR36","doi-asserted-by":"crossref","unstructured":"Rudinger, R., Naradowsky, J., Leonard, B., & Van Durme, B. (2018). Gender bias in coreference resolution. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) (pp. 8\u201314).","DOI":"10.18653\/v1\/N18-2002"},{"key":"9583_CR37","doi-asserted-by":"crossref","unstructured":"Sap, M., Card, D., Gabriel, S., Choi, Y., & Smith, N. A. (2019). The risk of racial bias in hate speech detection. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (pp. 1668\u20131678).","DOI":"10.18653\/v1\/P19-1163"},{"key":"9583_CR38","doi-asserted-by":"crossref","unstructured":"Saunders, D. and Byrne, B. (2020). Reducing gender bias in neural machine translation as a domain adaptation problem. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.","DOI":"10.18653\/v1\/2020.acl-main.690"},{"key":"9583_CR39","unstructured":"Saunders, D., Sallis, R. and Byrne, B. (2020). Neural machine translation doesn\u2019t translate gender coreference right unless you make it. In Proceedings of the Second Workshop on Gender Bias in Natural Language Processing (pp. 35\u201343)."},{"key":"9583_CR40","volume-title":"Technological utopianism in American culture","author":"H Segal","year":"2005","unstructured":"Segal, H. (2005). Technological utopianism in American culture. New York, USA: Syracuse University Press."},{"key":"9583_CR41","doi-asserted-by":"crossref","unstructured":"Shah, D., Schwartz, H. A., & Hovy, D. (2020). Predictive biases in natural language processing models: A conceptual framework and overview. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.","DOI":"10.18653\/v1\/2020.acl-main.468"},{"key":"9583_CR42","volume-title":"Practical ethics","author":"P Singer","year":"1979","unstructured":"Singer, P. (1979). Practical ethics. Cambridge, UK: Cambridge University Press."},{"key":"9583_CR43","doi-asserted-by":"crossref","unstructured":"Stanovsky, G., Smith, N. A., & Zettlemoyer, L. (2019). Evaluating gender bias in machine translation. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (pp. 1679\u20131684).","DOI":"10.18653\/v1\/P19-1164"},{"key":"9583_CR44","unstructured":"Statista. (2019a). \u00c4rztinnen in Deutschland nach Arztgruppe bis 2018. Retrieved 3 Feb 2020 from https:\/\/de.statista.com\/statistik\/daten\/studie\/158852\/umfrage\/anzahl-der-aerztinnen-nach-taetigkeitsbereichen\/#statisticContainer."},{"key":"9583_CR45","unstructured":"Statista. (2019b). Studierende im Fach Humanmedizin in Deutschland nach Geschlecht bis 2018\/2019. Retrieved 3 Feb 2020 from https:\/\/de.statista.com\/statistik\/daten\/studie\/200758\/umfrage\/entwicklung-der-anzahl-der-medizinstudenten."},{"key":"9583_CR46","doi-asserted-by":"crossref","unstructured":"Tan, S., Joty, S., Kan, M. Y., & Socher, R (2020). It\u2019s Morphin Time! Combating linguistic discrimination with inflectional perturbations. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.","DOI":"10.18653\/v1\/2020.acl-main.263"},{"key":"9583_CR47","volume-title":"Nudge: Improving decisions about health, wealth, and happiness","author":"RH Thaler","year":"2008","unstructured":"Thaler, R. H., & Sunstein, C. R. (2008). Nudge: Improving decisions about health, wealth, and happiness. London, UK: Yale University Press."},{"key":"9583_CR48","doi-asserted-by":"crossref","unstructured":"Vanmassenhove, E., Hardmeier, C., & Way, A. (2018). Getting gender right in neural machine translation. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (pp. 3003\u20133008).","DOI":"10.18653\/v1\/D18-1334"},{"key":"9583_CR49","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, \u0141. & Polosukhin, I. (2017). Attention is all you need. In Advances in Neural Information Processing Systems (pp. 5998\u20136008)."},{"key":"9583_CR50","unstructured":"Vaswani, A., Bengio, S., Brevdo, E., Chollet, F., Gomez, A.N., Gouws, S., Jones, L., Kaiser, \u0141., Kalchbrenner, N., Parmar, N. & Sepassi, R. (2018). Tensor2tensor for neural machine translation. arXiv preprint arXiv:1803.07416. https:\/\/arxiv.org\/pdf\/1803.07416.pdf."},{"issue":"3","key":"9583_CR51","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1177\/0162243905285847","volume":"31","author":"PP Verbeek","year":"2006","unstructured":"Verbeek, P. P. (2006). Materializing morality: Design ethics and technological mediation. Science, Technology, and Human Values, 31(3), 361\u2013380. https:\/\/doi.org\/10.1177\/0162243905285847","journal-title":"Science, Technology, and Human Values"},{"key":"9583_CR52","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1017\/9780511844317.005","volume-title":"Designing in ethics","author":"PP Verbeek","year":"2017","unstructured":"Verbeek, P. P. (2017). Designing the morality of things: The ethics of behaviour-guiding technology. In J. van den Hoven, S. Miller, & T. Pogge (Eds.), Designing in ethics (pp. 78\u201394). Cambridge, UK: Cambridge University Press."},{"key":"9583_CR53","doi-asserted-by":"crossref","unstructured":"Wang, W., Watanabe, T., Hughes, M., Nakagawa, T., & Chelba, C. (2018). Denoising neural machine translation training with trusted data and online data selection. In Proceedings of the Third Conference on Machine Translation: Research Papers (pp. 133\u2013143).","DOI":"10.18653\/v1\/W18-6314"},{"issue":"3","key":"9583_CR54","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1109\/JPROC.2019.2900622","volume":"107","author":"AF Winfield","year":"2019","unstructured":"Winfield, A. F., Michael, K., Pitt, J., & Evers, V. (2019). Machine ethics: The design and governance of ethical AI and autonomous systems. Proceedings of the IEEE, 107(3), 509\u2013517.","journal-title":"Proceedings of the IEEE"},{"key":"9583_CR55","unstructured":"Wong, J. C. (2019). The viral selfie app ImageNet Roulette seemed fun \u2013 until it called me a racist slur. The Guardian. Retrieved 3 Feb 2020 from https:\/\/www.theguardian.com\/technology\/2019\/sep\/17\/imagenet-roulette-asian-racist-slur-selfie."},{"key":"9583_CR56","doi-asserted-by":"crossref","unstructured":"Zhao, J., Wang, T., Yatskar, M., Ordonez, V., & Chang, K. W. (2017). Men also like shopping: Reducing gender bias amplification using corpus-level constraints. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing.","DOI":"10.18653\/v1\/D17-1323"},{"key":"9583_CR57","doi-asserted-by":"crossref","unstructured":"Zhao, J., Wang, T., Yatskar, M., Ordonez, V., & Chang, K. W. (2018a). Gender bias in coreference resolution: evaluation and debiasing methods. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) (pp. 15\u201320).","DOI":"10.18653\/v1\/N18-2003"},{"key":"9583_CR58","doi-asserted-by":"crossref","unstructured":"Zhao, J., Zhou, Y., Li, Z., Wang, W., & Chang, K. W. (2018b). Learning gender-neutral word embeddings. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (pp. 4847\u20134853).","DOI":"10.18653\/v1\/D18-1521"},{"key":"9583_CR59","doi-asserted-by":"publisher","first-page":"324","DOI":"10.1038\/d41586-018-05707-8","volume":"559","author":"J Zou","year":"2018","unstructured":"Zou, J., & Schiebinger, L. (2018). AI can be sexist and racist\u2014it\u2019s time to make it fair. Nature, 559, 324\u2013326. https:\/\/doi.org\/10.1038\/d41586-018-05707-8","journal-title":"Nature"},{"key":"9583_CR60","doi-asserted-by":"crossref","unstructured":"Zmigrod, R., Mielke, S. J., Wallach, H., & Cotterell, R. (2019). Counterfactual data augmentation for mitigating gender stereotypes in languages with rich morphology. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (pp. 1651\u20131661).","DOI":"10.18653\/v1\/P19-1161"}],"container-title":["Ethics and Information Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-021-09583-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10676-021-09583-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-021-09583-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,11,30]],"date-time":"2021-11-30T19:28:15Z","timestamp":1638300495000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10676-021-09583-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,6]]},"references-count":60,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["9583"],"URL":"https:\/\/doi.org\/10.1007\/s10676-021-09583-1","relation":{},"ISSN":["1388-1957","1572-8439"],"issn-type":[{"value":"1388-1957","type":"print"},{"value":"1572-8439","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,6]]},"assertion":[{"value":"12 February 2021","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 March 2021","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The authors declare that they have no conflicts of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}}]}}