{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T05:35:56Z","timestamp":1772256956078,"version":"3.50.1"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2021,5,20]],"date-time":"2021-05-20T00:00:00Z","timestamp":1621468800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"},{"start":{"date-parts":[[2021,5,20]],"date-time":"2021-05-20T00:00:00Z","timestamp":1621468800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Cogn Comput"],"published-print":{"date-parts":[[2021,7]]},"DOI":"10.1007\/s12559-021-09881-2","type":"journal-article","created":{"date-parts":[[2021,5,20]],"date-time":"2021-05-20T09:17:45Z","timestamp":1621502265000},"page":"1008-1018","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":71,"title":["Investigating Gender Bias in BERT"],"prefix":"10.1007","volume":"13","author":[{"given":"Rishabh","family":"Bhardwaj","sequence":"first","affiliation":[]},{"given":"Navonil","family":"Majumder","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6924-7931","authenticated-orcid":false,"given":"Soujanya","family":"Poria","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,5,20]]},"reference":[{"issue":"4","key":"9881_CR1","first-page":"e26627","volume":"23","author":"A Hussain","year":"2021","unstructured":"Hussain A, Tahir A, Hussain Z, Sheikh Z, Gogate M, Dashtipour K, Ali A, Sheikh A. Artificial intelligence-enabled analysis of public attitudes on facebook and twitter toward covid-19 vaccines in the united kingdom and the united states: Observational study. J Med Intern Res. 2021;23(4):e26627.","journal-title":"J Med Intern Res"},{"key":"9881_CR2","doi-asserted-by":"crossref","unstructured":"Basta C, Costa-juss\u00e0 MR, Casas N. Evaluating the underlying gender bias in contextualized word embeddings. In Proceedings of the First Workshop on Gender Bias in Natural Language Processing.\u00a0Association for Computational Linguistics. 2019:33\u201339.","DOI":"10.18653\/v1\/W19-3805"},{"key":"9881_CR3","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141, Polosukhin I. Attention is all you need. In Advances in neural information processing systems 2017:5998\u20136008."},{"key":"9881_CR4","doi-asserted-by":"crossref","unstructured":"Caliskan A, Bryson JJ, Narayanan A. Semantics derived automatically from language corpora contain human-like biases. Science. 2017;356(6334):83\u2013186.","DOI":"10.1126\/science.aal4230"},{"key":"9881_CR5","doi-asserted-by":"crossref","unstructured":"Dashtipour K, Gogate M, Cambria E, Hussain A. A novel context-aware multimodal framework for persian sentiment analysis. 2021. https:\/\/arxiv.org\/abs\/2103.02636.","DOI":"10.1016\/j.neucom.2021.02.020"},{"key":"9881_CR6","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K. Bert: Pre-training of deep bidirectional transformers for language understanding. 2018. https:\/\/arxiv.org\/abs\/1810.04805."},{"key":"9881_CR7","unstructured":"Bolukbasi T, Chang KW, Zou JY, Saligrama V, Kalai AT. Man is to computer programmer as woman is to homemaker? debiasing word embeddings. In Advances in neural information processing systems.\u00a02016:4349\u20134357."},{"key":"9881_CR8","unstructured":"Gonen H, Goldberg Y. Lipstick on a pig: Debiasing methods cover up systematic gender biases in word embeddings but do not remove them. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers).\u00a0Association for Computational Linguistics. 2019:609\u2013614."},{"issue":"6334","key":"9881_CR9","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1126\/science.aal4230","volume":"356","author":"A Caliskan","year":"2017","unstructured":"Caliskan A, Bryson JJ, Narayanan A. Semantics derived automatically from language corpora contain human-like biases. Science. 2017;356(6334):183\u20136.","journal-title":"Science"},{"key":"9881_CR10","doi-asserted-by":"crossref","unstructured":"Hussain A, Tahir A, Hussain Z, Sheikh Z, Gogate M, Dashtipour K, Ali A, Sheikh A. Artificial intelligence\u2013enabled analysis of public attitudes on facebook and twitter toward covid-19 vaccines in the united kingdom and the united states: Observational study. Journal of medical Internet research. 2021;23(4):e26627.","DOI":"10.2196\/26627"},{"key":"9881_CR11","doi-asserted-by":"crossref","unstructured":"Kim Y. Convolutional neural networks for sentence classification. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP).\u00a0Association for Computational Linguistics. 2014:1746\u20131751.","DOI":"10.3115\/v1\/D14-1181"},{"key":"9881_CR12","doi-asserted-by":"crossref","unstructured":"Kiritchenko S, Mohammad S. Examining gender and race bias in two hundred sentiment analysis systems. In Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics.\u00a0Association for Computational Linguistics. 2018:43\u201353.","DOI":"10.18653\/v1\/S18-2005"},{"key":"9881_CR13","doi-asserted-by":"crossref","unstructured":"Kurita K, Vyas N, Pareek A, Black AW, Tsvetkov Y. Measuring bias in contextualized word representations. In Proceedings of the First Workshop on Gender Bias in Natural Language Processing.\u00a0Association for Computational Linguistics. 2019:166\u2013172.","DOI":"10.18653\/v1\/W19-3823"},{"key":"9881_CR14","unstructured":"Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, Levy O, Lewis M, Zettlemoyer L, Stoyanov V. Roberta: A robustly optimized bert pretraining approach. 2019. https:\/\/arxiv.org\/abs\/1907.11692."},{"key":"9881_CR15","unstructured":"Lu J, Batra D, Parikh D, Lee S. Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks. In Advances in Neural Information Processing Systems.\u00a02019:13\u201323."},{"key":"9881_CR16","doi-asserted-by":"crossref","unstructured":"Mohammad S, Bravo-Marquez F, Salameh M, Kiritchenko S. SemEval-2018 task 1: Affect in tweets. In Proceedings of The 12th International Workshop on Semantic Evaluation.\u00a0Association for Computational Linguistics. 2018:pp.\u00a01\u201317.","DOI":"10.18653\/v1\/S18-1001"},{"key":"9881_CR17","unstructured":"Morcos A, Raghu M, Bengio S. Insights on representational similarity in neural networks with canonical correlation. In Advances in Neural Information Processing Systems. 2018:5727\u20135736."},{"key":"9881_CR18","doi-asserted-by":"crossref","unstructured":"Peters M, Neumann M, Iyyer M, Gardner M, Clark C, Lee K, Zettlemoyer L. Deep contextualized word representations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). Association for Computational Linguistics. 2018:2227\u20132237.","DOI":"10.18653\/v1\/N18-1202"},{"key":"9881_CR19","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1162\/tacl_a_00359","volume":"9","author":"Y Elazar","year":"2021","unstructured":"Elazar Y, Ravfogel S, Jacovi A, Goldberg Y. Amnesic probing: Behavioral explanation with amnesic counterfactuals. Transactions of the Association for Computational Linguistics. 2021;9:160\u201375.","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"9881_CR20","unstructured":"Morcos A, Raghu M, Bengio S. Insights on representational similarity in neural networks with canonical correlation. In Advances in Neural Information Processing Systems.\u00a02018:5727\u20135736."},{"key":"9881_CR21","unstructured":"Tenney I, Xia P, Chen B, Wang A, Poliak A, McCoy RT, Kim N, Van\u00a0Durme B, Bowman SR, Das D, et\u00a0al. What do you learn from context? probing for sentence structure in contextualized word representations. 2019. https:\/\/arxiv.org\/abs\/1905.06316."},{"key":"9881_CR22","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141, Polosukhin I. Attention is all you need. In Advances in neural information processing systems. 2017:5998\u20136008."},{"key":"9881_CR23","doi-asserted-by":"crossref","unstructured":"Voita E, Titov I. Information-theoretic probing with minimum description length. 2020. https:\/\/arxiv.org\/abs\/2003.12298.","DOI":"10.18653\/v1\/2020.emnlp-main.14"},{"key":"9881_CR24","doi-asserted-by":"crossref","unstructured":"Wolf T, Debut L, Sanh V, Chaumond J, Delangue C, Moi A, Cistac P, Rault T, Louf R, Funtowicz M, Brew J. Huggingface\u2019s transformers: State-of-the-art natural language processing. 2019. https:\/\/arxiv.org\/abs\/1910.03771.","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"9881_CR25","unstructured":"Yang Z, Dai Z, Yang Y, Carbonell J, Salakhutdinov R, Le Q.\u00a0V. Xlnet: Generalized autoregressive pretraining for language understanding. 2019. https:\/\/arxiv.org\/abs\/1906.08237."},{"key":"9881_CR26","doi-asserted-by":"crossref","unstructured":"Zhao J, Wang T, Yatskar M, Cotterell R, Ordonez V, Chang KW. Gender bias in contextualized word embeddings. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers).\u00a0Association for Computational Linguistics.\u00a02019:629\u2013634.","DOI":"10.18653\/v1\/N19-1064"},{"key":"9881_CR27","doi-asserted-by":"crossref","unstructured":"Zhao J, Wang T, Yatskar M, Ordonez V, Chang KW. Gender bias in coreference resolution: Evaluation and debiasing methods. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers).\u00a0Association for Computational Linguistics. 2018:15\u201320.","DOI":"10.18653\/v1\/N18-2003"},{"key":"9881_CR28","doi-asserted-by":"crossref","unstructured":"Zhao J, Zhou Y, Li Z, Wang W, Chang KW. Learning gender-neutral word embeddings. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics. 2018:4847\u20134853.","DOI":"10.18653\/v1\/D18-1521"},{"key":"9881_CR29","doi-asserted-by":"crossref","unstructured":"Zhao J, Zhou Y, Li Z, Wang W, Chang KW. Learning gender-neutral word embeddings.\u00a02018. https:\/\/arxiv.org\/abs\/1809.01496.","DOI":"10.18653\/v1\/D18-1521"}],"container-title":["Cognitive Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12559-021-09881-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12559-021-09881-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12559-021-09881-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,31]],"date-time":"2021-07-31T09:31:20Z","timestamp":1627723880000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12559-021-09881-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,20]]},"references-count":29,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,7]]}},"alternative-id":["9881"],"URL":"https:\/\/doi.org\/10.1007\/s12559-021-09881-2","relation":{},"ISSN":["1866-9956","1866-9964"],"issn-type":[{"value":"1866-9956","type":"print"},{"value":"1866-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,20]]},"assertion":[{"value":"20 April 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 May 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 May 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors did not receive support from any organization for the submitted work.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed Consent"}},{"value":"This article does not contain any studies with human participants or animals performed by any of the authors.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Standard"}},{"value":"All authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of Interest"}}]}}