{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,4]],"date-time":"2026-04-04T06:12:31Z","timestamp":1775283151258,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":27,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,6,26]],"date-time":"2022-06-26T00:00:00Z","timestamp":1656201600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,6,26]]},"DOI":"10.1145\/3501247.3531540","type":"proceedings-article","created":{"date-parts":[[2022,6,24]],"date-time":"2022-06-24T22:41:09Z","timestamp":1656110469000},"page":"245-249","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["On the Characteristics of Ranking-based Gender Bias Measures"],"prefix":"10.1145","author":[{"given":"Anja","family":"Klasnja","sequence":"first","affiliation":[{"name":"Ryerson, Canada"}]},{"given":"Negar","family":"Arabzadeh","sequence":"additional","affiliation":[{"name":"University of Waterloo, Canada"}]},{"given":"Mahbod","family":"Mehrvarz","sequence":"additional","affiliation":[{"name":"University College London, Canada"}]},{"given":"Ebrahim","family":"Bagheri","sequence":"additional","affiliation":[{"name":"Ryerson University, Canada"}]}],"member":"320","published-online":{"date-parts":[[2022,6,26]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 1748\u20131752","author":"Bigdeli Amin","year":"2021","unstructured":"Amin Bigdeli , Negar Arabzadeh , Shirin Seyedsalehi , Morteza Zihayat , and Ebrahim Bagheri . 2021 . On the Orthogonality of Bias and Utility in Ad hoc Retrieval. In SIGIR \u201921 : The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 1748\u20131752 . https:\/\/doi.org\/10.1145\/3404835.3463110 10.1145\/3404835.3463110 Amin Bigdeli, Negar Arabzadeh, Shirin Seyedsalehi, Morteza Zihayat, and Ebrahim Bagheri. 2021. On the Orthogonality of Bias and Utility in Ad hoc Retrieval. In SIGIR \u201921: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 1748\u20131752. https:\/\/doi.org\/10.1145\/3404835.3463110"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-99739-7_6"},{"key":"e_1_3_2_2_3_1","volume-title":"ECIR 2021(Lecture Notes in Computer Science), Vol.\u00a012657","author":"Bigdeli Amin","year":"2021","unstructured":"Amin Bigdeli , Negar Arabzadeh , Morteza Zihayat , and Ebrahim Bagheri . 2021 . Exploring Gender Biases in Information Retrieval Relevance Judgement Datasets. In Advances in Information Retrieval - 43rd European Conference on IR Research , ECIR 2021(Lecture Notes in Computer Science), Vol.\u00a012657 . Springer, 216\u2013224. Amin Bigdeli, Negar Arabzadeh, Morteza Zihayat, and Ebrahim Bagheri. 2021. Exploring Gender Biases in Information Retrieval Relevance Judgement Datasets. In Advances in Information Retrieval - 43rd European Conference on IR Research, ECIR 2021(Lecture Notes in Computer Science), Vol.\u00a012657. Springer, 216\u2013224."},{"key":"e_1_3_2_2_4_1","unstructured":"Tolga Bolukbasi Kai-Wei Chang James\u00a0Y. Zou Venkatesh Saligrama and Adam\u00a0Tauman Kalai. 2016. Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings. (2016) 4349\u20134357.  Tolga Bolukbasi Kai-Wei Chang James\u00a0Y. Zou Venkatesh Saligrama and Adam\u00a0Tauman Kalai. 2016. Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings. (2016) 4349\u20134357."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"crossref","unstructured":"Shikha Bordia and Samuel\u00a0R. Bowman. 2019. Identifying and Reducing Gender Bias in Word-Level Language Models. CoRR abs\/1904.03035(2019).  Shikha Bordia and Samuel\u00a0R. Bowman. 2019. Identifying and Reducing Gender Bias in Word-Level Language Models. CoRR abs\/1904.03035(2019).","DOI":"10.18653\/v1\/N19-3002"},{"key":"e_1_3_2_2_6_1","volume-title":"Semantics derived automatically from language corpora contain human-like biases. Science 356, 6334","author":"Caliskan Aylin","year":"2017","unstructured":"Aylin Caliskan , Joanna\u00a0 J Bryson , and Arvind Narayanan . 2017. Semantics derived automatically from language corpora contain human-like biases. Science 356, 6334 ( 2017 ), 183\u2013186. Aylin Caliskan, Joanna\u00a0J Bryson, and Arvind Narayanan. 2017. Semantics derived automatically from language corpora contain human-like biases. Science 356, 6334 (2017), 183\u2013186."},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2020.102377"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"crossref","unstructured":"Joel\u00a0Escud\u00e9 Font and Marta\u00a0R. Costa-juss\u00e0. 2019. Equalizing Gender Biases in Neural Machine Translation with Word Embeddings Techniques. CoRR abs\/1901.03116(2019). arXiv:1901.03116  Joel\u00a0Escud\u00e9 Font and Marta\u00a0R. Costa-juss\u00e0. 2019. Equalizing Gender Biases in Neural Machine Translation with Word Embeddings Techniques. CoRR abs\/1901.03116(2019). arXiv:1901.03116","DOI":"10.18653\/v1\/W19-3821"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3409256.3409834"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"crossref","unstructured":"Hila Gonen and Yoav Goldberg. 2019. Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Them. (2019).  Hila Gonen and Yoav Goldberg. 2019. Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Them. (2019).","DOI":"10.18653\/v1\/N19-1061"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998321"},{"key":"e_1_3_2_2_12_1","unstructured":"Haochen Liu Jamell Dacon Wenqi Fan Hui Liu Zitao Liu and Jiliang Tang. 2019. Does Gender Matter? Towards Fairness in Dialogue Systems. CoRR abs\/1910.10486(2019). arXiv:1910.10486  Haochen Liu Jamell Dacon Wenqi Fan Hui Liu Zitao Liu and Jiliang Tang. 2019. Does Gender Matter? Towards Fairness in Dialogue Systems. CoRR abs\/1910.10486(2019). arXiv:1910.10486"},{"key":"e_1_3_2_2_13_1","unstructured":"Haochen Liu Wentao Wang Yiqi Wang Hui Liu Zitao Liu and Jiliang Tang. 2020. Mitigating Gender Bias for Neural Dialogue Generation with Adversarial Learning. CoRR abs\/2009.13028(2020). arXiv:2009.13028  Haochen Liu Wentao Wang Yiqi Wang Hui Liu Zitao Liu and Jiliang Tang. 2020. Mitigating Gender Bias for Neural Dialogue Generation with Adversarial Learning. CoRR abs\/2009.13028(2020). arXiv:2009.13028"},{"key":"e_1_3_2_2_14_1","volume-title":"Logic, Language, and Security","author":"Lu Kaiji","unstructured":"Kaiji Lu , Piotr Mardziel , Fangjing Wu , Preetam Amancharla , and Anupam Datta . 2020. Gender bias in neural natural language processing . In Logic, Language, and Security . Springer , 189\u2013202. Kaiji Lu, Piotr Mardziel, Fangjing Wu, Preetam Amancharla, and Anupam Datta. 2020. Gender bias in neural natural language processing. In Logic, Language, and Security. Springer, 189\u2013202."},{"key":"e_1_3_2_2_15_1","volume-title":"Gender Bias in Neural Natural Language Processing. 12300","author":"Lu Kaiji","year":"2020","unstructured":"Kaiji Lu , Piotr Mardziel , Fangjing Wu , and Anupam Datta . 2020. Gender Bias in Neural Natural Language Processing. 12300 ( 2020 ), 189\u2013202. Kaiji Lu, Piotr Mardziel, Fangjing Wu, and Anupam Datta. 2020. Gender Bias in Neural Natural Language Processing. 12300 (2020), 189\u2013202."},{"key":"e_1_3_2_2_16_1","volume-title":"MS MARCO: A Human Generated MAchine Reading COmprehension Dataset, Vol.\u00a01773. CEUR-WS.org.","author":"Nguyen Tri","year":"2016","unstructured":"Tri Nguyen , Mir Rosenberg , Xia Song , Jianfeng Gao , Saurabh Tiwary , Rangan Majumder , and Li Deng . 2016 . MS MARCO: A Human Generated MAchine Reading COmprehension Dataset, Vol.\u00a01773. CEUR-WS.org. Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, and Li Deng. 2016. MS MARCO: A Human Generated MAchine Reading COmprehension Dataset, Vol.\u00a01773. CEUR-WS.org."},{"key":"e_1_3_2_2_17_1","volume-title":"ACM SIGIR Forum, Vol.\u00a053. ACM New York","author":"Olteanu Alexandra","unstructured":"Alexandra Olteanu , Jean Garcia-Gathright , Maarten de Rijke , Michael\u00a0 D Ekstrand , Adam Roegiest , Aldo Lipani , Alex Beutel , Alexandra Olteanu , Ana Lucic , Ana-Andreea Stoica , 2021. FACTS-IR: fairness, accountability, confidentiality, transparency, and safety in information retrieval . In ACM SIGIR Forum, Vol.\u00a053. ACM New York , NY , USA , 20\u201343. Alexandra Olteanu, Jean Garcia-Gathright, Maarten de Rijke, Michael\u00a0D Ekstrand, Adam Roegiest, Aldo Lipani, Alex Beutel, Alexandra Olteanu, Ana Lucic, Ana-Andreea Stoica, 2021. FACTS-IR: fairness, accountability, confidentiality, transparency, and safety in information retrieval. In ACM SIGIR Forum, Vol.\u00a053. ACM New York, NY, USA, 20\u201343."},{"key":"e_1_3_2_2_18_1","volume-title":"Linguistic inquiry and word count: LIWC","author":"Pennebaker W","year":"2001","unstructured":"James\u00a0 W Pennebaker , Martha\u00a0 E Francis , and Roger\u00a0 J Booth . 2001. Linguistic inquiry and word count: LIWC 2001 . Mahway : Lawrence Erlbaum Associates 71 (2001). James\u00a0W Pennebaker, Martha\u00a0E Francis, and Roger\u00a0J Booth. 2001. Linguistic inquiry and word count: LIWC 2001. Mahway: Lawrence Erlbaum Associates 71 (2001)."},{"key":"#cr-split#-e_1_3_2_2_19_1.1","doi-asserted-by":"crossref","unstructured":"Navid Rekabsaz Simone Kopeinik and Markus Schedl. 2021. Societal Biases in Retrieved Contents: Measurement Framework and Adversarial Mitigation of BERT Rankers. (2021) 306-316. https:\/\/doi.org\/10.1145\/3404835.3462949 10.1145\/3404835.3462949","DOI":"10.1145\/3404835.3462949"},{"key":"#cr-split#-e_1_3_2_2_19_1.2","doi-asserted-by":"crossref","unstructured":"Navid Rekabsaz Simone Kopeinik and Markus Schedl. 2021. Societal Biases in Retrieved Contents: Measurement Framework and Adversarial Mitigation of BERT Rankers. (2021) 306-316. https:\/\/doi.org\/10.1145\/3404835.3462949","DOI":"10.1145\/3404835.3462949"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401280"},{"key":"e_1_3_2_2_21_1","volume-title":"Okapi at TREC-3. 500-225","author":"Robertson E.","year":"1994","unstructured":"Stephen\u00a0 E. Robertson , Steve Walker , Susan Jones , Micheline Hancock-Beaulieu , and Mike Gatford . 1994. Okapi at TREC-3. 500-225 ( 1994 ), 109\u2013126. Stephen\u00a0E. Robertson, Steve Walker, Susan Jones, Micheline Hancock-Beaulieu, and Mike Gatford. 1994. Okapi at TREC-3. 500-225 (1994), 109\u2013126."},{"key":"e_1_3_2_2_22_1","unstructured":"Shirin SeyedSalehi Amin Bigdeli Negar Arabzadeh Bhaskar Mitra Morteza Zihayat and Ebrahim Bagheri. 2022. Bias-aware Fair Neural Ranking for Addressing Stereotypical Gender Biases. (2022).  Shirin SeyedSalehi Amin Bigdeli Negar Arabzadeh Bhaskar Mitra Morteza Zihayat and Ebrahim Bagheri. 2022. Bias-aware Fair Neural Ranking for Addressing Stereotypical Gender Biases. (2022)."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220088"},{"key":"e_1_3_2_2_24_1","unstructured":"Gabriel Stanovsky Noah\u00a0A. Smith and Luke Zettlemoyer. 2019. Evaluating Gender Bias in Machine Translation. CoRR abs\/1906.00591(2019). arXiv:1906.00591  Gabriel Stanovsky Noah\u00a0A. Smith and Luke Zettlemoyer. 2019. Evaluating Gender Bias in Machine Translation. CoRR abs\/1906.00591(2019). arXiv:1906.00591"},{"key":"e_1_3_2_2_25_1","unstructured":"Eva Vanmassenhove Christian Hardmeier and Andy Way. 2019. Getting Gender Right in Neural Machine Translation. CoRR abs\/1909.05088(2019). arXiv:1909.05088  Eva Vanmassenhove Christian Hardmeier and Andy Way. 2019. Getting Gender Right in Neural Machine Translation. CoRR abs\/1909.05088(2019). arXiv:1909.05088"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080721"}],"event":{"name":"WebSci '22: 14th ACM Web Science Conference 2022","location":"Barcelona Spain","acronym":"WebSci '22","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"]},"container-title":["14th ACM Web Science Conference 2022"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3501247.3531540","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3501247.3531540","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:12:18Z","timestamp":1750191138000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3501247.3531540"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,26]]},"references-count":27,"alternative-id":["10.1145\/3501247.3531540","10.1145\/3501247"],"URL":"https:\/\/doi.org\/10.1145\/3501247.3531540","relation":{},"subject":[],"published":{"date-parts":[[2022,6,26]]},"assertion":[{"value":"2022-06-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}