{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,23]],"date-time":"2026-06-23T21:35:37Z","timestamp":1782250537912,"version":"3.54.5"},"reference-count":117,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2025,2,10]],"date-time":"2025-02-10T00:00:00Z","timestamp":1739145600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Norwegian Research Center for AI Innovation, NorwAI","award":["309834"],"award-info":[{"award-number":["309834"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2025,6,30]]},"abstract":"<jats:p>We live in an information society that strongly relies on information retrieval systems, such as search engines and conversational assistants. Consequently, the trustworthiness of these systems is of critical importance and has attracted significant research attention in recent years. In this work, we perform a systematic literature review of the field of fairness, accountability, transparency, and ethics in information retrieval. In particular, we investigate the definitions, approaches, and evaluation methodologies proposed to build trustworthy information retrieval systems. This review reveals the lack of standard definitions, arguably due to the multi-dimensional nature of the different notions. In terms of approaches, most of the work focuses on building either a fair or a transparent information retrieval system. As for evaluation, fairness is often assessed by means of automatic evaluation, while accountability and transparency are most commonly evaluated using audits and user studies. Based on the surveyed literature, we develop taxonomies of requirements for the different notions, and further use these taxonomies to propose practical definitions to quantify the degree to which an information retrieval system satisfies a given notion. Finally, we discuss challenges that have yet to be solved for information retrieval systems to be trustworthy.<\/jats:p>\n          <jats:p\/>","DOI":"10.1145\/3637211","type":"journal-article","created":{"date-parts":[[2023,12,16]],"date-time":"2023-12-16T06:07:41Z","timestamp":1702706861000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":29,"title":["A Systematic Review of Fairness, Accountability, Transparency, and Ethics in Information Retrieval"],"prefix":"10.1145","volume":"57","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-0565-3210","authenticated-orcid":false,"given":"Nolwenn","family":"Bernard","sequence":"first","affiliation":[{"name":"University of Stavanger, Stavanger, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2762-721X","authenticated-orcid":false,"given":"Krisztian","family":"Balog","sequence":"additional","affiliation":[{"name":"University of Stavanger, Stavanger, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,2,10]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.3390\/informatics9010006"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/2124295.2124354"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-30179-8_4"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3409256.3409831"},{"key":"e_1_3_2_6_2","unstructured":"Julia Angwin Jeff Larson Surya Mattu and Lauren Kirchner. 2016. Machine Bias. Retrieved from https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-015-0386-1"},{"issue":"3","key":"e_1_3_2_8_2","first-page":"671","article-title":"Big data\u2019s disparate impact essay","volume":"104","author":"Barocas Solon","year":"2016","unstructured":"Solon Barocas and Andrew D. Selbst. 2016. Big data\u2019s disparate impact essay. Calif. Law Rev. 104, 3 (2016), 671\u2013732.","journal-title":"Calif. Law Rev."},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/62437.62446"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445922"},{"key":"e_1_3_2_11_2","unstructured":"Asia Biega. 2022. Responsible Design of Information Access Systems. Retrieved from http:\/\/essir2022.org\/slides\/asia-biega.pdf"},{"key":"e_1_3_2_12_2","volume-title":"Proceedings of the 28th Text REtrieval Conference Proceedings (TREC\u201919)","author":"Biega Asia J.","year":"2019","unstructured":"Asia J. Biega, Fernando Diaz, Michael D. Ekstrand, and Sebastian Kohlmeier. 2019. Overview of the TREC 2019 fair ranking track. In Proceedings of the 28th Text REtrieval Conference Proceedings (TREC\u201919)."},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210063"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-78468-3_18"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2017.154"},{"key":"e_1_3_2_16_2","volume-title":"Proceedings of the 1st Workshop on Recommender Systems for Human Resources co-located with the 15th ACM Conference on Recommender Systems (RecSysHR\u201921)","author":"Burke Ian","year":"2021","unstructured":"Ian Burke, Robin Burke, and Goran Kuljanin. 2021. Fair candidate ranking with spatial partitioning: Lessons from the SIOP ML competition. In Proceedings of the 1st Workshop on Recommender Systems for Human Resources co-located with the 15th ACM Conference on Recommender Systems (RecSysHR\u201921)."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308774.3308783"},{"key":"e_1_3_2_18_2","first-page":"28:1\u201328:15","volume-title":"Proceedings of the 45th International Colloquium on Automata, Languages, and Programming (ICALP\u201918)","author":"Celis L. Elisa","year":"2018","unstructured":"L. Elisa Celis, Damian Straszak, and Nisheeth K. Vishnoi. 2018. Ranking with fairness constraints. In Proceedings of the 45th International Colloquium on Automata, Languages, and Programming (ICALP\u201918). 28:1\u201328:15."},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/DSAA49011.2020.00083"},{"key":"e_1_3_2_20_2","volume-title":"Proceedings of the Joint Conference of the Information Retrieval Communities in Europe (CIRCLE\u201920)","author":"Chifu Adrian-Gabriel","year":"2020","unstructured":"Adrian-Gabriel Chifu, Josiane Mothe, and Md Zia Ullah. 2020. Fair exposure of documents in information retrieval: A community detection approach. In Proceedings of the Joint Conference of the Information Retrieval Communities in Europe (CIRCLE\u201920)."},{"key":"e_1_3_2_21_2","first-page":"31","article-title":"Artificial intelligence: Some ethical issues and regulatory challenges","volume":"2019","author":"Coeckelbergh Mark","year":"2019","unstructured":"Mark Coeckelbergh. 2019. Artificial intelligence: Some ethical issues and regulatory challenges. Technol. Regulat. 2019 (2019), 31\u201334.","journal-title":"Technol. Regulat."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/1142473.1142518"},{"key":"e_1_3_2_23_2","unstructured":"Chris DeBrusk. 2018. The Risk of Machine Learning Bias (And How to Prevent It). Retrieved from https:\/\/sloanreview.mit.edu\/article\/the-risk-of-machine-learning-bias-and-how-to-prevent-it\/"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICHMS53169.2021.9582653"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-78818-6_7"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377325.3377524"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3411962"},{"key":"e_1_3_2_28_2","volume-title":"Proceedings of the 1st International Workshop on Supporting Complex Search Tasks co-located with the 37th European Conference on Information Retrieval (SCST\u201915)","author":"Dori-Hacohen Shiri","year":"2015","unstructured":"Shiri Dori-Hacohen, Elad Yom-Tov, and James Allan. 2015. Navigating controversy as a complex search task. In Proceedings of the 1st International Workshop on Supporting Complex Search Tasks co-located with the 37th European Conference on Information Retrieval (SCST\u201915)."},{"key":"e_1_3_2_29_2","unstructured":"Dheeru Dua and Casey Graff. 2017. UCI Machine Learning Repository. Retrieved from http:\/\/archive.ics.uci.edu\/ml"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331380"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1561\/1500000079"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/1008992.1009004"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-78818-6_1"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.2005343"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1038\/nbt.4267"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2014.01.013"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3433949"},{"key":"e_1_3_2_38_2","first-page":"1","article-title":"FAIR: Fairness-aware information retrieval evaluation","author":"Gao Ruoyuan","year":"2022","unstructured":"Ruoyuan Gao, Yingqiang Ge, and Chirag Shah. 2022. FAIR: Fairness-aware information retrieval evaluation. J. Assoc. Inf. Sci. Technol. 73, 10 (2022), 1\u201313.","journal-title":"J. Assoc. Inf. Sci. Technol."},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/3341981.3344215"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2019.102138"},{"key":"e_1_3_2_41_2","volume-title":"Basics of Grounded Theory Analysis: Emergence Vs. Forcing","author":"Glaser Barney G.","year":"1992","unstructured":"Barney G. Glaser. 1992. Basics of Grounded Theory Analysis: Emergence Vs. Forcing. Sociology Press."},{"key":"e_1_3_2_42_2","unstructured":"David Graff. 2002. The AQUAINT Corpus of English News Text. Retrieved from https:\/\/catalog.ldc.upenn.edu\/LDC2002T31"},{"key":"e_1_3_2_43_2","first-page":"281","volume-title":"Proceedings of the 14th Conference of the International Society for Music Information Retrieval (ISMIR\u201913)","author":"Grant Maurice","year":"2013","unstructured":"Maurice Grant, Adeesha Ekanayake, and Douglas Turnbull. 2013. Meuse: Recommending internet radio stations. In Proceedings of the 14th Conference of the International Society for Music Information Retrieval (ISMIR\u201913). 281\u2013286."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1378"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11023-020-09517-8"},{"issue":"4","key":"e_1_3_2_46_2","article-title":"Guardians of the knowledge: Relevant, irrelevant, or algorithmic?","volume":"24","author":"Hajibayova Lala","year":"2019","unstructured":"Lala Hajibayova. 2019. Guardians of the knowledge: Relevant, irrelevant, or algorithmic? Inf. Res. 24, 4 (2019).","journal-title":"Inf. Res."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/2827872"},{"key":"e_1_3_2_48_2","volume-title":"Proceedings of the Workshop on Explainable Smart Systems for Algorithmic Transparency in Emerging Technologies co-located with 25th International Conference on Intelligent User Interfaces (ExSS-ATEC\u201920)","author":"Hepenstal Sam","year":"2020","unstructured":"Sam Hepenstal, Leishi Zhang, Neesha Kodagoda, and B. L. William Wong. 2020. What are you thinking? Explaining conversation agent responses for criminal investigations. In Proceedings of the Workshop on Explainable Smart Systems for Algorithmic Transparency in Emerging Technologies co-located with 25th International Conference on Intelligent User Interfaces (ExSS-ATEC\u201920)."},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-64949-4_11"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10676-006-9133-z"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-019-0088-2"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3269224"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702520"},{"key":"e_1_3_2_54_2","volume-title":"Guidelines for Performing Systematic Literature Reviews in Software Engineering","author":"Kitchenham Barbara Ann","year":"2007","unstructured":"Barbara Ann Kitchenham and Stuart Charters. 2007. Guidelines for Performing Systematic Literature Reviews in Software Engineering. Technical Report. Keele University and Durham University Joint Report."},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462588"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313443"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1093\/ijlit\/ean018"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/1463160.1463187"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1145\/2898361"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-47852-4_4"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/3446426"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1561\/1500000016"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.4018\/978-1-59904-543-6.ch010"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1108\/JD-10-2020-0177"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1177\/0267323104045258"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511809071"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-021-09399-z"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1023\/B:INRT.0000009441.78971.be"},{"key":"e_1_3_2_69_2","first-page":"100","volume-title":"Proceedings of the 1st Workshop on Bridging the Gap between Information Science, Information Retrieval and Data Science co-located with 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (BIRDS\u201920)","author":"Melucci Massimo","year":"2020","unstructured":"Massimo Melucci. 2020. Some reflections on the use of structural equation modeling for investigating the causal relationships that affect search engine results. In Proceedings of the 1st Workshop on Bridging the Gap between Information Science, Information Retrieval and Data Science co-located with 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (BIRDS\u201920). 100\u2013109."},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cosrev.2018.10.001"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331306"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1561\/1500000061"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2004.05.005"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/383952.383991"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.3390\/info12020065"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/3458553.3458556"},{"issue":"89","key":"e_1_3_2_77_2","article-title":"The PRISMA 2020 statement: An updated guideline for reporting systematic reviews","volume":"10","author":"Page Matthew J.","year":"2021","unstructured":"Matthew J. Page, Joanne E. McKenzie, , Patrick M. Bossuyt, Isabelle Boutron, Tammy C. Hoffmann, Cynthia D. Mulrow, Larissa Shamseer, Jennifer M. Tetzlaff, Elie A. Akl, Sue E. Brennan, Roger Chou, Julie Glanville, Jeremy M. Grimshaw, Asbj\u00f8rn Hr\u00f3bjartsson, Manoj M. Lalu, Tianjing Li, Elizabeth W. Loder, Evan Mayo-Wilson, Steve McDonald, Luke A. McGuinness, Lesley A. Stewart, James Thomas, Andrea C. Tricco, Vivian A. Welch, Penny Whiting, and David Moher. 2021. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. System. Rev. 10, 89 (2021).","journal-title":"System. Rev."},{"key":"e_1_3_2_78_2","article-title":"Beyond algorithmic bias: A socio-computational interrogation of the Google search by image algorithm","author":"Papakyriakopoulos Orestis","year":"2022","unstructured":"Orestis Papakyriakopoulos and Arwa M. Mboya. 2022. Beyond algorithmic bias: A socio-computational interrogation of the Google search by image algorithm. Soc. Sci. Comput. Rev. 41, 4 (2022).","journal-title":"Soc. Sci. Comput. Rev."},{"key":"e_1_3_2_79_2","unstructured":"The European Parliament and the Council of the European Union. 2021. The Artificial Intelligence Act. Retrieved from https:\/\/artificialintelligenceact.eu"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482099"},{"key":"e_1_3_2_81_2","first-page":"651","volume-title":"Proceedings of the 23rd International Conference on Extending Database Technology (EDBT\u201920)","author":"Pitoura Evaggelia","year":"2020","unstructured":"Evaggelia Pitoura, Georgia Koutrika, and Kostas Stefanidis. 2020. Fairness in rankings and recommenders. In Proceedings of the 23rd International Conference on Extending Database Technology (EDBT\u201920). 651\u2013654."},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1109\/MDM52706.2021.00013"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-021-00697-y"},{"key":"e_1_3_2_84_2","unstructured":"Tao Qin and Tie-Yan Liu. 2013. Introducing LETOR 4.0 Datasets. arxiv:1306.2597"},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401279"},{"key":"e_1_3_2_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462949"},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-85616-8_39"},{"key":"e_1_3_2_88_2","first-page":"2432","volume-title":"Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201920)","author":"Roy Rishiraj Saha","year":"2020","unstructured":"Rishiraj Saha Roy and Avishek Anand. 2020. Question answering over curated and open web sources. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201920). 2432\u20132435."},{"key":"e_1_3_2_89_2","first-page":"553","volume-title":"Proceedings of the World Wide Web Conference (WWW\u201919)","author":"Sapiezynski Piotr","year":"2019","unstructured":"Piotr Sapiezynski, Wesley Zeng, Ronald E. Robertson, Alan Mislove, and Christo Wilson. 2019. Quantifying the impact of user attention on fair group representation in ranked lists. In Proceedings of the World Wide Web Conference (WWW\u201919). 553\u2013562."},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.1145\/3289600.3290620"},{"key":"e_1_3_2_91_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-30284-8_49"},{"issue":"1","key":"e_1_3_2_92_2","article-title":"User centered and ontology based information retrieval system for life sciences","volume":"13","author":"Sy Mohameth-Fran\u00e7ois","year":"2012","unstructured":"Mohameth-Fran\u00e7ois Sy, Sylvie Ranwez, Jacky Montmain, Armelle Regnault, Michel Crampes, and Vincent Ranwez. 2012. User centered and ontology based information retrieval system for life sciences. BMC Bioinform. 13, 1 (2012).","journal-title":"BMC Bioinform."},{"key":"e_1_3_2_93_2","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462602"},{"key":"e_1_3_2_94_2","doi-asserted-by":"publisher","DOI":"10.1139\/facets-2019-0002"},{"key":"e_1_3_2_95_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2021.102711"},{"key":"e_1_3_2_96_2","doi-asserted-by":"publisher","DOI":"10.1145\/3371390"},{"key":"e_1_3_2_97_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401292"},{"key":"e_1_3_2_98_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1083-6101.2007.00354.x"},{"key":"e_1_3_2_99_2","first-page":"5998","volume-title":"Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS\u201917)","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS\u201917). 5998\u20136008."},{"key":"e_1_3_2_100_2","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331377"},{"key":"e_1_3_2_101_2","first-page":"624","volume-title":"Proceedings of International Conference on Recent Advances in Natural Language Processing (RANLP\u201907)","author":"Vilares Jes\u00fas","year":"2007","unstructured":"Jes\u00fas Vilares, Michael P. Oakes, and Manuel Vilares. 2007. A knowledge-light approach to query translation in cross-language information retrieval. In Proceedings of International Conference on Recent Advances in Natural Language Processing (RANLP\u201907). 624\u2013630."},{"key":"e_1_3_2_102_2","doi-asserted-by":"publisher","DOI":"10.1145\/3471158.3472256"},{"key":"e_1_3_2_103_2","volume-title":"TREC: Experiment and Evaluation in Information Retrieval","author":"Voorhees Ellen","year":"2005","unstructured":"Ellen Voorhees and Donna Harman. 2005. TREC: Experiment and Evaluation in Information Retrieval. MIT Press."},{"key":"e_1_3_2_104_2","doi-asserted-by":"publisher","DOI":"10.1145\/3471158.3472260"},{"key":"e_1_3_2_105_2","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911515"},{"key":"e_1_3_2_106_2","unstructured":"Linda F. Wightman. 1998. LSAC National Longitudinal Bar Passage Study. LSAC Research Report Series.https:\/\/eric.ed.gov\/?id=ED469370"},{"key":"e_1_3_2_107_2","doi-asserted-by":"publisher","DOI":"10.3389\/fdata.2021.622106"},{"key":"e_1_3_2_108_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380305"},{"key":"e_1_3_2_109_2","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052591"},{"key":"e_1_3_2_110_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/836"},{"key":"e_1_3_2_111_2","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3193568"},{"key":"e_1_3_2_112_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3132938"},{"key":"e_1_3_2_113_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366424.3383534"},{"key":"e_1_3_2_114_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2021.102707"},{"issue":"6","key":"e_1_3_2_115_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3533379","article-title":"Fairness in ranking, part I: Score-based ranking","volume":"55","author":"Zehlike Meike","year":"2022","unstructured":"Meike Zehlike, Ke Yang, and Julia Stoyanovich. 2022. Fairness in ranking, part I: Score-based ranking. Comput. Surv. 55, 6 (2022), 1\u201336.","journal-title":"Comput. Surv."},{"key":"e_1_3_2_116_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308774.3308795"},{"key":"e_1_3_2_117_2","doi-asserted-by":"publisher","DOI":"10.1109\/FSKD.2018.8687122"},{"key":"e_1_3_2_118_2","first-page":"507","volume-title":"Web Search Studies: Multidisciplinary Perspectives on Web Search Engines","author":"Zimmer Michael","year":"2010","unstructured":"Michael Zimmer. 2010. Web Search Studies: Multidisciplinary Perspectives on Web Search Engines. Springer Netherlands, 507\u2013521."}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3637211","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3637211","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T23:43:42Z","timestamp":1750290222000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3637211"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,10]]},"references-count":117,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2025,6,30]]}},"alternative-id":["10.1145\/3637211"],"URL":"https:\/\/doi.org\/10.1145\/3637211","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,10]]},"assertion":[{"value":"2022-10-14","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-12-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-02-10","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}