{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T18:45:52Z","timestamp":1774291552009,"version":"3.50.1"},"reference-count":206,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,6,1]],"date-time":"2024-06-01T00:00:00Z","timestamp":1717200000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:p>\n            The First Search Futures Workshop, in conjunction with the\n            <jats:italic>Fourty-sixth European Conference on Information Retrieval (ECIR)<\/jats:italic>\n            2024, looked into the future of search to ask questions such as:\n          <\/jats:p>\n          <jats:p>\u2022 How can we harness the power of generative AI to enhance, improve and re-imagine Information Retrieval (IR)?<\/jats:p>\n          <jats:p>\u2022 What are the principles and fundamental rights that the field of Information Retrieval should strive to uphold?<\/jats:p>\n          <jats:p>\u2022 How can we build trustworthy IR systems in light of Large Language Models and their ability to generate content at super human speeds?<\/jats:p>\n          <jats:p>\u2022 What new applications and affordances does generative AI offer and enable, and can we go back to the future, and do what we only dreamed of previously?<\/jats:p>\n          <jats:p>The workshop started with seventeen lightning talks from a diverse set speakers. Instead of conventional paper presentations, the lightning talks provided a rapid and concise overview of ideas, allowing speakers to share critical points or novel concepts quickly. This format was designed to encourage discussion and introduce a wide range of topics within a short period, thereby maximising the exchange of ideas and ensuring that participants could gain insights into various future search areas without the deep dive typically required in longer presentations. This report, co-authored by the workshop's organisers and its participants, summarises the talks and discussions. This report aims to provide the broader IR community with the insights and ideas discussed and debated during the workshop - and to provide a platform for future discussion.<\/jats:p>\n          <jats:p>\n            <jats:bold>Date<\/jats:bold>\n            : 24 March 2024.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Website<\/jats:bold>\n            : https:\/\/searchfutures.github.io\/.\n          <\/jats:p>","DOI":"10.1145\/3687273.3687288","type":"journal-article","created":{"date-parts":[[2024,8,7]],"date-time":"2024-08-07T22:24:53Z","timestamp":1723069493000},"page":"1-41","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Report on the Search Futures Workshop at ECIR 2024"],"prefix":"10.1145","volume":"58","author":[{"given":"Leif","family":"Azzopardi","sequence":"first","affiliation":[{"name":"University of Strathclyde, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Charles L. A.","family":"Clarke","sequence":"additional","affiliation":[{"name":"University of Waterloo, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul","family":"Kantor","sequence":"additional","affiliation":[{"name":"University of Wisconsin Madison, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bhaskar","family":"Mitra","sequence":"additional","affiliation":[{"name":"Microsoft, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Johanne R.","family":"Trippas","sequence":"additional","affiliation":[{"name":"RMIT University, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhaochun","family":"Ren","sequence":"additional","affiliation":[{"name":"Leiden University, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohammad","family":"Aliannejadi","sequence":"additional","affiliation":[{"name":"University of Amsterdam, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Negar","family":"Arabzadeh","sequence":"additional","affiliation":[{"name":"University of Waterloo, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raman","family":"Chandrasekar","sequence":"additional","affiliation":[{"name":"Institute for Experiential AI, Northeastern University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maarten","family":"de Rijke","sequence":"additional","affiliation":[{"name":"University of Amsterdam, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Panagiotis","family":"Eustratiadis","sequence":"additional","affiliation":[{"name":"University of Amsterdam, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"William","family":"Hersh","sequence":"additional","affiliation":[{"name":"Oregon Health &amp; Science University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jin","family":"Huang","sequence":"additional","affiliation":[{"name":"University of Amsterdam, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Evangelos","family":"Kanoulas","sequence":"additional","affiliation":[{"name":"University of Amsterdam, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jasmin","family":"Kareem","sequence":"additional","affiliation":[{"name":"Eindhoven University of Technology, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongkang","family":"Li","sequence":"additional","affiliation":[{"name":"University of Amsterdam, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Simon","family":"Lupart","sequence":"additional","affiliation":[{"name":"University of Amsterdam, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kidist Amde","family":"Mekonnen","sequence":"additional","affiliation":[{"name":"University of Amsterdam, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adam","family":"Roegiest","sequence":"additional","affiliation":[{"name":"Zuva, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ian","family":"Soboroff","sequence":"additional","affiliation":[{"name":"NIST, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fabrizio","family":"Silvestri","sequence":"additional","affiliation":[{"name":"Sapienza University of Rome, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Suzan","family":"Verberne","sequence":"additional","affiliation":[{"name":"Leiden University, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Vos","sequence":"additional","affiliation":[{"name":"University of Amsterdam, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eugene","family":"Yang","sequence":"additional","affiliation":[{"name":"Johns Hopkins University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuyue","family":"Zhao","sequence":"additional","affiliation":[{"name":"University of Amsterdam, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,8,7]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-07012-9_39"},{"key":"e_1_2_1_2_1","first-page":"3712","volume-title":"Leif Azzopardi. Retrievability Bias Estimation Using Synthetically Generated Queries. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management","author":"Abolghasemi Amin","year":"2023","unstructured":"Amin Abolghasemi, Suzan Verberne, Arian Askari, and Leif Azzopardi. Retrievability Bias Estimation Using Synthetically Generated Queries. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, pages 3712--3716, 2023."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-56069-9_1"},{"key":"e_1_2_1_4_1","volume-title":"Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. GPT-4 technical report. arXiv preprint arXiv:2303.08774","author":"Achiam Josh","year":"2023","unstructured":"Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. GPT-4 technical report. arXiv preprint arXiv:2303.08774, 2023."},{"key":"e_1_2_1_5_1","volume-title":"Charles LA Clarke, and Mark Sanderson. Generative information retrieval evaluation. arXiv preprint arXiv:2404.08137","author":"Alaofi Marwah","year":"2024","unstructured":"Marwah Alaofi, Negar Arabzadeh, Charles LA Clarke, and Mark Sanderson. Generative information retrieval evaluation. arXiv preprint arXiv:2404.08137, 2024."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343413.3377968"},{"key":"e_1_2_1_7_1","volume-title":"Explainable information retrieval: A survey. arXiv preprint arXiv:2211.02405","author":"Anand Avishek","year":"2022","unstructured":"Avishek Anand, Lijun Lyu, Maximilian Idahl, Yumeng Wang, Jonas Wallat, and Zijian Zhang. Explainable information retrieval: A survey. arXiv preprint arXiv:2211.02405, 2022."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3539618.3594249"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380281"},{"key":"e_1_2_1_10_1","volume-title":"A comparison of methods for evaluating generative ir. arXiv preprint arXiv:2404.04044","author":"Arabzadeh Negar","year":"2024","unstructured":"Negar Arabzadeh and Charles LA Clarke. A comparison of methods for evaluating generative ir. arXiv preprint arXiv:2404.04044, 2024a."},{"key":"e_1_2_1_11_1","volume-title":"Fr\u00e9chet distance for offline evaluation of information retrieval systems with sparse labels. arXiv preprint arXiv:2401.17543","author":"Arabzadeh Negar","year":"2024","unstructured":"Negar Arabzadeh and Charles LA Clarke. Fr\u00e9chet distance for offline evaluation of information retrieval systems with sparse labels. arXiv preprint arXiv:2401.17543, 2024b."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-56060-6_26"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3583780.3614812"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3583780.3615111"},{"key":"e_1_2_1_15_1","first-page":"10087","volume-title":"Generate: RL-driven Document Generation for Passage Reranking. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing","author":"Askari Arian","year":"2023","unstructured":"Arian Askari, Mohammad Aliannejadi, Chuan Meng, Evangelos Kanoulas, and Suzan Verberne. Expand, Highlight, Generate: RL-driven Document Generation for Passage Reranking. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 10087--10099, 2023c."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1101\/2023.12.22.23300458"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1924475.1924484"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-56069-9_57"},{"key":"e_1_2_1_19_1","volume-title":"Aaron Steven White, et al. Megawika: Millions of reports and their sources across 50 diverse languages. arXiv preprint arXiv:2307.07049","author":"Barham Samuel","year":"2023","unstructured":"Samuel Barham, Orion Weller, Michelle Yuan, Kenton Murray, Mahsa Yarmohammadi, Zhengping Jiang, Siddharth Vashishtha, Alexander Martin, Anqi Liu, Aaron Steven White, et al. Megawika: Millions of reports and their sources across 50 diverse languages. arXiv preprint arXiv:2307.07049, 2023."},{"key":"e_1_2_1_20_1","volume-title":"Perspectives on Predictive Coding: And Other Advanced Search Methods for the Legal Practitioner","author":"Baron J.R.","year":"2016","unstructured":"J.R. Baron, R.C. Losey, and M.D. Berman. Perspectives on Predictive Coding: And Other Advanced Search Methods for the Legal Practitioner. American Bar Association, Section of Litigation, 2016. ISBN 9781634256582. URL https:\/\/books.google.com\/books?id=TdJ2AQAACAAJ."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1394251.1394261"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the ASIS Annual Meeting","author":"Belkin NJ","year":"1976","unstructured":"NJ Belkin and SE Robertson. Some ethical and political implications of theoretical research in information science. In Proceedings of the ASIS Annual Meeting, 1976."},{"key":"e_1_2_1_23_1","volume-title":"Simulations in recommender systems: An industry perspective. arXiv preprint arXiv:2109.06723","author":"Bernardi Lucas","year":"2021","unstructured":"Lucas Bernardi, Sakshi Batra, and Cintia Alicia Bruscantini. Simulations in recommender systems: An industry perspective. arXiv preprint arXiv:2109.06723, 2021."},{"key":"e_1_2_1_24_1","volume-title":"Sebastian Riedel, and Fabio Petroni. Autoregressive search engines: Generating substrings as document identifiers. arXiv preprint arXiv:2204.10628","author":"Bevilacqua Michele","year":"2022","unstructured":"Michele Bevilacqua, Giuseppe Ottaviano, Patrick Lewis, Wen tau Yih, Sebastian Riedel, and Fabio Petroni. Autoregressive search engines: Generating substrings as document identifiers. arXiv preprint arXiv:2204.10628, 2022."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3375624"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3357939"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3334480.3383047"},{"key":"e_1_2_1_28_1","volume-title":"Autoregressive entity retrieval. arXiv preprint arXiv:2010.00904","author":"Cao Nicola De","year":"2021","unstructured":"Nicola De Cao, Gautier Izacard, Sebastian Riedel, and Fabio Petroni. Autoregressive entity retrieval. arXiv preprint arXiv:2010.00904, 2021."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1008992.1009080"},{"key":"e_1_2_1_30_1","volume-title":"Temporal ranking of search results","author":"Chandrasekar Raman","year":"2006","unstructured":"Raman Chandrasekar, Dean A. Slawson, and Michael K. Forney. Temporal ranking of search results, 2006. US Patent US7849079B2 Filed 2006, Granted 2010."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3511808.3557271"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3583780.3614821"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3539618.3591631"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3289600.3290999"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220122"},{"key":"e_1_2_1_36_1","first-page":"1052","volume-title":"Proceedings of the 36th International Conference on Machine Learning","author":"Chen Xinshi","year":"2019","unstructured":"Xinshi Chen, Shuang Li, Hui Li, Shaohua Jiang, Yuan Qi, and Le Song. Generative adversarial user model for reinforcement learning based recommendation system. In Proceedings of the 36th International Conference on Machine Learning, pages 1052--1061, 2019b."},{"key":"e_1_2_1_37_1","volume-title":"Sim2Rec: A simulator-based decision-making approach to optimize real-world long-term user engagement in sequential recommender systems. arXiv preprint arXiv:2305.04832","author":"Chen Xiong-Hui","year":"2023","unstructured":"Xiong-Hui Chen, Bowei He, Yang Yu, Qingyang Li, Zhiwei Qin, Wenjie Shang, Jieping Ye, and Chen Ma. Sim2Rec: A simulator-based decision-making approach to optimize real-world long-term user engagement in sequential recommender systems. arXiv preprint arXiv:2305.04832, 2023c."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-acl.416"},{"key":"e_1_2_1_39_1","volume-title":"April","author":"Coalition","year":"2023","unstructured":"Coalition for Health AI. Blueprint for Trustworthy AI Implementation Guidance and Assurance for Healthcare. Technical report, April 2023. URL https:\/\/www.coalitionforhealthai.org\/papers\/blueprint-for-trustworthy-ai_V1.0.pdf."},{"key":"e_1_2_1_40_1","volume-title":"Search as learning (dagstuhl seminar 17092)","author":"Collins-Thompson Kevyn","year":"2017","unstructured":"Kevyn Collins-Thompson, Preben Hansen, and Claudia Hauff. Search as learning (dagstuhl seminar 17092). 2017."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3626772.3657834"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274784.3274788"},{"key":"e_1_2_1_43_1","volume-title":"Fido: Fusion-in-decoder optimized for stronger performance and faster inference. arXiv preprint arXiv:2212.08153","author":"de Jong Michiel","year":"2023","unstructured":"Michiel de Jong, Yury Zemlyanskiy, Joshua Ainslie, Nicholas FitzGerald, Sumit Sanghai, Fei Sha, and William Cohen. Fido: Fusion-in-decoder optimized for stronger performance and faster inference. arXiv preprint arXiv:2212.08153, 2023."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3582900.3582905"},{"key":"e_1_2_1_45_1","volume-title":"November","author":"Deffayet Romain","year":"2023","unstructured":"Romain Deffayet, Thibaut Thonet, Dongyoon Hwang, Vassilissa Lehoux, Jean-Michel Renders, and Maarten de Rijke. SARDINE: A simulator for automated recommendation in dynamic and interactive environments. arXiv preprint arXiv:2311.16586, November 2023a."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3539597.3570412"},{"key":"e_1_2_1_47_1","first-page":"1","volume-title":"User Modeling and User-Adapted Interaction","author":"Deldjoo Yashar","year":"2023","unstructured":"Yashar Deldjoo, Dietmar Jannach, Alejandro Bellogin, Alessandro Difonzo, and Dario Zanzonelli. Fairness in recommender systems: research landscape and future directions. User Modeling and User-Adapted Interaction, pages 1--50, 2023."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3604915.3608889"},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of Text REtrieval Conference (TREC)","author":"Dietz Laura","year":"2019","unstructured":"Laura Dietz and John Foley. TREC CAR Y3: Complex answer retrieval overview. In Proceedings of Text REtrieval Conference (TREC), 2019."},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of Text REtrieval Conference (TREC)","author":"Dietz Laura","year":"2017","unstructured":"Laura Dietz, Manisha Verma, Filip Radlinski, and Nick Craswell. TREC complex answer retrieval overview. In Proceedings of Text REtrieval Conference (TREC), 2017."},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of Text REtrieval Conference (TREC)","author":"Dietz Laura","year":"2018","unstructured":"Laura Dietz, Ben Gamari, Jeff Dalton, and Nick Craswell. TREC complex answer retrieval overview. In Proceedings of Text REtrieval Conference (TREC), 2018."},{"key":"e_1_2_1_52_1","volume-title":"Responsible Artificial Intelligence: How to Develop and Use AI in a Responsible Way. Artificial Intelligence: Foundations, Theory, and Algorithms","author":"Dignum V.","year":"2019","unstructured":"V. Dignum. Responsible Artificial Intelligence: How to Develop and Use AI in a Responsible Way. Artificial Intelligence: Foundations, Theory, and Algorithms. Springer International Publishing, 2019. ISBN 9783030303716."},{"key":"e_1_2_1_53_1","volume-title":"Fairness in music recommender systems: A stakeholder-centered mini review. Frontiers in big Data, 5:913608","author":"Dinnissen Karlijn","year":"2022","unstructured":"Karlijn Dinnissen and Christine Bauer. Fairness in music recommender systems: A stakeholder-centered mini review. Frontiers in big Data, 5:913608, 2022."},{"key":"e_1_2_1_54_1","first-page":"36","article-title":"A simulation framework for methods that learn from human feedback","author":"Dubois Yann","year":"2024","unstructured":"Yann Dubois, Chen Xuechen Li, Rohan Taori, Tianyi Zhang, Ishaan Gulrajani, Jimmy Ba, Carlos Guestrin, Percy S Liang, and Tatsunori B Hashimoto. AlpacaFarm: A simulation framework for methods that learn from human feedback. Advances in Neural Information Processing Systems, 36, 2024.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_55_1","volume-title":"Deep reinforcement learning in large discrete action spaces. arXiv preprint arXiv:1512.07679","author":"Dulac-Arnold Gabriel","year":"2015","unstructured":"Gabriel Dulac-Arnold, Richard Evans, Hado van Hasselt, Peter Sunehag, Timothy Lillicrap, Jonathan Hunt, Timothy Mann, Theophane Weber, Thomas Degris, and Ben Coppin. Deep reinforcement learning in large discrete action spaces. arXiv preprint arXiv:1512.07679, 2015."},{"key":"e_1_2_1_56_1","volume-title":"Fairness and discrimination in information access systems. arXiv preprint arXiv:2105.05779","author":"Ekstrand Michael D","year":"2021","unstructured":"Michael D Ekstrand, Anubrata Das, Robin Burke, and Fernando Diaz. Fairness and discrimination in information access systems. arXiv preprint arXiv:2105.05779, 2021."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3578337.3605136"},{"key":"e_1_2_1_58_1","volume-title":"An exam-based evaluation approach beyond traditional relevance judgments","author":"Farzi Naghmeh","year":"2024","unstructured":"Naghmeh Farzi and Laura Dietz. An exam-based evaluation approach beyond traditional relevance judgments, 2024."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.4018\/IJeC.315019"},{"key":"e_1_2_1_60_1","volume-title":"S3: Social-network simulation system with large language model-empowered agents. arXiv preprint arXiv:2307.14984","author":"Gao Chen","year":"2023","unstructured":"Chen Gao, Xiaochong Lan, Zhihong Lu, Jinzhu Mao, Jinghua Piao, Huandong Wang, Depeng Jin, and Yong Li. S3: Social-network simulation system with large language model-empowered agents. arXiv preprint arXiv:2307.14984, 2023."},{"key":"e_1_2_1_61_1","volume-title":"November","author":"Gienapp Lukas","year":"2023","unstructured":"Lukas Gienapp, Harrisen Scells, Niklas Deckers, Janek Bevendorff, Shuai Wang, Johannes Kiesel, Shahbaz Syed, Maik Fr\u00f6be, Guido Zuccon, Benno Stein, Matthias Hagen, and Martin Potthast. Evaluating Generative Ad Hoc Information Retrieval, November 2023. URL http:\/\/arxiv.org\/abs\/2311.04694.arXiv:2311.04694 [cs]."},{"key":"e_1_2_1_62_1","volume-title":"Chatgpt outperforms crowd-workers for text-annotation tasks. arXiv preprint arXiv:2303.15056","author":"Gilardi Fabrizio","year":"2023","unstructured":"Fabrizio Gilardi, Meysam Alizadeh, and M\u00e4el Kubli. Chatgpt outperforms crowd-workers for text-annotation tasks. arXiv preprint arXiv:2303.15056, 2023."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159687"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2023.36483"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24818"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983323.2983769"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3539618.3591760"},{"key":"e_1_2_1_68_1","volume-title":"Cosplade: Contextualizing splade for conversational information retrieval. arXiv preprint arXiv:2301.04413","author":"Hai Nam Le","year":"2023","unstructured":"Nam Le Hai, Thomas Gerald, Thibault Formal, Jian-Yun Nie, Benjamin Piwowarski, and Laure Soulier. Cosplade: Contextualizing splade for conversational information retrieval. arXiv preprint arXiv:2301.04413, 2023."},{"key":"e_1_2_1_69_1","first-page":"44","volume-title":"Law Society Gazette","volume":"111","author":"Harty Karyn","year":"2017","unstructured":"Karyn Harty. Discovery program. In Law Society Gazette, volume 111, pages 44--47. Dublin, Ireland, April 2017."},{"key":"e_1_2_1_70_1","first-page":"21","volume-title":"Modern Information Retrieval","author":"Hearst Marti","year":"2011","unstructured":"Marti Hearst. User interfaces for search. Modern Information Retrieval, pages 21--55, 2011."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1080\/21670811.2019.1623700"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocae014"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788583"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1093\/jncics\/pkad010"},{"key":"e_1_2_1_75_1","volume-title":"Large language models are zero-shot rankers for recommender systems. arXiv preprint arXiv:2305.08845","author":"Hou Yupeng","year":"2023","unstructured":"Yupeng Hou, Junjie Zhang, Zihan Lin, Hongyu Lu, Ruobing Xie, Julian McAuley, and Wayne Xin Zhao. Large language models are zero-shot rankers for recommender systems. arXiv preprint arXiv:2305.08845, 2023."},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3383313.3412252"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3531716"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3488560.3498375"},{"key":"e_1_2_1_79_1","volume-title":"Retrieving supporting evidence for generative question answering. arXiv preprint arXiv:2309.11392","author":"Huo Siqing","year":"2023","unstructured":"Siqing Huo, Negar Arabzadeh, and Charles LA Clarke. Retrieving supporting evidence for generative question answering. arXiv preprint arXiv:2309.11392, 2023."},{"key":"e_1_2_1_80_1","volume-title":"RecSim: A configurable simulation platform for recommender systems. arXiv preprint arXiv:1909.04847","author":"Ie Eugene","year":"2019","unstructured":"Eugene Ie, Chih-wei Hsu, Martin Mladenov, Vihan Jain, Sanmit Narvekar, Jing Wang, Rui Wu, and Craig Boutilier. RecSim: A configurable simulation platform for recommender systems. arXiv preprint arXiv:1909.04847, 2019a."},{"key":"e_1_2_1_81_1","volume-title":"Reinforcement learning for slate-based recommender systems: A tractable decomposition and practical methodology. arXiv preprint arXiv:1905.12767","author":"Ie Eugene","year":"2019","unstructured":"Eugene Ie, Vihan Jain, Jing Wang, Sanmit Narvekar, Ritesh Agarwal, Rui Wu, Heng-Tze Cheng, Morgane Lustman, Vince Gatto, Paul Covington, et al. Reinforcement learning for slate-based recommender systems: A tractable decomposition and practical methodology. arXiv preprint arXiv:1905.12767, 2019b."},{"key":"e_1_2_1_82_1","volume-title":"Leveraging passage retrieval with generative models for open domain question answering. arXiv preprint arXiv:2007.01282","author":"Izacard Gautier","year":"2021","unstructured":"Gautier Izacard and Edouard Grave. Leveraging passage retrieval with generative models for open domain question answering. arXiv preprint arXiv:2007.01282, 2021."},{"key":"e_1_2_1_83_1","volume-title":"Distilling knowledge from reader to retriever for question answering. arXiv preprint arXiv:2012.04584","author":"Izacard Gautier","year":"2022","unstructured":"Gautier Izacard and Edouard Grave. Distilling knowledge from reader to retriever for question answering. arXiv preprint arXiv:2012.04584, 2022."},{"key":"e_1_2_1_84_1","volume-title":"Atlas: Few-shot learning with retrieval augmented language models. arXiv preprint arXiv:2208.03299","author":"Izacard Gautier","year":"2022","unstructured":"Gautier Izacard, Patrick Lewis, Maria Lomeli, Lucas Hosseini, Fabio Petroni, Timo Schick, Jane DwivediYu, Armand Joulin, Sebastian Riedel, and Edouard Grave. Atlas: Few-shot learning with retrieval augmented language models. arXiv preprint arXiv:2208.03299, 2022."},{"key":"e_1_2_1_85_1","volume-title":"Proximal policy optimization for improved convergence in irgan","author":"Jain Moksh","year":"2019","unstructured":"Moksh Jain and Sowmya Kamath S. Proximal policy optimization for improved convergence in irgan, 2019."},{"key":"e_1_2_1_86_1","volume-title":"InPars-v2: Large Language Models as Efficient Dataset Generators for Information Retrieval. arXiv preprint arXiv:2301.01820","author":"Jeronymo Vitor","year":"2023","unstructured":"Vitor Jeronymo, Luiz Bonifacio, Hugo Abonizio, Marzieh Fadaee, Roberto Lotufo, Jakub Zavrel, and Rodrigo Nogueira. InPars-v2: Large Language Models as Efficient Dataset Generators for Information Retrieval. arXiv preprint arXiv:2301.01820, 2023."},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1145\/3571730"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/2600428.2609633"},{"key":"e_1_2_1_89_1","volume-title":"Morgan Kaufmann","author":"Jones Karen Sparck","year":"1997","unstructured":"Karen Sparck Jones and Peter Willett. Readings in information retrieval. Morgan Kaufmann, 1997."},{"key":"e_1_2_1_90_1","volume-title":"Overview of the trec 2010 session track","author":"Kanoulas Evangelos","year":"2010","unstructured":"Evangelos Kanoulas, Mark Hall, Paul Clough, Ben Carterette, and Mark Sanderson. Overview of the trec 2010 session track. 2010."},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376219"},{"key":"e_1_2_1_92_1","volume-title":"Incdsi: Incrementally updatable document retrieval. arXiv preprint arXiv:2307.10323","author":"Kishore Varsha","year":"2023","unstructured":"Varsha Kishore, Chao Wan, Justin Lovelace, Yoav Artzi, and Kilian Q. Weinberger. Incdsi: Incrementally updatable document retrieval. arXiv preprint arXiv:2307.10323, 2023."},{"key":"e_1_2_1_93_1","first-page":"3971","volume-title":"Findings of the Association for Computational Linguistics: EMNLP '20","author":"Kumar Vaibhav","year":"2020","unstructured":"Vaibhav Kumar and Jamie Callan. Making information seeking easier: An improved pipeline for conversational search. In Trevor Cohn, Yulan He, and Yang Liu, editors, Findings of the Association for Computational Linguistics: EMNLP '20, pages 3971--3980. Association for Computational Linguistics, 2020."},{"key":"e_1_2_1_94_1","volume-title":"Information retrieval systems: Characteristics, testing, and evaluation","author":"Lancaster F. Wilfrid","year":"1979","unstructured":"F. Wilfrid Lancaster. Information retrieval systems: Characteristics, testing, and evaluation. John Wiley & Sons, New York, 2nd ed edition edition, January 1979. ISBN 978-0-471-04673-8.","edition":"2"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.477"},{"key":"e_1_2_1_96_1","first-page":"9459","article-title":"Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks","volume":"33","author":"Lewis Patrick","year":"2020","unstructured":"Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich K\u00fcttler, Mike Lewis, Wen-tau Yih, Tim Rockt\u00e4schel, et al. Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. Advances in Neural Information Processing Systems, 33:9459--9474, 2020.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_97_1","volume-title":"Learning to rank in generative retrieval. arXiv preprint arXiv:2306.15222","author":"Li Yongqi","year":"2023","unstructured":"Yongqi Li, Nan Yang, Liang Wang, Furu Wei, and Wenjie Li. Learning to rank in generative retrieval. arXiv preprint arXiv:2306.15222, 2023a."},{"key":"e_1_2_1_98_1","volume-title":"Multiview identifiers enhanced generative retrieval. arXiv preprint arXiv:2305.16675","author":"Li Yongqi","year":"2023","unstructured":"Yongqi Li, Nan Yang, Liang Wang, Furu Wei, and Wenjie Li. Multiview identifiers enhanced generative retrieval. arXiv preprint arXiv:2305.16675, 2023b."},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1145\/3627995"},{"key":"e_1_2_1_100_1","volume-title":"Leveraging large language models for NLG evaluation: A survey. arXiv preprint arXiv:2401.07103","author":"Li Zhen","year":"2024","unstructured":"Zhen Li, Xiaohan Xu, Tao Shen, Can Xu, Jia-Chen Gu, and Chongyang Tao. Leveraging large language models for NLG evaluation: A survey. arXiv preprint arXiv:2401.07103, 2024."},{"key":"e_1_2_1_101_1","first-page":"6565","volume-title":"International Conference on Machine Learning","author":"Liang Paul Pu","year":"2021","unstructured":"Paul Pu Liang, Chiyu Wu, Louis-Philippe Morency, and Ruslan Salakhutdinov. Towards understanding and mitigating social biases in language models. In International Conference on Machine Learning, pages 6565--6576. PMLR, 2021."},{"key":"e_1_2_1_102_1","volume-title":"Multi-stage conversational passage retrieval: An approach to fusing term importance estimation and neural query rewriting. arXiv preprint arXiv:2005.02230","author":"Lin Sheng-Chieh","year":"2021","unstructured":"Sheng-Chieh Lin, Jheng-Hong Yang, Rodrigo Nogueira, Ming-Feng Tsai, Chuan-Ju Wang, and Jimmy Lin. Multi-stage conversational passage retrieval: An approach to fusing term importance estimation and neural query rewriting. arXiv preprint arXiv:2005.02230, 2021."},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2925019"},{"key":"e_1_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.1145\/3336191.3371858"},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835457"},{"key":"e_1_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00638"},{"key":"e_1_2_1_107_1","volume-title":"G-Eval: NLG evaluation using GPT-4 with better human alignment. arXiv preprint arXiv:2303.16634","author":"Liu Yang","year":"2023","unstructured":"Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, and Chenguang Zhu. G-Eval: NLG evaluation using GPT-4 with better human alignment. arXiv preprint arXiv:2303.16634, 2023a."},{"key":"e_1_2_1_108_1","doi-asserted-by":"publisher","DOI":"10.1145\/3583780.3614793"},{"key":"e_1_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.1145\/3539618.3591777"},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1080\/21670811.2020.1764374"},{"key":"e_1_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380130"},{"key":"e_1_2_1_112_1","volume-title":"Leveraging large language models for relevance judgments in legal case retrieval. arXiv preprint arXiv:2403.18405","author":"Ma Shengjie","year":"2024","unstructured":"Shengjie Ma, Chong Chen, Qi Chu, and Jiaxin Mao. Leveraging large language models for relevance judgments in legal case retrieval. arXiv preprint arXiv:2403.18405, 2024."},{"key":"e_1_2_1_113_1","first-page":"36","article-title":"Self-refine: Iterative refinement with self-feedback","author":"Madaan Aman","year":"2023","unstructured":"Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, et al. Self-refine: Iterative refinement with self-feedback. Advances in Neural Information Processing Systems, 36, 2023.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_114_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911469"},{"key":"e_1_2_1_115_1","doi-asserted-by":"publisher","DOI":"10.1145\/3626772.3657846"},{"key":"e_1_2_1_116_1","volume-title":"McDonald. On faithfulness and factuality in abstractive summarization. CoRR, abs\/2005.00661","author":"Maynez Joshua","year":"2020","unstructured":"Joshua Maynez, Shashi Narayan, Bernd Bohnet, and Ryan T. McDonald. On faithfulness and factuality in abstractive summarization. CoRR, abs\/2005.00661, 2020. URL https:\/\/arxiv.org\/abs\/2005.00661."},{"key":"e_1_2_1_117_1","volume-title":"Bringing the full power of copilot to more people and businesses","author":"Mehdi Yusuf","year":"2024","unstructured":"Yusuf Mehdi. Bringing the full power of copilot to more people and businesses, 2024. URL https:\/\/blogs.microsoft.com\/blog\/2024\/01\/15\/bringing-the-full-power-of-copilot-to-more-people-and-businesses\/."},{"key":"e_1_2_1_118_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.510"},{"key":"e_1_2_1_119_1","volume-title":"Updating transformer memory with new documents. arXiv preprint arXiv:2212.09744","author":"Mehta Sanket Vaibhav","year":"2023","unstructured":"Sanket Vaibhav Mehta, Jai Gupta, Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Jinfeng Rao, Marc Najork, Emma Strubell, and Donald Metzler. Dsi++: Updating transformer memory with new documents. arXiv preprint arXiv:2212.09744, 2023b."},{"key":"e_1_2_1_120_1","doi-asserted-by":"publisher","DOI":"10.1145\/3476415.3476428"},{"key":"e_1_2_1_121_1","volume-title":"Search and society: Reimagining information access for radical futures. arXiv preprint arXiv:2403.17901","author":"Mitra Bhaskar","year":"2024","unstructured":"Bhaskar Mitra. Search and society: Reimagining information access for radical futures. arXiv preprint arXiv:2403.17901, 2024."},{"key":"e_1_2_1_122_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401099"},{"key":"e_1_2_1_123_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2018.1444076"},{"key":"e_1_2_1_124_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597307"},{"key":"e_1_2_1_125_1","volume-title":"Reuters Institute digital news report","author":"Newman Nic","year":"2023","unstructured":"Nic Newman, Richard Fletcher, Kirsten Eddy, Craig T. Robertson, and Rasmus Kleis Nielsen. Reuters Institute digital news report 2023. Reuters Institute for the Study of Journalism, https:\/\/reutersinstitute.politics.ox.ac.uk\/sites\/default\/files\/2023-06\/Digital_News_Report_2023.pdf."},{"key":"e_1_2_1_126_1","volume-title":"NIST","author":"Artifical NIST.","year":"2023","unstructured":"NIST. Artifical intelligence risk management framework (AI RMF 1.0). Technical Report NIST AI 100-1, NIST, January 2023."},{"key":"e_1_2_1_127_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1061"},{"key":"e_1_2_1_128_1","volume-title":"Case Study in Medicine","author":"Nori Harsha","year":"2023","unstructured":"Harsha Nori, Yin Tat Lee, Sheng Zhang, Dean Carignan, Richard Edgar, Nicolo Fusi, Nicholas King, Jonathan Larson, Yuanzhi Li, Weishung Liu, Renqian Luo, Scott Mayer McKinney, Robert Osazuwa Ness, Hoifung Poon, Tao Qin, Naoto Usuyama, Chris White, and Eric Horvitz. Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine, November 2023. URL http:\/\/arxiv.org\/abs\/2311.16452.arXiv:2311.16452 [cs]."},{"key":"e_1_2_1_129_1","doi-asserted-by":"publisher","DOI":"10.1145\/2389776.2389781"},{"key":"e_1_2_1_130_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767715"},{"key":"e_1_2_1_131_1","first-page":"20","volume-title":"ACM SIGIR Forum","author":"Olteanu Alexandra","year":"2021","unstructured":"Alexandra Olteanu, Jean Garcia-Gathright, Maarten de Rijke, Michael D Ekstrand, Adam Roegiest, Aldo Lipani, Alex Beutel, Alexandra Olteanu, Ana Lucic, Ana-Andreea Stoica, et al. Facts-ir: fairness, accountability, confidentiality, transparency, and safety in information retrieval. In ACM SIGIR Forum, volume 53, pages 20--43. ACM New York, NY, USA, 2021."},{"key":"e_1_2_1_132_1","volume-title":"WSDM 2021:  14th International Conference on Web Search and Data Mining. ACM","author":"Oosterhuis Harrie","year":"2021","unstructured":"Harrie Oosterhuis and Maarten de Rijke. Unifying online and counterfactual learning to rank. In WSDM 2021: 14th International Conference on Web Search and Data Mining. ACM, March 2021."},{"key":"e_1_2_1_133_1","volume-title":"Introducing chatgpt. https:\/\/openai.com\/blog\/chatgpt, 11","author":"AI.","year":"2022","unstructured":"OpenAI. Introducing chatgpt. https:\/\/openai.com\/blog\/chatgpt, 11 2022."},{"key":"e_1_2_1_134_1","first-page":"27730","volume-title":"Advances in Neural Information Processing Systems","volume":"35","author":"Ouyang Long","year":"2022","unstructured":"Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul F Christiano, Jan Leike, and Ryan Lowe. Training language models to follow instructions with human feedback. In Advances in Neural Information Processing Systems, volume 35, pages 27730--27744. Curran Associates, Inc., 2022."},{"key":"e_1_2_1_135_1","volume-title":"Automated annotation with generative ai requires validation","author":"Pangakis Nicholas","year":"2023","unstructured":"Nicholas Pangakis, Samuel Wolken, and Neil Fasching. Automated annotation with generative ai requires validation, 2023."},{"key":"e_1_2_1_136_1","volume-title":"The Filter Bubble: What the Internet is Hiding from You. penguin UK","author":"Pariser Eli","year":"2011","unstructured":"Eli Pariser. The Filter Bubble: What the Internet is Hiding from You. penguin UK, 2011."},{"key":"e_1_2_1_137_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-021-00697-y"},{"key":"e_1_2_1_138_1","volume-title":"How does generative retrieval scale to millions of passages? arXiv preprint arXiv:2305.11841","author":"Pradeep Ronak","year":"2023","unstructured":"Ronak Pradeep, Kai Hui, Jai Gupta, Adam D. Lelkes, Honglei Zhuang, Jimmy Lin, Donald Metzler, and Vinh Q. Tran. How does generative retrieval scale to millions of passages? arXiv preprint arXiv:2305.11841, 2023."},{"key":"e_1_2_1_139_1","volume-title":"Direct preference optimization: Your language model is secretly a reward model. arXiv preprint arXiv:2305.18290","author":"Rafailov Rafael","year":"2023","unstructured":"Rafael Rafailov, Archit Sharma, Eric Mitchell, Stefano Ermon, Christopher D. Manning, and Chelsea Finn. Direct preference optimization: Your language model is secretly a reward model. arXiv preprint arXiv:2305.18290, 2023."},{"key":"e_1_2_1_140_1","volume-title":"The curious case of hallucinations in neural machine translation. CoRR, abs\/2104.06683","author":"Raunak Vikas","year":"2021","unstructured":"Vikas Raunak, Arul Menezes, and Marcin Junczys-Dowmunt. The curious case of hallucinations in neural machine translation. CoRR, abs\/2104.06683, 2021. URL https:\/\/arxiv.org\/abs\/2104.06683."},{"key":"e_1_2_1_141_1","volume-title":"Implementing the deep q-network. arXiv preprint arXiv:1711.07478","author":"Roderick Melrose","year":"2017","unstructured":"Melrose Roderick, James MacGlashan, and Stefanie Tellex. Implementing the deep q-network. arXiv preprint arXiv:1711.07478, 2017."},{"key":"e_1_2_1_142_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCNS.2021.3105616"},{"key":"e_1_2_1_143_1","volume-title":"Swan: A generic framework for auditing textual conversational systems","author":"Sakai Tetsuya","year":"2023","unstructured":"Tetsuya Sakai. Swan: A generic framework for auditing textual conversational systems, 2023."},{"key":"e_1_2_1_144_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000040"},{"key":"e_1_2_1_145_1","volume-title":"Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347","author":"Schulman John","year":"2017","unstructured":"John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347, 2017."},{"key":"e_1_2_1_146_1","doi-asserted-by":"publisher","DOI":"10.1145\/3498366.3505816"},{"key":"e_1_2_1_147_1","doi-asserted-by":"publisher","DOI":"10.1145\/3649468"},{"key":"e_1_2_1_148_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33014902"},{"issue":"6","key":"e_1_2_1_149_1","first-page":"467","article-title":"The architecture of complexity","volume":"106","author":"Simon Herbert A.","year":"1962","unstructured":"Herbert A. Simon. The architecture of complexity. Proceedings of the American Philosophical Society, 106(6):467-482, 1962.","journal-title":"Proceedings of the American Philosophical Society"},{"key":"e_1_2_1_150_1","volume-title":"Adaptive dissemination of personalized and contextually relevant information","author":"Slawson Dean A.","year":"2006","unstructured":"Dean A. Slawson, Raman Chandrasekar, and Michael K. Forney. Adaptive dissemination of personalized and contextually relevant information, 2006. US Patent US7577718B2 Filed 2006, Granted 2009."},{"key":"e_1_2_1_151_1","volume-title":"Re3val: Reinforced and reranked generative retrieval. arXiv preprint arXiv:2401.16979","author":"Song EuiYul","year":"2024","unstructured":"EuiYul Song, Sangryul Kim, Haeju Lee, Joonkee Kim, and James Thorne. Re3val: Reinforced and reranked generative retrieval. arXiv preprint arXiv:2401.16979, 2024."},{"key":"e_1_2_1_152_1","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780199755509.001.0001"},{"key":"e_1_2_1_153_1","volume-title":"NeurIPS 2023: Thirty-seventh Conference on Neural Information Processing Systems","author":"Sun Weiwei","year":"2023","unstructured":"Weiwei Sun, Lingyong Yan, Zheng Chen, Shuaiqiang Wang, Haichao Zhu, Pengjie Ren, Zhumin Chen, Dawei Yin, Maarten de Rijke, and Zhaochun Ren. Learning to tokenize for generative retrieval. In NeurIPS 2023: Thirty-seventh Conference on Neural Information Processing Systems, December 2023."},{"key":"e_1_2_1_154_1","volume-title":"International Conference on Learning Representations, ICLR","author":"Szegedy Christian","year":"2014","unstructured":"Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian J. Goodfellow, and Rob Fergus. Intriguing properties of neural networks. In International Conference on Learning Representations, ICLR, 2014."},{"key":"e_1_2_1_155_1","doi-asserted-by":"publisher","DOI":"10.1145\/3580305.3599903"},{"key":"e_1_2_1_156_1","doi-asserted-by":"publisher","DOI":"10.1145\/3624918.3629547"},{"key":"e_1_2_1_157_1","volume-title":"ECIR 2024:  46th European Conference on Information Retrieval. Springer","author":"Tang Yubao","year":"2024","unstructured":"Yubao Tang, Ruqing Zhang, Zhaochun Ren, Jiafeng Guo, and Maarten de Rijke. Recent advances in generative information retrieval. In ECIR 2024: 46th European Conference on Information Retrieval. Springer, April 2024."},{"key":"e_1_2_1_158_1","volume-title":"Mostafa Dehghani, Jianmo Ni, Dara Bahri, Harsh Mehta, Zhen Qin, Kai Hui, Zhe Zhao, Jai Gupta","author":"Tay Yi","unstructured":"Yi Tay, Vinh Quang Tran, Mostafa Dehghani, Jianmo Ni, Dara Bahri, Harsh Mehta, Zhen Qin, Kai Hui, Zhe Zhao, Jai Gupta, Tal Schuster, William W. Cohen, and Donald Metzler. Transformer memory as a differentiable search index. In NeurIPS, 2022."},{"key":"e_1_2_1_159_1","doi-asserted-by":"publisher","DOI":"10.5860\/crl_29_03_178"},{"key":"e_1_2_1_160_1","volume-title":"FATREC Workshop on Responsible Recommendation","author":"Hoeve Maartje Ter","year":"2017","unstructured":"Maartje Ter Hoeve, Mathieu Heruer, Daan Odijk, Anne Schuth, Martijn Spitters, Ron Mulder, Nick van der Wildt, and Maarten de Rijke. Do news consumers want explanations for personalized news rankings? In FATREC Workshop on Responsible Recommendation, August 2017."},{"key":"e_1_2_1_161_1","doi-asserted-by":"publisher","DOI":"10.1145\/3626772.3657707"},{"key":"e_1_2_1_162_1","doi-asserted-by":"publisher","DOI":"10.1145\/3626772.3657914"},{"key":"e_1_2_1_163_1","volume-title":"January","author":"Tu Tao","year":"2024","unstructured":"Tao Tu, Anil Palepu, Mike Schaekermann, Khaled Saab, Jan Freyberg, Ryutaro Tanno, Amy Wang, Brenna Li, Mohamed Amin, Nenad Tomasev, Shekoofeh Azizi, Karan Singhal, Yong Cheng, Le Hou, Albert Webson, Kavita Kulkarni, S. Sara Mahdavi, Christopher Semturs, Juraj Gottweis, Joelle Barral, Katherine Chou, Greg S. Corrado, Yossi Matias, Alan Karthikesalingam, and Vivek Natarajan. Towards Conversational Diagnostic AI, January 2024. URL http:\/\/arxiv.org\/abs\/2401.05654.arXiv:2401.05654 [cs]."},{"key":"e_1_2_1_164_1","doi-asserted-by":"publisher","DOI":"10.1145\/3437963.3441748"},{"key":"e_1_2_1_165_1","doi-asserted-by":"publisher","DOI":"10.1093\/eurjcn\/zvad038"},{"key":"e_1_2_1_166_1","doi-asserted-by":"publisher","DOI":"10.1145\/1007568.1007586"},{"key":"e_1_2_1_167_1","doi-asserted-by":"publisher","DOI":"10.1145\/3406522.3446019"},{"key":"e_1_2_1_168_1","doi-asserted-by":"publisher","DOI":"10.1145\/3523227.3546780"},{"key":"e_1_2_1_169_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-11-55"},{"key":"e_1_2_1_170_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-41032-5"},{"key":"e_1_2_1_171_1","doi-asserted-by":"publisher","DOI":"10.1145\/3547333"},{"key":"e_1_2_1_172_1","volume-title":"Weiwei Deng, Qi Zhang, and Mao Yang. A neural corpus indexer for document retrieval. arXiv preprint arXiv:2206.02743","author":"Wang Yujing","year":"2023","unstructured":"Yujing Wang, Yingyan Hou, Haonan Wang, Ziming Miao, Shibin Wu, Hao Sun, Qi Chen, Yuqing Xia, Chengmin Chi, Guoshuai Zhao, Zheng Liu, Xing Xie, Hao Allen Sun, Weiwei Deng, Qi Zhang, and Mao Yang. A neural corpus indexer for document retrieval. arXiv preprint arXiv:2206.02743, 2023b."},{"key":"e_1_2_1_173_1","doi-asserted-by":"publisher","DOI":"10.1145\/3583780.3614993"},{"key":"e_1_2_1_174_1","volume-title":"Microsoft's new copilot pro brings ai-powered office features to the rest of us","author":"Warren Tom","year":"2024","unstructured":"Tom Warren. Microsoft's new copilot pro brings ai-powered office features to the rest of us, 2024. URL https:\/\/www.theverge.com\/2024\/1\/15\/24038711\/microsoft-copilot-pro-office-ai-apps."},{"key":"e_1_2_1_175_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080685"},{"key":"e_1_2_1_176_1","doi-asserted-by":"publisher","DOI":"10.1145\/3539618.3593069"},{"key":"e_1_2_1_177_1","doi-asserted-by":"publisher","DOI":"10.1145\/3576923"},{"key":"e_1_2_1_178_1","volume-title":"Daniel E. Ho, and James Zou. How well do LLMs cite relevant medical references? An evaluation framework and analyses","author":"Wu Kevin","year":"2024","unstructured":"Kevin Wu, Eric Wu, Ally Cassasola, Angela Zhang, Kevin Wei, Teresa Nguyen, Sith Riantawan, Patricia Shi Riantawan, Daniel E. Ho, and James Zou. How well do LLMs cite relevant medical references? An evaluation framework and analyses, February 2024. URL http:\/\/arxiv.org\/abs\/2402.02008.arXiv:2402.02008 [cs]."},{"key":"e_1_2_1_179_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401148"},{"key":"e_1_2_1_180_1","doi-asserted-by":"publisher","DOI":"10.1145\/3469096.3469872"},{"key":"e_1_2_1_181_1","volume-title":"Auto search indexer for end-to-end document retrieval. arXiv preprint arXiv:2310.12455","author":"Yang Tianchi","year":"2023","unstructured":"Tianchi Yang, Minghui Song, Zihan Zhang, Haizhen Huang, Weiwei Deng, Feng Sun, and Qi Zhang. Auto search indexer for end-to-end document retrieval. arXiv preprint arXiv:2310.12455, 2023."},{"key":"e_1_2_1_182_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.acl-long.340"},{"key":"e_1_2_1_183_1","volume-title":"Few-shot generative conversational query rewriting. arXiv preprint arXiv:2006.05009","author":"Yu Shi","year":"2020","unstructured":"Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, and Zhiyuan Liu. Few-shot generative conversational query rewriting. arXiv preprint arXiv:2006.05009, 2020."},{"key":"e_1_2_1_184_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462856"},{"key":"e_1_2_1_185_1","doi-asserted-by":"publisher","DOI":"10.1145\/3589334.3645483"},{"key":"e_1_2_1_186_1","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3531722"},{"key":"e_1_2_1_187_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000081"},{"issue":"6","key":"e_1_2_1_188_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3533379","article-title":"Fairness in ranking, part I: Score-based ranking","volume":"55","author":"Zehlike Meike","year":"2022","unstructured":"Meike Zehlike, Ke Yang, and Julia Stoyanovich. Fairness in ranking, part I: Score-based ranking. ACM Computing Surveys, 55(6):1--36, 2022a.","journal-title":"ACM Computing Surveys"},{"issue":"6","key":"e_1_2_1_189_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3533380","article-title":"Fairness in ranking, part II: Learning-to-rank and recommender systems","volume":"55","author":"Zehlike Meike","year":"2022","unstructured":"Meike Zehlike, Ke Yang, and Julia Stoyanovich. Fairness in ranking, part II: Learning-to-rank and recommender systems. ACM Computing Surveys, 55(6):1-41, 2022b.","journal-title":"ACM Computing Surveys"},{"key":"e_1_2_1_190_1","volume-title":"Tianxin Wei, and Hamed Zamani. Scalable and effective generative information retrieval. arXiv preprint arXiv:2311.09134","author":"Zeng Hansi","year":"2023","unstructured":"Hansi Zeng, Chen Luo, Bowen Jin, Sheikh Muhammad Sarwar, Tianxin Wei, and Hamed Zamani. Scalable and effective generative information retrieval. arXiv preprint arXiv:2311.09134, 2023."},{"key":"e_1_2_1_191_1","doi-asserted-by":"publisher","DOI":"10.1145\/3234944.3234977"},{"key":"e_1_2_1_192_1","doi-asserted-by":"publisher","DOI":"10.1145\/3511808.3557711"},{"key":"e_1_2_1_193_1","volume-title":"Model-enhanced vector index. arXiv preprint arXiv:2309.13335","author":"Zhang Hailin","year":"2023","unstructured":"Hailin Zhang, Yujing Wang, Qi Chen, Ruiheng Chang, Ting Zhang, Ziming Miao, Yingyan Hou, Yang Ding, Xupeng Miao, Haonan Wang, Bochen Pang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Xing Xie, Mao Yang, and Bin Cui. Model-enhanced vector index. arXiv preprint arXiv:2309.13335, 2023a."},{"key":"e_1_2_1_194_1","volume-title":"Term-sets can be strong document identifiers for auto-regressive search engines. arXiv preprint arXiv:2305.13859","author":"Zhang Peitian","year":"2023","unstructured":"Peitian Zhang, Zheng Liu, Yujia Zhou, Zhicheng Dou, and Zhao Cao. Term-sets can be strong document identifiers for auto-regressive search engines. arXiv preprint arXiv:2305.13859, 2023b."},{"key":"e_1_2_1_195_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000066"},{"key":"e_1_2_1_196_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219886"},{"key":"e_1_2_1_197_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403384"},{"key":"e_1_2_1_198_1","first-page":"167","volume-title":"WWW","author":"Zheng Guanjie","year":"2018","unstructured":"Guanjie Zheng, Fuzheng Zhang, Zihan Zheng, Yang Xiang, Nicholas Jing Yuan, Xing Xie, and Zhenhui Li. Drn: A deep reinforcement learning framework for news recommendation. In WWW, pages 167-176. ACM, 2018."},{"key":"e_1_2_1_199_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.849"},{"key":"e_1_2_1_200_1","volume-title":"Dynamicretriever: A pre-training model-based ir system with neither sparse nor dense index. arXiv preprint arXiv:2203.00537","author":"Zhou Yujia","year":"2022","unstructured":"Yujia Zhou, Jing Yao, Zhicheng Dou, Ledell Wu, and Ji-Rong Wen. Dynamicretriever: A pre-training model-based ir system with neither sparse nor dense index. arXiv preprint arXiv:2203.00537, 2022a."},{"key":"e_1_2_1_201_1","volume-title":"Ultron: An ultimate retriever on corpus with a model-based indexer. arXiv preprint arXiv:2208.09257","author":"Zhou Yujia","year":"2022","unstructured":"Yujia Zhou, Jing Yao, Zhicheng Dou, Ledell Wu, Peitian Zhang, and Ji-Rong Wen. Ultron: An ultimate retriever on corpus with a model-based indexer. arXiv preprint arXiv:2208.09257, 2022b."},{"key":"e_1_2_1_202_1","first-page":"12481","volume-title":"Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing","author":"Zhou Yujia","unstructured":"Yujia Zhou, Zhicheng Dou, and Ji-Rong Wen. Enhancing generative retrieval with reinforcement learning from relevance feedback. In Houda Bouamor, Juan Pino, and Kalika Bali, editors, Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 12481-12490, Singapore,"},{"key":"e_1_2_1_203_1","unstructured":"2023. Association for Computational Linguistics."},{"key":"e_1_2_1_204_1","volume-title":"Bridging the gap between indexing and retrieval for differentiable search index with query generation. arXiv preprint arXiv:2206.10128","author":"Zhuang Shengyao","year":"2023","unstructured":"Shengyao Zhuang, Houxing Ren, Linjun Shou, Jian Pei, Ming Gong, Guido Zuccon, and Daxin Jiang. Bridging the gap between indexing and retrieval for differentiable search index with query generation. arXiv preprint arXiv:2206.10128, 2023."},{"key":"e_1_2_1_205_1","volume-title":"Large language models are built-in autoregressive search engines. arXiv preprint arXiv:2305.09612","author":"Ziems Noah","year":"2023","unstructured":"Noah Ziems, Wenhao Yu, Zhihan Zhang, and Meng Jiang. Large language models are built-in autoregressive search engines. arXiv preprint arXiv:2305.09612, 2023."},{"key":"e_1_2_1_206_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330668"}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3687273.3687288","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3687273.3687288","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:10:01Z","timestamp":1750295401000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3687273.3687288"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6]]},"references-count":206,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["10.1145\/3687273.3687288"],"URL":"https:\/\/doi.org\/10.1145\/3687273.3687288","relation":{},"ISSN":["0163-5840"],"issn-type":[{"value":"0163-5840","type":"print"}],"subject":[],"published":{"date-parts":[[2024,6]]},"assertion":[{"value":"2024-08-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}