{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T23:46:49Z","timestamp":1769039209447,"version":"3.49.0"},"reference-count":24,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2024,12,1]],"date-time":"2024-12-01T00:00:00Z","timestamp":1733011200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:p>Retrieval-Augmented Generation (RAG) systems have become a transformative component of artificial intelligence, combining the strengths of information retrieval (IR) and generative models to tackle complex problems in diverse domains. Despite their rapid adoption and proven potential, the role of IR within RAG frameworks remains under-explored, with research often prioritising advances in generative techniques. This imbalance has left a critical gap in understanding how robust retrieval mechanisms can optimise the overall performance and reliability of RAG systems.<\/jats:p>\n          <jats:p>The 1st Workshop on Information Retrieval's Role in RAG Systems (IR-RAG), held at SIGIR 2024, addressed this gap by focusing on the fundamental principles of information retrieval within the RAG paradigm. The workshop provided a dedicated platform for researchers, practitioners, and experts to share insights, foster discussions, and present innovative research highlighting the centrality of IR in RAG frameworks.<\/jats:p>\n          <jats:p>Through keynote talks, oral and poster presentations, and collaborative breakout sessions, the workshop highlighted both the challenges and opportunities in refining retrieval methodologies to support the generative components of RAG systems. This event has set the stage for advancing research on IR's pivotal role in shaping the future of RAG systems.<\/jats:p>\n          <jats:p>The proceedings of the workshop, published in CEUR Workshop Proceedings, are available at https:\/\/ceur-ws.org\/Vol-3784\/.<\/jats:p>\n          <jats:p>\n            <jats:bold>Date<\/jats:bold>\n            : 18 July 2024.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Website<\/jats:bold>\n            : https:\/\/coda.io\/@rstless-group\/ir-rag-sigir24.\n          <\/jats:p>","DOI":"10.1145\/3722449.3722463","type":"journal-article","created":{"date-parts":[[2025,3,6]],"date-time":"2025-03-06T17:24:20Z","timestamp":1741281860000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Report on the 1st Workshop on Information Retrieval's Role in RAG Systems (IR-RAG 2024) at SIGIR 2024"],"prefix":"10.1145","volume":"58","author":[{"given":"Fabio","family":"Petroni","sequence":"first","affiliation":[{"name":"Samaya AI, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Federico","family":"Siciliano","sequence":"additional","affiliation":[{"name":"Sapienza University of Rome, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fabrizio","family":"Silvestri","sequence":"additional","affiliation":[{"name":"Sapienza University of Rome, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giovanni","family":"Trappolini","sequence":"additional","affiliation":[{"name":"Sapienza University of Rome, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,3,6]]},"reference":[{"key":"e_1_2_1_1_1","series-title":"CEUR Workshop Proceedings","first-page":"34","volume-title":"Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG","author":"Alessio Marco","year":"2024","unstructured":"Marco Alessio, Guglielmo Faggioli, Nicola Ferro, Franco Maria Nardini, and Raffaele Perego. Improving RAG Systems via Sentence Clustering and Reordering. In Fabio Petroni, Federico Siciliano, Fabrizio Silvestri, and Giovanni Trappolini, editors, Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024), volume 3784 of CEUR Workshop Proceedings, pages 34--43, Washington DC, USA, 2024. CEUR. URL https:\/\/ceur-ws.org\/Vol-3784\/#paper4. ISSN: 1613-0073."},{"key":"e_1_2_1_2_1","volume-title":"Generating query recommendations via llms","author":"Bacciu Andrea","year":"2024","unstructured":"Andrea Bacciu, Enrico Palumbo, Andreas Damianou, Nicola Tonellotto, and Fabrizio Silvestri. Generating query recommendations via llms, 2024. URL https:\/\/arxiv.org\/abs\/2405.19749."},{"key":"e_1_2_1_3_1","volume-title":"Purple llama cyberseceval: A secure coding benchmark for language models","author":"Bhatt Manish","year":"2023","unstructured":"Manish Bhatt, Sahana Chennabasappa, Cyrus Nikolaidis, Shengye Wan, Ivan Evtimov, Dominik Gabi, Daniel Song, Faizan Ahmad, Cornelius Aschermann, Lorenzo Fontana, et al. Purple llama cyberseceval: A secure coding benchmark for language models, 2023."},{"key":"e_1_2_1_4_1","volume-title":"Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, et al. Improving language models by retrieving from trillions of tokens","author":"Borgeaud Sebastian","year":"2022","unstructured":"Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George Bm Van Den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, et al. Improving language models by retrieving from trillions of tokens, 2022."},{"key":"e_1_2_1_5_1","volume-title":"Language models are few-shot learners. Advances in neural information processing systems, 33:1877--1901","author":"Brown Tom","year":"2020","unstructured":"Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. Language models are few-shot learners. Advances in neural information processing systems, 33:1877--1901, 2020."},{"key":"e_1_2_1_6_1","first-page":"62 1613","volume-title":"Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024), volume 3784 of CEUR Workshop Proceedings","author":"Caspari Laura","year":"2024","unstructured":"Laura Caspari, Kanishka Ghosh Dastidar, Saber Zerhoudi, Jelena Mitrovic, and Michael Granitzer. Beyond Benchmarks: Evaluating Embedding Model Similarity for Retrieval Augmented Generation Systems. In Fabio Petroni, Federico Siciliano, Fabrizio Silvestri, and Giovanni Trappolini, editors, Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024), volume 3784 of CEUR Workshop Proceedings, pages 62--70, Washington DC, USA, 2024. CEUR. URL https:\/\/ceur-ws.org\/Vol-3784\/#short4. ISSN: 1613-0073."},{"key":"e_1_2_1_7_1","series-title":"CEUR Workshop Proceedings","first-page":"12","volume-title":"Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG","author":"Contal Emile","year":"2024","unstructured":"Emile Contal and Garrin McGoldrick. RAGSys: Item-Cold-Start Recommender as RAG System. In Fabio Petroni, Federico Siciliano, Fabrizio Silvestri, and Giovanni Trappolini, editors, Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024), volume 3784 of CEUR Workshop Proceedings, pages 12--22, Washington DC, USA, 2024. CEUR. URL https:\/\/ceur-ws.org\/Vol-3784\/#paper2. ISSN: 1613-0073."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3626772.3657834"},{"key":"e_1_2_1_9_1","volume-title":"A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions","author":"Huang Lei","year":"2023","unstructured":"Lei Huang, Weijiang Yu, Weitao Ma, Weihong Zhong, Zhangyin Feng, Haotian Wang, Qianglong Chen, Weihua Peng, Xiaocheng Feng, Bing Qin, et al. A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions, 2023."},{"key":"e_1_2_1_10_1","volume-title":"Llama guard: Llm-based input-output safeguard for human-ai conversations","author":"Inan Hakan","year":"2023","unstructured":"Hakan Inan, Kartikeya Upasani, Jianfeng Chi, Rashi Rungta, Krithika Iyer, Yuning Mao, Michael Tontchev, Qing Hu, Brian Fuller, Davide Testuggine, et al. Llama guard: Llm-based input-output safeguard for human-ai conversations, 2023."},{"key":"e_1_2_1_11_1","first-page":"7b","article-title":"Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al","author":"Jiang Albert Q","year":"2023","unstructured":"Albert Q Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al. Mistral 7b, 2023.","journal-title":"Mistral"},{"key":"e_1_2_1_12_1","series-title":"CEUR Workshop Proceedings","first-page":"50","volume-title":"Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG","author":"Kim Kihun","year":"2024","unstructured":"Kihun Kim, Mintae Kim, Hokyung Lee, Seongik Park, Youngsub Han, and Byoung-Ki Jeon. THoRR: Complex Table Retrieval and Refinement for RAG. In Fabio Petroni, Federico Siciliano, Fabrizio Silvestri, and Giovanni Trappolini, editors, Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024), volume 3784 of CEUR Workshop Proceedings, pages 50--55, Washington DC, USA, 2024. CEUR. URL https:\/\/ceur-ws.org\/Vol-3784\/#short2. ISSN: 1613-0073."},{"key":"e_1_2_1_13_1","series-title":"CEUR Workshop Proceedings","first-page":"23","volume-title":"Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG","author":"Korikov Anton","year":"2024","unstructured":"Anton Korikov, George Saad, Ethan Baron, Mustafa Khan, Manav Shah, and Scott Sanner. Multi-Aspect Reviewed-Item Retrieval via LLM Query Decomposition and Aspect Fusion. In Fabio Petroni, Federico Siciliano, Fabrizio Silvestri, and Giovanni Trappolini, editors, Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024), volume 3784 of CEUR Workshop Proceedings, pages 23--33, Washington DC, USA, 2024. CEUR. URL https:\/\/ceur-ws.org\/Vol-3784\/#paper3. ISSN: 1613-0073."},{"key":"e_1_2_1_14_1","first-page":"9459","article-title":"Retrieval-augmented generation for knowledge-intensive nlp tasks","volume":"33","author":"Lewis Patrick","year":"2020","unstructured":"Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich K\u00fcttler, Mike Lewis, Wen-tau Yih, Tim Rockt\u00e4schel, et al. Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in Neural Information Processing Systems, 33:9459--9474, 2020.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_15_1","volume-title":"Augmented language models: a survey","author":"Mialon Gr\u00e9goire","year":"2023","unstructured":"Gr\u00e9goire Mialon, Roberto Dess\u00ec, Maria Lomeli, Christoforos Nalmpantis, Ram Pasunuru, Roberta Raileanu, Baptiste Rozi\u00e8re, Timo Schick, Jane Dwivedi-Yu, Asli Celikyilmaz, et al. Augmented language models: a survey, 2023."},{"key":"e_1_2_1_16_1","series-title":"CEUR Workshop Proceedings","first-page":"82","volume-title":"Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG","author":"Park Haeju","year":"2024","unstructured":"Haeju Park, Kyungjae Lee, Sunghyun Park, and Moontae Lee. Enhancing Fusion-in-Decoder for Multi-Granularity Ranking. In Fabio Petroni, Federico Siciliano, Fabrizio Silvestri, and Giovanni Trappolini, editors, Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024), volume 3784 of CEUR Workshop Proceedings, pages 82--86, Washington DC, USA, 2024. CEUR. URL https:\/\/ceur-ws.org\/Vol-3784\/#short7. ISSN: 1613-0073."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3626772.3657984"},{"key":"e_1_2_1_18_1","first-page":"44 1613","volume-title":"Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024), volume 3784 of CEUR Workshop Proceedings","author":"Sanna Leonardo","year":"2024","unstructured":"Leonardo Sanna, Simone Magnolini, Patrizio Bellan, Saba Ghanbari Haez, Marina Segala, Monica Consolandi, and Mauro Dragoni. Chain-of-Thought to Enhance Document Retrieval in Certified Medical Chatbots. In Fabio Petroni, Federico Siciliano, Fabrizio Silvestri, and Giovanni Trappolini, editors, Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024), volume 3784 of CEUR Workshop Proceedings, pages 44--49, Washington DC, USA, 2024. CEUR. URL https:\/\/ceur-ws.org\/Vol-3784\/#short1. ISSN: 1613-0073."},{"key":"e_1_2_1_19_1","series-title":"CEUR Workshop Proceedings","first-page":"71","volume-title":"Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG","author":"Sun Fangzheng","year":"2024","unstructured":"Fangzheng Sun, Tianqi Zheng, Aakash Kolekar, Rohit Patki, Hossein Khazaei, Xuan Guo, Ziheng Cai, David Liu, Ruirui Li, Yupin Huang, Dante Everaert, Hanqing Lu, Garima Patel, and Monica Cheng. A Product-Aware Query Auto-Completion Framework for E-Commerce Search via Retrieval-Augmented Generation Method. In Fabio Petroni, Federico Siciliano, Fabrizio Silvestri, and Giovanni Trappolini, editors, Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024), volume 3784 of CEUR Workshop Proceedings, pages 71--76, Washington DC, USA, 2024. CEUR. URL https:\/\/ceur-ws.org\/Vol-3784\/#short5. ISSN: 1613-0073."},{"key":"e_1_2_1_20_1","volume-title":"Jing Nathan Yan, and Alon Y Halevy. Timelineqa: A benchmark for question answering over timelines","author":"Tan Wang-Chiew","year":"2023","unstructured":"Wang-Chiew Tan, Jane Dwivedi-Yu, Yuliang Li, Lambert Mathias, Marzieh Saeidi, Jing Nathan Yan, and Alon Y Halevy. Timelineqa: A benchmark for question answering over timelines, 2023."},{"key":"e_1_2_1_21_1","volume-title":"et al. Llama: Open and efficient foundation language models","author":"Touvron Hugo","year":"2023","unstructured":"Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timoth\u00e9e Lacroix, Baptiste Rozi\u00e8re, Naman Goyal, Eric Hambro, Faisal Azhar, et al. Llama: Open and efficient foundation language models, 2023."},{"key":"e_1_2_1_22_1","series-title":"CEUR Workshop Proceedings","first-page":"77","volume-title":"Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG","author":"Yazan Mert","year":"2024","unstructured":"Mert Yazan, Suzan Verberne, and Frederik Situmeang. The Impact of Quantization on Retrieval-Augmented Generation: An Analysis of Small LLMs. In Fabio Petroni, Federico Siciliano, Fabrizio Silvestri, and Giovanni Trappolini, editors, Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024), volume 3784 of CEUR Workshop Proceedings, pages 77--81, Washington DC, USA, 2024. CEUR. URL https:\/\/ceur-ws.org\/Vol-3784\/#short6. ISSN: 1613-0073."},{"key":"e_1_2_1_23_1","series-title":"CEUR Workshop Proceedings","first-page":"56","volume-title":"Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG","author":"Yu Haitao","year":"2024","unstructured":"Haitao Yu, Lingzhen Zheng, Kaiyu Yang, Sumio Fujita, and Hideo Joho. Towards Incorporating Personalized Context for Conversational Information Seeking. In Fabio Petroni, Federico Siciliano, Fabrizio Silvestri, and Giovanni Trappolini, editors, Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024), volume 3784 of CEUR Workshop Proceedings, pages 56--61, Washington DC, USA, 2024. CEUR. URL https:\/\/ceur-ws.org\/Vol-3784\/#short3. ISSN: 1613-0073."},{"key":"e_1_2_1_24_1","series-title":"CEUR Workshop Proceedings","first-page":"1","volume-title":"Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG","author":"Zerhoudi Saber","year":"2024","unstructured":"Saber Zerhoudi and Michael Granitzer. PersonaRAG: Enhancing Retrieval-Augmented Generation Systems with User-Centric Agents. In Fabio Petroni, Federico Siciliano, Fabrizio Silvestri, and Giovanni Trappolini, editors, Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024), volume 3784 of CEUR Workshop Proceedings, pages 1--11, Washington DC, USA, 2024. CEUR. URL https:\/\/ceur-ws.org\/Vol-3784\/#paper1. ISSN: 1613-0073."}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3722449.3722463","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3722449.3722463","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:57:10Z","timestamp":1750298230000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3722449.3722463"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12]]},"references-count":24,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["10.1145\/3722449.3722463"],"URL":"https:\/\/doi.org\/10.1145\/3722449.3722463","relation":{},"ISSN":["0163-5840"],"issn-type":[{"value":"0163-5840","type":"print"}],"subject":[],"published":{"date-parts":[[2024,12]]},"assertion":[{"value":"2025-03-06","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}