{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T21:18:18Z","timestamp":1769548698462,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":117,"publisher":"ACM","funder":[{"name":"NSF","award":["IIS-2312794"],"award-info":[{"award-number":["IIS-2312794"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,7,18]]},"DOI":"10.1145\/3731120.3744590","type":"proceedings-article","created":{"date-parts":[[2025,7,18]],"date-time":"2025-07-18T13:34:06Z","timestamp":1752845646000},"page":"238-253","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Oreo: A Plug-in Context Reconstructor to Enhance Retrieval-Augmented Generation"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4393-9977","authenticated-orcid":false,"given":"Sha","family":"Li","sequence":"first","affiliation":[{"name":"Virginia Tech, Blacksburg, VA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1821-9743","authenticated-orcid":false,"given":"Naren","family":"Ramakrishnan","sequence":"additional","affiliation":[{"name":"Virginia Tech, Alexandria, VA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,7,18]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al.","author":"Ahmad Lama","year":"2023","unstructured":"JoshAchiam, StevenAdler, SandhiniAgarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023. Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023)."},{"key":"e_1_3_2_1_2_1","unstructured":"Bo Adler Niket Agarwal Ashwath Aithal Dong H Anh Pallab Bhattacharya Annika Brundyn Jared Casper Bryan Catanzaro Sharon Clay Jonathan Cohen et al. 2024. Nemotron-4 340B Technical Report. arXiv preprint arXiv:2406.11704 (2024)."},{"key":"e_1_3_2_1_3_1","first-page":"2197","article-title":"Cont: Contrastive neural text generation","volume":"35","author":"An Chenxin","year":"2022","unstructured":"Chenxin An, Jiangtao Feng, Kai Lv, Lingpeng Kong, Xipeng Qiu, and Xuanjing Huang. 2022. Cont: Contrastive neural text generation. Advances in Neural Information Processing Systems 35 (2022), 2197-2210.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_4_1","volume-title":"RRAML: reinforced retrieval augmented machine learning. arXiv preprint arXiv:2307.12798","author":"Bacciu Andrea","year":"2023","unstructured":"Andrea Bacciu, Florin Cuconasu, Federico Siciliano, Fabrizio Silvestri, Nicola Tonellotto, and Giovanni Trappolini. 2023. RRAML: reinforced retrieval augmented machine learning. arXiv preprint arXiv:2307.12798 (2023)."},{"key":"e_1_3_2_1_5_1","unstructured":"Yuntao Bai Andy Jones Kamal Ndousse Amanda Askell Anna Chen Nova DasSarma Dawn Drain Stanislav Fort Deep Ganguli Tom Henighan et al. 2022. Training a helpful and harmless assistant with reinforcement learning from human feedback. arXiv preprint arXiv:2204.05862 (2022)."},{"key":"e_1_3_2_1_6_1","unstructured":"Yuntao Bai Saurav Kadavath Sandipan Kundu Amanda Askell Jackson Kernion Andy Jones Anna Chen Anna Goldie Azalia Mirhoseini Cameron McKinnon et al. 2022. Constitutional ai: Harmlessness from ai feedback. arXiv preprint arXiv:2212.08073 (2022)."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.emnlp-main.667"},{"key":"e_1_3_2_1_8_1","volume-title":"Can retrieveraugmented language models reason? the blame game between the retriever and the language model. arXiv preprint arXiv:2212.09146","author":"BehnamGhader Parishad","year":"2022","unstructured":"Parishad BehnamGhader, Santiago Miret, and Siva Reddy. 2022. Can retrieveraugmented language models reason? the blame game between the retriever and the language model. arXiv preprint arXiv:2212.09146 (2022)."},{"key":"e_1_3_2_1_9_1","volume-title":"International conference on machine learning. PMLR, 2206-2240","author":"Borgeaud Sebastian","year":"2022","unstructured":"Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George Bm Van Den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, et al. 2022. Improving language models by retrieving from trillions of tokens. In International conference on machine learning. PMLR, 2206-2240."},{"key":"e_1_3_2_1_10_1","unstructured":"Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell et al. 2020. Language models are few-shot learners. Advances in neural information processing systems 33 (2020) 1877-1901."},{"key":"e_1_3_2_1_11_1","volume-title":"Survey on large language model-enhanced reinforcement learning: Concept, taxonomy, and methods","author":"Cao Yuji","year":"2024","unstructured":"Yuji Cao, Huan Zhao, Yuheng Cheng, Ting Shu, Yue Chen, Guolong Liu, Gaoqi Liang, Junhua Zhao, Jinyue Yan, and Yun Li. 2024. Survey on large language model-enhanced reinforcement learning: Concept, taxonomy, and methods. IEEE Transactions on Neural Networks and Learning Systems (2024)."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024"},{"key":"e_1_3_2_1_13_1","volume-title":"Rq-rag: Learning to refine queries for retrieval augmented generation. arXiv preprint arXiv:2404.00610","author":"Chan Chi-Min","year":"2024","unstructured":"Chi-Min Chan, Chunpu Xu, Ruibin Yuan, Hongyin Luo, Wei Xue, Yike Guo, and Jie Fu. 2024. Rq-rag: Learning to refine queries for retrieval augmented generation. arXiv preprint arXiv:2404.00610 (2024)."},{"key":"e_1_3_2_1_14_1","volume-title":"xrag: Extreme context compression for retrieval-augmented generation with one token. arXiv preprint arXiv:2405.13792","author":"Cheng Xin","year":"2024","unstructured":"Xin Cheng, Xun Wang, Xingxing Zhang, Tao Ge, Si-Qing Chen, Furu Wei, Huishuai Zhang, and Dongyan Zhao. 2024. xrag: Extreme context compression for retrieval-augmented generation with one token. arXiv preprint arXiv:2405.13792 (2024)."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.232"},{"key":"e_1_3_2_1_16_1","unstructured":"Yunfei Chu Jin Xu Qian Yang Haojie Wei Xipin Wei Zhifang Guo Yichong Leng Yuanjun Lv Jinzheng He Junyang Lin et al. 2024. Qwen2-audio technical report. arXiv preprint arXiv:2407.10759 (2024)."},{"key":"e_1_3_2_1_17_1","first-page":"1","article-title":"Scaling instruction-finetuned language models","volume":"25","author":"Chung Hyung Won","year":"2024","unstructured":"Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, et al. 2024. Scaling instruction-finetuned language models. Journal of Machine Learning Research 25, 70 (2024), 1-53.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3626772.3657834"},{"key":"e_1_3_2_1_19_1","volume-title":"Ultrafeedback: Boosting language models with high-quality feedback.","author":"Cui Ganqu","year":"2023","unstructured":"Ganqu Cui, Lifan Yuan, Ning Ding, Guanming Yao, Wei Zhu, Yuan Ni, Guotong Xie, Zhiyuan Liu, and Maosong Sun. 2023. Ultrafeedback: Boosting language models with high-quality feedback. (2023)."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-024-45563-x"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.emnlp-main.222"},{"key":"e_1_3_2_1_22_1","volume-title":"Understand what LLM needs: Dual preference alignment for retrieval-augmented generation. arXiv preprint arXiv:2406.18676","author":"Dong Guanting","year":"2024","unstructured":"Guanting Dong, Yutao Zhu, Chenghao Zhang, Zechen Wang, Zhicheng Dou, and Ji-RongWen. 2024. Understand what LLM needs: Dual preference alignment for retrieval-augmented generation. arXiv preprint arXiv:2406.18676 (2024)."},{"key":"e_1_3_2_1_23_1","volume-title":"Don't Forget to Connect! Improving RAG with Graph-based Reranking. arXiv preprint arXiv:2405.18414","author":"Dong Jialin","year":"2024","unstructured":"Jialin Dong, Bahare Fatemi, Bryan Perozzi, Lin F Yang, and Anton Tsitsulin. 2024. Don't Forget to Connect! Improving RAG with Graph-based Reranking. arXiv preprint arXiv:2405.18414 (2024)."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.acl-long.505"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.acllong"},{"key":"e_1_3_2_1_26_1","volume-title":"Retrieval-augmented generation for large language models: A survey. arXiv preprint arXiv:2312.10997","author":"Gao Yunfan","year":"2023","unstructured":"Yunfan Gao, Yun Xiong, Xinyu Gao, Kangxiang Jia, Jinliu Pan, Yuxi Bi, Yi Dai, Jiawei Sun, and Haofen Wang. 2023. Retrieval-augmented generation for large language models: A survey. arXiv preprint arXiv:2312.10997 (2023)."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.acl-long.90"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.naacl-main.194"},{"key":"e_1_3_2_1_29_1","unstructured":"Jiawei Gu Xuhui Jiang Zhichao Shi Hexiang Tan Xuehao Zhai Chengjin Xu Wei Li Yinghan Shen Shengjie Ma Honghao Liu et al. 2024. A Survey on LLM-as-a-Judge. arXiv preprint arXiv:2411.15594 (2024)."},{"key":"e_1_3_2_1_30_1","volume-title":"International conference on machine learning. PMLR, 3929-3938","author":"Guu Kelvin","year":"2020","unstructured":"Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Mingwei Chang. 2020. Retrieval augmented language model pre-training. In International conference on machine learning. PMLR, 3929-3938."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.coling-main.580"},{"key":"e_1_3_2_1_32_1","volume-title":"Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1437-1447","author":"Hofst\u00e4tter Sebastian","year":"2023","unstructured":"Sebastian Hofst\u00e4tter, Jiecao Chen, Karthik Raman, and Hamed Zamani. 2023. Fidlight: Efficient and effective retrieval-augmented text generation. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1437-1447."},{"key":"e_1_3_2_1_33_1","volume-title":"Aligning language models with offline reinforcement learning from human feedback. arXiv preprint arXiv:2308.12050","author":"Hu Jian","year":"2023","unstructured":"Jian Hu, Li Tao, June Yang, and Chandler Zhou. 2023. Aligning language models with offline reinforcement learning from human feedback. arXiv preprint arXiv:2308.12050 (2023)."},{"key":"e_1_3_2_1_34_1","volume-title":"EXIT: Context-Aware Extractive Compression for Enhancing Retrieval-Augmented Generation. arXiv preprint arXiv:2412.12559","author":"Hwang Taeho","year":"2024","unstructured":"Taeho Hwang, Sukmin Cho, Soyeong Jeong, Hoyun Song, SeungYoon Han, and Jong C Park. 2024. EXIT: Context-Aware Extractive Compression for Enhancing Retrieval-Augmented Generation. arXiv preprint arXiv:2412.12559 (2024)."},{"key":"e_1_3_2_1_35_1","volume-title":"Ramakanth Pasunuru, Todor Mihaylov, D\u00e1niel Simig, Ping Yu, Kurt Shuster, Tianlu Wang, Qing Liu, Punit Singh Koura, et al.","author":"Iyer Srinivasan","year":"2022","unstructured":"Srinivasan Iyer, Xi Victoria Lin, Ramakanth Pasunuru, Todor Mihaylov, D\u00e1niel Simig, Ping Yu, Kurt Shuster, Tianlu Wang, Qing Liu, Punit Singh Koura, et al. 2022. OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization. arXiv:2212.12017 [cs.CL]"},{"key":"e_1_3_2_1_36_1","volume-title":"Few-shot learning with retrieval augmented language models. arXiv preprint arXiv:2208.03299 1, 2","author":"Izacard Gautier","year":"2022","unstructured":"Gautier Izacard, Patrick Lewis, Maria Lomeli, Lucas Hosseini, Fabio Petroni, Timo Schick, Jane Dwivedi-Yu, Armand Joulin, Sebastian Riedel, and Edouard Grave. 2022. Few-shot learning with retrieval augmented language models. arXiv preprint arXiv:2208.03299 1, 2 (2022), 4."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.825"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.acl-long.91"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.findings-acl.42"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1147"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.550"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.acl-long.562"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401075"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.63"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00276"},{"key":"e_1_3_2_1_46_1","volume-title":"Kalesha Bullard, and Dorsa Sadigh.","author":"Kwon Minae","year":"2023","unstructured":"Minae Kwon, Sang Michael Xie, Kalesha Bullard, and Dorsa Sadigh. 2023. Reward design with language models. arXiv preprint arXiv:2303.00001 (2023)."},{"key":"e_1_3_2_1_47_1","volume-title":"Thomas Mesnard, Johan Ferret, Colton Bishop, Ethan Hall, Victor Carbune, and Abhinav Rastogi.","author":"Lee Harrison","year":"2023","unstructured":"Harrison Lee, Samrat Phatale, Hassan Mansoor, Kellie Ren Lu, Thomas Mesnard, Johan Ferret, Colton Bishop, Ethan Hall, Victor Carbune, and Abhinav Rastogi. 2023. Rlaif: Scaling reinforcement learning from human feedback with ai feedback. (2023)."},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.eacl-short.34"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-acl.695"},{"key":"e_1_3_2_1_50_1","volume-title":"A survey on retrieval-augmented text generation. arXiv preprint arXiv:2202.01110","author":"Li Huayang","year":"2022","unstructured":"Huayang Li, Yixuan Su, Deng Cai, Yan Wang, and Lemao Liu. 2022. A survey on retrieval-augmented text generation. arXiv preprint arXiv:2202.01110 (2022)."},{"key":"e_1_3_2_1_51_1","volume-title":"AnglE-optimized Text Embeddings. arXiv preprint arXiv:2309.12871","author":"Li Xianming","year":"2023","unstructured":"Xianming Li and Jing Li. 2023. AnglE-optimized Text Embeddings. arXiv preprint arXiv:2309.12871 (2023)."},{"key":"e_1_3_2_1_52_1","volume-title":"Unlocking context constraints of llms: Enhancing context efficiency of llms with self-information-based content filtering. arXiv preprint arXiv:2304.12102","author":"Yucheng Li.","year":"2023","unstructured":"Yucheng Li. 2023. Unlocking context constraints of llms: Enhancing context efficiency of llms with self-information-based content filtering. arXiv preprint arXiv:2304.12102 (2023)."},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlpmain"},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.findings-emnlp.500"},{"key":"e_1_3_2_1_55_1","volume-title":"Ra-dit: Retrieval-augmented dual instruction tuning. arXiv preprint arXiv:2310.01352","author":"Lin Xi Victoria","year":"2023","unstructured":"Xi Victoria Lin, Xilun Chen, Mingda Chen,Weijia Shi, Maria Lomeli, Rich James, Pedro Rodriguez, Jacob Kahn, Gergely Szilvasy, Mike Lewis, et al. 2023. Ra-dit: Retrieval-augmented dual instruction tuning. arXiv preprint arXiv:2310.01352 (2023)."},{"key":"e_1_3_2_1_56_1","unstructured":"Jiongnan Liu Jiajie Jin Zihan Wang Jiehan Cheng Zhicheng Dou and J Wen."},{"key":"e_1_3_2_1_57_1","volume-title":"RETA-LLM: a retrieval-augmented large language model toolkit","year":"2023","unstructured":". RETA-LLM: a retrieval-augmented large language model toolkit (2023). arXiv preprint arXiv:2306.05212 ([n. d.])."},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-emnlp.655"},{"key":"e_1_3_2_1_59_1","volume-title":"Lost in the middle: How language models use long contexts. arXiv preprint arXiv:2307.03172","author":"Liu Nelson F","year":"2023","unstructured":"Nelson F Liu, Kevin Lin, John Hewitt, Ashwin Paranjape, Michele Bevilacqua, Fabio Petroni, and Percy Liang. 2023. Lost in the middle: How language models use long contexts. arXiv preprint arXiv:2307.03172 (2023)."},{"key":"e_1_3_2_1_60_1","volume-title":"PISCO: Pretty Simple Compression for Retrieval-Augmented Generation. arXiv preprint arXiv:2501.16075","author":"Louis Maxime","year":"2025","unstructured":"Maxime Louis, Herv\u00e9 D\u00e9jean, and St\u00e9phane Clinchant. 2025. PISCO: Pretty Simple Compression for Retrieval-Augmented Generation. arXiv preprint arXiv:2501.16075 (2025)."},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlpmain"},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/"},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.acl-long.546"},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.findings-acl.29"},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.173"},{"key":"e_1_3_2_1_66_1","volume-title":"Multi-stage document ranking with BERT. arXiv preprint arXiv:1910.14424","author":"Nogueira Rodrigo","year":"2019","unstructured":"Rodrigo Nogueira,Wei Yang, Kyunghyun Cho, and Jimmy Lin. 2019. Multi-stage document ranking with BERT. arXiv preprint arXiv:1910.14424 (2019)."},{"key":"e_1_3_2_1_67_1","unstructured":"Long Ouyang JeffreyWu Xu Jiang Diogo Almeida CarrollWainwright Pamela Mishkin Chong Zhang Sandhini Agarwal Katarina Slama Alex Ray et al. 2022. Training language models to followinstructions with human feedback. Advances in neural information processing systems 35 (2022) 27730-27744."},{"key":"e_1_3_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.findings-acl.57"},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024"},{"key":"e_1_3_2_1_70_1","volume-title":"RankZephyr: Effective and Robust Zero-Shot Listwise Reranking is a Breeze! arXiv preprint arXiv:2312.02724","author":"Pradeep Ronak","year":"2023","unstructured":"Ronak Pradeep, Sahel Sharifymoghaddam, and Jimmy Lin. 2023. RankZephyr: Effective and Robust Zero-Shot Listwise Reranking is a Breeze! arXiv preprint arXiv:2312.02724 (2023)."},{"key":"e_1_3_2_1_71_1","volume-title":"The RL\/LLM Taxonomy Tree: Reviewing Synergies Between Reinforcement Learning and Large Language Models. arXiv preprint arXiv:2402.01874","author":"Pternea Moschoula","year":"2024","unstructured":"Moschoula Pternea, Prerna Singh, Abir Chakraborty, Yagna Oruganti, Mirco Milletari, Sayli Bapat, and Kebei Jiang. 2024. The RL\/LLM Taxonomy Tree: Reviewing Synergies Between Reinforcement Learning and Large Language Models. arXiv preprint arXiv:2402.01874 (2024)."},{"key":"e_1_3_2_1_72_1","volume-title":"Direct preference optimization: Your language model is secretly a reward model. Advances in Neural Information Processing Systems 36","author":"Rafailov Rafael","year":"2024","unstructured":"Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D Manning, Stefano Ermon, and Chelsea Finn. 2024. Direct preference optimization: Your language model is secretly a reward model. Advances in Neural Information Processing Systems 36 (2024)."},{"key":"e_1_3_2_1_73_1","first-page":"1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel Colin","year":"2020","unstructured":"Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of machine learning research 21, 140 (2020), 1-67.","journal-title":"Journal of machine learning research"},{"key":"e_1_3_2_1_74_1","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR).","author":"Ramamurthy Rajkumar","year":"2023","unstructured":"Rajkumar Ramamurthy, Prithviraj Ammanabrolu, Kiant\u00e9 Brantley, Jack Hessel, Rafet Sifa, Christian Bauckhage, Hannaneh Hajishirzi, and Yejin Choi. 2023. Is reinforcement learning (not) for natural language processing: Benchmarks, baselines, and building blocks for natural language policy optimization. In Proceedings of the International Conference on Learning Representations (ICLR)."},{"key":"e_1_3_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-2099-5_24"},{"key":"e_1_3_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.naacl-main.272"},{"key":"e_1_3_2_1_77_1","volume-title":"High-dimensional continuous control using generalized advantage estimation. arXiv preprint arXiv:1506.02438","author":"Schulman John","year":"2015","unstructured":"John Schulman, Philipp Moritz, Sergey Levine, Michael Jordan, and Pieter Abbeel. 2015. High-dimensional continuous control using generalized advantage estimation. arXiv preprint arXiv:1506.02438 (2015)."},{"key":"e_1_3_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-emnlp.620"},{"key":"e_1_3_2_1_79_1","volume-title":"International Conference on Machine Learning. PMLR, 31210-31227","author":"Shi Freda","year":"2023","unstructured":"Freda Shi, Xinyun Chen, Kanishka Misra, Nathan Scales, David Dohan, Ed H Chi, Nathanael Sch\u00e4rli, and Denny Zhou. 2023. Large language models can be easily distracted by irrelevant context. In International Conference on Machine Learning. PMLR, 31210-31227."},{"key":"e_1_3_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.naacl-long.463"},{"key":"e_1_3_2_1_81_1","unstructured":"Nisan Stiennon Ouyang Long Jeffrey Wu Daniel M. Ziegler Ryan Lowe Chelsea Voss Alec Radford Dario Amodei and Paul Francis Christiano. 2020. Learning to summarize with human feedback. In Neural Information Processing Systems. https:\/\/api.semanticscholar.org\/CorpusID:263874153"},{"key":"e_1_3_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v37i11.26596"},{"key":"e_1_3_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlpmain"},{"key":"e_1_3_2_1_84_1","volume-title":"Small Models","author":"Tan Jiejun","year":"2052","unstructured":"Jiejun Tan, Zhicheng Dou, Yutao Zhu, Peidong Guo, Kun Fang, and Ji-Rong Wen. 2024. Small Models, Big Insights: Leveraging Slim Proxy Models To Decide When and What to Retrieve for LLMs. arXiv preprint arXiv:2402.12052 (2024)."},{"key":"e_1_3_2_1_85_1","volume-title":"Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971","author":"Touvron Hugo","year":"2023","unstructured":"Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timoth\u00e9e Lacroix, Baptiste Rozi\u00e8re, Naman Goyal, Eric Hambro, Faisal Azhar, et al. 2023. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023)."},{"key":"e_1_3_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-emnlp.1013"},{"key":"e_1_3_2_1_87_1","volume-title":"Retrieval-Augmented Generation with Conflicting Evidence. arXiv preprint arXiv:2504.13079","author":"Wang Han","year":"2025","unstructured":"Han Wang, Archiki Prasad, Elias Stengel-Eskin, and Mohit Bansal. 2025. Retrieval-Augmented Generation with Conflicting Evidence. arXiv preprint arXiv:2504.13079 (2025)."},{"key":"e_1_3_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.585"},{"key":"e_1_3_2_1_89_1","volume-title":"Md Rizwan Parvez, and Graham Neubig","author":"Wang Zhiruo","year":"2023","unstructured":"Zhiruo Wang, Jun Araki, Zhengbao Jiang, Md Rizwan Parvez, and Graham Neubig. 2023. Learning to filter context for retrieval-augmented generation. arXiv preprint arXiv:2311.08377 (2023)."},{"key":"e_1_3_2_1_90_1","volume-title":"Denny Zhou, et al.","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems 35 (2022), 24824-24837."},{"key":"e_1_3_2_1_91_1","volume-title":"InstructRAG: Instructing Retrieval-Augmented Generation with Explicit Denoising. arXiv preprint arXiv:2406.13629","author":"Wei Zhepei","year":"2024","unstructured":"Zhepei Wei, Wei-Lin Chen, and Yu Meng. 2024. InstructRAG: Instructing Retrieval-Augmented Generation with Explicit Denoising. arXiv preprint arXiv:2406.13629 (2024)."},{"key":"e_1_3_2_1_92_1","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. Association for Computational Linguistics, Online, 38-45","author":"Wolf Thomas","year":"2020","unstructured":"Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, R\u00e9mi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander M. Rush. 2020. Transformers: State-of-the-Art Natural Language Processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. Association for Computational Linguistics, Online, 38-45. https:\/\/www.aclweb.org\/anthology\/2020.emnlpdemos. 6"},{"key":"e_1_3_2_1_93_1","volume-title":"Recursively summarizing books with human feedback. arXiv preprint arXiv:2109.10862","author":"Wu Jeff","year":"2021","unstructured":"Jeff Wu, Long Ouyang, Daniel M Ziegler, Nisan Stiennon, Ryan Lowe, Jan Leike, and Paul Christiano. 2021. Recursively summarizing books with human feedback. arXiv preprint arXiv:2109.10862 (2021)."},{"key":"e_1_3_2_1_94_1","volume-title":"beta-DPO: Direct Preference Optimization with Dynamic beta. arXiv preprint arXiv:2407.08639","author":"Wu Junkang","year":"2024","unstructured":"Junkang Wu, Yuexiang Xie, Zhengyi Yang, Jiancan Wu, Jinyang Gao, Bolin Ding, Xiang Wang, and Xiangnan He. 2024. beta-DPO: Direct Preference Optimization with Dynamic beta. arXiv preprint arXiv:2407.08639 (2024)."},{"key":"e_1_3_2_1_95_1","volume-title":"How Easily do Irrelevant Inputs Skew the Responses of Large Language Models? arXiv preprint arXiv:2404.03302","author":"Wu Siye","year":"2024","unstructured":"Siye Wu, Jian Xie, Jiangjie Chen, Tinghui Zhu, Kai Zhang, and Yanghua Xiao. 2024. How Easily do Irrelevant Inputs Skew the Responses of Large Language Models? arXiv preprint arXiv:2404.03302 (2024)."},{"key":"e_1_3_2_1_96_1","unstructured":"Shitao Xiao Zheng Liu Peitian Zhang and Niklas Muennighoff. 2023. C-Pack: Packaged Resources To Advance General Chinese Embedding. arXiv:2309.07597 [cs.CL]"},{"key":"e_1_3_2_1_97_1","volume-title":"RECOMP: Improving Retrieval- Augmented LMs with Context Compression and Selective Augmentation. In The 12th International Conference on Learning Representations.","author":"Xu Fangyuan","year":"2024","unstructured":"Fangyuan Xu,Weijia Shi, and Eunsol Choi. 2024. RECOMP: Improving Retrieval- Augmented LMs with Context Compression and Selective Augmentation. In The 12th International Conference on Learning Representations."},{"key":"e_1_3_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.emnlp-main.486"},{"key":"e_1_3_2_1_99_1","volume-title":"ActiveRAG: Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented Agents. arXiv preprint arXiv:2402.13547","author":"Xu Zhipeng","year":"2024","unstructured":"Zhipeng Xu, Zhenghao Liu, Yukun Yan, ShuoWang, Shi Yu, Zheni Zeng, Chaojun Xiao, Zhiyuan Liu, Ge Yu, and Chenyan Xiong. 2024. ActiveRAG: Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented Agents. arXiv preprint arXiv:2402.13547 (2024)."},{"key":"e_1_3_2_1_100_1","volume-title":"Corrective retrieval augmented generation. arXiv preprint arXiv:2401.15884","author":"Yan Shi-Qi","year":"2024","unstructured":"Shi-Qi Yan, Jia-Chen Gu, Yun Zhu, and Zhen-Hua Ling. 2024. Corrective retrieval augmented generation. arXiv preprint arXiv:2401.15884 (2024)."},{"key":"e_1_3_2_1_101_1","unstructured":"An Yang Baosong Yang Beichen Zhang Binyuan Hui Bo Zheng Bowen Yu Chengyuan Li Dayiheng Liu Fei Huang Haoran Wei et al. 2024. Qwen2. 5 technical report. arXiv preprint arXiv:2412.15115 (2024)."},{"key":"e_1_3_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.326"},{"key":"e_1_3_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1259"},{"key":"e_1_3_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.emnlp-main.1194"},{"key":"e_1_3_2_1_105_1","volume-title":"Making retrieval-augmented languagemodels robust to irrelevant context. arXiv preprint arXiv:2310.01558","author":"Yoran Ori","year":"2023","unstructured":"Ori Yoran, Tomer Wolfson, Ori Ram, and Jonathan Berant. 2023. Making retrieval-augmented languagemodels robust to irrelevant context. arXiv preprint arXiv:2310.01558 (2023)."},{"key":"e_1_3_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.emnlpmain"},{"key":"e_1_3_2_1_107_1","volume-title":"Chain-of-note: Enhancing robustness in retrieval-augmented language models. arXiv preprint arXiv:2311.09210","author":"Yu Wenhao","year":"2023","unstructured":"Wenhao Yu, Hongming Zhang, Xiaoman Pan, Kaixin Ma, Hongwei Wang, and Dong Yu. 2023. Chain-of-note: Enhancing robustness in retrieval-augmented language models. arXiv preprint arXiv:2311.09210 (2023)."},{"key":"e_1_3_2_1_108_1","volume-title":"Kyunghyun Cho, Sainbayar Sukhbaatar, Jing Xu, and JasonWeston.","author":"Yuan Weizhe","year":"2024","unstructured":"Weizhe Yuan, Richard Yuanzhe Pang, Kyunghyun Cho, Sainbayar Sukhbaatar, Jing Xu, and JasonWeston. 2024. Self-rewarding language models. arXiv preprint arXiv:2401.10020 (2024)."},{"key":"e_1_3_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.1145\/3626772.3657923"},{"key":"e_1_3_2_1_110_1","first-page":"15476","article-title":"Star: Bootstrapping reasoning with reasoning","volume":"35","author":"Zelikman Eric","year":"2022","unstructured":"Eric Zelikman, Yuhuai Wu, Jesse Mu, and Noah Goodman. 2022. Star: Bootstrapping reasoning with reasoning. Advances in Neural Information Processing Systems 35 (2022), 15476-15488.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_111_1","volume-title":"Generative verifiers: Reward modeling as nexttoken prediction. arXiv preprint arXiv:2408.15240","author":"Zhang Lunjun","year":"2024","unstructured":"Lunjun Zhang, Arian Hosseini, Hritik Bansal, Mehran Kazemi, Aviral Kumar, and Rishabh Agarwal. 2024. Generative verifiers: Reward modeling as nexttoken prediction. arXiv preprint arXiv:2408.15240 (2024)."},{"key":"e_1_3_2_1_112_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.acl-long.203"},{"key":"e_1_3_2_1_113_1","volume-title":"Tempera: Test-time prompting via reinforcement learning. arXiv preprint arXiv:2211.11890","author":"Zhang Tianjun","year":"2022","unstructured":"Tianjun Zhang, Xuezhi Wang, Denny Zhou, Dale Schuurmans, and Joseph E Gonzalez. 2022. Tempera: Test-time prompting via reinforcement learning. arXiv preprint arXiv:2211.11890 (2022)."},{"key":"e_1_3_2_1_114_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/"},{"key":"e_1_3_2_1_115_1","doi-asserted-by":"crossref","unstructured":"Chunting Zhou Graham Neubig Jiatao Gu Mona Diab Francisco Guzm\u00e1n Luke Zettlemoyer and Marjan Ghazvininejad. 2021. Detecting Hallucinated Content in Conditional Neural Sequence Generation. In Findings of the Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP Findings). Virtual. https:\/\/arxiv.org\/abs\/2011.02593","DOI":"10.18653\/v1\/2021.findings-acl.120"},{"key":"e_1_3_2_1_116_1","volume-title":"Large language models for information retrieval: A survey. arXiv preprint arXiv:2308.07107","author":"Zhu Yutao","year":"2023","unstructured":"Yutao Zhu, Huaying Yuan, Shuting Wang, Jiongnan Liu, Wenhan Liu, Chenlong Deng, Haonan Chen, Zheng Liu, Zhicheng Dou, and Ji-Rong Wen. 2023. Large language models for information retrieval: A survey. arXiv preprint arXiv:2308.07107 (2023)."},{"key":"e_1_3_2_1_117_1","doi-asserted-by":"publisher","DOI":"10.1145\/3539618.3592047"}],"event":{"name":"ICTIR '25: International ACM SIGIR Conference on Innovative Concepts and Theories in Information Retrieval","location":"Padua Italy","acronym":"ICTIR '25","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 2025 International ACM SIGIR Conference on Innovative Concepts and Theories in Information Retrieval (ICTIR)"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3731120.3744590","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T13:17:58Z","timestamp":1755868678000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3731120.3744590"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,18]]},"references-count":117,"alternative-id":["10.1145\/3731120.3744590","10.1145\/3731120"],"URL":"https:\/\/doi.org\/10.1145\/3731120.3744590","relation":{},"subject":[],"published":{"date-parts":[[2025,7,18]]},"assertion":[{"value":"2025-07-18","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}