{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,11]],"date-time":"2026-08-11T15:55:37Z","timestamp":1786463737580,"version":"build-2736575974"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T00:00:00Z","timestamp":1785456000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2026,7,31]]},"abstract":"<jats:p>Query performance prediction (QPP) estimates the retrieval quality of ranking models without the use of any human-assessed relevance judgements and finds applications in query-specific selective decision making to improve overall retrieval effectiveness. Although unsupervised QPP approaches are effective for lexical retrieval models, they usually perform weaker for neural rankers. Recent work shows that leveraging query variants (QVs), i.e., queries with potentially similar information needs to a given query, can enhance unsupervised QPP accuracy. However, existing QV-based prediction methods rely on QVs generated by term expansion of the input query, which is likely to yield incoherent, hallucinatory and off-topic QVs. In this article, we propose to make use of queries retrieved from a log of past queries as QVs to be subsequently used for QPP. In addition to directly applying retrieved QVs in QPP, we further propose to leverage large language models to generate QVs conditioned on the retrieved QVs, thus mitigating the limitation of relying only on existing queries in a log. Experiments on TREC DL\u201919 and DL\u201920 show that QPP enhanced with retrieval-augmented query generation outperforms the best-performing existing QV-based prediction approach by as much as 30% on neural ranking models such as MonoT5.<\/jats:p>","DOI":"10.1145\/3815198","type":"journal-article","created":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T13:49:49Z","timestamp":1778161789000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["RAQG-QPP: Query Performance Prediction with Retrieved Query Variants and Retrieval-Augmented Query Generation"],"prefix":"10.1145","volume":"44","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-3282-0220","authenticated-orcid":false,"given":"Fangzheng","family":"Tian","sequence":"first","affiliation":[{"name":"University of Glasgow, Glasgow, United Kingdom of Great Britain and Northern Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0050-7138","authenticated-orcid":false,"given":"Debasis","family":"Ganguly","sequence":"additional","affiliation":[{"name":"University of Glasgow, Glasgow, United Kingdom of Great Britain and Northern Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3143-279X","authenticated-orcid":false,"given":"Craig","family":"MacDonald","sequence":"additional","affiliation":[{"name":"University of Glasgow, Glasgow, United Kingdom of Great Britain and Northern Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,8,11]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2005.11.003"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-56060-6_13"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/2180868.2180873"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3121050.3121087"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3545112"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331253"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/2926790"},{"key":"e_1_3_2_9_2","first-page":"1","volume-title":"Proceedings of the 13th Text REtrieval Conference (Trec \u201904)","author":"Jaleel N. A.","year":"2004","unstructured":"N. A. Jaleel, J. Allan, W. B. Croft, F. Diaz, L. S. Larkey, X. Li, M. D. Smucker, and C. Wade, 2004. Umass at TREC 2004: Novelty and HARD. In Proceedings of the 13th Text REtrieval Conference (Trec \u201904), 1\u201313."},{"key":"e_1_3_2_10_2","first-page":"1","volume-title":"Proceedings of the 1st International Conference on Learning Representations (ICLR \u201913), Workshop Track Proceedings","author":"Mikolov T.","year":"2013","unstructured":"T. Mikolov, K. Chen, G. Corrado, and J. Dean. 2013. Efficient estimation of word representations in vector space. In Proceedings of the 1st International Conference on Learning Representations (ICLR \u201913), Workshop Track Proceedings, 1\u201312."},{"key":"e_1_3_2_11_2","first-page":"414","volume-title":"Proceedings of the Advances in Information Retrieval: 45th European Conference on Information Retrieval (ECIR \u201923), Part II","author":"Gospodinov M.","year":"2023","unstructured":"M. Gospodinov, S. MacAvaney, and C. Macdonald. 2023. Doc2query\u2013: When less is more. In Proceedings of the Advances in Information Retrieval: 45th European Conference on Information Retrieval (ECIR \u201923), Part II. Springer Nature Switzerland, Cham, 414\u2013422."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3539618.3591960"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.5555\/3495724.3495883"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3698204.3716468"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-024-07421-0"},{"key":"e_1_3_2_16_2","unstructured":"P. Bajaj D. Campos N. Craswell L. Deng J. Gao X. Liu R. Majumder A. McNamara B. Mitra T. Nguyen et al. 2016. MS MARCO: A human generated machine reading comprehension dataset. arXiv:1611.09268. Retrieved from https:\/\/arxiv.org\/abs\/1611.09268"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-56063-7_6"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/383952.383972"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/1458082.1458311"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2020.102248"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2018.10.009"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/564376.564429"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2010063"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3121050.3121087"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835494"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2015.06.005"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412032"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-56066-8_6"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-emnlp.950"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3539618.3592032"},{"key":"e_1_3_2_31_2","unstructured":"C. Meng N. Arabzadeh A. Askari M. Aliannejadi and M. de Rijke. 2024. Query performance prediction using relevance judgments generated by large language models. arXiv:2404.01012. Retrieved from https:\/\/arxiv.org\/abs\/2404.01012"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.585"},{"key":"e_1_3_2_33_2","unstructured":"Q. Dong L. Li D. Dai C. Zheng J. Ma R. Li H. Xia J. Xu Z. Wu B. Chang et al. 2024. A survey on in-context learning. arXiv:2301.00234. Retrieved from https:\/\/arxiv.org\/abs\/2301.00234"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3626772.3657842"},{"key":"e_1_3_2_35_2","unstructured":"O. Khattab K. Santhanam X. L. Li D. Hall P. Liang C. Potts and M. Zaharia. 2022. Demonstrate-search-predict: Composing retrieval and language models for knowledge-intensive NLP. arXiv:2212.14024. Retrieved from https:\/\/arxiv.org\/abs\/2212.14024"},{"key":"e_1_3_2_36_2","first-page":"1","volume-title":"Proceedings of the 34th International Conference on Neural Information Processing Systems (NIPS \u201920)","author":"Lewis P.","year":"2020","unstructured":"P. Lewis, E. Perez, A. Piktus, F. Petroni, V. Karpukhin, N. Goyal, H. K\u00fcttler, M. Lewis, W.-t. Yih, T. Rockt\u00e4schel, et al. 2020. Retrieval-augmented generation for knowledge-intensive NLP tasks. In Proceedings of the 34th International Conference on Neural Information Processing Systems (NIPS \u201920). Curran Associates Inc., Red Hook, NY, 1\u201316."},{"key":"e_1_3_2_37_2","unstructured":"Y. Gao Y. Xiong X. Gao K. Jia J. Pan Y. Bi Y. Dai J. Sun M. Wang and H. Wang. 2023. Retrieval-augmented generation for large language models: A survey. arXiv:2312.10997. Retrieved from https:\/\/arxiv.org\/abs\/2312.10997"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.495"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/1852102.1852106"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1410"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/2983323.2983750"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/582415.582416"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767780"},{"key":"e_1_3_2_44_2","first-page":"1041","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language TechnologiesVol. 1, Long and Short Papers)","author":"Sen P.","year":"2019","unstructured":"P. Sen, D. Ganguly, and G. J. F. Jones. 2019. Word-Node2Vec: Improving word embedding with document-level non-local word co-occurrences. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Vol. 1, Long and Short Papers). Association for Computational Linguistics, 1041\u20131051."},{"key":"e_1_3_2_45_2","first-page":"403","volume-title":"Proceedings of the 10th International Conference on Information and Knowledge Management (CIKM \u201901)","author":"Zhai C.","year":"2001","unstructured":"C. Zhai and J. Lafferty. 2001. Model-based feedback in the KL-divergence retrieval model. Proceedings of the 10th International Conference on Information and Knowledge Management (CIKM \u201901), 403\u2013410."},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3269277"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-28244-7_40"},{"key":"e_1_3_2_48_2","doi-asserted-by":"crossref","unstructured":"N. Craswell B. Mitra E. Yilmaz D. Campos and E. Voorhees. 2020. Overview of the TREC 2019 deep learning track. arXiv:2003.07820. Retrieved from https:\/\/arxiv.org\/abs\/2003.07820","DOI":"10.6028\/NIST.SP.1266.deep-overview"},{"key":"e_1_3_2_49_2","doi-asserted-by":"crossref","unstructured":"N. Craswell B. Mitra E. Yilmaz and D. Campos. 2021. Overview of the TREC 2020 deep learning track. arXiv:2102.07662. Retrieved from https:\/\/arxiv.org\/abs\/2102.07662","DOI":"10.6028\/NIST.SP.1266.deep-overview"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210176"},{"key":"e_1_3_2_51_2","doi-asserted-by":"crossref","unstructured":"D. Ganguly S. Datta M. Mitra and D. Greene. 2022. An analysis of variations in the effectiveness of query performance prediction. arXiv:2202.06306. Retrieved from https:\/\/arxiv.org\/abs\/2202.06306","DOI":"10.1007\/978-3-030-99736-6_15"},{"key":"e_1_3_2_52_2","first-page":", 109","volume-title":"Proceedings of the Overview of the 3rd Text REtrieval Conference (TREC-3 \u201995)","author":"Robertson S.","year":"1995","unstructured":"S. Robertson, S. Walker, S. Jones, M. M. Hancock-Beaulieu, and M. Gatford. 1995. Okapi at TREC-3. In Proceedings of the Overview of the 3rd Text REtrieval Conference (TREC-3 \u201995). NIST, Gaithersburg, MD, 109\u2013126. Retrieved from https:\/\/www.microsoft.com\/en-us\/research\/publication\/okapi-at-trec-3\/"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.repl4nlp-1.17"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401075"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.findings-emnlp.63"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3626772.3657951"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482013"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482063"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-022-09407-w"},{"key":"e_1_3_2_60_2","doi-asserted-by":"crossref","unstructured":"N. Craswell B. Mitra E. Yilmaz D. Campos and J. Lin.2025. Overview of the TREC 2021 deep learning track. arXiv:2507.08191. Retrieved from https:\/\/arxiv.org\/abs\/2507.08191","DOI":"10.6028\/NIST.SP.500-335.deep-overview"},{"key":"e_1_3_2_61_2","doi-asserted-by":"crossref","unstructured":"N. Craswell B. Mitra E. Yilmaz D. Campos J. Lin E. M. Voorhees and I. Soboroff. 2025. Overview of the TREC 2022 deep learning track. arXiv:2507.10865. Retrieved from https:\/\/arxiv.org\/abs\/2507.10865","DOI":"10.6028\/NIST.SP.500-338.deep-overview"}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3815198","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,11]],"date-time":"2026-08-11T13:45:49Z","timestamp":1786455949000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3815198"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,31]]},"references-count":60,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2026,7,31]]}},"alternative-id":["10.1145\/3815198"],"URL":"https:\/\/doi.org\/10.1145\/3815198","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"value":"1046-8188","type":"print"},{"value":"1558-2868","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,31]]},"assertion":[{"value":"2025-06-15","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-04-26","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-08-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}