{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T05:14:30Z","timestamp":1784178870381,"version":"3.55.0"},"reference-count":242,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,3,24]],"date-time":"2022-03-24T00:00:00Z","timestamp":1648080000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Beijing Academy of Artificial Intelligence","award":["BAAI2019ZD0306"],"award-info":[{"award-number":["BAAI2019ZD0306"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61902381, 62006218, and 61872338"],"award-info":[{"award-number":["61902381, 62006218, and 61872338"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100004739","name":"Youth Innovation Promotion Association CAS","doi-asserted-by":"crossref","award":["20144310, and 2021100"],"award-info":[{"award-number":["20144310, and 2021100"]}],"id":[{"id":"10.13039\/501100004739","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Lenovo-CAS Joint Lab Youth Scientist Project"},{"name":"Foundation and Frontier Research Key Program of Chongqing Science and Technology Commission","award":["cstc2017jcyjBX0059"],"award-info":[{"award-number":["cstc2017jcyjBX0059"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2022,10,31]]},"abstract":"<jats:p>Multi-stage ranking pipelines have been a practical solution in modern search systems, where the first-stage retrieval is to return a subset of candidate documents and latter stages attempt to re-rank those candidates. Unlike re-ranking stages going through quick technique shifts over the past decades, the first-stage retrieval has long been dominated by classical term-based models. Unfortunately, these models suffer from the vocabulary mismatch problem, which may block re-ranking stages from relevant documents at the very beginning. Therefore, it has been a long-term desire to build semantic models for the first-stage retrieval that can achieve high recall efficiently. Recently, we have witnessed an explosive growth of research interests on the first-stage semantic retrieval models. We believe it is the right time to survey current status, learn from existing methods, and gain some insights for future development. In this article, we describe the current landscape of the first-stage retrieval models under a unified framework to clarify the connection between classical term-based retrieval methods, early semantic retrieval methods, and neural semantic retrieval methods. Moreover, we identify some open challenges and envision some future directions, with the hope of inspiring more research on these important yet less investigated topics.<\/jats:p>","DOI":"10.1145\/3486250","type":"journal-article","created":{"date-parts":[[2022,3,24]],"date-time":"2022-03-24T21:23:23Z","timestamp":1648157003000},"page":"1-42","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":86,"title":["Semantic Models for the First-Stage Retrieval: A Comprehensive Review"],"prefix":"10.1145","volume":"40","author":[{"given":"Jiafeng","family":"Guo","sequence":"first","affiliation":[{"name":"Institute of Computing Technology, Chinese Academy of Sciences; University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yinqiong","family":"Cai","sequence":"additional","affiliation":[{"name":"Institute of Computing Technology, Chinese Academy of Sciences; University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yixing","family":"Fan","sequence":"additional","affiliation":[{"name":"Institute of Computing Technology, Chinese Academy of Sciences; University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fei","family":"Sun","sequence":"additional","affiliation":[{"name":"Alibaba Group, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruqing","family":"Zhang","sequence":"additional","affiliation":[{"name":"Institute of Computing Technology, Chinese Academy of Sciences; University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xueqi","family":"Cheng","sequence":"additional","affiliation":[{"name":"Institute of Computing Technology, Chinese Academy of Sciences; University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,3,24]]},"reference":[{"issue":"25","key":"e_1_3_2_2_2","article-title":"A survey on nearest neighbor search methods","volume":"95","author":"Abbasifard Mohammad Reza","year":"2014","unstructured":"Mohammad Reza Abbasifard, Bijan Ghahremani, and Hassan Naderi. 2014. A survey on nearest neighbor search methods. International Journal of Computer Applications 95, 25 (2014), 39\u201352.","journal-title":"International Journal of Computer Applications"},{"key":"e_1_3_2_3_2","first-page":"189","article-title":"UMass at TREC 2004: Novelty and HARD","author":"Abdul-Jaleel Nasreen","year":"2004","unstructured":"Nasreen Abdul-Jaleel, James Allan, W. Bruce Croft, Fernando Diaz, Leah Larkey, Xiaoyan Li, Mark D. Smucker, and Courtney Wade. 2004. UMass at TREC 2004: Novelty and HARD. Computer Science Department Faculty Publication Series 2004 (2004), 189.","journal-title":"Computer Science Department Faculty Publication Series"},{"key":"e_1_3_2_4_2","first-page":"9","volume-title":"Proceedings of COLING 2010: Posters","author":"Agirre Eneko","year":"2010","unstructured":"Eneko Agirre, Xabier Arregi, and Arantxa Otegi. 2010. Document expansion based on WordNet for robust IR. In Proceedings of COLING 2010: Posters. 9\u201317."},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3417996"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/2970398.2970409"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2914688"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/582415.582416"},{"key":"e_1_3_2_9_2","volume-title":"Nearest Neighbor Search: The Old, the New, and the Impossible","author":"Andoni Alexandr","year":"2009","unstructured":"Alexandr Andoni. 2009. Nearest Neighbor Search: The Old, the New, and the Impossible. Ph.D. Dissertation. Massachusetts Institute of Technology, Cambridge, MA."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33013191"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/1964897.1964900"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-68474-1_3"},{"key":"e_1_3_2_13_2","volume-title":"Modern Information Retrieval: The Concepts and Technology Behind Search (2nd ed.)","author":"Baeza-Yates Ricardo","year":"2011","unstructured":"Ricardo Baeza-Yates and Berthier Ribeiro-Neto. 2011. Modern Information Retrieval: The Concepts and Technology Behind Search (2nd ed.). Addison-Wesley."},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277747"},{"key":"e_1_3_2_15_2","article-title":"SparTerm: Learning term-based sparse representation for fast text retrieval","author":"Bai Yang","year":"2020","unstructured":"Yang Bai, Xiaoguang Li, Gang Wang, Chaoliang Zhang, Lifeng Shang, Jun Xu, Zhaowei Wang, Fangshan Wang, and Qun Liu. 2020. SparTerm: Learning term-based sparse representation for fast text retrieval. arXiv preprint arXiv:2010.00768 (2020).","journal-title":"arXiv preprint arXiv:2010.00768"},{"key":"e_1_3_2_16_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Bamler Robert","year":"2020","unstructured":"Robert Bamler and Stephan Mandt. 2020. Extreme classification via adversarial softmax approximation. In Proceedings of the International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=rJxe3xSYDS."},{"key":"e_1_3_2_17_2","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1007\/978-3-319-24027-5_20","volume-title":"Experimental IR Meets Multilinguality, Multimodality, and Interaction","author":"Baudi\u0161 Petr","year":"2015","unstructured":"Petr Baudi\u0161 and Jan \u0160ediv\u00fd. 2015. Modeling of the question answering task in the YodaQA system. In Experimental IR Meets Multilinguality, Multimodality, and Interaction, Josanne Mothe, Jacques Savoy, Jaap Kamps, Karen Pinel-Sauvagnat, Gareth Jones, Eric San Juan, Linda Capellato, and Nicola Ferro (Eds.). Springer International Publishing, Cham, Switzerland, 222\u2013228."},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.1997.609451"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553380"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/361002.361007"},{"key":"e_1_3_2_21_2","first-page":"1533","volume-title":"Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing","author":"Berant Jonathan","year":"2013","unstructured":"Jonathan Berant, Andrew Chou, Roy Frostig, and Percy Liang. 2013. Semantic parsing on freebase from question-answer pairs. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. 1533\u20131544. https:\/\/www.aclweb.org\/anthology\/D13-1160."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/312624.312681"},{"issue":"0","key":"e_1_3_2_23_2","article-title":"Annoy: Approximate nearest neighbors in C++\/Python","volume":"1","author":"Bernhardsson Erik","year":"2018","unstructured":"Erik Bernhardsson. 2018. Annoy: Approximate nearest neighbors in C++\/Python. Python Package Version 1, 0 (2018).","journal-title":"Python Package Version"},{"key":"e_1_3_2_24_2","first-page":"34","volume-title":"Proceedings of the 10th Australasian Document Computing Symposium","author":"Billerbeck Bodo","year":"2005","unstructured":"Bodo Billerbeck and Justin Zobel. 2005. Document expansion versus query expansion for ad-hoc retrieval. In Proceedings of the 10th Australasian Document Computing Symposium. 34\u201341."},{"key":"e_1_3_2_25_2","first-page":"590","volume-title":"Proceedings of the 35th International Conference on Machine Learning.","author":"Blanc Guy","year":"2018","unstructured":"Guy Blanc and Steffen Rendle. 2018. Adaptive sampled softmax with kernel based sampling. In Proceedings of the 35th International Conference on Machine Learning.590\u2013599."},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944937"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00051"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1094"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/2983323.2983815"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.5555\/1928328.1928368"},{"key":"e_1_3_2_31_2","first-page":"737","volume-title":"Advances in Neural Information Processing Systems 6","author":"Bromley Jane","year":"1994","unstructured":"Jane Bromley, Isabelle Guyon, Yann LeCun, Eduard S\u00e4ckinger, and Roopak Shah. 1994. Signature verification using a \u201cSiamese\u201d time delay neural network. In Advances in Neural Information Processing Systems 6, J. D. Cowan, G. Tesauro, and J. Alspector (Eds.). Morgan-Kaufmann, 737\u2013744. http:\/\/papers.nips.cc\/paper\/769-signature-verification-using-a-siamese-time-delay-neural-network.pdf."},{"issue":"2","key":"e_1_3_2_32_2","first-page":"57","article-title":"Question answering from frequently asked question files: Experiences with the FAQ FINDER system","volume":"18","author":"Burke Robin D.","year":"1997","unstructured":"Robin D. Burke, Kristian J. Hammond, Vladimir Kulyukin, Steven L. Lytinen, Noriko Tomuro, and Scott Schoenberg. 1997. Question answering from frequently asked question files: Experiences with the FAQ FINDER system. AI Magazine 18, 2 (1997), 57.","journal-title":"AI Magazine"},{"key":"e_1_3_2_33_2","article-title":"A discriminative semantic ranker for question retrieval","author":"Cai Yinqiong","year":"2021","unstructured":"Yinqiong Cai, Yixing Fan, Jiafeng Guo, Ruqing Zhang, Yanyan Lan, and Xueqi Cheng. 2021. A discriminative semantic ranker for question retrieval. arXiv preprint arXiv:2107.08345 (2021).","journal-title":"arXiv preprint arXiv:2107.08345"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390377"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.411"},{"key":"e_1_3_2_36_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Chang Wei-Cheng","year":"2020","unstructured":"Wei-Cheng Chang, Felix X. Yu, Yin-Wen Chang, Yiming Yang, and Sanjiv Kumar. 2020. Pre-training tasks for embedding-based large-scale retrieval. In Proceedings of the International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=rkg-mA4FDr."},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1171"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159695"},{"key":"e_1_3_2_39_2","unstructured":"Qi Chen Haidong Wang Mingqin Li Gang Ren Scarlett Li Jeffery Zhu Jason Li Chuanjie Liu Lintao Zhang and Jingdong Wang. 2018. SPTAG: A Library for Fast Approximate Nearest Neighbor Search . GitHub. https:\/\/github.com\/Microsoft\/SPTAG."},{"key":"e_1_3_2_40_2","volume-title":"SPTAG: A Library for Fast Approximate Nearest Neighbor Search","author":"Chen Qi","year":"2018","unstructured":"Qi Chen, Haidong Wang, Mingqin Li, Gang Ren, Scarlett Li, Jeffery Zhu, Jason Li, Chuanjie Liu, Lintao Zhang, and Jingdong Wang. 2018. SPTAG: A Library for Fast Approximate Nearest Neighbor Search. GitHub. https:\/\/github.com\/Microsoft\/SPTAG."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080819"},{"key":"e_1_3_2_42_2","article-title":"A simple framework for contrastive learning of visual representations","author":"Chen Ting","year":"2020","unstructured":"Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton. 2020. A simple framework for contrastive learning of visual representations. arXiv preprint arXiv:2002.05709 (2020).","journal-title":"arXiv preprint arXiv:2002.05709"},{"key":"e_1_3_2_43_2","volume-title":"Advances in Neural Information Processing Systems","author":"Chuang Ching-Yao","year":"2020","unstructured":"Ching-Yao Chuang, Joshua Robinson, Lin Yen-Chen, Antonio Torralba, and Stefanie Jegelka. 2020. Debiased contrastive learning. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_44_2","first-page":"74","volume-title":"Proceedings of the 13th Text REtrieval Conference (TREC\u201904)","volume":"4","author":"Clarke Charles L. A.","year":"2004","unstructured":"Charles L. A. Clarke, Nick Craswell, and Ian Soboroff. 2004. Overview of the TREC 2004 terabyte track. In Proceedings of the 13th Text REtrieval Conference (TREC\u201904), Vol. 4. 74."},{"key":"e_1_3_2_45_2","volume-title":"Overview of the TREC 2009 Web Track","author":"Clarke Charles L.","year":"2009","unstructured":"Charles L. Clarke, Nick Craswell, and Ian Soboroff. 2009. Overview of the TREC 2009 Web Track. Technical Report. Waterloo University, Ontario, Canada."},{"key":"e_1_3_2_46_2","first-page":"100","volume-title":"Proceedings of the Workshop on Continuous Vector Space Models and Their Compositionality","author":"Clinchant St\u00e9phane","year":"2013","unstructured":"St\u00e9phane Clinchant and Florent Perronnin. 2013. Aggregating continuous word embeddings for information retrieval. In Proceedings of the Workshop on Continuous Vector Space Models and Their Compositionality. 100\u2013109."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1646059"},{"key":"e_1_3_2_48_2","article-title":"Overview of the TREC 2019 Deep Learning Track","author":"Craswell Nick","year":"2020","unstructured":"Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, and Ellen M. Voorhees. 2020. Overview of the TREC 2019 Deep Learning Track. arXiv preprint arXiv:2003.07820 (2020).","journal-title":"arXiv preprint arXiv:2003.07820"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1055"},{"key":"e_1_3_2_50_2","article-title":"Context-aware sentence\/passage term importance estimation for first stage retrieval","author":"Dai Zhuyun","year":"2019","unstructured":"Zhuyun Dai and Jamie Callan. 2019. Context-aware sentence\/passage term importance estimation for first stage retrieval. arXiv preprint arXiv:1910.10687 (2019).","journal-title":"arXiv preprint arXiv:1910.10687"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380258"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401204"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159659"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/997817.997857"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1423"},{"key":"e_1_3_2_57_2","article-title":"Quasar: Datasets for question answering by search and reading","author":"Dhingra Bhuwan","year":"2017","unstructured":"Bhuwan Dhingra, Kathryn Mazaitis, and William W. Cohen. 2017. Quasar: Datasets for question answering by search and reading. arXiv preprint arXiv:1707.03904 (2017).","journal-title":"arXiv preprint arXiv:1707.03904"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/1099554.1099722"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1035"},{"key":"e_1_3_2_60_2","unstructured":"NIST Special Publication Proceedings of the Twenty-Sixth Text REtrieval Conference TREC 500-324 Laura Dietz Manisha Verma Filip Radlinski Nick Craswell Ellen M. Voorhees Angela Ellis TREC complex answer retrieval overview 2017"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/309"},{"key":"e_1_3_2_62_2","article-title":"RocketQA: An optimized training approach to dense passage retrieval for open-domain question answering","author":"Ding Yingqi","year":"2020","unstructured":"Yingqi Ding, Yuchen Qu, Jing Liu, Kai Liu, Ruiyang Ren, Xin Zhao, Daxiang Dong, Hua Wu, and Haifeng Wang. 2020. RocketQA: An optimized training approach to dense passage retrieval for open-domain question answering. arXiv preprint arXiv:2010.08191 (2020).","journal-title":"arXiv preprint arXiv:2010.08191"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-2114"},{"key":"e_1_3_2_64_2","article-title":"SearchQA: A new Q&A dataset augmented with context from a search engine","volume":"1704","author":"Dunn Matthew","year":"2017","unstructured":"Matthew Dunn, Levent Sagun, Mike Higgins, V. Ugur G\u00fcney, Volkan Cirik, and Kyunghyun Cho. 2017. SearchQA: A new Q&A dataset augmented with context from a search engine. CoRR abs\/1704.05179 (2017). http:\/\/arxiv.org\/abs\/1704.05179.","journal-title":"CoRR"},{"key":"e_1_3_2_65_2","article-title":"Return of the Lernaean Hydra: Experimental evaluation of data series approximate similarity search","author":"Echihabi Karima","year":"2020","unstructured":"Karima Echihabi, Kostas Zoumpatianos, Themis Palpanas, and Houda Benbrahim. 2020. Return of the Lernaean Hydra: Experimental evaluation of data series approximate similarity search. arXiv preprint arXiv:2006.11459 (2020).","journal-title":"arXiv preprint arXiv:2006.11459"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348405"},{"key":"e_1_3_2_67_2","first-page":"1608","volume-title":"Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Fader Anthony","year":"2013","unstructured":"Anthony Fader, Luke Zettlemoyer, and Oren Etzioni. 2013. Paraphrase-driven learning for open question answering. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 1608\u20131618. https:\/\/www.aclweb.org\/anthology\/P13-1158."},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.5555\/866280"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330651"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1222"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3463098"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401211"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/32206.32212"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767780"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/1871437.1871582"},{"key":"e_1_3_2_76_2","doi-asserted-by":"crossref","unstructured":"Jianfeng Gao and Jian-Yun Nie. 2012. Towards concept-based translation models using search logs for query expansion. Microsoft . Retrieved November 1 2021 from https:\/\/www.microsoft.com\/en-us\/research\/publication\/towards-concept-based-translation-models-using-search-logs-query-expansion\/.","DOI":"10.1145\/2396761.2530275"},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/1008992.1009024"},{"key":"e_1_3_2_78_2","article-title":"COIL: Revisit exact lexical match in information retrieval with contextualized inverted list","author":"Gao Luyu","year":"2021","unstructured":"Luyu Gao, Zhuyun Dai, and Jamie Callan. 2021. COIL: Revisit exact lexical match in information retrieval with contextualized inverted list. arXiv preprint arXiv:2104.07186 (2021).","journal-title":"arXiv preprint arXiv:2104.07186"},{"key":"e_1_3_2_79_2","article-title":"Complementing lexical retrieval with semantic residual embedding","author":"Gao Luyu","year":"2020","unstructured":"Luyu Gao, Zhuyun Dai, Zhen Fan, and Jamie Callan. 2020. Complementing lexical retrieval with semantic residual embedding. arXiv preprint arXiv:2004.13969 (2020).","journal-title":"arXiv preprint arXiv:2004.13969"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.240"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K19-1049"},{"key":"e_1_3_2_82_2","article-title":"End-to-end retrieval in continuous space","author":"Gillick Daniel","year":"2018","unstructured":"Daniel Gillick, Alessandro Presta, and Gaurav Singh Tomar. 2018. End-to-end retrieval in continuous space. arXiv preprint arXiv:1811.08008 (2018).","journal-title":"arXiv preprint arXiv:1811.08008"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.1145\/2983323.2983769"},{"key":"e_1_3_2_84_2","first-page":"102067","article-title":"A deep look into neural ranking models for information retrieval","author":"Guo Jiafeng","year":"2019","unstructured":"Jiafeng Guo, Yixing Fan, Liang Pang, Liu Yang, Qingyao Ai, Hamed Zamani, Chen Wu, W. Bruce Croft, and Xueqi Cheng. 2019. A deep look into neural ranking models for information retrieval. Information Processing & Management 2019 (2019), 102067.","journal-title":"Information Processing & Management"},{"key":"e_1_3_2_85_2","volume-title":"Proceedings of the 37th International Conference on Machine Learning","author":"Guu Kelvin","year":"2020","unstructured":"Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Ming-Wei Chang. 2020. Realm: Retrieval-augmented language model pre-training. In Proceedings of the 37th International Conference on Machine Learning."},{"key":"e_1_3_2_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/3196826"},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00975"},{"key":"e_1_3_2_88_2","article-title":"Efficient natural language response suggestion for smart reply","author":"Henderson Matthew","year":"2017","unstructured":"Matthew Henderson, Rami Al-Rfou, Brian Strope, Yun-Hsuan Sung, L\u00e1szl\u00f3 Luk\u00e1cs, Ruiqi Guo, Sanjiv Kumar, Balint Miklos, and Ray Kurzweil. 2017. Efficient natural language response suggestion for smart reply. arXiv preprint arXiv:1705.00652 (2017).","journal-title":"arXiv preprint arXiv:1705.00652"},{"key":"e_1_3_2_89_2","article-title":"Training neural response selection for task-oriented dialogue systems","author":"Henderson Matthew","year":"2019","unstructured":"Matthew Henderson, Ivan Vuli\u0107, Daniela Gerz, I\u00f1igo Casanueva, Pawe\u0142 Budzianowski, Sam Coope, Georgios Spithourakis, Tsung-Hsien Wen, Nikola Mrk\u0161i\u0107, and Pei-Hao Su. 2019. Training neural response selection for task-oriented dialogue systems. arXiv preprint arXiv:1906.01543 (2019).","journal-title":"arXiv preprint arXiv:1906.01543"},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.1007\/s007999900025"},{"key":"e_1_3_2_91_2","doi-asserted-by":"publisher","DOI":"10.1145\/3130348.3130370"},{"key":"e_1_3_2_92_2","article-title":"Let\u2019s measure run time! Extending the IR replicability infrastructure to include performance aspects","author":"Hofst\u00e4tter Sebastian","year":"2019","unstructured":"Sebastian Hofst\u00e4tter and Allan Hanbury. 2019. Let\u2019s measure run time! Extending the IR replicability infrastructure to include performance aspects. arXiv preprint arXiv:1907.04614 (2019).","journal-title":"arXiv preprint arXiv:1907.04614"},{"key":"e_1_3_2_93_2","article-title":"Interpretable and time-budget-constrained contextualization for re-ranking","author":"Hofst\u00e4tter Sebastian","year":"2020","unstructured":"Sebastian Hofst\u00e4tter, Markus Zlabinger, and Allan Hanbury. 2020. Interpretable and time-budget-constrained contextualization for re-ranking. arXiv preprint arXiv:2002.01854 (2020).","journal-title":"arXiv preprint arXiv:2002.01854"},{"key":"e_1_3_2_94_2","first-page":"2042","volume-title":"Advances in Neural Information Processing Systems 27","author":"Hu Baotian","year":"2014","unstructured":"Baotian Hu, Zhengdong Lu, Hang Li, and Qingcai Chen. 2014. Convolutional neural network architectures for matching natural language sentences. In Advances in Neural Information Processing Systems 27, Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger (Eds.). Curran Associates, 2042\u20132050. http:\/\/papers.nips.cc\/paper\/5550-convolutional-neural-network-architectures-for-matching-natural-language-sentences.pdf."},{"key":"e_1_3_2_95_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.351"},{"key":"e_1_3_2_96_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403305"},{"key":"e_1_3_2_97_2","doi-asserted-by":"publisher","DOI":"10.1145\/2505515.2505665"},{"key":"e_1_3_2_98_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Humeau Samuel","year":"2019","unstructured":"Samuel Humeau, Kurt Shuster, Marie-Anne Lachaux, and Jason Weston. 2019. Poly-encoders: Transformer architectures and pre-training strategies for fast and accurate multi-sentence scoring. In Proceedings of the International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=SkxgnnNFvH."},{"key":"e_1_3_2_99_2","doi-asserted-by":"publisher","DOI":"10.1002\/smll.201900656"},{"key":"e_1_3_2_100_2","doi-asserted-by":"publisher","DOI":"10.1145\/276698.276876"},{"key":"e_1_3_2_101_2","article-title":"UHD-BERT: Bucketed ultra-high dimensional sparse representations for full ranking","author":"Jang Kyoung-Rok","year":"2021","unstructured":"Kyoung-Rok Jang, Junmo Kang, Giwon Hong, Sung-Hyon Myaeng, Joohee Park, Taewon Yoon, and Heecheol Seo. 2021. UHD-BERT: Bucketed ultra-high dimensional sparse representations for full ranking. arXiv preprint arXiv:2104.07198 (2021).","journal-title":"arXiv preprint arXiv:2104.07198"},{"key":"e_1_3_2_102_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1001"},{"key":"e_1_3_2_103_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.57"},{"key":"e_1_3_2_104_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313576"},{"key":"e_1_3_2_105_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2016.2578680"},{"key":"e_1_3_2_106_2","article-title":"Billion-scale similarity search with GPUs","author":"Johnson Jeff","year":"2017","unstructured":"Jeff Johnson, Matthijs Douze, and Herv\u00e9 J\u00e9gou. 2017. Billion-scale similarity search with GPUs. arXiv preprint arXiv:1702.08734 (2017).","journal-title":"arXiv preprint arXiv:1702.08734"},{"key":"e_1_3_2_107_2","first-page":"535","article-title":"Billion-scale similarity search with GPUs","author":"Johnson Jeff","year":"2019","unstructured":"Jeff Johnson, Matthijs Douze, and Herv\u00e9 J\u00e9gou. 2019. Billion-scale similarity search with GPUs. IEEE Transactions on Big Data 7, 3 (2019), 535\u2013547.","journal-title":"IEEE Transactions on Big Data"},{"key":"e_1_3_2_108_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1147"},{"key":"e_1_3_2_109_2","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835505"},{"key":"e_1_3_2_110_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-28997-2_23"},{"key":"e_1_3_2_111_2","article-title":"Dense passage retrieval for open-domain question answering","author":"Karpukhin Vladimir","year":"2020","unstructured":"Vladimir Karpukhin, Barlas O\u011fuz, Sewon Min, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen-Tau Yih. 2020. Dense passage retrieval for open-domain question answering. arXiv preprint arXiv:2004.04906 (2020).","journal-title":"arXiv preprint arXiv:2004.04906"},{"key":"e_1_3_2_112_2","doi-asserted-by":"publisher","DOI":"10.1145\/2806416.2806475"},{"key":"e_1_3_2_113_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401075"},{"key":"e_1_3_2_114_2","doi-asserted-by":"publisher","DOI":"10.1038\/35022643"},{"key":"e_1_3_2_115_2","doi-asserted-by":"publisher","DOI":"10.1145\/1008992.1009027"},{"key":"e_1_3_2_116_2","article-title":"Leveraging semantic and lexical matching to improve the recall of document retrieval systems: A hybrid approach","author":"Kuzi Saar","year":"2020","unstructured":"Saar Kuzi, Mingyang Zhang, Cheng Li, Michael Bendersky, and Marc Najork. 2020. Leveraging semantic and lexical matching to improve the recall of document retrieval systems: A hybrid approach. arXiv preprint arXiv:2010.01195 (2020).","journal-title":"arXiv preprint arXiv:2010.01195"},{"key":"e_1_3_2_117_2","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00276"},{"key":"e_1_3_2_118_2","volume-title":"Proceedings of the 2004 Text REtrieval Conference (TREC\u201904)","author":"Kwok Kui-Lam","year":"2004","unstructured":"Kui-Lam Kwok, Laszlo Grunfeld, H. L. Sun, Peter Deng, and N. Dinstl. 2004. TREC2004 robust track experiments using PIRCS. In Proceedings of the 2004 Text REtrieval Conference (TREC\u201904)."},{"key":"e_1_3_2_119_2","doi-asserted-by":"publisher","DOI":"10.5555\/1481032"},{"key":"e_1_3_2_120_2","doi-asserted-by":"publisher","DOI":"10.1145\/383952.383972"},{"key":"e_1_3_2_121_2","first-page":"1188","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Le Quoc","year":"2014","unstructured":"Quoc Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. In Proceedings of the International Conference on Machine Learning. 1188\u20131196."},{"key":"e_1_3_2_122_2","first-page":"556","volume-title":"Advances in Neural Information Processing Systems 13","author":"Lee Daniel D.","year":"2001","unstructured":"Daniel D. Lee and H. Sebastian Seung. 2001. Algorithms for non-negative matrix factorization. In Advances in Neural Information Processing Systems 13, T. K. Leen, T. G. Dietterich, and V. Tresp (Eds.). MIT Press, Cambridge, MA, 556\u2013562. http:\/\/papers.nips.cc\/paper\/1861-algorithms-for-non-negative-matrix-factorization.pdf."},{"key":"e_1_3_2_123_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.85"},{"key":"e_1_3_2_124_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1612"},{"key":"e_1_3_2_125_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630200106"},{"key":"e_1_3_2_126_2","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3357814"},{"key":"e_1_3_2_127_2","doi-asserted-by":"publisher","DOI":"10.5555\/2018740"},{"key":"e_1_3_2_128_2","doi-asserted-by":"publisher","DOI":"10.1561\/1500000035"},{"key":"e_1_3_2_129_2","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331434"},{"key":"e_1_3_2_130_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2019.2909204"},{"key":"e_1_3_2_131_2","article-title":"Embedding-based zero-shot retrieval through query generation","author":"Liang Davis","year":"2020","unstructured":"Davis Liang, Peng Xu, Siamak Shakeri, Cicero Nogueira dos Santos, Ramesh Nallapati, Zhiheng Huang, and Bing Xiang. 2020. Embedding-based zero-shot retrieval through query generation. arXiv preprint arXiv:2009.10270 (2020).","journal-title":"arXiv preprint arXiv:2009.10270"},{"key":"e_1_3_2_132_2","article-title":"Pretrained transformers for text ranking: Bert and beyond","author":"Lin Jimmy","year":"2020","unstructured":"Jimmy Lin, Rodrigo Nogueira, and Andrew Yates. 2020. Pretrained transformers for text ranking: Bert and beyond. arXiv preprint arXiv:2010.06467 (2020).","journal-title":"arXiv preprint arXiv:2010.06467"},{"key":"e_1_3_2_133_2","article-title":"Distilling dense representations for ranking using tightly-coupled teachers","author":"Lin Sheng-Chieh","year":"2020","unstructured":"Sheng-Chieh Lin, Jheng-Hong Yang, and Jimmy Lin. 2020. Distilling dense representations for ranking using tightly-coupled teachers. arXiv preprint arXiv:2010.11386 (2020).","journal-title":"arXiv preprint arXiv:2010.11386"},{"key":"e_1_3_2_134_2","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098011"},{"key":"e_1_3_2_135_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-14267-3"},{"key":"e_1_3_2_136_2","doi-asserted-by":"publisher","DOI":"10.1145\/1008992.1009026"},{"key":"e_1_3_2_137_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-48051-0_12"},{"key":"e_1_3_2_138_2","article-title":"Sparse, dense, and attentional representations for text retrieval","author":"Luan Yi","year":"2020","unstructured":"Yi Luan, Jacob Eisenstein, Kristina Toutanova, and Michael Collins. 2020. Sparse, dense, and attentional representations for text retrieval. arXiv preprint arXiv:2005.00181 (2020).","journal-title":"arXiv preprint arXiv:2005.00181"},{"key":"e_1_3_2_139_2","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1646259"},{"key":"e_1_3_2_140_2","article-title":"PROP: Pre-training with representative words prediction for ad-hoc retrieval","author":"Ma Xinyu","year":"2020","unstructured":"Xinyu Ma, Jiafeng Guo, Ruqing Zhang, Yixing Fan, Xiang Ji, and Xueqi Cheng. 2020. PROP: Pre-training with representative words prediction for ad-hoc retrieval. arXiv preprint arXiv:2010.10137 (2020).","journal-title":"arXiv preprint arXiv:2010.10137"},{"key":"e_1_3_2_141_2","article-title":"B-PROP: Bootstrapped pre-training with representative words prediction for ad-hoc retrieval","author":"Ma Xinyu","year":"2021","unstructured":"Xinyu Ma, Jiafeng Guo, Ruqing Zhang, Yixing Fan, Yingyan Li, and Xueqi Cheng. 2021. B-PROP: Bootstrapped pre-training with representative words prediction for ad-hoc retrieval. arXiv preprint arXiv:2104.09791 (2021).","journal-title":"arXiv preprint arXiv:2104.09791"},{"key":"e_1_3_2_142_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401093"},{"key":"e_1_3_2_143_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401262"},{"key":"e_1_3_2_144_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401263"},{"key":"e_1_3_2_145_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2889473"},{"key":"e_1_3_2_146_2","article-title":"Learning passage impacts for inverted indexes","author":"Mallia Antonio","year":"2021","unstructured":"Antonio Mallia, Omar Khattab, Nicola Tonellotto, and Torsten Suel. 2021. Learning passage impacts for inverted indexes. arXiv preprint arXiv:2104.12016 (2021).","journal-title":"arXiv preprint arXiv:2104.12016"},{"key":"e_1_3_2_147_2","article-title":"Generation-augmented retrieval for open-domain question answering","author":"Mao Yuning","year":"2020","unstructured":"Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, and Weizhu Chen. 2020. Generation-augmented retrieval for open-domain question answering. arXiv preprint arXiv:2009.08553 (2020).","journal-title":"arXiv preprint arXiv:2009.08553"},{"key":"e_1_3_2_148_2","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148246"},{"key":"e_1_3_2_149_2","doi-asserted-by":"publisher","DOI":"10.1145\/1076034.1076115"},{"key":"e_1_3_2_150_2","first-page":"3111","volume-title":"Advances in Neural Information Processing Systems 26","author":"Mikolov Tomas","year":"2013","unstructured":"Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems 26, C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K. Q. Weinberger (Eds.). Curran Associates, 3111\u20133119. http:\/\/papers.nips.cc\/paper\/5021-distributed-representations-of-words-and-phrases-and-their-compositionality.pdf."},{"key":"e_1_3_2_151_2","doi-asserted-by":"publisher","DOI":"10.1145\/312624.312680"},{"key":"e_1_3_2_152_2","article-title":"Neural models for information retrieval","author":"Mitra Bhaskar","year":"2017","unstructured":"Bhaskar Mitra and Nick Craswell. 2017. Neural models for information retrieval. arXiv preprint arXiv:1705.01509 (2017).","journal-title":"arXiv preprint arXiv:1705.01509"},{"key":"e_1_3_2_153_2","doi-asserted-by":"publisher","DOI":"10.1561\/1500000061"},{"key":"e_1_3_2_154_2","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052579"},{"key":"e_1_3_2_155_2","article-title":"Conformer-kernel with query term independence for document retrieval","author":"Mitra Bhaskar","year":"2020","unstructured":"Bhaskar Mitra, Sebastian Hofstatter, Hamed Zamani, and Nick Craswell. 2020. Conformer-kernel with query term independence for document retrieval. arXiv preprint arXiv:2007.10434 (2020).","journal-title":"arXiv preprint arXiv:2007.10434"},{"key":"e_1_3_2_156_2","article-title":"A dual embedding space model for document ranking","author":"Mitra Bhaskar","year":"2016","unstructured":"Bhaskar Mitra, Eric Nalisnick, Nick Craswell, and Rich Caruana. 2016. A dual embedding space model for document ranking. arXiv preprint arXiv:1602.01137 (2016).","journal-title":"arXiv preprint arXiv:1602.01137"},{"key":"e_1_3_2_157_2","article-title":"Incorporating query term independence assumption for efficient retrieval and ranking using deep neural networks","author":"Mitra Bhaskar","year":"2019","unstructured":"Bhaskar Mitra, Corby Rosset, David Hawking, Nick Craswell, Fernando Diaz, and Emine Yilmaz. 2019. Incorporating query term independence assumption for efficient retrieval and ranking using deep neural networks. arXiv preprint arXiv:1907.03693 (2019).","journal-title":"arXiv preprint arXiv:1907.03693"},{"key":"e_1_3_2_158_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2321376"},{"key":"e_1_3_2_159_2","doi-asserted-by":"publisher","DOI":"10.1145\/2872518.2889361"},{"key":"e_1_3_2_160_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-59758-4_17"},{"key":"e_1_3_2_161_2","unstructured":"CEUR Workshop Proceedings Proceedings of the Workshop on Cognitive Computation: Integrating Neural and Symbolic Approaches 2016 1773 Tri Nguyen Mir Rosenberg Xia Song Jianfeng Gao Saurabh Tiwary Rangan Majumder Li Deng Tarek Richard Besold Antoine Bordes Artur S. d\u2019Avila Garcez Greg Wayne MS MARCO: A human generated machine reading comprehension dataset 2016"},{"key":"e_1_3_2_162_2","article-title":"Passage re-ranking with BERT","author":"Nogueira Rodrigo","year":"2019","unstructured":"Rodrigo Nogueira and Kyunghyun Cho. 2019. Passage re-ranking with BERT. arXiv preprint arXiv:1901.04085 (2019).","journal-title":"arXiv preprint arXiv:1901.04085"},{"key":"e_1_3_2_163_2","unstructured":"Technical Report. 2019 From doc2query to docTTTTTquery"},{"key":"e_1_3_2_164_2","article-title":"Multi-stage document ranking with BERT","author":"Nogueira Rodrigo","year":"2019","unstructured":"Rodrigo Nogueira, Wei Yang, Kyunghyun Cho, and Jimmy Lin. 2019. Multi-stage document ranking with BERT. arXiv preprint arXiv:1910.14424 (2019).","journal-title":"arXiv preprint arXiv:1910.14424"},{"key":"e_1_3_2_165_2","article-title":"Document expansion by query prediction","author":"Nogueira Rodrigo","year":"2019","unstructured":"Rodrigo Nogueira, Wei Yang, Jimmy Lin, and Kyunghyun Cho. 2019. Document expansion by query prediction. arXiv preprint arXiv:1904.08375 (2019).","journal-title":"arXiv preprint arXiv:1904.08375"},{"key":"e_1_3_2_166_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-017-9321-y"},{"key":"e_1_3_2_167_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313416"},{"key":"e_1_3_2_168_2","article-title":"Query understanding at bing","author":"Pedersen Jan","year":"2010","unstructured":"Jan Pedersen. 2010. Query understanding at bing. Invited Talk, SIGIR (2010).","journal-title":"Invited Talk, SIGIR"},{"key":"e_1_3_2_169_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_2_170_2","article-title":"Deep contextualized word representations","author":"Peters Matthew E.","year":"2018","unstructured":"Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018. Deep contextualized word representations. arXiv preprint arXiv:1802.05365 (2018).","journal-title":"arXiv preprint arXiv:1802.05365"},{"key":"e_1_3_2_171_2","doi-asserted-by":"publisher","DOI":"10.1145\/290941.291008"},{"key":"e_1_3_2_172_2","doi-asserted-by":"publisher","DOI":"10.1145\/160688.160713"},{"key":"e_1_3_2_173_2","unstructured":"Alec Radford Karthik Narasimhan Tim Salimans and Ilya Sutskever. 2018. Improving language understanding by generative pre-training. Preprint."},{"issue":"140","key":"e_1_3_2_174_2","first-page":"1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel Colin","year":"2020","unstructured":"Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research 21, 140 (2020), 1\u201367. http:\/\/jmlr.org\/papers\/v21\/20-074.html.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_175_2","first-page":"13857","volume-title":"Advances in Neural Information Processing Systems","author":"Rawat Ankit Singh","year":"2019","unstructured":"Ankit Singh Rawat, Jiecao Chen, Felix Xinnan X. Yu, Ananda Theertha Suresh, and Sanjiv Kumar. 2019. Sampled softmax with random Fourier features. In Advances in Neural Information Processing Systems, Vol. 32. Curran Associates, 13857\u201313867. https:\/\/proceedings.neurips.cc\/paper\/2019\/file\/e43739bba7cdb577e9e3e4e42447f5a5-Paper.pdf."},{"key":"e_1_3_2_176_2","first-page":"452","volume-title":"Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence (UAI\u201909)","author":"Rendle Steffen","year":"2009","unstructured":"Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence (UAI\u201909). 452\u2013461."},{"key":"e_1_3_2_177_2","doi-asserted-by":"publisher","DOI":"10.1162\/coli_a_00010"},{"key":"e_1_3_2_178_2","doi-asserted-by":"publisher","DOI":"10.1561\/1500000019"},{"key":"e_1_3_2_179_2","first-page":"143","volume-title":"Relevance Weighting of Search Terms","author":"Robertson Stephen E.","year":"1988","unstructured":"Stephen E. Robertson and Karen Sparck Jones. 1988. Relevance Weighting of Search Terms. Taylor Graham Publishing, GBR, 143\u2013160."},{"key":"e_1_3_2_180_2","first-page":"313","article-title":"Relevance feedback in information retrieval","author":"Rocchio Joseph","year":"1971","unstructured":"Joseph Rocchio. 1971. Relevance feedback in information retrieval. Smart Retrieval System\u2014Experiments in Automatic Document Processing 1971 (1971), 313\u2013323.","journal-title":"Smart Retrieval System\u2014Experiments in Automatic Document Processing"},{"key":"e_1_3_2_181_2","volume-title":"Proceedings of Neu-IR: The SIGIR 2016 Workshop on Neural Information Retrieval","author":"Roy Dwaipayan","year":"2016","unstructured":"Dwaipayan Roy, Debasis Ganguly, Mandar Mitra, and Gareth J. F. Jones. 2016. Representing documents and queries as sets of word embedded vectors for information retrieval. In Proceedings of Neu-IR: The SIGIR 2016 Workshop on Neural Information Retrieval."},{"key":"e_1_3_2_182_2","volume-title":"Proceedings of Neu-IR: The SIGIR 2016 Workshop on Neural Information Retrieval","author":"Roy Dwaipayan","year":"2016","unstructured":"Dwaipayan Roy, Debjyoti Paul, Mandar Mitra, and Utpal Garain. 2016. Using word embeddings for automatic query expansion. In Proceedings of Neu-IR: The SIGIR 2016 Workshop on Neural Information Retrieval."},{"key":"e_1_3_2_183_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijar.2008.11.006"},{"key":"e_1_3_2_184_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.253.5023.974"},{"key":"e_1_3_2_185_2","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(88)90021-0"},{"key":"e_1_3_2_186_2","doi-asserted-by":"publisher","DOI":"10.1145\/361219.361220"},{"key":"e_1_3_2_187_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1052"},{"key":"e_1_3_2_188_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1436"},{"key":"e_1_3_2_189_2","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/4908.001.0001"},{"key":"e_1_3_2_190_2","doi-asserted-by":"publisher","DOI":"10.1145\/2567948.2577348"},{"key":"e_1_3_2_191_2","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080716"},{"key":"e_1_3_2_192_2","doi-asserted-by":"publisher","DOI":"10.1145\/363707.363732"},{"key":"e_1_3_2_193_2","doi-asserted-by":"publisher","DOI":"10.1145\/312624.312645"},{"key":"e_1_3_2_194_2","doi-asserted-by":"publisher","DOI":"10.1145\/2934687"},{"key":"e_1_3_2_195_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00643"},{"key":"e_1_3_2_196_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Sun Zhiqing","year":"2019","unstructured":"Zhiqing Sun, Zhi-Hong Deng, Jian-Yun Nie, and Jian Tang. 2019. RotatE: Knowledge graph embedding by relational rotation in complex space. In Proceedings of the International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=HkgEQnRqYQ."},{"key":"e_1_3_2_197_2","article-title":"Distilling knowledge for fast retrieval-based chat-bots","author":"Tahami Amir Vakili","year":"2020","unstructured":"Amir Vakili Tahami, Kamyar Ghajar, and Azadeh Shakery. 2020. Distilling knowledge for fast retrieval-based chat-bots. arXiv preprint arXiv:2004.11045 (2020).","journal-title":"arXiv preprint arXiv:2004.11045"},{"key":"e_1_3_2_198_2","doi-asserted-by":"publisher","DOI":"10.1145\/3349527"},{"key":"e_1_3_2_199_2","article-title":"LSTM-based deep learning models for non-factoid answer selection","author":"Tan Ming","year":"2015","unstructured":"Ming Tan, Cicero dos Santos, Bing Xiang, and Bowen Zhou. 2015. LSTM-based deep learning models for non-factoid answer selection. arXiv preprint arXiv:1511.04108 (2015).","journal-title":"arXiv preprint arXiv:1511.04108"},{"key":"e_1_3_2_200_2","article-title":"Improving document representations by generating pseudo query embeddings for dense retrieval","author":"Tang Hongyin","year":"2021","unstructured":"Hongyin Tang, Xingwu Sun, Beihong Jin, Jingang Wang, Fuzheng Zhang, and Wei Wu. 2021. Improving document representations by generating pseudo query embeddings for dense retrieval. arXiv preprint arXiv:2105.03599 (2021).","journal-title":"arXiv preprint arXiv:2105.03599"},{"key":"e_1_3_2_201_2","doi-asserted-by":"publisher","DOI":"10.3115\/1220835.1220887"},{"key":"e_1_3_2_202_2","article-title":"Representation learning with contrastive predictive coding","volume":"1807","author":"Oord A\u00e4ron van den","year":"2018","unstructured":"A\u00e4ron van den Oord, Yazhe Li, and Oriol Vinyals. 2018. Representation learning with contrastive predictive coding. CoRR abs\/1807.03748 (2018). arXiv:1807.03748 http:\/\/arxiv.org\/abs\/1807.03748.","journal-title":"CoRR"},{"key":"e_1_3_2_203_2","article-title":"A theoretical basis for the use of co-occurrence data in information retrieval","author":"Rijsbergen Cornelis Joost Van","year":"1977","unstructured":"Cornelis Joost Van Rijsbergen. 1977. A theoretical basis for the use of co-occurrence data in information retrieval. Journal of Documentation 33, 2 (1977), 106\u2013199.","journal-title":"Journal of Documentation"},{"key":"e_1_3_2_204_2","first-page":"1","volume-title":"ACM SIGIR Forum","author":"Voorhees Ellen","year":"2021","unstructured":"Ellen Voorhees, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, William R. Hersh, Kyle Lo, Kirk Roberts, Ian Soboroff, and Lucy Lu Wang. 2021. TREC-COVID: Constructing a pandemic information retrieval test collection. ACM SIGIR Forum 54 (2021), 1\u201312."},{"key":"e_1_3_2_205_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-2099-5_7"},{"key":"e_1_3_2_206_2","volume-title":"Proceedings of the 2005 Text REtrieval Conference (TREC\u201905)","year":"2005","unstructured":"Ellen M. Voorhees. 2005. Overview of the TREC 2005 robust retrieval track. In Proceedings of the 2005 Text REtrieval Conference (TREC\u201905)."},{"key":"e_1_3_2_207_2","doi-asserted-by":"publisher","DOI":"10.1145\/345508.345577"},{"key":"e_1_3_2_208_2","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767752"},{"key":"e_1_3_2_209_2","article-title":"Match-SRNN: Modeling the recursive matching structure with spatial RNN","author":"Wan Shengxian","year":"2016","unstructured":"Shengxian Wan, Yanyan Lan, Jun Xu, Jiafeng Guo, Liang Pang, and Xueqi Cheng. 2016. Match-SRNN: Modeling the recursive matching structure with spatial RNN. arXiv preprint arXiv:1604.04378 (2016).","journal-title":"arXiv preprint arXiv:1604.04378"},{"key":"e_1_3_2_210_2","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2018.2822810"},{"key":"e_1_3_2_211_2","doi-asserted-by":"publisher","DOI":"10.1145\/3123266.3123359"},{"key":"e_1_3_2_212_2","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2010008"},{"key":"e_1_3_2_213_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401143"},{"key":"e_1_3_2_214_2","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148204"},{"key":"e_1_3_2_215_2","volume-title":"Managing Gigabytes: Compressing and Indexing Documents and Images","year":"1999","unstructured":"Ian H. Witten, Alistair Moffat, and Timothy C. Bell. 1999. Managing Gigabytes: Compressing and Indexing Documents and Images. Morgan Kaufmann."},{"key":"e_1_3_2_216_2","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080809"},{"key":"e_1_3_2_217_2","article-title":"Approximate nearest neighbor negative contrastive learning for dense text retrieval","volume":"2007","author":"Xiong Lee","year":"2020","unstructured":"Lee Xiong, Chenyan Xiong, Ye Li, Kwok-Fung Tang, Jialin Liu, Paul Bennett, Junaid Ahmed, and Arnold Overwijk. 2020. Approximate nearest neighbor negative contrastive learning for dense text retrieval. CoRR abs\/2007.00808 (2020). arXiv:2007.00808 https:\/\/arxiv.org\/abs\/2007.00808.","journal-title":"CoRR"},{"key":"e_1_3_2_218_2","doi-asserted-by":"crossref","unstructured":"Jinxi Xu and W. Bruce Croft. 2017. Query expansion using local and global document analysis. ACM SIGIR Forum 51 (2017) 168\u2013175.","DOI":"10.1145\/3130348.3130364"},{"key":"e_1_3_2_219_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-17187-1_1"},{"key":"e_1_3_2_220_2","first-page":"4555","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"35","author":"Yan Ming","year":"2021","unstructured":"Ming Yan, Chenliang Li, Bin Bi, Wei Wang, and Songfang Huang. 2021. A unified pretraining framework for passage ranking and expansion. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 4555\u20134563."},{"key":"e_1_3_2_221_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366424.3386195"},{"key":"e_1_3_2_222_2","first-page":"5753","volume-title":"Advances in Neural Information Processing Systems 32","author":"Yang Zhilin","year":"2019","unstructured":"Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R. Salakhutdinov, and Quoc V. Le. 2019. XLNet: Generalized autoregressive pretraining for language understanding. In Advances in Neural Information Processing Systems 32. Curran Associates, 5753\u20135763. http:\/\/papers.nips.cc\/paper\/8812-xlnet-generalized-autoregressive-pretraining-for-language-understanding.pdf."},{"key":"e_1_3_2_223_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403218"},{"key":"e_1_3_2_224_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33017370"},{"key":"e_1_3_2_225_2","first-page":"29","volume-title":"Advances in Information Retrieval","author":"Yi Xing","year":"2009","unstructured":"Xing Yi and James Allan. 2009. A comparative study of utilizing topic models for information retrieval. In Advances in Information Retrieval, Mohand Boughanem, Catherine Berrut, Josiane Mothe, and Chantal Soule-Dupuy (Eds.). Springer, Berlin, Germany, 29\u201341."},{"key":"e_1_3_2_226_2","doi-asserted-by":"publisher","DOI":"10.1145\/3298689.3346996"},{"key":"e_1_3_2_227_2","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219890"},{"key":"e_1_3_2_228_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01246-5_12"},{"key":"e_1_3_2_229_2","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3271800"},{"key":"e_1_3_2_230_2","doi-asserted-by":"publisher","DOI":"10.1561\/1500000008"},{"key":"e_1_3_2_231_2","doi-asserted-by":"publisher","DOI":"10.1145\/502585.502654"},{"key":"e_1_3_2_232_2","article-title":"Optimizing dense retrieval model training with hard negatives","author":"Zhan Jingtao","year":"2021","unstructured":"Jingtao Zhan, Jiaxin Mao, Yiqun Liu, Jiafeng Guo, Min Zhang, and Shaoping Ma. 2021. Optimizing dense retrieval model training with hard negatives. arXiv preprint arXiv:2104.08051 (2021).","journal-title":"arXiv preprint arXiv:2104.08051"},{"key":"e_1_3_2_233_2","article-title":"RepBERT: Contextualized text embeddings for first-stage retrieval","volume":"2006","author":"Zhan Jingtao","year":"2020","unstructured":"Jingtao Zhan, Jiaxin Mao, Yiqun Liu, Min Zhang, and Shaoping Ma. 2020. RepBERT: Contextualized text embeddings for first-stage retrieval. CoRR abs\/2006.15498 (2020). https:\/\/arxiv.org\/abs\/2006.15498.","journal-title":"CoRR"},{"key":"e_1_3_2_234_2","article-title":"Joint learning of deep retrieval model and product quantization based embedding index","author":"Zhang Han","year":"2021","unstructured":"Han Zhang, Hongwei Shen, Yiming Qiu, Yunjiang Jiang, Songlin Wang, Sulong Xu, Yun Xiao, Bo Long, and Wen-Yun Yang. 2021. Joint learning of deep retrieval model and product quantization based embedding index. arXiv preprint arXiv:2105.03933 (2021).","journal-title":"arXiv preprint arXiv:2105.03933"},{"key":"e_1_3_2_235_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401446"},{"key":"e_1_3_2_236_2","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3357938"},{"key":"e_1_3_2_237_2","doi-asserted-by":"publisher","DOI":"10.1145\/2484028.2484126"},{"key":"e_1_3_2_238_2","article-title":"DC-BERT: Decoupling question and document for efficient contextual encoding","author":"Zhang Yuyu","year":"2020","unstructured":"Yuyu Zhang, Ping Nie, Xiubo Geng, Arun Ramamurthy, Le Song, and Daxin Jiang. 2020. DC-BERT: Decoupling question and document for efficient contextual encoding. arXiv preprint arXiv:2002.12591 (2020).","journal-title":"arXiv preprint arXiv:2002.12591"},{"key":"e_1_3_2_239_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-2090"},{"key":"e_1_3_2_240_2","doi-asserted-by":"publisher","DOI":"10.1145\/1871437.1871474"},{"key":"e_1_3_2_241_2","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767700"},{"key":"e_1_3_2_242_2","doi-asserted-by":"publisher","DOI":"10.1145\/1132956.1132959"},{"key":"e_1_3_2_243_2","doi-asserted-by":"publisher","DOI":"10.1145\/2838931.2838936"}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3486250","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3486250","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:48:38Z","timestamp":1750193318000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3486250"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,24]]},"references-count":242,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,10,31]]}},"alternative-id":["10.1145\/3486250"],"URL":"https:\/\/doi.org\/10.1145\/3486250","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"value":"1046-8188","type":"print"},{"value":"1558-2868","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,24]]},"assertion":[{"value":"2021-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-03-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}