{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T18:43:35Z","timestamp":1774291415554,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":46,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,7,11]],"date-time":"2021-07-11T00:00:00Z","timestamp":1625961600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"the National Key Research and Development Program of China","award":["2020AAA0106501"],"award-info":[{"award-number":["2020AAA0106501"]}]},{"name":"Beijing Academy of Artificial Intelligence (BAAI)"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,7,11]]},"DOI":"10.1145\/3471158.3472245","type":"proceedings-article","created":{"date-parts":[[2021,8,31]],"date-time":"2021-08-31T20:38:17Z","timestamp":1630442297000},"page":"287-296","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["More Robust Dense Retrieval with Contrastive Dual Learning"],"prefix":"10.1145","author":[{"given":"Yizhi","family":"Li","sequence":"first","affiliation":[{"name":"Tsinghua University, Beijing, China"}]},{"given":"Zhenghao","family":"Liu","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}]},{"given":"Chenyan","family":"Xiong","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA, USA"}]},{"given":"Zhiyuan","family":"Liu","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}]}],"member":"320","published-online":{"date-parts":[[2021,8,31]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. CoRR","author":"Bajaj Payal","year":"2016","unstructured":"Payal Bajaj , Daniel Campos , Nick Craswell , Li Deng , Jianfeng Gao , Xiaodong Liu , Rangan Majumder , Andrew McNamara , Bhaskar Mitra , Tri Nguyen , 2016 . MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. CoRR , Vol. abs\/ 1611 .09268 (2016). arxiv: 1611.09268 Payal Bajaj, Daniel Campos, Nick Craswell, Li Deng, Jianfeng Gao, Xiaodong Liu, Rangan Majumder, Andrew McNamara, Bhaskar Mitra, Tri Nguyen, et al. 2016. MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. CoRR, Vol. abs\/1611.09268 (2016). arxiv: 1611.09268"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1171"},{"key":"e_1_3_2_2_3_1","volume-title":"Hinton","author":"Chen Ting","year":"2020","unstructured":"Ting Chen , Simon Kornblith , Mohammad Norouzi , and Geoffrey E . Hinton . 2020 . A Simple Framework for Contrastive Learning of Visual Representations. In Proceedings of ICML. 1597--1607. Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey E. Hinton. 2020. A Simple Framework for Contrastive Learning of Visual Representations. In Proceedings of ICML. 1597--1607."},{"key":"e_1_3_2_2_4_1","volume-title":"Intriguing Properties of Contrastive Losses. CoRR","author":"Chen Ting","year":"2020","unstructured":"Ting Chen and Lala Li. 2020. Intriguing Properties of Contrastive Losses. CoRR ( 2020 ). arxiv: 2011.02803 Ting Chen and Lala Li. 2020. Intriguing Properties of Contrastive Losses. CoRR (2020). arxiv: 2011.02803"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331303"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380258"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159659"},{"key":"e_1_3_2_2_8_1","volume-title":"Proceedings of NAACL-HLT. 4171--4186","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding . In Proceedings of NAACL-HLT. 4171--4186 . Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of NAACL-HLT. 4171--4186."},{"key":"e_1_3_2_2_9_1","volume-title":"Complementing Lexical Retrieval with Semantic Residual Embedding. CoRR","author":"Gao Luyu","year":"2020","unstructured":"Luyu Gao , Zhuyun Dai , Zhen Fan , and Jamie Callan . 2020. Complementing Lexical Retrieval with Semantic Residual Embedding. CoRR , Vol. abs\/ 2004 .13969 ( 2020 ). arxiv: 2004.13969 Luyu Gao, Zhuyun Dai, Zhen Fan, and Jamie Callan. 2020. Complementing Lexical Retrieval with Semantic Residual Embedding. CoRR, Vol. abs\/2004.13969 (2020). arxiv: 2004.13969"},{"key":"e_1_3_2_2_10_1","volume-title":"Proceedings of CIKM. 55--64","author":"Guo Jiafeng","unstructured":"Jiafeng Guo , Yixing Fan , Qingyao Ai , and W. Bruce Croft . 2016. A Deep Relevance Matching Model for Ad-hoc Retrieval . In Proceedings of CIKM. 55--64 . Jiafeng Guo, Yixing Fan, Qingyao Ai, and W. Bruce Croft. 2016. A Deep Relevance Matching Model for Ad-hoc Retrieval. In Proceedings of CIKM. 55--64."},{"key":"e_1_3_2_2_11_1","volume-title":"Proceedings of ICML. 3887--3896","author":"Guo Ruiqi","year":"2020","unstructured":"Ruiqi Guo , Philip Sun , Erik Lindgren , Quan Geng , David Simcha , Felix Chern , and Sanjiv Kumar . 2020 . Accelerating large-scale inference with anisotropic vector quantization . In Proceedings of ICML. 3887--3896 . Ruiqi Guo, Philip Sun, Erik Lindgren, Quan Geng, David Simcha, Felix Chern, and Sanjiv Kumar. 2020. Accelerating large-scale inference with anisotropic vector quantization. In Proceedings of ICML. 3887--3896."},{"key":"e_1_3_2_2_12_1","volume-title":"Proceedings of ICML. 3929--3938","author":"Guu Kelvin","year":"2020","unstructured":"Kelvin Guu , Kenton Lee , Zora Tung , Panupong Pasupat , and Mingwei Chang . 2020 . Retrieval Augmented Language Model Pre-Training . In Proceedings of ICML. 3929--3938 . Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Mingwei Chang. 2020. Retrieval Augmented Language Model Pre-Training. In Proceedings of ICML. 3929--3938."},{"key":"e_1_3_2_2_13_1","volume-title":"Proceedings of NIPS. 820--828","author":"He Di","year":"2016","unstructured":"Di He , Yingce Xia , Tao Qin , Liwei Wang , Nenghai Yu , Tie-Yan Liu , and Wei-Ying Ma . 2016 . Dual Learning for Machine Translation . In Proceedings of NIPS. 820--828 . Di He, Yingce Xia, Tao Qin, Liwei Wang, Nenghai Yu, Tie-Yan Liu, and Wei-Ying Ma. 2016. Dual Learning for Machine Translation. In Proceedings of NIPS. 820--828."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1110"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBDATA.2019.2921572"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.550"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401075"},{"key":"e_1_3_2_2_18_1","volume-title":"Relevance-Based Language Models. SIGIR Forum","author":"Lavrenko Victor","year":"2017","unstructured":"Victor Lavrenko and W. Bruce Croft . 2017. Relevance-Based Language Models. SIGIR Forum ( 2017 ), 260--267. Victor Lavrenko and W. Bruce Croft. 2017. Relevance-Based Language Models. SIGIR Forum (2017), 260--267."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1612"},{"key":"e_1_3_2_2_20_1","volume-title":"Proceedings of NeurIPS.","author":"Lewis Mike","year":"2020","unstructured":"Mike Lewis , Marjan Ghazvininejad , Gargi Ghosh , Armen Aghajanyan , Sida Wang , and Luke Zettlemoyer . 2020 a. Pre-training via Paraphrasing . In Proceedings of NeurIPS. Mike Lewis, Marjan Ghazvininejad, Gargi Ghosh, Armen Aghajanyan, Sida Wang, and Luke Zettlemoyer. 2020 a. Pre-training via Paraphrasing. In Proceedings of NeurIPS."},{"key":"e_1_3_2_2_21_1","volume-title":"Proceedings of NeurIPS.","author":"Lewis Patrick","year":"2020","unstructured":"Patrick Lewis , Ethan Perez , Aleksandra Piktus , Fabio Petroni , Vladimir Karpukhin , Naman Goyal , Heinrich K\u00fc ttler, Mike Lewis , Wen-tau Yih, Tim Rockt\"a schel, Sebastian Riedel , and Douwe Kiela . 2020 b. Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks . In Proceedings of NeurIPS. Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich K\u00fc ttler, Mike Lewis, Wen-tau Yih, Tim Rockt\"a schel, Sebastian Riedel, and Douwe Kiela. 2020 b. Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. In Proceedings of NeurIPS."},{"key":"e_1_3_2_2_22_1","volume-title":"Proceedings of NeurIPS. 6--12","author":"Lewis Patrick S. H.","year":"2020","unstructured":"Patrick S. H. Lewis , Ethan Perez , Aleksandra Piktus , Fabio Petroni , Vladimir Karpukhin , Naman Goyal , Heinrich K\u00fc ttler, Mike Lewis , Wen-tau Yih, Tim Rockt\"a schel, Sebastian Riedel , and Douwe Kiela . 2020 c. Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks . In Proceedings of NeurIPS. 6--12 . Patrick S. H. Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich K\u00fc ttler, Mike Lewis, Wen-tau Yih, Tim Rockt\"a schel, Sebastian Riedel, and Douwe Kiela. 2020 c. Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. In Proceedings of NeurIPS. 6--12."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00579"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.713"},{"key":"e_1_3_2_2_25_1","volume-title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu , Myle Ott , Naman Goyal , Jingfei Du , Mandar Joshi , Danqi Chen , Omer Levy , Mike Lewis , Luke Zettlemoyer , and Veselin Stoyanov . 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR ( 2019 ). arxiv: 1907.11692 Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR (2019). arxiv: 1907.11692"},{"key":"e_1_3_2_2_26_1","volume-title":"329--345","author":"Luan Yi","year":"2021","unstructured":"Yi Luan , Jacob Eisenstein , Kristina Toutanova , and Michael Collins . 2021. Sparse, Dense, and Attentional Representations for Text Retrieval . Trans. Assoc. Comput. Linguistics ( 2021 ), 329--345 . Yi Luan, Jacob Eisenstein, Kristina Toutanova, and Michael Collins. 2021. Sparse, Dense, and Attentional Representations for Text Retrieval. Trans. Assoc. Comput. Linguistics (2021), 329--345."},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331317"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"crossref","unstructured":"Bhaskar Mitra Nick Craswell etal 2018. An introduction to neural information retrieval. Foundations and Trends\u00ae in Information Retrieval 1 (2018) 1--126.  Bhaskar Mitra Nick Craswell et al. 2018. An introduction to neural information retrieval. Foundations and Trends\u00ae in Information Retrieval 1 (2018) 1--126.","DOI":"10.1561\/1500000061"},{"key":"e_1_3_2_2_29_1","volume-title":"Passage Re-ranking with BERT. CoRR","author":"Nogueira Rodrigo","year":"2019","unstructured":"Rodrigo Nogueira and Kyunghyun Cho . 2019. Passage Re-ranking with BERT. CoRR , Vol. abs\/ 1901 .04085 ( 2019 ). arxiv: 1901.04085 Rodrigo Nogueira and Kyunghyun Cho. 2019. Passage Re-ranking with BERT. CoRR, Vol. abs\/1901.04085 (2019). arxiv: 1901.04085"},{"key":"e_1_3_2_2_30_1","volume-title":"From doc2query to docTTTTTquery. Online preprint","author":"Nogueira Rodrigo","year":"2019","unstructured":"Rodrigo Nogueira , Jimmy Lin , and AI Epistemic . 2019. From doc2query to docTTTTTquery. Online preprint ( 2019 ). Rodrigo Nogueira, Jimmy Lin, and AI Epistemic. 2019. From doc2query to docTTTTTquery. Online preprint (2019)."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3463106"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401110"},{"key":"e_1_3_2_2_33_1","volume-title":"Question answering and question generation as dual tasks. CoRR","author":"Tang Duyu","year":"2017","unstructured":"Duyu Tang , Nan Duan , Tao Qin , Zhao Yan , and Ming Zhou . 2017. Question answering and question generation as dual tasks. CoRR ( 2017 ). arxiv: 1706.02027 Duyu Tang, Nan Duan, Tao Qin, Zhao Yan, and Ming Zhou. 2017. Question answering and question generation as dual tasks. CoRR (2017). arxiv: 1706.02027"},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5501"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123266.3123359"},{"key":"e_1_3_2_2_36_1","volume-title":"Proceedings of ICML. 9929--9939","author":"Wang Tongzhou","year":"2020","unstructured":"Tongzhou Wang and Phillip Isola . 2020 . Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere . In Proceedings of ICML. 9929--9939 . Tongzhou Wang and Phillip Isola. 2020. Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere. In Proceedings of ICML. 9929--9939."},{"key":"e_1_3_2_2_37_1","volume-title":"Proceedings of ICML. 3789--3798","author":"Xia Yingce","year":"2017","unstructured":"Yingce Xia , Tao Qin , Wei Chen , Jiang Bian , Nenghai Yu , and Tie-Yan Liu . 2017 . Dual Supervised Learning . In Proceedings of ICML. 3789--3798 . Yingce Xia, Tao Qin, Wei Chen, Jiang Bian, Nenghai Yu, and Tie-Yan Liu. 2017. Dual Supervised Learning. In Proceedings of ICML. 3789--3798."},{"key":"e_1_3_2_2_38_1","volume-title":"Proceedings of ICML. 5379--5388","author":"Xia Yingce","year":"2018","unstructured":"Yingce Xia , Xu Tan , Fei Tian , Tao Qin , Nenghai Yu , and Tie-Yan Liu . 2018 . Model-Level Dual Learning . In Proceedings of ICML. 5379--5388 . Yingce Xia, Xu Tan, Fei Tian, Tao Qin, Nenghai Yu, and Tie-Yan Liu. 2018. Model-Level Dual Learning. In Proceedings of ICML. 5379--5388."},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080809"},{"key":"e_1_3_2_2_40_1","volume-title":"Proceedings of ICLR.","author":"Xiong Lee","year":"2021","unstructured":"Lee Xiong , Chenyan Xiong , Ye Li , Kwok-Fung Tang , Jialin Liu , Paul N. Bennett , Junaid Ahmed , and Arnold Overwijk . 2021 . Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval . In Proceedings of ICLR. Lee Xiong, Chenyan Xiong, Ye Li, Kwok-Fung Tang, Jialin Liu, Paul N. Bennett, Junaid Ahmed, and Arnold Overwijk. 2021. Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval. In Proceedings of ICLR."},{"key":"e_1_3_2_2_41_1","volume-title":"Srinivasan Iyer, Jingfei Du, Patrick S. H. Lewis, William Yang Wang, Yashar Mehdad, Wen-tau Yih, Sebastian Riedel, Douwe Kiela, and Barlas Oguz.","author":"Xiong Wenhan","year":"2020","unstructured":"Wenhan Xiong , Xiang Lorraine Li , Srinivasan Iyer, Jingfei Du, Patrick S. H. Lewis, William Yang Wang, Yashar Mehdad, Wen-tau Yih, Sebastian Riedel, Douwe Kiela, and Barlas Oguz. 2020 . Answering Complex Open-Domain Questions with Multi-Hop Dense Retrieval. CoRR ( 2020). arxiv: 2009.12756 Wenhan Xiong, Xiang Lorraine Li, Srinivasan Iyer, Jingfei Du, Patrick S. H. Lewis, William Yang Wang, Yashar Mehdad, Wen-tau Yih, Sebastian Riedel, Douwe Kiela, and Barlas Oguz. 2020. Answering Complex Open-Domain Questions with Multi-Hop Dense Retrieval. CoRR (2020). arxiv: 2009.12756"},{"key":"e_1_3_2_2_42_1","first-page":"1","article-title":"Anserini: Reproducible ranking baselines using Lucene","volume":"4","author":"Yang Peilin","year":"2018","unstructured":"Peilin Yang , Hui Fang , and Jimmy Lin . 2018 . Anserini: Reproducible ranking baselines using Lucene . Journal of Data and Information Quality (JDIQ) 4 (2018), 1 -- 20 . Peilin Yang, Hui Fang, and Jimmy Lin. 2018. Anserini: Reproducible ranking baselines using Lucene. Journal of Data and Information Quality (JDIQ) 4 (2018), 1--20.","journal-title":"Journal of Data and Information Quality (JDIQ)"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.310"},{"key":"e_1_3_2_2_44_1","volume-title":"Proceedings of ICLR.","author":"You Yang","year":"2020","unstructured":"Yang You , Jing Li , Sashank J. Reddi , Jonathan Hseu , Sanjiv Kumar , Srinadh Bhojanapalli , Xiaodan Song , James Demmel , Kurt Keutzer , and Cho-Jui Hsieh . 2020 . Large Batch Optimization for Deep Learning: Training BERT in 76 minutes . In Proceedings of ICLR. Yang You, Jing Li, Sashank J. Reddi, Jonathan Hseu, Sanjiv Kumar, Srinadh Bhojanapalli, Xiaodan Song, James Demmel, Kurt Keutzer, and Cho-Jui Hsieh. 2020. Large Batch Optimization for Deep Learning: Training BERT in 76 minutes. In Proceedings of ICLR."},{"key":"e_1_3_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462856"},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462880"}],"event":{"name":"ICTIR '21: The 2021 ACM SIGIR International Conference on the Theory of Information Retrieval","location":"Virtual Event Canada","acronym":"ICTIR '21","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 2021 ACM SIGIR International Conference on Theory of Information Retrieval"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3471158.3472245","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3471158.3472245","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T17:49:30Z","timestamp":1750268970000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3471158.3472245"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,11]]},"references-count":46,"alternative-id":["10.1145\/3471158.3472245","10.1145\/3471158"],"URL":"https:\/\/doi.org\/10.1145\/3471158.3472245","relation":{},"subject":[],"published":{"date-parts":[[2021,7,11]]},"assertion":[{"value":"2021-08-31","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}