{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,23]],"date-time":"2025-08-23T05:20:48Z","timestamp":1755926448532,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":54,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,4,20]],"date-time":"2020-04-20T00:00:00Z","timestamp":1587340800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,4,20]]},"DOI":"10.1145\/3366423.3380131","type":"proceedings-article","created":{"date-parts":[[2020,5,4]],"date-time":"2020-05-04T08:11:44Z","timestamp":1588579904000},"page":"474-485","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Selective Weak Supervision for Neural Information Retrieval"],"prefix":"10.1145","author":[{"given":"Kaitao","family":"Zhang","sequence":"first","affiliation":[{"name":"Tsinghua University, China"}]},{"given":"Chenyan","family":"Xiong","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University; Microsoft, USA"}]},{"given":"Zhenghao","family":"Liu","sequence":"additional","affiliation":[{"name":"Tsinghua University, China"}]},{"given":"Zhiyuan","family":"Liu","sequence":"additional","affiliation":[{"name":"Tsinghua University, China"}]}],"member":"320","published-online":{"date-parts":[[2020,4,20]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Amin Ahmad Noah Constant Yinfei Yang and Daniel Cer. 2019. ReQA: An Evaluation for End-to-End Answer Retrieval Models. CoRR abs\/1907.04780(2019).  Amin Ahmad Noah Constant Yinfei Yang and Daniel Cer. 2019. ReQA: An Evaluation for End-to-End Answer Retrieval Models. CoRR abs\/1907.04780(2019).","DOI":"10.18653\/v1\/D19-5819"},{"key":"e_1_3_2_1_2_1","volume-title":"Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"L.","year":"1999","unstructured":"Adam\u00a0 L. Berger and John\u00a0D. Lafferty. 1999. Information Retrieval as Statistical Translation. In SIGIR \u201999 : Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval , August 15-19, 1999 , Berkeley, CA, USA. 222\u2013229. Adam\u00a0L. Berger and John\u00a0D. Lafferty. 1999. Information Retrieval as Statistical Translation. In SIGIR \u201999: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, August 15-19, 1999, Berkeley, CA, USA. 222\u2013229."},{"key":"e_1_3_2_1_3_1","unstructured":"W.\u00a0Bruce Croft Donald Metzler and Trevor Strohman. 2009. Search Engines - Information Retrieval in Practice. Pearson Education.  W.\u00a0Bruce Croft Donald Metzler and Trevor Strohman. 2009. Search Engines - Information Retrieval in Practice. Pearson Education."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331303"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159659"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718487.1718493"},{"key":"e_1_3_2_1_7_1","unstructured":"Mostafa Dehghani Aliaksei Severyn Sascha Rothe and Jaap Kamps. 2017. Learning to Learn from Weak Supervision by Full Supervision. CoRR abs\/1711.11383(2017).  Mostafa Dehghani Aliaksei Severyn Sascha Rothe and Jaap Kamps. 2017. Learning to Learn from Weak Supervision by Full Supervision. CoRR abs\/1711.11383(2017)."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080832"},{"key":"e_1_3_2_1_9_1","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019","volume":"1","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019 , Minneapolis, MN, USA , June 2-7, 2019, Volume 1 (Long and Short Papers). 4171\u20134186. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2-7, 2019, Volume 1 (Long and Short Papers). 4171\u20134186."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1035"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1571941.1571982"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/860435.860550"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983323.2983769"},{"key":"e_1_3_2_1_14_1","unstructured":"Jiafeng Guo Yixing Fan Liang Pang Liu Yang Qingyao Ai Hamed Zamani Chen Wu W.\u00a0Bruce Croft and Xueqi Cheng. 2019. A Deep Look into Neural Ranking Models for Information Retrieval. CoRR abs\/1903.06902(2019).  Jiafeng Guo Yixing Fan Liang Pang Liu Yang Qingyao Ai Hamed Zamani Chen Wu W.\u00a0Bruce Croft and Xueqi Cheng. 2019. A Deep Look into Neural Ranking Models for Information Retrieval. CoRR abs\/1903.06902(2019)."},{"key":"e_1_3_2_1_15_1","volume-title":"Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018","author":"Han Bo","year":"2018","unstructured":"Bo Han , Quanming Yao , Xingrui Yu , Gang Niu , Miao Xu , Weihua Hu , Ivor\u00a0 W. Tsang , and Masashi Sugiyama . 2018 . Co-teaching: Robust training of deep neural networks with extremely noisy labels . In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018 , NeurIPS 2018, 3-8 December 2018, Montr\u00e9al, Canada. 8536\u20138546. Bo Han, Quanming Yao, Xingrui Yu, Gang Niu, Miao Xu, Weihua Hu, Ivor\u00a0W. Tsang, and Masashi Sugiyama. 2018. Co-teaching: Robust training of deep neural networks with extremely noisy labels. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, 3-8 December 2018, Montr\u00e9al, Canada. 8536\u20138546."},{"key":"e_1_3_2_1_16_1","volume-title":"Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018","author":"Hendrycks Dan","year":"2018","unstructured":"Dan Hendrycks , Mantas Mazeika , Duncan Wilson , and Kevin Gimpel . 2018 . Using Trusted Data to Train Deep Networks on Labels Corrupted by Severe Noise . In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018 , NeurIPS 2018, 3-8 December 2018, Montr\u00e9al, Canada. 10477\u201310486. Dan Hendrycks, Mantas Mazeika, Duncan Wilson, and Kevin Gimpel. 2018. Using Trusted Data to Train Deep Networks on Labels Corrupted by Severe Noise. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, 3-8 December 2018, Montr\u00e9al, Canada. 10477\u201310486."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331344"},{"key":"e_1_3_2_1_18_1","volume-title":"Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems","author":"Hu Baotian","year":"2014","unstructured":"Baotian Hu , Zhengdong Lu , Hang Li , and Qingcai Chen . 2014. Convolutional Neural Network Architectures for Matching Natural Language Sentences . In Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems 2014 , December 8-13 2014, Montreal , Quebec, Canada . 2042\u20132050. Baotian Hu, Zhengdong Lu, Hang Li, and Qingcai Chen. 2014. Convolutional Neural Network Architectures for Matching Natural Language Sentences. In Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems 2014, December 8-13 2014, Montreal, Quebec, Canada. 2042\u20132050."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2505515.2505665"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1110"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/988672.988763"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1612"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1223"},{"key":"e_1_3_2_1_24_1","volume-title":"ADC 2017, Brisbane, QLD, Australia, September 25-28, 2017, Proceedings. 205\u2013216","author":"Luo Cheng","year":"2017","unstructured":"Cheng Luo , Yukun Zheng , Jiaxin Mao , Yiqun Liu , Min Zhang , and Shaoping Ma . 2017 . Training Deep Ranking Model with Weak Relevance Labels. In Databases Theory and Applications - 28th Australasian Database Conference , ADC 2017, Brisbane, QLD, Australia, September 25-28, 2017, Proceedings. 205\u2013216 . Cheng Luo, Yukun Zheng, Jiaxin Mao, Yiqun Liu, Min Zhang, and Shaoping Ma. 2017. Training Deep Ranking Model with Weak Relevance Labels. In Databases Theory and Applications - 28th Australasian Database Conference, ADC 2017, Brisbane, QLD, Australia, September 25-28, 2017, Proceedings. 205\u2013216."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331317"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331316"},{"key":"e_1_3_2_1_27_1","volume-title":"Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013. Proceedings of a meeting held","author":"Mikolov Tomas","year":"2013","unstructured":"Tomas Mikolov , Ilya Sutskever , Kai Chen , Gregory\u00a0 S. Corrado , and Jeffrey Dean . 2013 . Distributed Representations of Words and Phrases and their Compositionality . In Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013. Proceedings of a meeting held December 5-8, 2013, Lake Tahoe, Nevada, United States. 3111\u20133119. Tomas Mikolov, Ilya Sutskever, Kai Chen, Gregory\u00a0S. Corrado, and Jeffrey Dean. 2013. Distributed Representations of Words and Phrases and their Compositionality. In Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013. Proceedings of a meeting held December 5-8, 2013, Lake Tahoe, Nevada, United States. 3111\u20133119."},{"key":"e_1_3_2_1_28_1","volume-title":"Proceedings of the Workshop on Cognitive Computation: Integrating neural and symbolic approaches 2016 co-located with the 30th Annual Conference on Neural Information Processing Systems (NIPS 2016","author":"Nguyen Tri","year":"2016","unstructured":"Tri Nguyen , Mir Rosenberg , Xia Song , Jianfeng Gao , Saurabh Tiwary , Rangan Majumder , and Li Deng . 2016 . MS MARCO: A Human Generated MAchine Reading COmprehension Dataset . In Proceedings of the Workshop on Cognitive Computation: Integrating neural and symbolic approaches 2016 co-located with the 30th Annual Conference on Neural Information Processing Systems (NIPS 2016 ), Barcelona, Spain , December 9, 2016. Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, and Li Deng. 2016. MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. In Proceedings of the Workshop on Cognitive Computation: Integrating neural and symbolic approaches 2016 co-located with the 30th Annual Conference on Neural Information Processing Systems (NIPS 2016), Barcelona, Spain, December 9, 2016."},{"key":"e_1_3_2_1_29_1","unstructured":"Rodrigo Nogueira and Kyunghyun Cho. 2019. Passage Re-ranking with BERT. CoRR abs\/1901.04085(2019).  Rodrigo Nogueira and Kyunghyun Cho. 2019. Passage Re-ranking with BERT. CoRR abs\/1901.04085(2019)."},{"key":"e_1_3_2_1_30_1","unstructured":"Rodrigo Nogueira Wei Yang Jimmy Lin and Kyunghyun Cho. 2019. Document Expansion by Query Prediction. CoRR abs\/1904.08375(2019).  Rodrigo Nogueira Wei Yang Jimmy Lin and Kyunghyun Cho. 2019. Document Expansion by Query Prediction. CoRR abs\/1904.08375(2019)."},{"key":"e_1_3_2_1_31_1","unstructured":"Harshith Padigela Hamed Zamani and W.\u00a0Bruce Croft. 2019. Investigating the Successes and Failures of BERT for Passage Re-Ranking. CoRR abs\/1905.01758(2019).  Harshith Padigela Hamed Zamani and W.\u00a0Bruce Croft. 2019. Investigating the Successes and Failures of BERT for Passage Re-Ranking. CoRR abs\/1905.01758(2019)."},{"key":"e_1_3_2_1_32_1","unstructured":"Liang Pang Yanyan Lan Jiafeng Guo Jun Xu Shengxian Wan and Xueqi Cheng. 2016. Text Matching as Image Recognition. 2793\u20132799\u00a0pages.  Liang Pang Yanyan Lan Jiafeng Guo Jun Xu Shengxian Wan and Xueqi Cheng. 2016. Text Matching as Image Recognition. 2793\u20132799\u00a0pages."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3132914"},{"key":"e_1_3_2_1_34_1","volume-title":"Glove: Global Vectors for Word Representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP","author":"Pennington Jeffrey","year":"2014","unstructured":"Jeffrey Pennington , Richard Socher , and Christopher\u00a0 D. Manning . 2014 . Glove: Global Vectors for Word Representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, October 25-29, 2014, Doha, Qatar , A meeting of SIGDAT, a Special Interest Group of the ACL. 1532\u20131543. Jeffrey Pennington, Richard Socher, and Christopher\u00a0D. Manning. 2014. Glove: Global Vectors for Word Representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, October 25-29, 2014, Doha, Qatar, A meeting of SIGDAT, a Special Interest Group of the ACL. 1532\u20131543."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1202"},{"key":"e_1_3_2_1_36_1","volume-title":"Consistency and Variation in Kernel Neural Ranking Model. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018","author":"Pyreddy Mary\u00a0Arpita","year":"2018","unstructured":"Mary\u00a0Arpita Pyreddy , Varshini Ramaseshan , Narendra\u00a0Nath Joshi , Zhuyun Dai , Chenyan Xiong , Jamie Callan , and Zhiyuan Liu . 2018 . Consistency and Variation in Kernel Neural Ranking Model. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018 , Ann Arbor, MI, USA , July 08-12, 2018. 961\u2013964. Mary\u00a0Arpita Pyreddy, Varshini Ramaseshan, Narendra\u00a0Nath Joshi, Zhuyun Dai, Chenyan Xiong, Jamie Callan, and Zhiyuan Liu. 2018. Consistency and Variation in Kernel Neural Ranking Model. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, USA, July 08-12, 2018. 961\u2013964."},{"key":"e_1_3_2_1_37_1","unstructured":"Yifan Qiao Chenyan Xiong Zheng-Hao Liu and Zhiyuan Liu. 2019. Understanding the Behaviors of BERT in Ranking. CoRR abs\/1904.07531(2019).  Yifan Qiao Chenyan Xiong Zheng-Hao Liu and Zhiyuan Liu. 2019. Understanding the Behaviors of BERT in Ranking. CoRR abs\/1904.07531(2019)."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3289600.3290978"},{"key":"e_1_3_2_1_39_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan","author":"Ren Mengye","year":"2018","unstructured":"Mengye Ren , Wenyuan Zeng , Bin Yang , and Raquel Urtasun . 2018 . Learning to Reweight Examples for Robust Deep Learning . In Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan , Stockholm, Sweden , July 10-15, 2018. 4331\u20134340. Mengye Ren, Wenyuan Zeng, Bin Yang, and Raquel Urtasun. 2018. Learning to Reweight Examples for Robust Deep Learning. In Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan, Stockholm, Sweden, July 10-15, 2018. 4331\u20134340."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661829.2661935"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330841"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/bf00992696"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080775"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080768"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080809"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3209982"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331340"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080831"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3234944.3234968"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210041"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3234944.3234977"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331198"},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210092"},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.2478\/dim-2019-0010"}],"event":{"name":"WWW '20: The Web Conference 2020","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"],"location":"Taipei Taiwan","acronym":"WWW '20"},"container-title":["Proceedings of The Web Conference 2020"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3366423.3380131","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3366423.3380131","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:33:00Z","timestamp":1750199580000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3366423.3380131"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,20]]},"references-count":54,"alternative-id":["10.1145\/3366423.3380131","10.1145\/3366423"],"URL":"https:\/\/doi.org\/10.1145\/3366423.3380131","relation":{},"subject":[],"published":{"date-parts":[[2020,4,20]]},"assertion":[{"value":"2020-04-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}