{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T01:55:14Z","timestamp":1775181314258,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":28,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,10,19]],"date-time":"2020-10-19T00:00:00Z","timestamp":1603065600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,10,19]]},"DOI":"10.1145\/3340531.3412779","type":"proceedings-article","created":{"date-parts":[[2020,10,19]],"date-time":"2020-10-19T05:31:06Z","timestamp":1603085466000},"page":"2983-2989","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":42,"title":["ORCAS: 18 Million Clicked Query-Document Pairs for Analyzing Search"],"prefix":"10.1145","author":[{"given":"Nick","family":"Craswell","sequence":"first","affiliation":[{"name":"Microsoft, Seattle, WA, USA"}]},{"given":"Daniel","family":"Campos","sequence":"additional","affiliation":[{"name":"Microsoft & University of Washington, Seattle, WA, USA"}]},{"given":"Bhaskar","family":"Mitra","sequence":"additional","affiliation":[{"name":"Microsoft & University College London, Montreal, PQ, Canada"}]},{"given":"Emine","family":"Yilmaz","sequence":"additional","affiliation":[{"name":"University College London, London, United Kingdom"}]},{"given":"Bodo","family":"Billerbeck","sequence":"additional","affiliation":[{"name":"Microsoft, Melbourne, VIC, Australia"}]}],"member":"320","published-online":{"date-parts":[[2020,10,19]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1281192.1281204"},{"key":"e_1_3_2_2_2_1","volume-title":"et almbox","author":"Bajaj Payal","year":"2016","unstructured":"Payal Bajaj , Daniel Campos , Nick Craswell , Li Deng , Jianfeng Gao , Xiaodong Liu , Rangan Majumder , Andrew McNamara , Bhaskar Mitra , Tri Nguyen , et almbox . 2016 . MS MARCO : A Human Generated MAchine Reading COmprehension Dataset . arXiv preprint arXiv:1611.09268 (2016). Payal Bajaj, Daniel Campos, Nick Craswell, Li Deng, Jianfeng Gao, Xiaodong Liu, Rangan Majumder, Andrew McNamara, Bhaskar Mitra, Tri Nguyen, et almbox. 2016. MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. arXiv preprint arXiv:1611.09268 (2016)."},{"key":"e_1_3_2_2_3_1","first-page":"8","article-title":"A face is exposed for AOL searcher no. 4417749","volume":"9","author":"Barbaro Michael","year":"2006","unstructured":"Michael Barbaro , Tom Zeller , and Saul Hansell . 2006 . A face is exposed for AOL searcher no. 4417749 . New York Times , Vol. 9 , 2008 (2006), 8 . Michael Barbaro, Tom Zeller, and Saul Hansell. 2006. A face is exposed for AOL searcher no. 4417749. New York Times, Vol. 9, 2008 (2006), 8.","journal-title":"New York Times"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/347090.347176"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/347090.347176"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348312"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1102351.1102363"},{"key":"e_1_3_2_2_8_1","volume-title":"Overview of the TREC 2019 deep learning track. In TREC.","author":"Craswell Nick","year":"2020","unstructured":"Nick Craswell , Bhaskar Mitra , Emine Yilmaz , and Daniel Campos . 2020 . Overview of the TREC 2019 deep learning track. In TREC. Nick Craswell, Bhaskar Mitra, Emine Yilmaz, and Daniel Campos. 2020. Overview of the TREC 2019 deep learning track. In TREC."},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277784"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1561\/9781680831627"},{"key":"e_1_3_2_2_11_1","volume-title":"Proc. SIGIR. ACM.","author":"Sebastian","year":"2020","unstructured":"Sebastian Hofst\"atter, Hamed Zamani , Bhaskar Mitra , Nick Craswell , and Allan Hanbury . 2020 . Local Self-Attention over Long Text for Efficient Document Retrieval . In Proc. SIGIR. ACM. Sebastian Hofst\"atter, Hamed Zamani, Bhaskar Mitra, Nick Craswell, and Allan Hanbury. 2020. Local Self-Attention over Long Text for Efficient Document Retrieval. In Proc. SIGIR. ACM."},{"key":"e_1_3_2_2_12_1","volume-title":"arXiv preprint arXiv:1912.01385","author":"Sebastian","year":"2019","unstructured":"Sebastian Hofst\"atter, Markus Zlabinger , and Allan Hanbury . 2019. TU Wien@ TREC Deep Learning'19-- Simple Contextualization for Re-ranking. arXiv preprint arXiv:1912.01385 ( 2019 ). Sebastian Hofst\"atter, Markus Zlabinger, and Allan Hanbury. 2019. TU Wien@ TREC Deep Learning'19--Simple Contextualization for Re-ranking. arXiv preprint arXiv:1912.01385 (2019)."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2505515.2505665"},{"key":"e_1_3_2_2_14_1","first-page":"3","article-title":"Learning to Rank for Information Retrieval","volume":"3","author":"Liu Tie-Yan","year":"2009","unstructured":"Tie-Yan Liu . 2009 . Learning to Rank for Information Retrieval . Foundation and Trends in Information Retrieval , Vol. 3 , 3 (March 2009), 225--331. Tie-Yan Liu. 2009. Learning to Rank for Information Retrieval. Foundation and Trends in Information Retrieval, Vol. 3, 3 (March 2009), 225--331.","journal-title":"Foundation and Trends in Information Retrieval"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1458082.1458145"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767702"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/3239802"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052579"},{"key":"e_1_3_2_2_19_1","volume-title":"Conformer-Kernel with Query Term Independence for Document Retrieval. arXiv preprint arXiv:2007.10434","author":"Mitra Bhaskar","year":"2020","unstructured":"Bhaskar Mitra , Sebastian Hofstatter , Hamed Zamani , and Nick Craswell . 2020. Conformer-Kernel with Query Term Independence for Document Retrieval. arXiv preprint arXiv:2007.10434 ( 2020 ). Bhaskar Mitra, Sebastian Hofstatter, Hamed Zamani, and Nick Craswell. 2020. Conformer-Kernel with Query Term Independence for Document Retrieval. arXiv preprint arXiv:2007.10434 (2020)."},{"key":"e_1_3_2_2_20_1","volume-title":"Incorporating Query Term Independence Assumption for Efficient Retrieval and Ranking using Deep Neural Networks. arXiv preprint arXiv:1907.03693","author":"Mitra Bhaskar","year":"2019","unstructured":"Bhaskar Mitra , Corby Rosset , David Hawking , Nick Craswell , Fernando Diaz , and Emine Yilmaz . 2019. Incorporating Query Term Independence Assumption for Efficient Retrieval and Ranking using Deep Neural Networks. arXiv preprint arXiv:1907.03693 ( 2019 ). Bhaskar Mitra, Corby Rosset, David Hawking, Nick Craswell, Fernando Diaz, and Emine Yilmaz. 2019. Incorporating Query Term Independence Assumption for Efficient Retrieval and Ranking using Deep Neural Networks. arXiv preprint arXiv:1907.03693 (2019)."},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1146847.1146848"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556195.2556207"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2484028.2484076"},{"key":"e_1_3_2_2_24_1","volume-title":"Proceedings of the International Conference on Intelligent Analysis","volume":"2","author":"Strohman Trevor","year":"2005","unstructured":"Trevor Strohman , Donald Metzler , Howard Turtle , and W Bruce Croft . 2005 . Indri: A language model-based search engine for complex queries . In Proceedings of the International Conference on Intelligent Analysis , Vol. 2 . Citeseer, 2--6. Trevor Strohman, Donald Metzler, Howard Turtle, and W Bruce Croft. 2005. Indri: A language model-based search engine for complex queries. In Proceedings of the International Conference on Intelligent Analysis, Vol. 2. Citeseer, 2--6."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/371920.371974"},{"key":"e_1_3_2_2_26_1","volume-title":"Proceedings of the 23rd International Conference on World Wide Web","author":"Whiting Stewart","unstructured":"Stewart Whiting and Joemon M. Jose . 2014. Recent and Robust Query Auto-Completion . In Proceedings of the 23rd International Conference on World Wide Web ( Seoul, Korea) (WWW '14). Association for Computing Machinery, New York, NY, USA, 971--982. Stewart Whiting and Joemon M. Jose. 2014. Recent and Robust Query Auto-Completion. In Proceedings of the 23rd International Conference on World Wide Web (Seoul, Korea) (WWW '14). Association for Computing Machinery, New York, NY, USA, 971--982."},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1031171.1031192"},{"key":"e_1_3_2_2_28_1","first-page":"1","article-title":"Some Observations on User Search Behaviour","volume":"9","author":"Zhang Yuye","year":"2006","unstructured":"Yuye Zhang and Alistair Moffat . 2006 . Some Observations on User Search Behaviour . Austr. J. Intelligent Information Processing Systems , Vol. 9 , 2 (2006), 1 -- 8 . Yuye Zhang and Alistair Moffat. 2006. Some Observations on User Search Behaviour. Austr. J. Intelligent Information Processing Systems, Vol. 9, 2 (2006), 1--8.","journal-title":"Austr. J. Intelligent Information Processing Systems"}],"event":{"name":"CIKM '20: The 29th ACM International Conference on Information and Knowledge Management","location":"Virtual Event Ireland","acronym":"CIKM '20","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 29th ACM International Conference on Information & Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3340531.3412779","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3340531.3412779","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:02:56Z","timestamp":1750197776000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3340531.3412779"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,19]]},"references-count":28,"alternative-id":["10.1145\/3340531.3412779","10.1145\/3340531"],"URL":"https:\/\/doi.org\/10.1145\/3340531.3412779","relation":{},"subject":[],"published":{"date-parts":[[2020,10,19]]},"assertion":[{"value":"2020-10-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}