{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,24]],"date-time":"2025-12-24T18:07:30Z","timestamp":1766599650850,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":45,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,4,19]],"date-time":"2021-04-19T00:00:00Z","timestamp":1618790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,4,19]]},"DOI":"10.1145\/3442381.3450018","type":"proceedings-article","created":{"date-parts":[[2021,6,3]],"date-time":"2021-06-03T19:34:17Z","timestamp":1622748857000},"page":"158-170","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Robust Generalization and Safe Query-Specializationin Counterfactual Learning to Rank"],"prefix":"10.1145","author":[{"given":"Harrie","family":"Oosterhuis","sequence":"first","affiliation":[{"name":"Radboud University, Netherlands"}]},{"given":"Maarten de","family":"de Rijke","sequence":"additional","affiliation":[{"name":"University of Amsterdam and Ahold Delhaize, Netherlands"}]}],"member":"320","published-online":{"date-parts":[[2021,6,3]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331202"},{"key":"e_1_3_2_1_2_1","volume-title":"Addressing Trust Bias for Unbiased Learning-to-Rank. In The World Wide Web Conference. ACM, 4\u201314","author":"Agarwal Aman","year":"2019","unstructured":"Aman Agarwal , Xuanhui Wang , Cheng Li , Michael Bendersky , and Marc Najork . 2019 . Addressing Trust Bias for Unbiased Learning-to-Rank. In The World Wide Web Conference. ACM, 4\u201314 . Aman Agarwal, Xuanhui Wang, Cheng Li, Michael Bendersky, and Marc Najork. 2019. Addressing Trust Bias for Unbiased Learning-to-Rank. In The World Wide Web Conference. ACM, 4\u201314."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3289600.3291017"},{"key":"e_1_3_2_1_4_1","unstructured":"Qingyao Ai Tao Yang Huazheng Wang and Jiaxin Mao. 2020. Unbiased Learning to Rank: Online or Offline?arXiv preprint arXiv:2004.13574(2020).  Qingyao Ai Tao Yang Huazheng Wang and Jiaxin Mao. 2020. Unbiased Learning to Rank: Online or Offline?arXiv preprint arXiv:2004.13574(2020)."},{"key":"e_1_3_2_1_6_1","first-page":"1","article-title":"Yahoo! Learning to Rank Challenge Overview","volume":"14","author":"Chapelle Olivier","year":"2011","unstructured":"Olivier Chapelle and Yi Chang . 2011 . Yahoo! Learning to Rank Challenge Overview . Journal of Machine Learning Research 14 (2011), 1 \u2013 24 . Olivier Chapelle and Yi Chang. 2011. Yahoo! Learning to Rank Challenge Overview. Journal of Machine Learning Research 14 (2011), 1\u201324.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1341531.1341545"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2987380"},{"key":"e_1_3_2_1_9_1","unstructured":"Trey Grainger. 2021. AI Powered Search. Manning.  Trey Grainger. 2021. AI Powered Search. Manning."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2433396.2433419"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3385670"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331269"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/582415.582418"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775067"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3018661.3018699"},{"key":"e_1_3_2_1_16_1","volume-title":"International Conference on Machine Learning. 1215\u20131224","author":"Katariya Sumeet","year":"2016","unstructured":"Sumeet Katariya , Branislav Kveton , Csaba Szepesvari , and Zheng Wen . 2016 . DCM Bandits: Learning to Rank with Multiple Clicks . In International Conference on Machine Learning. 1215\u20131224 . Sumeet Katariya, Branislav Kveton, Csaba Szepesvari, and Zheng Wen. 2016. DCM Bandits: Learning to Rank with Multiple Clicks. In International Conference on Machine Learning. 1215\u20131224."},{"key":"e_1_3_2_1_17_1","volume-title":"International Conference on Machine Learning. 767\u2013776","author":"Kveton Branislav","year":"2015","unstructured":"Branislav Kveton , Csaba Szepesvari , Zheng Wen , and Azin Ashkan . 2015 . Cascading bandits: Learning to rank in the cascade model . In International Conference on Machine Learning. 767\u2013776 . Branislav Kveton, Csaba Szepesvari, Zheng Wen, and Azin Ashkan. 2015. Cascading bandits: Learning to rank in the cascade model. In International Conference on Machine Learning. 767\u2013776."},{"key":"e_1_3_2_1_18_1","unstructured":"Paul Lagr\u00e9e Claire Vernade and Olivier Capp\u00e9. 2016. Multiple-play Bandits in the Position-based Model. In Advances in Neural Information Processing Systems. 1597\u20131605.  Paul Lagr\u00e9e Claire Vernade and Olivier Capp\u00e9. 2016. Multiple-play Bandits in the Position-based Model. In Advances in Neural Information Processing Systems. 1597\u20131605."},{"volume-title":"Bandit Algorithms","author":"Lattimore Tor","key":"e_1_3_2_1_19_1","unstructured":"Tor Lattimore and Csaba Szepesv\u00e1ri . 2020. Bandit Algorithms . Cambridge University Press . Tor Lattimore and Csaba Szepesv\u00e1ri. 2020. Bandit Algorithms. Cambridge University Press."},{"key":"e_1_3_2_1_20_1","unstructured":"Chang Li Branislav Kveton Tor Lattimore Ilya Markov Maarten de Rijke Csaba Szepesv\u00e1ri and Masrour Zoghi. 2020. BubbleRank: Safe online learning to re-rank via implicit click feedback. In Uncertainty in Artificial Intelligence. PMLR 196\u2013206.  Chang Li Branislav Kveton Tor Lattimore Ilya Markov Maarten de Rijke Csaba Szepesv\u00e1ri and Masrour Zoghi. 2020. BubbleRank: Safe online learning to re-rank via implicit click feedback. In Uncertainty in Artificial Intelligence. PMLR 196\u2013206."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000016"},{"key":"e_1_3_2_1_22_1","volume-title":"Beyond Algorithms: Ranking at Scale at Booking.com. In ComplexRec 2020: Workshop on Recommendation in Complex Environments. ACM.","author":"Mavridis Themis","year":"2020","unstructured":"Themis Mavridis , Soraya Hausl , Andrew Mende , and Roberto Pagano . 2020 . Beyond Algorithms: Ranking at Scale at Booking.com. In ComplexRec 2020: Workshop on Recommendation in Complex Environments. ACM. Themis Mavridis, Soraya Hausl, Andrew Mende, and Roberto Pagano. 2020. Beyond Algorithms: Ranking at Scale at Booking.com. In ComplexRec 2020: Workshop on Recommendation in Complex Environments. ACM."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3271686"},{"volume-title":"Advances in Information Retrieval","author":"Oosterhuis Harrie","key":"e_1_3_2_1_24_1","unstructured":"Harrie Oosterhuis and Maarten de Rijke . 2019. Optimizing Ranking Models in an Online Setting . In Advances in Information Retrieval . Springer International Publishing , Cham , 382\u2013396. Harrie Oosterhuis and Maarten de Rijke. 2019. Optimizing Ranking Models in an Online Setting. In Advances in Information Retrieval. Springer International Publishing, Cham, 382\u2013396."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401102"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3437963.3441794"},{"key":"e_1_3_2_1_27_1","unstructured":"Tao Qin and Tie-Yan Liu. 2013. Introducing LETOR 4.0 datasets. arXiv preprint arXiv:1306.2597(2013).  Tao Qin and Tie-Yan Liu. 2013. Introducing LETOR 4.0 datasets. arXiv preprint arXiv:1306.2597(2013)."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390255"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1458082.1458092"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835542"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/336992.337035"},{"volume-title":"ACM SIGIR Forum, Vol.\u00a033. ACM New York","author":"Silverstein Craig","key":"e_1_3_2_1_32_1","unstructured":"Craig Silverstein , Hannes Marais , Monika Henzinger , and Michael Moricz . 1999. Analysis of a Very Large Web Search Engine Query Log . In ACM SIGIR Forum, Vol.\u00a033. ACM New York , NY , USA , 6\u201312. Craig Silverstein, Hannes Marais, Monika Henzinger, and Michael Moricz. 1999. Analysis of a Very Large Web Search Engine Query Log. In ACM SIGIR Forum, Vol.\u00a033. ACM New York, NY, USA, 6\u201312."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2926725"},{"volume-title":"ACM Sigir Forum, Vol.\u00a036. ACM New York","author":"Spink Amanda","key":"e_1_3_2_1_34_1","unstructured":"Amanda Spink , Seda Ozmutlu , Huseyin\u00a0 C Ozmutlu , and Bernard\u00a0 J Jansen . 2002. US versus European Web Searching Trends . In ACM Sigir Forum, Vol.\u00a036. ACM New York , NY , USA , 32\u201338. Amanda Spink, Seda Ozmutlu, Huseyin\u00a0C Ozmutlu, and Bernard\u00a0J Jansen. 2002. US versus European Web Searching Trends. In ACM Sigir Forum, Vol.\u00a036. ACM New York, NY, USA, 32\u201338."},{"key":"e_1_3_2_1_35_1","volume-title":"High-confidence Off-policy Evaluation. In Twenty-Ninth AAAI Conference on Artificial Intelligence.","author":"Thomas S","year":"2015","unstructured":"Philip\u00a0 S Thomas , Georgios Theocharous , and Mohammad Ghavamzadeh . 2015 . High-confidence Off-policy Evaluation. In Twenty-Ninth AAAI Conference on Artificial Intelligence. Philip\u00a0S Thomas, Georgios Theocharous, and Mohammad Ghavamzadeh. 2015. High-confidence Off-policy Evaluation. In Twenty-Ninth AAAI Conference on Artificial Intelligence."},{"key":"e_1_3_2_1_36_1","volume-title":"SIGIR Workshop on eCommerce. ACM.","author":"Trotman Andrew","year":"2017","unstructured":"Andrew Trotman , Jon Degenhardt , and Surya Kallumadi . 2017 . The Architecture of eBay Search . In SIGIR Workshop on eCommerce. ACM. Andrew Trotman, Jon Degenhardt, and Surya Kallumadi. 2017. The Architecture of eBay Search. In SIGIR Workshop on eCommerce. ACM."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412031"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2009934"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911537"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159732"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3271784"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277771"},{"key":"e_1_3_2_1_43_1","volume-title":"Conservative Bandits. In International Conference on Machine Learning. 1254\u20131262","author":"Wu Yifan","year":"2016","unstructured":"Yifan Wu , Roshan Shariff , Tor Lattimore , and Csaba Szepesv\u00e1ri . 2016 . Conservative Bandits. In International Conference on Machine Learning. 1254\u20131262 . Yifan Wu, Roshan Shariff, Tor Lattimore, and Csaba Szepesv\u00e1ri. 2016. Conservative Bandits. In International Conference on Machine Learning. 1254\u20131262."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553527"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-45439-5_28"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911500"}],"event":{"name":"WWW '21: The Web Conference 2021","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"],"location":"Ljubljana Slovenia","acronym":"WWW '21"},"container-title":["Proceedings of the Web Conference 2021"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442381.3450018","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3442381.3450018","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:45Z","timestamp":1750195485000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442381.3450018"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,19]]},"references-count":45,"alternative-id":["10.1145\/3442381.3450018","10.1145\/3442381"],"URL":"https:\/\/doi.org\/10.1145\/3442381.3450018","relation":{},"subject":[],"published":{"date-parts":[[2021,4,19]]},"assertion":[{"value":"2021-06-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}