{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,20]],"date-time":"2026-08-20T16:37:02Z","timestamp":1787243822451,"version":"build-2736575974"},"publisher-location":"New York, NY, USA","reference-count":25,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,9,13]],"date-time":"2021-09-13T00:00:00Z","timestamp":1631491200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,9,13]]},"DOI":"10.1145\/3460231.3473320","type":"proceedings-article","created":{"date-parts":[[2021,9,13]],"date-time":"2021-09-13T17:45:04Z","timestamp":1631555104000},"page":"828-830","source":"Crossref","is-referenced-by-count":47,"title":["Counterfactual Learning and Evaluation for Recommender Systems: Foundations, Implementations, and Recent Advances"],"prefix":"10.1145","author":[{"given":"Yuta","family":"Saito","sequence":"first","affiliation":[{"name":"Cornell University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thorsten","family":"Joachims","sequence":"additional","affiliation":[{"name":"Dept of Information Science Cornell University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,9,13]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098155"},{"key":"e_1_3_2_1_2_1","unstructured":"Mert Demirer Vasilis Syrgkanis Greg Lewis and Victor Chernozhukov. 2019. Semi-Parametric Efficient Policy Learning with Continuous Actions. In Advances in Neural Information Processing Systems Vol.\u00a032.  Mert Demirer Vasilis Syrgkanis Greg Lewis and Victor Chernozhukov. 2019. Semi-Parametric Efficient Policy Learning with Continuous Actions. In Advances in Neural Information Processing Systems Vol.\u00a032."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1214\/14-STS500"},{"key":"e_1_3_2_1_4_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning, Vol.\u00a080","author":"Farajtabar Mehrdad","year":"2018","unstructured":"Mehrdad Farajtabar , Yinlam Chow , and Mohammad Ghavamzadeh . 2018 . More Robust Doubly Robust Off-policy Evaluation . In Proceedings of the 35th International Conference on Machine Learning, Vol.\u00a080 . PMLR, 1447\u20131456. Mehrdad Farajtabar, Yinlam Chow, and Mohammad Ghavamzadeh. 2018. More Robust Doubly Robust Off-policy Evaluation. In Proceedings of the 35th International Conference on Machine Learning, Vol.\u00a080. PMLR, 1447\u20131456."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/3045390.3045460"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2914803"},{"key":"e_1_3_2_1_7_1","volume-title":"Proceedings of the 38th International Conference on Machine Learning, Vol.\u00a0139","author":"Kallus Nathan","year":"2021","unstructured":"Nathan Kallus , Yuta Saito , and Masatoshi Uehara . 2021 . Optimal Off-Policy Evaluation from Multiple Logging Policies . In Proceedings of the 38th International Conference on Machine Learning, Vol.\u00a0139 . PMLR, 5247\u20135256. Nathan Kallus, Yuta Saito, and Masatoshi Uehara. 2021. Optimal Off-Policy Evaluation from Multiple Logging Policies. In Proceedings of the 38th International Conference on Machine Learning, Vol.\u00a0139. PMLR, 5247\u20135256."},{"key":"e_1_3_2_1_8_1","volume-title":"Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics. PMLR, 1243\u20131251","author":"Kallus Nathan","year":"2018","unstructured":"Nathan Kallus and Angela Zhou . 2018 . Policy Evaluation and Optimization with Continuous Treatments . In Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics. PMLR, 1243\u20131251 . Nathan Kallus and Angela Zhou. 2018. Policy Evaluation and Optimization with Continuous Treatments. In Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics. PMLR, 1243\u20131251."},{"key":"e_1_3_2_1_9_1","unstructured":"Masahiro Kato Shota Yasui and Masatoshi Uehara. 2020. Off-Policy Evaluation and Learning for External Validity under a Covariate Shift. In Advances in Neural Information Processing Systems Vol.\u00a033. 49\u201361.  Masahiro Kato Shota Yasui and Masatoshi Uehara. 2020. Off-Policy Evaluation and Learning for External Validity under a Covariate Shift. In Advances in Neural Information Processing Systems Vol.\u00a033. 49\u201361."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220028"},{"key":"e_1_3_2_1_11_1","unstructured":"Anqi Liu Hao Liu Anima Anandkumar and Yisong Yue. 2019. Triply Robust Off-Policy Evaluation. arXiv preprint arXiv:1911.05811(2019).  Anqi Liu Hao Liu Anima Anandkumar and Yisong Yue. 2019. Triply Robust Off-Policy Evaluation. arXiv preprint arXiv:1911.05811(2019)."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403229"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403139"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3383313.3412262"},{"key":"e_1_3_2_1_15_1","unstructured":"Yuta Saito Shunsuke Aihara Megumi Matsutani and Yusuke Narita. 2020. Open Bandit Dataset and Pipeline: Towards Realistic and Reproducible Off-Policy Evaluation. arXiv preprint arXiv:2008.07146(2020).  Yuta Saito Shunsuke Aihara Megumi Matsutani and Yusuke Narita. 2020. Open Bandit Dataset and Pipeline: Towards Realistic and Reproducible Off-Policy Evaluation. arXiv preprint arXiv:2008.07146(2020)."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/3524938.3525762"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220088"},{"key":"e_1_3_2_1_18_1","unstructured":"Ashudeep Singh and Thorsten Joachims. 2019. Policy Learning for Fairness in Ranking. In Advances in Neural Information Processing Systems Vol.\u00a032.  Ashudeep Singh and Thorsten Joachims. 2019. Policy Learning for Fairness in Ranking. In Advances in Neural Information Processing Systems Vol.\u00a032."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/3524938.3525788"},{"key":"e_1_3_2_1_20_1","volume-title":"Proceedings of the 36th International Conference on Machine Learning, Vol.\u00a097","author":"Su Yi","year":"2019","unstructured":"Yi Su , Lequn Wang , Michele Santacatterina , and Thorsten Joachims . 2019 . Cab: Continuous Adaptive Blending for Policy Evaluation and Learning . In Proceedings of the 36th International Conference on Machine Learning, Vol.\u00a097 . PMLR, 6005\u20136014. Yi Su, Lequn Wang, Michele Santacatterina, and Thorsten Joachims. 2019. Cab: Continuous Adaptive Blending for Policy Evaluation and Learning. In Proceedings of the 36th International Conference on Machine Learning, Vol.\u00a097. PMLR, 6005\u20136014."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/2789272.2886805"},{"key":"e_1_3_2_1_22_1","unstructured":"Lequn Wang Yiwei Bai Wen Sun and Thorsten Joachims. 2021. Fairness of Exposure in Stochastic Bandits. arXiv preprint arXiv:2103.02735(2021).  Lequn Wang Yiwei Bai Wen Sun and Thorsten Joachims. 2021. Fairness of Exposure in Stochastic Bandits. arXiv preprint arXiv:2103.02735(2021)."},{"key":"e_1_3_2_1_23_1","unstructured":"Lequn Wang and Thorsten Joachims. 2020. Fairness and Diversity for Rankings in Two-Sided Markets. arXiv preprint arXiv:2010.01470(2020).  Lequn Wang and Thorsten Joachims. 2020. Fairness and Diversity for Rankings in Two-Sided Markets. arXiv preprint arXiv:2010.01470(2020)."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/3305890.3306052"},{"key":"e_1_3_2_1_25_1","unstructured":"Himank Yadav Zhengxiao Du and Thorsten Joachims. 2019. Fair Learning-to-Rank from Implicit Feedback. arXiv preprint arXiv:1911.08054(2019).  Himank Yadav Zhengxiao Du and Thorsten Joachims. 2019. Fair Learning-to-Rank from Implicit Feedback. arXiv preprint arXiv:1911.08054(2019)."}],"event":{"name":"RecSys '21: Fifteenth ACM Conference on Recommender Systems","location":"Amsterdam Netherlands","acronym":"RecSys '21","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGAI ACM Special Interest Group on Artificial Intelligence","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data","SIGIR ACM Special Interest Group on Information Retrieval","SIGCHI ACM Special Interest Group on Computer-Human Interaction","SIGecom Special Interest Group on Economics and Computation"]},"container-title":["Fifteenth ACM Conference on Recommender Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3460231.3473320","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3460231.3473320","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:12:17Z","timestamp":1750176737000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3460231.3473320"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,13]]},"references-count":25,"alternative-id":["10.1145\/3460231.3473320","10.1145\/3460231"],"URL":"https:\/\/doi.org\/10.1145\/3460231.3473320","relation":{},"subject":[],"published":{"date-parts":[[2021,9,13]]}}}