{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T16:19:58Z","timestamp":1761581998532,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":45,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T00:00:00Z","timestamp":1597881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,8,23]]},"DOI":"10.1145\/3394486.3403285","type":"proceedings-article","created":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T23:15:22Z","timestamp":1597965322000},"page":"2359-2367","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":30,"title":["Attribute-based Propensity for Unbiased Learning in Recommender Systems"],"prefix":"10.1145","author":[{"given":"Zhen","family":"Qin","sequence":"first","affiliation":[{"name":"Google LLC, Mountain View, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Suming J.","family":"Chen","sequence":"additional","affiliation":[{"name":"Google LLC, Mountain View, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Donald","family":"Metzler","sequence":"additional","affiliation":[{"name":"Google LLC, Mountain View, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongwoo","family":"Noh","sequence":"additional","affiliation":[{"name":"Google LLC, Mountain View, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingzheng","family":"Qin","sequence":"additional","affiliation":[{"name":"Google LLC, Mountain View, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuanhui","family":"Wang","sequence":"additional","affiliation":[{"name":"Google LLC, Mountain View, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,8,20]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"2016. Save time with Quick Access in Drive. https:\/\/gsuiteupdates.googleblog. com\/2016\/09\/save-time-with-quick-access-in-drive.html. Accessed: 2020-01-15. 2016. Save time with Quick Access in Drive. https:\/\/gsuiteupdates.googleblog. com\/2016\/09\/save-time-with-quick-access-in-drive.html. Accessed: 2020-01-15."},{"key":"e_1_3_2_1_2_1","unstructured":"2017. Quick Access in Google Drive now available on the web. https:\/\/gsuiteupdates.googleblog.com\/2017\/05\/quick-access-in-google-drive-now. html. Accessed: 2020-01-15. 2017. Quick Access in Google Drive now available on the web. https:\/\/gsuiteupdates.googleblog.com\/2017\/05\/quick-access-in-google-drive-now. html. Accessed: 2020-01-15."},{"key":"e_1_3_2_1_3_1","unstructured":"2018. Find shared content with new file organization in Google Drive. https: \/\/gsuiteupdates.googleblog.com\/2018\/03\/find-shared-content-with-new-file. html. Accessed: 2020-1-15. 2018. Find shared content with new file organization in Google Drive. https: \/\/gsuiteupdates.googleblog.com\/2018\/03\/find-shared-content-with-new-file. html. Accessed: 2020-1-15."},{"key":"e_1_3_2_1_4_1","unstructured":"2018. New intelligent search box in Google Drive. https:\/\/gsuiteupdates. googleblog.com\/2018\/07\/intelligent-search-box-in-google-drive.html. Accessed: 2020-01-15. 2018. New intelligent search box in Google Drive. https:\/\/gsuiteupdates. googleblog.com\/2018\/07\/intelligent-search-box-in-google-drive.html. Accessed: 2020-01-15."},{"key":"e_1_3_2_1_5_1","volume-title":"mbox","author":"Martin Abadi","year":"2016","unstructured":"Martin Abadi et al mbox . 2016 . TensorFlow: A system for large-scale machine learning. In OSDI. 265--283. Martin Abadi et almbox. 2016. TensorFlow: A system for large-scale machine learning. In OSDI. 265--283."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Aman Agarwal Ivan Zaitsev Xuanhui Wang Cheng Li Marc Najork and Thorsten Joachims. 2019. Estimating Position Bias without Intrusive Interventions. In WSDM. 474--482. Aman Agarwal Ivan Zaitsev Xuanhui Wang Cheng Li Marc Najork and Thorsten Joachims. 2019. Estimating Position Bias without Intrusive Interventions. In WSDM. 474--482.","DOI":"10.1145\/3289600.3291017"},{"key":"e_1_3_2_1_7_1","unstructured":"Qingyao Ai Keping Bi Cheng Luo Jiafeng Guo and W. Bruce Croft. 2018. Unbiased Learning to Rank with Unbiased Propensity Estimation. In SIGIR. 385--394. Qingyao Ai Keping Bi Cheng Luo Jiafeng Guo and W. Bruce Croft. 2018. Unbiased Learning to Rank with Unbiased Propensity Estimation. In SIGIR. 385--394."},{"key":"e_1_3_2_1_8_1","volume-title":"Proceedings of KDD cup and workshop.","author":"Bennett James","year":"2007","unstructured":"James Bennett , Stan Lanning , 2007 . The Netflix prize . In Proceedings of KDD cup and workshop. James Bennett, Stan Lanning, et almbox. 2007. The Netflix prize. In Proceedings of KDD cup and workshop."},{"key":"e_1_3_2_1_9_1","volume-title":"Chi","author":"Beutel Alex","year":"2018","unstructured":"Alex Beutel , Paul Covington , Sagar Jain , Can Xu , Jia Li , Vince Gatto , and Ed H . Chi . 2018 . Latent Cross : Making Use of Context in Recurrent Recommender Systems. In WSDM. 46--54. Alex Beutel, Paul Covington, Sagar Jain, Can Xu, Jia Li, Vince Gatto, and Ed H. Chi. 2018. Latent Cross: Making Use of Context in Recurrent Recommender Systems. In WSDM. 46--54."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Alexey Borisov Ilya Markov Maarten de Rijke and Pavel Serdyukov. 2016. A Neural Click Model for Web Search. In WWW. 531--541. Alexey Borisov Ilya Markov Maarten de Rijke and Pavel Serdyukov. 2016. A Neural Click Model for Web Search. In WWW. 531--541.","DOI":"10.1145\/2872427.2883033"},{"key":"e_1_3_2_1_11_1","volume-title":"Chi","author":"Chen Minmin","year":"2019","unstructured":"Minmin Chen , Alex Beutel , Paul Covington , Sagar Jain , Francois Belletti , and Ed H . Chi . 2019 . Top-K Off-Policy Correction for a REINFORCE Recommender System. In WSDM. 456--464. Minmin Chen, Alex Beutel, Paul Covington, Sagar Jain, Francois Belletti, and Ed H. Chi. 2019. Top-K Off-Policy Correction for a REINFORCE Recommender System. In WSDM. 456--464."},{"key":"e_1_3_2_1_12_1","volume-title":"Chen et almbox","author":"Suming","year":"2020","unstructured":"Suming J. Chen et almbox . 2020 . Improving Recommendation Quality in Google Drive. In KDD. Suming J. Chen et almbox. 2020. Improving Recommendation Quality in Google Drive. In KDD."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2988450.2988454"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Aleksandr Chuklin Ilya Markov and Maarten de Rijke. 2015. Click Models for Web Search. Morgan & Claypool. Aleksandr Chuklin Ilya Markov and Maarten de Rijke. 2015. Click Models for Web Search. Morgan & Claypool.","DOI":"10.1007\/978-3-031-02294-4"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-78105-1_37"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Zhichong Fang A. Agarwal and T. Joachims. 2019. Intervention Harvesting for Context-Dependent Examination-Bias Estimation. In SIGIR. Zhichong Fang A. Agarwal and T. Joachims. 2019. Intervention Harvesting for Context-Dependent Examination-Bias Estimation. In SIGIR.","DOI":"10.1145\/3331184.3331238"},{"key":"e_1_3_2_1_17_1","unstructured":"Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR. 770--778. Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR. 770--778."},{"key":"e_1_3_2_1_18_1","unstructured":"Xiangnan He Lizi Liao Hanwang Zhang Liqiang Nie Xia Hu and Tat-Seng Chua. 2017. Neural collaborative filtering. In WWW. 173--182. Xiangnan He Lizi Liao Hanwang Zhang Liqiang Nie Xia Hu and Tat-Seng Chua. 2017. Neural collaborative filtering. In WWW. 173--182."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Katja Hofmann Anne Schuth Alejandro Bellogin and Maarten De Rijke. 2014. Effects of position bias on click-based recommender evaluation. In ECIR. 624--630. Katja Hofmann Anne Schuth Alejandro Bellogin and Maarten De Rijke. 2014. Effects of position bias on click-based recommender evaluation. In ECIR. 624--630.","DOI":"10.1007\/978-3-319-06028-6_67"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Y. Hu Y. Koren and C. Volinsky. 2008. Collaborative Filtering for Implicit Feedback Datasets. In ICDM. 263--272. Y. Hu Y. Koren and C. Volinsky. 2008. Collaborative Filtering for Implicit Feedback Datasets. In ICDM. 263--272.","DOI":"10.1109\/ICDM.2008.22"},{"key":"e_1_3_2_1_21_1","unstructured":"Ziniu Hu Yang Wang Qu Peng and Hang Li. 2019. Unbiased LambdaMART: An Unbiased Pairwise Learning-to-Rank Algorithm. In WWW. 2830--2836. Ziniu Hu Yang Wang Qu Peng and Hang Li. 2019. Unbiased LambdaMART: An Unbiased Pairwise Learning-to-Rank Algorithm. In WWW. 2830--2836."},{"key":"e_1_3_2_1_22_1","volume-title":"Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167","author":"Ioffe Sergey","year":"2015","unstructured":"Sergey Ioffe and Christian Szegedy . 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 ( 2015 ). Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 (2015)."},{"key":"e_1_3_2_1_23_1","volume-title":"Evaluating the accuracy of implicit feedback from clicks and query reformulations in web search. ACM Trans. Inf. Syst. (TOIS)","author":"Joachims Thorsten","year":"2007","unstructured":"Thorsten Joachims , Laura Granka , Bing Pan , Helene Hembrooke , Filip Radlinski , and Geri Gay . 2007. Evaluating the accuracy of implicit feedback from clicks and query reformulations in web search. ACM Trans. Inf. Syst. (TOIS) ( 2007 ), 1--7. Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, Filip Radlinski, and Geri Gay. 2007. Evaluating the accuracy of implicit feedback from clicks and query reformulations in web search. ACM Trans. Inf. Syst. (TOIS) (2007), 1--7."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Thorsten Joachims Adith Swaminathan and Tobias Schnabel. 2017. Unbiased Learning-to-Rank with Biased Feedback. In WSDM. 781--789. Thorsten Joachims Adith Swaminathan and Tobias Schnabel. 2017. Unbiased Learning-to-Rank with Biased Feedback. In WSDM. 781--789.","DOI":"10.1145\/3018661.3018699"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2009.263"},{"key":"e_1_3_2_1_26_1","volume-title":"Schapire","author":"Li Lihong","year":"2010","unstructured":"Lihong Li , Wei Chu , John Langford , and Robert E . Schapire . 2010 . A Contextual-bandit Approach to Personalized News Article Recommendation. In WWW. 661--670. Lihong Li, Wei Chu, John Langford, and Robert E. Schapire. 2010. A Contextual-bandit Approach to Personalized News Article Recommendation. In WWW. 661--670."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"crossref","unstructured":"David C. Liu Stephanie Rogers Raymond Shiau Dmitry Kislyuk Kevin C. Ma Zhigang Zhong Jenny Liu and Yushi Jing. 2017. Related Pins at Pinterest: The Evolution of a Real-World Recommender System. In WWW. 583--592. David C. Liu Stephanie Rogers Raymond Shiau Dmitry Kislyuk Kevin C. Ma Zhigang Zhong Jenny Liu and Yushi Jing. 2017. Related Pins at Pinterest: The Evolution of a Real-World Recommender System. In WWW. 583--592.","DOI":"10.1145\/3041021.3054202"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Zhen Qin Zhongliang Li Michael Bendersky and Donald Metzler. 2020. Matching Cross Network for Learning to Rank in Personal Search. In WWW. 2835--2841. Zhen Qin Zhongliang Li Michael Bendersky and Donald Metzler. 2020. Matching Cross Network for Learning to Rank in Personal Search. In WWW. 2835--2841.","DOI":"10.1145\/3366423.3380046"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242643"},{"key":"e_1_3_2_1_30_1","unstructured":"Tobias Schnabel Adith Swaminathan Ashudeep Singh Navin Chandak and Thorsten Joachims. 2016. Recommendations as Treatments: Debiasing Learning and Evaluation. In ICML. 1670--1679. Tobias Schnabel Adith Swaminathan Ashudeep Singh Navin Chandak and Thorsten Joachims. 2016. Recommendations as Treatments: Debiasing Learning and Evaluation. In ICML. 1670--1679."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Jiaxi Tang and Ke Wang. 2018. Personalized top-n sequential recommendation via convolutional sequence embedding. In WSDM. 565--573. Jiaxi Tang and Ke Wang. 2018. Personalized top-n sequential recommendation via convolutional sequence embedding. In WSDM. 565--573.","DOI":"10.1145\/3159652.3159656"},{"key":"e_1_3_2_1_32_1","volume-title":"mbox","author":"Sandeep Tata","year":"2017","unstructured":"Sandeep Tata et al mbox . 2017 . Quick Access : Building a Smart Experience for Google Drive. In KDD. 1643--1651. Sandeep Tata et almbox. 2017. Quick Access: Building a Smart Experience for Google Drive. In KDD. 1643--1651."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Xuanhui Wang Michael Bendersky Donald Metzler and Marc Najork. 2016. Learning to Rank with Selection Bias in Personal Search. In SIGIR. 115--124. Xuanhui Wang Michael Bendersky Donald Metzler and Marc Najork. 2016. Learning to Rank with Selection Bias in Personal Search. In SIGIR. 115--124.","DOI":"10.1145\/2911451.2911537"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Xuanhui Wang Nadav Golbandi Michael Bendersky Donald Metzler and Marc Najork. 2018a. Position Bias Estimation for Unbiased Learning to Rank in Personal Search. In WSDM. 610--618. Xuanhui Wang Nadav Golbandi Michael Bendersky Donald Metzler and Marc Najork. 2018a. Position Bias Estimation for Unbiased Learning to Rank in Personal Search. In WSDM. 610--618.","DOI":"10.1145\/3159652.3159732"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"crossref","unstructured":"Xuanhui Wang Cheng Li Nadav Golbandi Mike Bendersky and Marc Najork. 2018b. The LambdaLoss Framework for Ranking Metric Optimization. In CIKM. 1313--1322. Xuanhui Wang Cheng Li Nadav Golbandi Mike Bendersky and Marc Najork. 2018b. The LambdaLoss Framework for Ranking Metric Optimization. In CIKM. 1313--1322.","DOI":"10.1145\/3269206.3271784"},{"key":"e_1_3_2_1_36_1","unstructured":"Xiaojie Wang Rui Zhang Yu Sun and Jianzhong Qi. 2019. Doubly Robust Joint Learning for Recommendation on Data Missing Not at Random. In ICML. 6638--6647. Xiaojie Wang Rui Zhang Yu Sun and Jianzhong Qi. 2019. Doubly Robust Joint Learning for Recommendation on Data Missing Not at Random. In ICML. 6638--6647."},{"key":"e_1_3_2_1_37_1","unstructured":"Chao-Yuan Wu Amr Ahmed Alex Beutel Alexander J Smola and How Jing. 2017a. Recurrent recommender networks. In WSDM. 495--503. Chao-Yuan Wu Amr Ahmed Alex Beutel Alexander J Smola and How Jing. 2017a. Recurrent recommender networks. In WSDM. 495--503."},{"key":"e_1_3_2_1_38_1","unstructured":"Qingyun Wu Hongning Wang Liangjie Hong and Yue Shi. 2017b. Returning is believing: Optimizing long-term user engagement in recommender systems. In CIKM. 1927--1936. Qingyun Wu Hongning Wang Liangjie Hong and Yue Shi. 2017b. Returning is believing: Optimizing long-term user engagement in recommender systems. In CIKM. 1927--1936."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Longqi Yang Yin Cui Yuan Xuan Chenyang Wang Serge Belongie and Deborah Estrin. 2018. Unbiased Offline Recommender Evaluation for Missing-not-at-random Implicit Feedback. In RecSys. 279--287. Longqi Yang Yin Cui Yuan Xuan Chenyang Wang Serge Belongie and Deborah Estrin. 2018. Unbiased Offline Recommender Evaluation for Missing-not-at-random Implicit Feedback. In RecSys. 279--287.","DOI":"10.1145\/3240323.3240355"},{"key":"e_1_3_2_1_40_1","volume-title":"Nanthan Nan Liu, and Suju Rajan","author":"Yi Xing","year":"2014","unstructured":"Xing Yi , Liangjie Hong , Erheng Zhong , Nanthan Nan Liu, and Suju Rajan . 2014 . Beyond Clicks : Dwell Time for Personalization. In RecSys . 113--120. Xing Yi, Liangjie Hong, Erheng Zhong, Nanthan Nan Liu, and Suju Rajan. 2014. Beyond Clicks: Dwell Time for Personalization. In RecSys. 113--120."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"crossref","unstructured":"Rex Ying Ruining He Kaifeng Chen Pong Eksombatchai William L Hamilton and Jure Leskovec. 2018. Graph convolutional neural networks for web-scale recommender systems. In KDD. 974--983. Rex Ying Ruining He Kaifeng Chen Pong Eksombatchai William L Hamilton and Jure Leskovec. 2018. Graph convolutional neural networks for web-scale recommender systems. In KDD. 974--983.","DOI":"10.1145\/3219819.3219890"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3285029"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"crossref","unstructured":"Qian Zhao Shuo Chang F Maxwell Harper and Joseph A Konstan. 2016. Gaze prediction for recommender systems. In RecSys. 131--138. Qian Zhao Shuo Chang F Maxwell Harper and Joseph A Konstan. 2016. Gaze prediction for recommender systems. In RecSys. 131--138.","DOI":"10.1145\/2959100.2959150"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"crossref","unstructured":"Xiangyu Zhao Long Xia Liang Zhang Zhuoye Ding Dawei Yin and Jiliang Tang. 2018. Deep reinforcement learning for page-wise recommendations. In RecSys. 95--103. Xiangyu Zhao Long Xia Liang Zhang Zhuoye Ding Dawei Yin and Jiliang Tang. 2018. Deep reinforcement learning for page-wise recommendations. In RecSys. 95--103.","DOI":"10.1145\/3240323.3240374"},{"key":"e_1_3_2_1_45_1","volume-title":"Chi","author":"Zhao Zhe","year":"2019","unstructured":"Zhe Zhao , Lichan Hong , Li Wei , Jilin Chen , Aniruddh Nath , Shawn Andrews , Aditee Kumthekar , Maheswaran Sathiamoorthy , Xinyang Yi , and Ed Chi . 2019 . Recommending what video to watch next: a multitask ranking system. In RecSys . 43--51. Zhe Zhao, Lichan Hong, Li Wei, Jilin Chen, Aniruddh Nath, Shawn Andrews, Aditee Kumthekar, Maheswaran Sathiamoorthy, Xinyang Yi, and Ed Chi. 2019. Recommending what video to watch next: a multitask ranking system. In RecSys. 43--51."}],"event":{"name":"KDD '20: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"],"location":"Virtual Event CA USA","acronym":"KDD '20"},"container-title":["Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394486.3403285","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3394486.3403285","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:01:48Z","timestamp":1750197708000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394486.3403285"}},"subtitle":["Algorithm and Case Studies"],"short-title":[],"issued":{"date-parts":[[2020,8,20]]},"references-count":45,"alternative-id":["10.1145\/3394486.3403285","10.1145\/3394486"],"URL":"https:\/\/doi.org\/10.1145\/3394486.3403285","relation":{},"subject":[],"published":{"date-parts":[[2020,8,20]]},"assertion":[{"value":"2020-08-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}