{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T16:28:42Z","timestamp":1773246522044,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":40,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T00:00:00Z","timestamp":1615161600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,3,8]]},"DOI":"10.1145\/3437963.3441799","type":"proceedings-article","created":{"date-parts":[[2021,3,6]],"date-time":"2021-03-06T04:34:28Z","timestamp":1615005268000},"page":"427-435","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":81,"title":["Combating Selection Biases in Recommender Systems with a Few Unbiased Ratings"],"prefix":"10.1145","author":[{"given":"Xiaojie","family":"Wang","sequence":"first","affiliation":[{"name":"Amazon.com, Inc., Melbourne, VIC, Australia"}]},{"given":"Rui","family":"Zhang","sequence":"additional","affiliation":[{"name":"The University of Melbourne, Melbourne, VIC, Australia"}]},{"given":"Yu","family":"Sun","sequence":"additional","affiliation":[{"name":"Twitter Inc., San Francisco, CA, USA"}]},{"given":"Jianzhong","family":"Qi","sequence":"additional","affiliation":[{"name":"The University of Melbourne, Melbourne, VIC, Australia"}]}],"member":"320","published-online":{"date-parts":[[2021,3,8]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Bal\u00e1zs Csan\u00e1d Cs\u00e1ji etal 2001. Approximation with artificial neural networks. Faculty of Sciences Etvs Lornd University Hungary (2001).  Bal\u00e1zs Csan\u00e1d Cs\u00e1ji et al. 2001. Approximation with artificial neural networks. Faculty of Sciences Etvs Lornd University Hungary (2001)."},{"key":"e_1_3_2_1_2_1","volume-title":"Adaptive Subgradient Methods for Online Learning and Stochastic Optimization. Journal of Machine Learning Research (JMLR)","author":"Duchi John","year":"2011","unstructured":"John Duchi , Elad Hazan , and Yoram Singer . 2011. Adaptive Subgradient Methods for Online Learning and Stochastic Optimization. Journal of Machine Learning Research (JMLR) ( 2011 ). John Duchi, Elad Hazan, and Yoram Singer. 2011. Adaptive Subgradient Methods for Online Learning and Stochastic Optimization. Journal of Machine Learning Research (JMLR) (2011)."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/3305381.3305502"},{"key":"e_1_3_2_1_4_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning (ICML).","author":"Franceschi Luca","year":"2018","unstructured":"Luca Franceschi , Paolo Frasconi , Saverio Salzo , Riccardo Grazzi , and Massimiliano Pontil . 2018 . Bilevel programming for hyperparameter optimization and meta-learning . In Proceedings of the 35th International Conference on Machine Learning (ICML). Luca Franceschi, Paolo Frasconi, Saverio Salzo, Riccardo Grazzi, and Massimiliano Pontil. 2018. Bilevel programming for hyperparameter optimization and meta-learning. In Proceedings of the 35th International Conference on Machine Learning (ICML)."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080777"},{"key":"e_1_3_2_1_6_1","volume-title":"Proceedings of the 31st International Conference on Machine Learning (ICML).","author":"Hern\u00e1ndez-Lobato Jos\u00e9 Miguel","year":"2014","unstructured":"Jos\u00e9 Miguel Hern\u00e1ndez-Lobato , Neil Houlsby , and Zoubin Ghahramani . 2014 . Probabilistic matrix factorization with non-random missing data . In Proceedings of the 31st International Conference on Machine Learning (ICML). Jos\u00e9 Miguel Hern\u00e1ndez-Lobato, Neil Houlsby, and Zoubin Ghahramani. 2014. Probabilistic matrix factorization with non-random missing data. In Proceedings of the 31st International Conference on Machine Learning (ICML)."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2806416.2806455"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6306"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.62"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01249-6_38"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3018661.3018699"},{"key":"e_1_3_2_1_12_1","volume-title":"Matrix factorization techniques for recommender systems. Computer","author":"Koren Yehuda","year":"2009","unstructured":"Yehuda Koren , Robert Bell , and Chris Volinsky . 2009. Matrix factorization techniques for recommender systems. Computer ( 2009 ). Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer (2009)."},{"key":"e_1_3_2_1_13_1","volume-title":"Proceedings of the 28th Conference on Uncertainty in Artificial Intelligence (UAI).","author":"Ling Guang","year":"2012","unstructured":"Guang Ling , Haiqin Yang , Michael R Lyu , and Irwin King . 2012 . Response aware model-based collaborative filtering . In Proceedings of the 28th Conference on Uncertainty in Artificial Intelligence (UAI). Guang Ling, Haiqin Yang, Michael R Lyu, and Irwin King. 2012. Response aware model-based collaborative filtering. In Proceedings of the 28th Conference on Uncertainty in Artificial Intelligence (UAI)."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330906"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401084"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401089"},{"key":"e_1_3_2_1_17_1","volume-title":"Proceedings of the 32nd International Conference on Machine Learning (ICML).","author":"Maclaurin Dougal","year":"2015","unstructured":"Dougal Maclaurin , David Duvenaud , and Ryan P Adams . 2015 . Gradient-based hyperparameter optimization through reversible learning . In Proceedings of the 32nd International Conference on Machine Learning (ICML). Dougal Maclaurin, David Duvenaud, and Ryan P Adams. 2015. Gradient-based hyperparameter optimization through reversible learning. In Proceedings of the 32nd International Conference on Machine Learning (ICML)."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1639714.1639717"},{"key":"e_1_3_2_1_19_1","volume-title":"Proceedings of the 23rd Conference on Uncertainty in Artificial Intelligence (UAI).","author":"Marlin Benjamin M","year":"2007","unstructured":"Benjamin M Marlin , Richard S Zemel , Sam Roweis , and Malcolm Slaney . 2007 . Collaborative filtering and the missing at random assumption . In Proceedings of the 23rd Conference on Uncertainty in Artificial Intelligence (UAI). Benjamin M Marlin, Richard S Zemel, Sam Roweis, and Malcolm Slaney. 2007. Collaborative filtering and the missing at random assumption. In Proceedings of the 23rd Conference on Uncertainty in Artificial Intelligence (UAI)."},{"key":"e_1_3_2_1_20_1","volume-title":"Proceedings of the 33rd International Conference on Machine Learning (ICML).","author":"Pedregosa Fabian","year":"2016","unstructured":"Fabian Pedregosa . 2016 . Hyperparameter optimization with approximate gradient . In Proceedings of the 33rd International Conference on Machine Learning (ICML). Fabian Pedregosa. 2016. Hyperparameter optimization with approximate gradient. In Proceedings of the 33rd International Conference on Machine Learning (ICML)."},{"key":"e_1_3_2_1_21_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning (ICML).","author":"Ren Mengye","year":"2018","unstructured":"Mengye Ren , Wenyuan Zeng , Bin Yang , and Raquel Urtasun . 2018 . Learning to Reweight Examples for Robust Deep Learning . In Proceedings of the 35th International Conference on Machine Learning (ICML). Mengye Ren, Wenyuan Zeng, Bin Yang, and Raquel Urtasun. 2018. Learning to Reweight Examples for Robust Deep Learning. In Proceedings of the 35th International Conference on Machine Learning (ICML)."},{"key":"e_1_3_2_1_22_1","volume-title":"Unbiased Learning for the Causal Effect of Recommendation. In Fourteenth ACM Conference on Recommender Systems (RecSys).","author":"Sato Masahiro","year":"2020","unstructured":"Masahiro Sato , Sho Takemori , Janmajay Singh , and Tomoko Ohkuma . 2020 . Unbiased Learning for the Causal Effect of Recommendation. In Fourteenth ACM Conference on Recommender Systems (RecSys). Masahiro Sato, Sho Takemori, Janmajay Singh, and Tomoko Ohkuma. 2020. Unbiased Learning for the Causal Effect of Recommendation. In Fourteenth ACM Conference on Recommender Systems (RecSys)."},{"key":"e_1_3_2_1_23_1","volume-title":"Debiasing Item-to-Item Recommendations With Small Annotated Datasets. In Fourteenth ACM Conference on Recommender Systems (RecSys).","author":"Schnabel Tobias","year":"2020","unstructured":"Tobias Schnabel and Paul N Bennett . 2020 . Debiasing Item-to-Item Recommendations With Small Annotated Datasets. In Fourteenth ACM Conference on Recommender Systems (RecSys). Tobias Schnabel and Paul N Bennett. 2020. Debiasing Item-to-Item Recommendations With Small Annotated Datasets. In Fourteenth ACM Conference on Recommender Systems (RecSys)."},{"key":"e_1_3_2_1_24_1","volume-title":"Proceedings of the 33rd International Conference on Machine Learning (ICML).","author":"Schnabel Tobias","year":"2016","unstructured":"Tobias Schnabel , Adith Swaminathan , Ashudeep Singh , Navin Chandak , and Thorsten Joachims . 2016 . Recommendations as treatments: debiasing learning and evaluation . In Proceedings of the 33rd International Conference on Machine Learning (ICML). Tobias Schnabel, Adith Swaminathan, Ashudeep Singh, Navin Chandak, and Thorsten Joachims. 2016. Recommendations as treatments: debiasing learning and evaluation. In Proceedings of the 33rd International Conference on Machine Learning (ICML)."},{"key":"e_1_3_2_1_25_1","volume-title":"Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics (AISTATS).","author":"Shaban Amirreza","year":"2019","unstructured":"Amirreza Shaban , Ching-An Cheng , Nathan Hatch , and Byron Boots . 2019 . Truncated back-propagation for bilevel optimization . In Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics (AISTATS). Amirreza Shaban, Ching-An Cheng, Nathan Hatch, and Byron Boots. 2019. Truncated back-propagation for bilevel optimization. In Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics (AISTATS)."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939704"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3336191.3371831"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835804.1835895"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2507157.2507160"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i5.16561"},{"key":"e_1_3_2_1_31_1","volume-title":"Proceedings of the 32nd International Conference on Machine Learning (ICML).","author":"Swaminathan Adith","year":"2015","unstructured":"Adith Swaminathan and Thorsten Joachims . 2015 a. Counterfactual risk minimization: learning from logged bandit feedback . In Proceedings of the 32nd International Conference on Machine Learning (ICML). Adith Swaminathan and Thorsten Joachims. 2015a. Counterfactual risk minimization: learning from logged bandit feedback. In Proceedings of the 32nd International Conference on Machine Learning (ICML)."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/2969442.2969600"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/3327757.3327773"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911497"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-93040-4_47"},{"key":"e_1_3_2_1_36_1","volume-title":"Search result diversity evaluation based on intent hierarchies","author":"Wang Xiaojie","year":"2017","unstructured":"Xiaojie Wang , Ji-Rong Wen , Zhicheng Dou , Tetsuya Sakai , and Rui Zhang . 2017. Search result diversity evaluation based on intent hierarchies . IEEE Transactions on Knowledge and Data Engineering (TKDE) ( 2017 ). Xiaojie Wang, Ji-Rong Wen, Zhicheng Dou, Tetsuya Sakai, and Rui Zhang. 2017. Search result diversity evaluation based on intent hierarchies. IEEE Transactions on Knowledge and Data Engineering (TKDE) (2017)."},{"key":"e_1_3_2_1_37_1","volume-title":"Kdgan: Knowledge distillation with generative adversarial networks. In Advances in Neural Information Processing Systems (NeurIPS).","author":"Wang Xiaojie","year":"2018","unstructured":"Xiaojie Wang , Rui Zhang , Yu Sun , and Jianzhong Qi . 2018 c. Kdgan: Knowledge distillation with generative adversarial networks. In Advances in Neural Information Processing Systems (NeurIPS). Xiaojie Wang, Rui Zhang, Yu Sun, and Jianzhong Qi. 2018c. Kdgan: Knowledge distillation with generative adversarial networks. In Advances in Neural Information Processing Systems (NeurIPS)."},{"key":"e_1_3_2_1_38_1","volume-title":"2019 a. Adversarial distillation for learning with privileged provisions","author":"Wang Xiaojie","year":"2019","unstructured":"Xiaojie Wang , Rui Zhang , Yu Sun , and Jianzhong Qi . 2019 a. Adversarial distillation for learning with privileged provisions . IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) ( 2019 ). Xiaojie Wang, Rui Zhang, Yu Sun, and Jianzhong Qi. 2019 a. Adversarial distillation for learning with privileged provisions. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) (2019)."},{"key":"e_1_3_2_1_39_1","volume-title":"Proceedings of the 36th International Conference on Machine Learning (ICML).","author":"Wang Xiaojie","year":"2019","unstructured":"Xiaojie Wang , Rui Zhang , Yu Sun , and Jianzhong Qi . 2019 b. Doubly robust joint learning for recommendation on data missing not at random . In Proceedings of the 36th International Conference on Machine Learning (ICML). Xiaojie Wang, Rui Zhang, Yu Sun, and Jianzhong Qi. 2019 b. Doubly robust joint learning for recommendation on data missing not at random. In Proceedings of the 36th International Conference on Machine Learning (ICML)."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159681"}],"event":{"name":"WSDM '21: The Fourteenth ACM International Conference on Web Search and Data Mining","location":"Virtual Event Israel","acronym":"WSDM '21","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 14th ACM International Conference on Web Search and Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3437963.3441799","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3437963.3441799","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:36Z","timestamp":1750193256000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3437963.3441799"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,8]]},"references-count":40,"alternative-id":["10.1145\/3437963.3441799","10.1145\/3437963"],"URL":"https:\/\/doi.org\/10.1145\/3437963.3441799","relation":{},"subject":[],"published":{"date-parts":[[2021,3,8]]},"assertion":[{"value":"2021-03-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}