{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T08:42:36Z","timestamp":1774946556160,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":45,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,4,20]],"date-time":"2020-04-20T00:00:00Z","timestamp":1587340800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,4,20]]},"DOI":"10.1145\/3366423.3380255","type":"proceedings-article","created":{"date-parts":[[2020,5,4]],"date-time":"2020-05-04T08:11:44Z","timestamp":1588579904000},"page":"1863-1873","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":83,"title":["Correcting for Selection Bias in Learning-to-rank Systems"],"prefix":"10.1145","author":[{"given":"Zohreh","family":"Ovaisi","sequence":"first","affiliation":[{"name":"University of Illinois at Chicago"}]},{"given":"Ragib","family":"Ahsan","sequence":"additional","affiliation":[{"name":"University of Illinois at Chicago"}]},{"given":"Yifan","family":"Zhang","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University"}]},{"given":"Kathryn","family":"Vasilaky","sequence":"additional","affiliation":[{"name":"California Polytechnic State University"}]},{"given":"Elena","family":"Zheleva","sequence":"additional","affiliation":[{"name":"University of Illinois at Chicago"}]}],"member":"320","published-online":{"date-parts":[[2020,4,20]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331202"},{"key":"e_1_3_2_1_2_1","volume-title":"Unbiased Learning to Rank with Unbiased Propensity Estimation. SIGIR","author":"Ai Qingyao","year":"2018","unstructured":"Qingyao Ai , Keping Bi , Cheng Luo , Jiafeng Guo , and W\u00a0Bruce Croft . 2018. Unbiased Learning to Rank with Unbiased Propensity Estimation. SIGIR ( 2018 ). Qingyao Ai, Keping Bi, Cheng Luo, Jiafeng Guo, and W\u00a0Bruce Croft. 2018. Unbiased Learning to Rank with Unbiased Propensity Estimation. SIGIR (2018)."},{"key":"e_1_3_2_1_3_1","unstructured":"Elias Bareinboim and Judea Pearl. 2012. Controlling selection bias in causal inference. In AISTATS. 100\u2013108.  Elias Bareinboim and Judea Pearl. 2012. Controlling selection bias in causal inference. In AISTATS. 100\u2013108."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1510507113"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/2888116.2888199"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Elias Bareinboim Jin Tian and Judea Pearl. 2014. Recovering from Selection Bias in Causal and Statistical Inference.. In AAAI. 2410\u20132416.  Elias Bareinboim Jin Tian and Judea Pearl. 2014. Recovering from Selection Bias in Causal and Statistical Inference.. In AAAI. 2410\u20132416.","DOI":"10.1609\/aaai.v28i1.9074"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872427.2883033"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1722149.1722154"},{"key":"e_1_3_2_1_9_1","volume-title":"How Algorithmic Confounding in Recommendation Systems Increases Homogeneity and Decreases Utility. RecSys","author":"Chaney JB","year":"2018","unstructured":"Allison\u00a0 JB Chaney , Brandon\u00a0 M Stewart , and Barbara\u00a0 E Engelhardt . 2018. How Algorithmic Confounding in Recommendation Systems Increases Homogeneity and Decreases Utility. RecSys ( 2018 ). Allison\u00a0JB Chaney, Brandon\u00a0M Stewart, and Barbara\u00a0E Engelhardt. 2018. How Algorithmic Confounding in Recommendation Systems Increases Homogeneity and Decreases Utility. RecSys (2018)."},{"key":"e_1_3_2_1_10_1","volume-title":"Proceedings of the Learning to Rank Challenge. 1\u201324","author":"Chapelle Olivier","year":"2011","unstructured":"Olivier Chapelle and Yi Chang . 2011 . Yahoo! learning to rank challenge overview . In Proceedings of the Learning to Rank Challenge. 1\u201324 . Olivier Chapelle and Yi Chang. 2011. Yahoo! learning to rank challenge overview. In Proceedings of the Learning to Rank Challenge. 1\u201324."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2094072.2094078"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1526709.1526711"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2533670.2533675"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/3298023.3298112"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Juan\u00a0D Correa Jin Tian and Elias Bareinboim. 2018. Generalized adjustment under confounding and selection biases. In AAAI.  Juan\u00a0D Correa Jin Tian and Elias Bareinboim. 2018. Generalized adjustment under confounding and selection biases. In AAAI.","DOI":"10.1609\/aaai.v32i1.12125"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Nick Craswell Onno Zoeter Michael Taylor and Bill Ramsey. 2008. An experimental comparison of click position-bias models. In WSDM. ACM 87\u201394.  Nick Craswell Onno Zoeter Michael Taylor and Bill Ramsey. 2008. An experimental comparison of click position-bias models. In WSDM. ACM 87\u201394.","DOI":"10.1145\/1341531.1341545"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1088\/0256-307X\/30\/11\/118901"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1217220110"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/371920.372165"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1250910.1250939"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.2307\/1912352"},{"key":"e_1_3_2_1_22_1","volume-title":"International Conference on Machine Learning. 1512\u20131520","author":"Hern\u00e1ndez-Lobato Jos\u00e9\u00a0Miguel","year":"2014","unstructured":"Jos\u00e9\u00a0Miguel Hern\u00e1ndez-Lobato , Neil Houlsby , and Zoubin Ghahramani . 2014 . Probabilistic matrix factorization with non-random missing data . In International Conference on Machine Learning. 1512\u20131520 . Jos\u00e9\u00a0Miguel Hern\u00e1ndez-Lobato, Neil Houlsby, and Zoubin Ghahramani. 2014. Probabilistic matrix factorization with non-random missing data. In International Conference on Machine Learning. 1512\u20131520."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2433396.2433419"},{"key":"e_1_3_2_1_24_1","unstructured":"Ziniu Hu Yang Wang Qu Peng and Hang Li. 2019. Unbiased LambdaMART: An Unbiased Pairwise Learning-to-Rank Algorithm. (2019).  Ziniu Hu Yang Wang Qu Peng and Hang Li. 2019. Unbiased LambdaMART: An Unbiased Pairwise Learning-to-Rank Algorithm. (2019)."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Rolf Jagerman Harrie Oosterhuis and Maarten de Rijke. 2019. To Model or to Intervene: A Comparison of Counterfactual and Online Learning to Rank from User Interactions. (2019).  Rolf Jagerman Harrie Oosterhuis and Maarten de Rijke. 2019. To Model or to Intervene: A Comparison of Counterfactual and Online Learning to Rank from User Interactions. (2019).","DOI":"10.1145\/3331184.3331269"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1093\/poq\/nfv039"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775067"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Thorsten Joachims Laura\u00a0A Granka Bing Pan Helene Hembrooke and Geri Gay. 2005. Accurately interpreting clickthrough data as implicit feedback. In Sigir Vol.\u00a05. 154\u2013161.  Thorsten Joachims Laura\u00a0A Granka Bing Pan Helene Hembrooke and Geri Gay. 2005. Accurately interpreting clickthrough data as implicit feedback. In Sigir Vol.\u00a05. 154\u2013161.","DOI":"10.1145\/1076034.1076063"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Thorsten Joachims Adith Swaminathan and Tobias Schnabel. 2017. Unbiased learning-to-rank with biased feedback. In WSDM. ACM 781\u2013789.  Thorsten Joachims Adith Swaminathan and Tobias Schnabel. 2017. Unbiased learning-to-rank with biased feedback. In WSDM. ACM 781\u2013789.","DOI":"10.1145\/3018661.3018699"},{"key":"e_1_3_2_1_30_1","volume-title":"The parable of Google Flu: traps in big data analysis. Science 343, 6176","author":"Lazer David","year":"2014","unstructured":"David Lazer , Ryan Kennedy , Gary King , and Alessandro Vespignani . 2014. The parable of Google Flu: traps in big data analysis. Science 343, 6176 ( 2014 ), 1203\u20131205. David Lazer, Ryan Kennedy, Gary King, and Alessandro Vespignani. 2014. The parable of Google Flu: traps in big data analysis. Science 343, 6176 (2014), 1203\u20131205."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1002\/wics.111"},{"key":"e_1_3_2_1_32_1","volume-title":"Learning to rank for information retrieval","author":"Liu Tie-Yan","unstructured":"Tie-Yan Liu . 2011. Learning to rank for information retrieval . Springer Science & Business Media . Tie-Yan Liu. 2011. Learning to rank for information retrieval. Springer Science & Business Media."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3271686"},{"key":"e_1_3_2_1_34_1","volume-title":"Causal inference in statistics: A primer","author":"Pearl Judea","unstructured":"Judea Pearl , Madelyn Glymour , and Nicholas\u00a0 P Jewell . 2016. Causal inference in statistics: A primer . John Wiley & Sons . Judea Pearl, Madelyn Glymour, and Nicholas\u00a0P Jewell. 2016. Causal inference in statistics: A primer. John Wiley & Sons."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-40991-2_9"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Matthew Richardson Ewa Dominowska and Robert Ragno. 2007. Predicting clicks: estimating the click-through rate for new ads. In WWW. ACM 521\u2013530.  Matthew Richardson Ewa Dominowska and Robert Ragno. 2007. Predicting clicks: estimating the click-through rate for new ads. In WWW. ACM 521\u2013530.","DOI":"10.1145\/1242572.1242643"},{"key":"e_1_3_2_1_37_1","unstructured":"Tobias Schnabel Adith Swaminathan Ashudeep Singh Navin Chandak and Thorsten Joachims. 2016. Recommendations as treatments: Debiasing learning and evaluation. arXiv preprint arXiv:1602.05352(2016).  Tobias Schnabel Adith Swaminathan Ashudeep Singh Navin Chandak and Thorsten Joachims. 2016. Recommendations as treatments: Debiasing learning and evaluation. arXiv preprint arXiv:1602.05352(2016)."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2835776.2835804"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661829.2661952"},{"key":"e_1_3_2_1_40_1","volume-title":"A Bayesian network framework for reject inference. KDD","author":"Smith Andrew","year":"2004","unstructured":"Andrew Smith and Charles Elkan . 2004. A Bayesian network framework for reject inference. KDD ( 2004 ). http:\/\/delivery.acm.org\/10.1145\/1020000\/1014085\/p286-smith.pdf Andrew Smith and Charles Elkan. 2004. A Bayesian network framework for reject inference. KDD (2004). http:\/\/delivery.acm.org\/10.1145\/1020000\/1014085\/p286-smith.pdf"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"crossref","unstructured":"Xuanhui Wang Michael Bendersky Donald Metzler and Marc Najork. 2016. Learning to rank with selection bias in personal search. In SIGIR. ACM 115\u2013124.  Xuanhui Wang Michael Bendersky Donald Metzler and Marc Najork. 2016. Learning to rank with selection bias in personal search. In SIGIR. ACM 115\u2013124.","DOI":"10.1145\/2911451.2911537"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"crossref","unstructured":"Xuanhui Wang Nadav Golbandi Michael Bendersky Donald Metzler and Marc Najork. 2018. Position bias estimation for unbiased learning to rank in personal search. In WSDM. ACM 610\u2013618.  Xuanhui Wang Nadav Golbandi Michael Bendersky Donald Metzler and Marc Najork. 2018. Position bias estimation for unbiased learning to rank in personal search. In WSDM. ACM 610\u2013618.","DOI":"10.1145\/3159652.3159732"},{"key":"e_1_3_2_1_43_1","unstructured":"Yixin Wang Dawen Liang Laurent Charlin and David\u00a0M Blei. 2018. The deconfounded recommender: A causal inference approach to recommendation. arXiv preprint arXiv:1808.06581(2018).  Yixin Wang Dawen Liang Laurent Charlin and David\u00a0M Blei. 2018. The deconfounded recommender: A causal inference approach to recommendation. arXiv preprint arXiv:1808.06581(2018)."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553527"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015425"}],"event":{"name":"WWW '20: The Web Conference 2020","location":"Taipei Taiwan","acronym":"WWW '20","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"]},"container-title":["Proceedings of The Web Conference 2020"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3366423.3380255","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3366423.3380255","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:33:10Z","timestamp":1750199590000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3366423.3380255"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,20]]},"references-count":45,"alternative-id":["10.1145\/3366423.3380255","10.1145\/3366423"],"URL":"https:\/\/doi.org\/10.1145\/3366423.3380255","relation":{},"subject":[],"published":{"date-parts":[[2020,4,20]]},"assertion":[{"value":"2020-04-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}