{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T01:44:06Z","timestamp":1787017446306,"version":"build-2736575974"},"publisher-location":"New York, NY, USA","reference-count":19,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,7,25]],"date-time":"2020-07-25T00:00:00Z","timestamp":1595635200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"EPSRC","award":["EP\/ R018634\/1"],"award-info":[{"award-number":["EP\/ R018634\/1"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,7,25]]},"DOI":"10.1145\/3397271.3401230","type":"proceedings-article","created":{"date-parts":[[2020,7,25]],"date-time":"2020-07-25T03:50:08Z","timestamp":1595649008000},"page":"2025-2028","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Using Exploration to Alleviate Closed Loop Effects in Recommender Systems"],"prefix":"10.1145","author":[{"given":"Amir H.","family":"Jadidinejad","sequence":"first","affiliation":[{"name":"University of Glasgow, Glasgow, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Craig","family":"Macdonald","sequence":"additional","affiliation":[{"name":"University of Glasgow, Glasgow, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Iadh","family":"Ounis","sequence":"additional","affiliation":[{"name":"University of Glasgow, Glasgow, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,7,25]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1515\/9781400828739"},{"key":"e_1_3_2_2_2_1","volume-title":"Proceedings of RecSys.","author":"R.","unstructured":"R. Ca namares, M. Redondo , and P. Castells . 2019. Multi-Armed Recommender System Bandit Ensembles . In Proceedings of RecSys. R. Ca namares, M. Redondo, and P. Castells. 2019. Multi-Armed Recommender System Bandit Ensembles. In Proceedings of RecSys."},{"key":"e_1_3_2_2_3_1","volume-title":"Proceedings of RecSys.","author":"Chaney A.","unstructured":"A. Chaney , B. Stewart , and B. Engelhardt . 2018. How Algorithmic Confounding in Recommendation Systems Increases Homogeneity and Decreases Utility . In Proceedings of RecSys. A. Chaney, B. Stewart, and B. Engelhardt. 2018. How Algorithmic Confounding in Recommendation Systems Increases Homogeneity and Decreases Utility. In Proceedings of RecSys."},{"key":"e_1_3_2_2_4_1","volume-title":"Workshop on Reinforcement and Robust Estimators for Recommendation (REVEAL).","author":"Jadidinejad A.","unstructured":"A. Jadidinejad , C. Macdonald , and I. Ounis . 2019. How Sensitive is Recommendation Systems' Offline Evaluation to Popularity? . In Workshop on Reinforcement and Robust Estimators for Recommendation (REVEAL). A. Jadidinejad, C. Macdonald, and I. Ounis. 2019. How Sensitive is Recommendation Systems' Offline Evaluation to Popularity?. In Workshop on Reinforcement and Robust Estimators for Recommendation (REVEAL)."},{"key":"e_1_3_2_2_5_1","volume-title":"Proceedings of AIES.","author":"Jiang R.","unstructured":"R. Jiang , S. Chiappa , T. Lattimore , A. Gy\u00f6rgy , and P. Kohli . 2019. Degenerate Feedback Loops in Recommender Systems . In Proceedings of AIES. R. Jiang, S. Chiappa, T. Lattimore, A. Gy\u00f6rgy, and P. Kohli. 2019. Degenerate Feedback Loops in Recommender Systems. In Proceedings of AIES."},{"key":"e_1_3_2_2_6_1","volume-title":"REVEAL 2018: Offline Evaluation for Recommender Systems. In Proceedings of RecSys.","author":"Joachims T.","unstructured":"T. Joachims , A. Swaminathan , Y. Raimond , O. Koch , and F. Vasile . 2018 . REVEAL 2018: Offline Evaluation for Recommender Systems. In Proceedings of RecSys. T. Joachims, A. Swaminathan, Y. Raimond, O. Koch, and F. Vasile. 2018. REVEAL 2018: Offline Evaluation for Recommender Systems. In Proceedings of RecSys."},{"key":"e_1_3_2_2_7_1","volume-title":"Proceedings of WSDM.","author":"Joachims T.","unstructured":"T. Joachims , A. Swaminathan , and T. Schnabel . 2017. Unbiased Learning-to-Rank with Biased Feedback . In Proceedings of WSDM. T. Joachims, A. Swaminathan, and T. Schnabel. 2017. Unbiased Learning-to-Rank with Biased Feedback. In Proceedings of WSDM."},{"key":"e_1_3_2_2_8_1","volume-title":"Proceedings of WSDM.","author":"Li L.","unstructured":"L. Li , W. Chu , J. Langford , and X. Wang . 2011. Unbiased Offline Evaluation of Contextual-bandit-based News Article Recommendation Algorithms . In Proceedings of WSDM. L. Li, W. Chu, J. Langford, and X. Wang. 2011. Unbiased Offline Evaluation of Contextual-bandit-based News Article Recommendation Algorithms. In Proceedings of WSDM."},{"key":"e_1_3_2_2_9_1","volume-title":"Proceedings of RecSys.","author":"McInerney J.","unstructured":"J. McInerney , B. Lacker , S. Hansen , K. Higley , H. Bouchard , A. Gruson , and R. Mehrotra . 2018. Explore, Exploit, and Explain: Personalizing Explainable Recommendations with Bandits . In Proceedings of RecSys. J. McInerney, B. Lacker, S. Hansen, K. Higley, H. Bouchard, A. Gruson, and R. Mehrotra. 2018. Explore, Exploit, and Explain: Personalizing Explainable Recommendations with Bandits. In Proceedings of RecSys."},{"key":"e_1_3_2_2_10_1","volume":"201","author":"Nguyen T.","unstructured":"T. Nguyen , P. Hui , F.M. Harper , L. Terveen , and J. Konstan. 201 4. Exploring the Filter Bubble: The Effect of Using Recommender Systems on Content Diversity. In Proceedings of WWW. T. Nguyen, P. Hui, F.M. Harper, L. Terveen, and J. Konstan. 2014. Exploring the Filter Bubble: The Effect of Using Recommender Systems on Content Diversity. In Proceedings of WWW.","journal-title":"J. Konstan."},{"key":"e_1_3_2_2_11_1","volume-title":"Proceedings of CIKM.","author":"Radlinski F.","unstructured":"F. Radlinski , M. Kurup , and T. Joachims . 2008. How Does Clickthrough Data Reflect Retrieval Quality? . In Proceedings of CIKM. F. Radlinski, M. Kurup, and T. Joachims. 2008. How Does Clickthrough Data Reflect Retrieval Quality?. In Proceedings of CIKM."},{"key":"e_1_3_2_2_12_1","volume-title":"Proceedings of UAI.","author":"Rendle S.","unstructured":"S. Rendle , C. Freudenthaler , Z. Gantner , and L. Schmidt-Thieme . 2009. BPR: Bayesian Personalized Ranking from Implicit Feedback . In Proceedings of UAI. S. Rendle, C. Freudenthaler, Z. Gantner, and L. Schmidt-Thieme. 2009. BPR: Bayesian Personalized Ranking from Implicit Feedback. In Proceedings of UAI."},{"key":"e_1_3_2_2_13_1","volume-title":"Proceedings of WSDM.","author":"Schnabel T.","unstructured":"T. Schnabel , P. Bennett , S. Dumais , and T. Joachims . 2018. Short-Term Satisfaction and Long-Term Coverage: Understanding How Users Tolerate Algorithmic Exploration . In Proceedings of WSDM. T. Schnabel, P. Bennett, S. Dumais, and T. Joachims. 2018. Short-Term Satisfaction and Long-Term Coverage: Understanding How Users Tolerate Algorithmic Exploration. In Proceedings of WSDM."},{"key":"e_1_3_2_2_14_1","volume-title":"Proceedings of ICML.","author":"Schnabel T.","unstructured":"T. Schnabel , A. Swaminathan , A. Singh , N. Chandak , and T. Joachims . 2016. Recommendations as Treatments: Debiasing Learning and Evaluation . In Proceedings of ICML. T. Schnabel, A. Swaminathan, A. Singh, N. Chandak, and T. Joachims. 2016. Recommendations as Treatments: Debiasing Learning and Evaluation. In Proceedings of ICML."},{"key":"e_1_3_2_2_15_1","volume-title":"Debiasing the Human-Recommender System Feedback Loop in Collaborative Filtering. In Companion Proceedings of WWW.","author":"Sun W.","unstructured":"W. Sun , S. Khenissi , O. Nasraoui , and P. Shafto . 2019 . Debiasing the Human-Recommender System Feedback Loop in Collaborative Filtering. In Companion Proceedings of WWW. W. Sun, S. Khenissi, O. Nasraoui, and P. Shafto. 2019. Debiasing the Human-Recommender System Feedback Loop in Collaborative Filtering. In Companion Proceedings of WWW."},{"key":"e_1_3_2_2_16_1","volume-title":"Proceedings of KDIR.","author":"Sun W.","unstructured":"W. Sun , O. Nasraoui , and P. Shafto . 2018. Iterated Algorithmic Bias in the Interactive Machine Learning Process of Information Filtering . In Proceedings of KDIR. W. Sun, O. Nasraoui, and P. Shafto. 2018. Iterated Algorithmic Bias in the Interactive Machine Learning Process of Information Filtering. In Proceedings of KDIR."},{"key":"e_1_3_2_2_17_1","volume-title":"Proceedings of SIGIR.","author":"Wang X.","unstructured":"X. Wang , M. Bendersky , D. Metzler , and M. Najork . 2016. Learning to Rank with Selection Bias in Personal Search . In Proceedings of SIGIR. X. Wang, M. Bendersky, D. Metzler, and M. Najork. 2016. Learning to Rank with Selection Bias in Personal Search. In Proceedings of SIGIR."},{"key":"e_1_3_2_2_18_1","volume-title":"Proceedings of RecSys.","author":"Weston J.","unstructured":"J. Weston , H. Yee , and R. Weiss . 2013. Learning to Rank Recommendations with the K-order Statistic Loss . In Proceedings of RecSys. J. Weston, H. Yee, and R. Weiss. 2013. Learning to Rank Recommendations with the K-order Statistic Loss. In Proceedings of RecSys."},{"key":"e_1_3_2_2_19_1","volume-title":"Proceedings of RecSys.","author":"Yang L.","unstructured":"L. Yang , Y. Cui , Y. Xuan , C. Wang , S. Belongie , and D. Estrin . 2018. Unbiased Offline Recommender Evaluation for Missing-not-at-random Implicit Feedback . In Proceedings of RecSys. L. Yang, Y. Cui, Y. Xuan, C. Wang, S. Belongie, and D. Estrin. 2018. Unbiased Offline Recommender Evaluation for Missing-not-at-random Implicit Feedback. In Proceedings of RecSys."}],"event":{"name":"SIGIR '20: The 43rd International ACM SIGIR conference on research and development in Information Retrieval","location":"Virtual Event China","acronym":"SIGIR '20","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3397271.3401230","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3397271.3401230","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:41:44Z","timestamp":1750185704000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3397271.3401230"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,25]]},"references-count":19,"alternative-id":["10.1145\/3397271.3401230","10.1145\/3397271"],"URL":"https:\/\/doi.org\/10.1145\/3397271.3401230","relation":{},"subject":[],"published":{"date-parts":[[2020,7,25]]},"assertion":[{"value":"2020-07-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}