{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,16]],"date-time":"2025-07-16T13:25:49Z","timestamp":1752672349187,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,5,13]],"date-time":"2019-05-13T00:00:00Z","timestamp":1557705600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,5,13]]},"DOI":"10.1145\/3308558.3313727","type":"proceedings-article","created":{"date-parts":[[2019,5,13]],"date-time":"2019-05-13T12:17:59Z","timestamp":1557749879000},"page":"2080-2090","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Dynamic Ensemble of Contextual Bandits to Satisfy Users' Changing Interests"],"prefix":"10.1145","author":[{"given":"Qingyun","family":"Wu","sequence":"first","affiliation":[{"name":"University of Virginia, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huazheng","family":"Wang","sequence":"additional","affiliation":[{"name":"University of Virginia, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanen","family":"Li","sequence":"additional","affiliation":[{"name":"Snap Inc., USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongning","family":"Wang","sequence":"additional","affiliation":[{"name":"University of Virginia, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,5,13]]},"reference":[{"key":"e_1_3_2_1_1_1","first-page":"2312","article-title":"Improved Algorithms for Linear Stochastic Bandits","author":"Yasin","year":"2011","unstructured":"Yasin Abbasi-yadkori, D\u00e1vid P\u00e1l , and Csaba Szepesv\u00e1ri . 2011 . Improved Algorithms for Linear Stochastic Bandits . In NIPS. 2312 - 2320 . Yasin Abbasi-yadkori, D\u00e1vid P\u00e1l, and Csaba Szepesv\u00e1ri. 2011. Improved Algorithms for Linear Stochastic Bandits. In NIPS. 2312-2320.","journal-title":"NIPS."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2527031.2527040"},{"key":"e_1_3_2_1_3_1","first-page":"397","article-title":"Using Confidence Bounds for Exploitation-Exploration Trade-offs","volume":"3","author":"Auer Peter","year":"2002","unstructured":"Peter Auer . 2002 . Using Confidence Bounds for Exploitation-Exploration Trade-offs . Journal of Machine Learning Research 3 (2002), 397 - 422 . Peter Auer. 2002. Using Confidence Bounds for Exploitation-Exploration Trade-offs. Journal of Machine Learning Research 3 (2002), 397-422.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1013689704352"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1287\/opre.48.1.80.12444"},{"key":"e_1_3_2_1_7_1","unstructured":"Yang Cao Zheng Wen Branislav Kveton and Yao Xie. 2018. Nearly Optimal Adaptive Procedure for Piecewise-Stationary Bandit: a Change-Point Detection Approach. https:\/\/arxiv.org\/abs\/1802.03692(2018).  Yang Cao Zheng Wen Branislav Kveton and Yao Xie. 2018. Nearly Optimal Adaptive Procedure for Piecewise-Stationary Bandit: a Change-Point Detection Approach. https:\/\/arxiv.org\/abs\/1802.03692(2018)."},{"key":"e_1_3_2_1_8_1","volume-title":"Pro. NIPS","author":"Cesa-Bianchi Nicol\u00f2","year":"2013","unstructured":"Nicol\u00f2 Cesa-Bianchi , Claudio Gentile , and Giovanni Zappella . 2013. A Gang of Bandits . In Pro. NIPS ( 2013 ). Nicol\u00f2 Cesa-Bianchi, Claudio Gentile, and Giovanni Zappella. 2013. A Gang of Bandits. In Pro. NIPS (2013)."},{"key":"e_1_3_2_1_9_1","first-page":"2249","article-title":"An Empirical Evaluation of Thompson Sampling","author":"Chapelle Olivier","year":"2011","unstructured":"Olivier Chapelle and Lihong Li . 2011 . An Empirical Evaluation of Thompson Sampling . In Advances in Neural Information Processing Systems. 2249 - 2257 . Olivier Chapelle and Lihong Li. 2011. An Empirical Evaluation of Thompson Sampling. In Advances in Neural Information Processing Systems. 2249-2257.","journal-title":"Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_10_1","unstructured":"Joohyun Lee Fang Liu and Ness Shroff. 2018. A Change-Detection based Framework for Piecewise-stationary Multi-Armed Bandit Problem(AAAI'18).  Joohyun Lee Fang Liu and Ness Shroff. 2018. A Change-Detection based Framework for Piecewise-stationary Multi-Armed Bandit Problem(AAAI'18)."},{"key":"e_1_3_2_1_11_1","first-page":"586","article-title":"Parametric bandits: The generalized linear case","author":"Filippi Sarah","year":"2010","unstructured":"Sarah Filippi , Olivier Cappe , Aure\u00b4lien Garivier , and Csaba Szepesv\u00e1ri . 2010 . Parametric bandits: The generalized linear case . In NIPS. 586 - 594 . Sarah Filippi, Olivier Cappe, Aure\u00b4lien Garivier, and Csaba Szepesv\u00e1ri. 2010. Parametric bandits: The generalized linear case. In NIPS. 586-594.","journal-title":"NIPS."},{"key":"e_1_3_2_1_12_1","unstructured":"Aure\u00b4lien Garivier and Eric Moulines. 2008. On upper-confidence bound policies for non-stationary bandit problems. arXiv preprint arXiv:0805.3415(2008).  Aure\u00b4lien Garivier and Eric Moulines. 2008. On upper-confidence bound policies for non-stationary bandit problems. arXiv preprint arXiv:0805.3415(2008)."},{"key":"e_1_3_2_1_13_1","first-page":"1253","volume-title":"Proceedings of the 34th International Conference on Machine Learning(Proceedings of Machine Learning Research), Doina Precup and Yee Whye Teh (Eds.)","volume":"70","author":"Gentile Claudio","year":"2017","unstructured":"Claudio Gentile , Shuai Li , Purushottam Kar , Alexandros Karatzoglou , Giovanni Zappella , and Evans Etrue . 2017 . On Context-Dependent Clustering of Bandits . In Proceedings of the 34th International Conference on Machine Learning(Proceedings of Machine Learning Research), Doina Precup and Yee Whye Teh (Eds.) , Vol. 70 . PMLR, International Convention Centre, Sydney, Australia , 1253 - 1262 . Claudio Gentile, Shuai Li, Purushottam Kar, Alexandros Karatzoglou, Giovanni Zappella, and Evans Etrue. 2017. On Context-Dependent Clustering of Bandits. In Proceedings of the 34th International Conference on Machine Learning(Proceedings of Machine Learning Research), Doina Precup and Yee Whye Teh (Eds.), Vol. 70. PMLR, International Convention Centre, Sydney, Australia, 1253-1262."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/2832747.2832852"},{"key":"e_1_3_2_1_15_1","volume-title":"Dynamic Environments and Meta-Bandits. (Nov","author":"Hartland Ce\u00b4dric","year":"2006","unstructured":"Ce\u00b4dric Hartland , Sylvain Gelly , Nicolas Baskiotis , Olivier Teytaud , and Mich\u00e8le Sebag . 2006. Multi-armed Bandit , Dynamic Environments and Meta-Bandits. (Nov . 2006 ). https:\/\/hal.archives-ouvertes.fr\/hal-00113668working paper or preprint. Ce\u00b4dric Hartland, Sylvain Gelly, Nicolas Baskiotis, Olivier Teytaud, and Mich\u00e8le Sebag. 2006. Multi-armed Bandit, Dynamic Environments and Meta-Bandits. (Nov. 2006). https:\/\/hal.archives-ouvertes.fr\/hal-00113668working paper or preprint."},{"key":"e_1_3_2_1_16_1","first-page":"1297","article-title":"Efficient Thompson Sampling for Online Matrix-Factorization Recommendation","author":"Kawale Jaya","year":"2015","unstructured":"Jaya Kawale , Hung H Bui , Branislav Kveton , Long Tran-Thanh , and Sanjay Chawla . 2015 . Efficient Thompson Sampling for Online Matrix-Factorization Recommendation . In Advances in Neural Information Processing Systems. 1297 - 1305 . Jaya Kawale, Hung H Bui, Branislav Kveton, Long Tran-Thanh, and Sanjay Chawla. 2015. Efficient Thompson Sampling for Online Matrix-Factorization Recommendation. In Advances in Neural Information Processing Systems. 1297-1305.","journal-title":"Advances in Neural Information Processing Systems."},{"volume-title":"E-Commerce and Web Technologies","author":"Kompan Michal","key":"e_1_3_2_1_17_1","unstructured":"Michal Kompan and M\u00e1ria Bielikov\u00e1 . 2010. Content-Based News Recommendation . In E-Commerce and Web Technologies , Francesco Buccafurri and Giovanni Semeraro (Eds.). Springer Berlin Heidelberg , Berlin, Heidelberg , 61-72. Michal Kompan and M\u00e1ria Bielikov\u00e1. 2010. Content-Based News Recommendation. In E-Commerce and Web Technologies, Francesco Buccafurri and Giovanni Semeraro (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 61-72."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Georgia Koutrika. 2018. Recent Advances in Recommender Systems: Matrices Bandits and Blenders. In EDBT.  Georgia Koutrika. 2018. Recent Advances in Recommender Systems: Matrices Bandits and Blenders. In EDBT.","DOI":"10.1145\/3183713.3197389"},{"key":"e_1_3_2_1_19_1","first-page":"817","article-title":"The Epoch-Greedy Algorithm for Multi-armed Bandits with Side Information","author":"Langford John","year":"2008","unstructured":"John Langford and Tong Zhang . 2008 . The Epoch-Greedy Algorithm for Multi-armed Bandits with Side Information . In NIPS. 817 - 824 . John Langford and Tong Zhang. 2008. The Epoch-Greedy Algorithm for Multi-armed Bandits with Side Information. In NIPS. 817-824.","journal-title":"NIPS."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772758"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1935826.1935878"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2009937"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835804.1835811"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1719970.1719976"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1287\/moor.24.2.293"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/1996889.1996947"},{"key":"e_1_3_2_1_27_1","first-page":"7287","article-title":"Bandit Learning with Implicit Feedback","author":"Qi Yi","year":"2018","unstructured":"Yi Qi , Qingyun Wu , Hongning Wang , Jie Tang , and Maosong Sun . 2018 . Bandit Learning with Implicit Feedback . In Advances in Neural Information Processing Systems. 7287 - 7297 . Yi Qi, Qingyun Wu, Hongning Wang, Jie Tang, and Maosong Sun. 2018. Bandit Learning with Implicit Feedback. In Advances in Neural Information Processing Systems. 7287-7297.","journal-title":"Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_28_1","unstructured":"Vishnu Raj and Sheetal Kalyani. 2017. Taming non-stationary bandits: A Bayesian approach. arXiv preprint arXiv:1707.09727(2017).  Vishnu Raj and Sheetal Kalyani. 2017. Taming non-stationary bandits: A Bayesian approach. arXiv preprint arXiv:1707.09727(2017)."},{"key":"e_1_3_2_1_29_1","volume-title":"Some aspects of the sequential design of experiments. Bull. Amer. Math. Soc. 58, 5 (09","author":"Robbins Herbert","year":"1952","unstructured":"Herbert Robbins . 1952. Some aspects of the sequential design of experiments. Bull. Amer. Math. Soc. 58, 5 (09 1952 ), 527-535. http:\/\/projecteuclid.org\/euclid.bams\/1183517370 Herbert Robbins. 1952. Some aspects of the sequential design of experiments. Bull. Amer. Math. Soc. 58, 5 (09 1952), 527-535. http:\/\/projecteuclid.org\/euclid.bams\/1183517370"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/371920.372071"},{"key":"e_1_3_2_1_31_1","volume-title":"21st Conference on Learning Theory (COLT).","author":"Slivkins Alex","year":"2008","unstructured":"Alex Slivkins and Eli Upfal . 2008 . Adapting to a Changing Environment: the Brownian Restless Bandits . In 21st Conference on Learning Theory (COLT). Alex Slivkins and Eli Upfal. 2008. Adapting to a Changing Environment: the Brownian Restless Bandits. In 21st Conference on Learning Theory (COLT)."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983323.2983847"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/3298483.3298627"},{"key":"e_1_3_2_1_34_1","volume-title":"A","author":"Whittle P.","year":"1988","unstructured":"P. Whittle . 1988. Restless bandits: activity allocation in a changing world. Journal of Applied Probability 25 , A ( 1988 ), 287-298. P. Whittle. 1988. Restless bandits: activity allocation in a changing world. Journal of Applied Probability 25, A (1988), 287-298."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210051"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911528"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3133025"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553524"}],"event":{"name":"WWW '19: The Web Conference","sponsor":["IW3C2 International World Wide Web Conference Committee"],"location":"San Francisco CA USA","acronym":"WWW '19"},"container-title":["The World Wide Web Conference"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3308558.3313727","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3308558.3313727","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:53:31Z","timestamp":1750204411000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3308558.3313727"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,5,13]]},"references-count":37,"alternative-id":["10.1145\/3308558.3313727","10.1145\/3308558"],"URL":"https:\/\/doi.org\/10.1145\/3308558.3313727","relation":{},"subject":[],"published":{"date-parts":[[2019,5,13]]},"assertion":[{"value":"2019-05-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}