{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T12:12:35Z","timestamp":1784203955757,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":27,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,6,27]],"date-time":"2018-06-27T00:00:00Z","timestamp":1530057600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1553568, IIS-1618948"],"award-info":[{"award-number":["IIS-1553568, IIS-1618948"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,6,27]]},"DOI":"10.1145\/3209978.3210051","type":"proceedings-article","created":{"date-parts":[[2018,7,2]],"date-time":"2018-07-02T12:12:40Z","timestamp":1530533560000},"page":"495-504","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":42,"title":["Learning Contextual Bandits in a Non-stationary Environment"],"prefix":"10.1145","author":[{"given":"Qingyun","family":"Wu","sequence":"first","affiliation":[{"name":"University of Virginia, Charlottesville, VA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Naveen","family":"Iyer","sequence":"additional","affiliation":[{"name":"University of Virginia, Charlottesville, VA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongning","family":"Wang","sequence":"additional","affiliation":[{"name":"University of Virginia, Charlottesville, VA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,6,27]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Yasin Abbasi-yadkori D\u00e1vid P\u00e1l and Csaba Szepesv\u00e1ri . 2011. Improved Algorithms for Linear Stochastic Bandits. NIPS. 2312--2320.   Yasin Abbasi-yadkori D\u00e1vid P\u00e1l and Csaba Szepesv\u00e1ri . 2011. Improved Algorithms for Linear Stochastic Bandits. NIPS. 2312--2320."},{"key":"e_1_3_2_1_2_1","first-page":"397","article-title":"Using Confidence Bounds for Exploitation-Exploration Trade-offs","volume":"3","author":"Peter Auer","year":"2002","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1013689704352"},{"key":"e_1_3_2_1_4_1","volume-title":"Proceedings., 36th Annual Symposium on. 322--331","author":"Auer P."},{"key":"e_1_3_2_1_5_1","volume-title":"Pro. NIPS","author":"Cesa-Bianchi Nicol\u00f2","year":"2013"},{"key":"e_1_3_2_1_6_1","volume-title":"AISTATS'11","author":"Chu Wei","year":"2011"},{"key":"e_1_3_2_1_7_1","unstructured":"Robert B Cialdini and Melanie R Trost . 1998. Social influence: Social norms conformity and compliance. (1998).  Robert B Cialdini and Melanie R Trost . 1998. Social influence: Social norms conformity and compliance. (1998)."},{"key":"e_1_3_2_1_8_1","unstructured":"Joohyun Lee Fang Liu and Ness Shroff . 2018. A Change-Detection based Framework for Piecewise-stationary Multi-Armed Bandit Problem (AAAI'18).  Joohyun Lee Fang Liu and Ness Shroff . 2018. A Change-Detection based Framework for Piecewise-stationary Multi-Armed Bandit Problem (AAAI'18)."},{"key":"e_1_3_2_1_9_1","unstructured":"Sarah Filippi Olivier Cappe Aur\u00e9lien Garivier and Csaba Szepesv\u00e1ri . 2010. Parametric bandits: The generalized linear case. NIPS. 586--594.   Sarah Filippi Olivier Cappe Aur\u00e9lien Garivier and Csaba Szepesv\u00e1ri . 2010. Parametric bandits: The generalized linear case. NIPS. 586--594."},{"key":"e_1_3_2_1_10_1","unstructured":"Aur\u00e9lien Garivier and Eric Moulines On Upper-Confidence Bound Policies for Non-stationary Bandit Problems arXiv preprint arXiv:0805.3415 (2008).  Aur\u00e9lien Garivier and Eric Moulines On Upper-Confidence Bound Policies for Non-stationary Bandit Problems arXiv preprint arXiv:0805.3415 (2008)."},{"key":"e_1_3_2_1_11_1","volume-title":"On Context-Dependent Clustering of Bandits. In ICML'17","author":"Gentile Claudio","year":"2017"},{"key":"e_1_3_2_1_12_1","volume-title":"Online Clustering of Bandits. In ICML'14","author":"Gentile Claudio","year":"2014"},{"key":"e_1_3_2_1_13_1","volume-title":"Sayak Ray Chowdhury, and Aditya Gopalan","author":"Ghosh Avishek","year":"2017"},{"key":"e_1_3_2_1_14_1","series-title":"Series B (Methodological)","volume-title":"Bandit processes and dynamic allocation indices. Journal of the Royal Statistical Society","author":"Gittins John C","year":"1979"},{"key":"e_1_3_2_1_15_1","unstructured":"Negar Hariri Bamshad Mobasher and Robin Burke Adapting to User Preference Changes in Interactive Recommendation.  Negar Hariri Bamshad Mobasher and Robin Burke Adapting to User Preference Changes in Interactive Recommendation."},{"key":"e_1_3_2_1_16_1","volume-title":"Dynamic Environments and Meta-Bandits. (Nov","author":"Hartland Cedric","year":"2006"},{"key":"e_1_3_2_1_17_1","unstructured":"John Langford and Tong Zhang . 2008. The epoch-greedy algorithm for multi-armed bandits with side information NIPS. 817--824.   John Langford and Tong Zhang . 2008. The epoch-greedy algorithm for multi-armed bandits with side information NIPS. 817--824."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772758"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1935826.1935878"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911548"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835804.1835811"},{"key":"e_1_3_2_1_22_1","volume-title":"Efficient Contextual Bandits in Non-stationary Worlds. arXiv preprint arXiv:1708.01799","author":"Luo Haipeng","year":"2017"},{"key":"e_1_3_2_1_23_1","unstructured":"Alex Slivkins and Eli Upfal . 2008. Adapting to a Changing Environment: the Brownian Restless Bandits In COLT08'. 343--354.  Alex Slivkins and Eli Upfal . 2008. Adapting to a Changing Environment: the Brownian Restless Bandits In COLT08'. 343--354."},{"key":"e_1_3_2_1_24_1","unstructured":"Huazheng Wang Qingyun Wu and Hongning Wang . 2017. Factorization Bandits for Interactive Recommendation. AAAI. 2695--2702.  Huazheng Wang Qingyun Wu and Hongning Wang . 2017. Factorization Bandits for Interactive Recommendation. AAAI. 2695--2702."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911528"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553524"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553527"}],"event":{"name":"SIGIR '18: The 41st International ACM SIGIR conference on research and development in Information Retrieval","location":"Ann Arbor MI USA","acronym":"SIGIR '18","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3209978.3210051","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3209978.3210051","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3209978.3210051","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:07:49Z","timestamp":1750212469000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3209978.3210051"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,27]]},"references-count":27,"alternative-id":["10.1145\/3209978.3210051","10.1145\/3209978"],"URL":"https:\/\/doi.org\/10.1145\/3209978.3210051","relation":{},"subject":[],"published":{"date-parts":[[2018,6,27]]},"assertion":[{"value":"2018-06-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}