{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T12:37:03Z","timestamp":1776083823088,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":22,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,8,13]],"date-time":"2017-08-13T00:00:00Z","timestamp":1502582400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,8,13]]},"DOI":"10.1145\/3097983.3098184","type":"proceedings-article","created":{"date-parts":[[2017,8,4]],"date-time":"2017-08-04T18:35:54Z","timestamp":1501871754000},"page":"1813-1821","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":55,"title":["An Efficient Bandit Algorithm for Realtime Multivariate Optimization"],"prefix":"10.1145","author":[{"given":"Daniel N.","family":"Hill","sequence":"first","affiliation":[{"name":"Amazon.com, Inc., Palo Alto, CA, USA"}]},{"given":"Houssam","family":"Nassif","sequence":"additional","affiliation":[{"name":"Amazon.com, Inc., Seattle, WA, USA"}]},{"given":"Yi","family":"Liu","sequence":"additional","affiliation":[{"name":"Amazon.com, Inc., Seattle, WA, USA"}]},{"given":"Anand","family":"Iyer","sequence":"additional","affiliation":[{"name":"Amazon.com, Inc., Seattle, WA, USA"}]},{"given":"S.V.N.","family":"Vishwanathan","sequence":"additional","affiliation":[{"name":"Amazon.com, Inc. & University of California, Santa Cruz, Palo Alto, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2017,8,13]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Shipra Agrawal and Navin Goyal 2012. Analysis of Thompson Sampling for the Multi-armed Bandit Problem. COLT. 39--1.  Shipra Agrawal and Navin Goyal 2012. Analysis of Thompson Sampling for the Multi-armed Bandit Problem. COLT. 39--1."},{"key":"e_1_3_2_1_2_1","volume-title":"Thompson Sampling for Contextual Bandits with Linear Payoffs Proceedings of the 30th International Conference on Machine Learning (ICML). JMLR","author":"Agrawal Shipra","year":"2013","unstructured":"Shipra Agrawal and Navin Goyal 2013 . Thompson Sampling for Contextual Bandits with Linear Payoffs Proceedings of the 30th International Conference on Machine Learning (ICML). JMLR , Atlanta, Georgia, 127--135. Shipra Agrawal and Navin Goyal 2013. Thompson Sampling for Contextual Bandits with Linear Payoffs Proceedings of the 30th International Conference on Machine Learning (ICML). JMLR, Atlanta, Georgia, 127--135."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.50"},{"key":"e_1_3_2_1_4_1","volume-title":"Statistics for experimenters: design, innovation, and discovery","author":"Box George EP","unstructured":"George EP Box , J Stuart Hunter , and William Gordon Hunter . 2005. Statistics for experimenters: design, innovation, and discovery . Vol. Vol. 2 . Wiley-Interscience New York . George EP Box, J Stuart Hunter, and William Gordon Hunter. 2005. Statistics for experimenters: design, innovation, and discovery. Vol. Vol. 2. Wiley-Interscience New York."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1561\/2200000024"},{"key":"e_1_3_2_1_6_1","volume-title":"Statistical inference","author":"Casella George","unstructured":"George Casella and Roger L Berger 2002. Statistical inference . Vol. Vol. 2 . Duxbury Pacific Grove , CA. George Casella and Roger L Berger 2002. Statistical inference. Vol. Vol. 2. Duxbury Pacific Grove, CA."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcss.2012.01.001"},{"key":"e_1_3_2_1_8_1","unstructured":"Olivier Chapelle and Lihong Li 2011. An empirical evaluation of thompson sampling. In Advances in neural information processing systems. 2249--2257.  Olivier Chapelle and Lihong Li 2011. An empirical evaluation of thompson sampling. In Advances in neural information processing systems. 2249--2257."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Flavio Chierichetti Ravi Kumar and Prabhakar Raghavan. 2011. Optimizing two-dimensional search results presentation Proceedings of the fourth ACM international conference on Web search and data mining. ACM 257--266.  Flavio Chierichetti Ravi Kumar and Prabhakar Raghavan. 2011. Optimizing two-dimensional search results presentation Proceedings of the fourth ACM international conference on Web search and data mining. ACM 257--266.","DOI":"10.1145\/1935826.1935873"},{"key":"e_1_3_2_1_10_1","volume-title":"Sample size calculations in clinical research","author":"Chow Shein-Chung","unstructured":"Shein-Chung Chow , Hansheng Wang , and Jun Shao 2007. Sample size calculations in clinical research . CRC press . Shein-Chung Chow, Hansheng Wang, and Jun Shao 2007. Sample size calculations in clinical research. CRC press."},{"key":"e_1_3_2_1_11_1","volume-title":"Kakade","author":"Dani Varsha","year":"2008","unstructured":"Varsha Dani , Thomas P. Hayes , and Sham M . Kakade . 2008 . Stochastic Linear Optimization under Bandit Feedback Proceedings of the 21st Annual Conference on Learning Theory (COLT). Helsinki, Finland , 355--366. Varsha Dani, Thomas P. Hayes, and Sham M. Kakade. 2008. Stochastic Linear Optimization under Bandit Feedback Proceedings of the 21st Annual Conference on Learning Theory (COLT). Helsinki, Finland, 355--366."},{"key":"e_1_3_2_1_12_1","volume-title":"Proceedings of International Conference on Machine Learning (ICML)","author":"Graepel Thore","year":"2010","unstructured":"Thore Graepel , Joaquin Q Candela , Thomas Borchert , and Ralf Herbrich 2010 . Web-scale bayesian click-through rate prediction for sponsored search advertising in microsoft's bing search engine . In Proceedings of International Conference on Machine Learning (ICML) . Haifa, Israel, 13--20. Thore Graepel, Joaquin Q Candela, Thomas Borchert, and Ralf Herbrich 2010. Web-scale bayesian click-through rate prediction for sponsored search advertising in microsoft's bing search engine. In Proceedings of International Conference on Machine Learning (ICML). Haifa, Israel, 13--20."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1080\/07408170500488964"},{"key":"e_1_3_2_1_14_1","volume-title":"A contextual-bandit approach to personalized news article recommendation Proceedings of the 19th international conference on World wide web. ACM, 661--670","author":"Li Lihong","unstructured":"Lihong Li , Wei Chu , John Langford , and Robert E Schapire . 2010. A contextual-bandit approach to personalized news article recommendation Proceedings of the 19th international conference on World wide web. ACM, 661--670 . Lihong Li, Wei Chu, John Langford, and Robert E Schapire. 2010. A contextual-bandit approach to personalized news article recommendation Proceedings of the 19th international conference on World wide web. ACM, 661--670."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0377-2217(99)00262-3"},{"key":"e_1_3_2_1_16_1","unstructured":"Karthik Mohan and Ofer Dekel 2011. Online bipartite matching with partially-bandit feedback Proceedings of NIPS workshop on Discrete optimization in Machine Learning. Granada Spain 1--7.  Karthik Mohan and Ofer Dekel 2011. Online bipartite matching with partially-bandit feedback Proceedings of NIPS workshop on Discrete optimization in Machine Learning. Granada Spain 1--7."},{"key":"e_1_3_2_1_17_1","volume-title":"Proceedings of Machine Learning for Music Discovery Workshop at 33rd International Conference on Machine Learning (ICML).","author":"Nassif Houssam","year":"2016","unstructured":"Houssam Nassif , Kemal Oral Cansizlar , Mitchell Goodman , and S. V. N. Vishwanathan 2016 . Diversifying Music Recommendations . In Proceedings of Machine Learning for Music Discovery Workshop at 33rd International Conference on Machine Learning (ICML). Houssam Nassif, Kemal Oral Cansizlar, Mitchell Goodman, and S. V. N. Vishwanathan 2016. Diversifying Music Recommendations. In Proceedings of Machine Learning for Music Discovery Workshop at 33rd International Conference on Machine Learning (ICML)."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2010.127"},{"key":"e_1_3_2_1_19_1","volume-title":"Automatic ad format selection via contextual bandits Proceedings of the 22nd ACM international conference on Conference on information & knowledge management. ACM, 1587--1594","author":"Tang Liang","unstructured":"Liang Tang , Romer Rosales , Ajit Singh , and Deepak Agarwal 2013. Automatic ad format selection via contextual bandits Proceedings of the 22nd ACM international conference on Conference on information & knowledge management. ACM, 1587--1594 . Liang Tang, Romer Rosales, Ajit Singh, and Deepak Agarwal 2013. Automatic ad format selection via contextual bandits Proceedings of the 22nd ACM international conference on Conference on information & knowledge management. ACM, 1587--1594."},{"key":"e_1_3_2_1_20_1","volume-title":"Personalized Diversity for Visual Discovery Proceedings of the 10th ACM Conference on Recommender Systems (RecSys). ACM","author":"Teo Choon Hui","year":"2016","unstructured":"Choon Hui Teo , Houssam Nassif , Daniel Hill , Sriram Srinivasan , Mitchell Goodman , Vijai Mohan , and S.V.N. Vishwanathan 2016 . Adaptive , Personalized Diversity for Visual Discovery Proceedings of the 10th ACM Conference on Recommender Systems (RecSys). ACM , Boston, 35--38. Choon Hui Teo, Houssam Nassif, Daniel Hill, Sriram Srinivasan, Mitchell Goodman, Vijai Mohan, and S.V.N. Vishwanathan 2016. Adaptive, Personalized Diversity for Visual Discovery Proceedings of the 10th ACM Conference on Recommender Systems (RecSys). ACM, Boston, 35--38."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Yue Wang Dawei Yin Luo Jie Pengyuan Wang Makoto Yamada Yi Chang and Qiaozhu Mei 2016. Beyond ranking: Optimizing whole-page presentation Proceedings of the Ninth ACM International Conference on Web Search and Data Mining. ACM 103--112.  Yue Wang Dawei Yin Luo Jie Pengyuan Wang Makoto Yamada Yi Chang and Qiaozhu Mei 2016. Beyond ranking: Optimizing whole-page presentation Proceedings of the Ninth ACM International Conference on Web Search and Data Mining. ACM 103--112.","DOI":"10.1145\/2835776.2835824"},{"key":"e_1_3_2_1_22_1","unstructured":"Yisong Yue and Carlos Guestrin 2011. Linear submodular bandits and their application to diversified retrieval Advances in Neural Information Processing Systems. 2483--2491.  Yisong Yue and Carlos Guestrin 2011. Linear submodular bandits and their application to diversified retrieval Advances in Neural Information Processing Systems. 2483--2491."}],"event":{"name":"KDD '17: The 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","location":"Halifax NS Canada","acronym":"KDD '17","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3097983.3098184","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3097983.3098184","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:30:02Z","timestamp":1750217402000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3097983.3098184"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,8,13]]},"references-count":22,"alternative-id":["10.1145\/3097983.3098184","10.1145\/3097983"],"URL":"https:\/\/doi.org\/10.1145\/3097983.3098184","relation":{},"subject":[],"published":{"date-parts":[[2017,8,13]]},"assertion":[{"value":"2017-08-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}