{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:18:40Z","timestamp":1750220320506,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":48,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,11,1]],"date-time":"2021-11-01T00:00:00Z","timestamp":1635724800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,11]]},"DOI":"10.1145\/3472883.3487001","type":"proceedings-article","created":{"date-parts":[[2021,10,27]],"date-time":"2021-10-27T10:48:16Z","timestamp":1635331696000},"page":"273-288","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Sayer"],"prefix":"10.1145","author":[{"given":"Mathias","family":"L\u00e9cuyer","sequence":"first","affiliation":[{"name":"University of British Columbia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sang Hoon","family":"Kim","sequence":"additional","affiliation":[{"name":"Columbia University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mihir","family":"Nanavati","sequence":"additional","affiliation":[{"name":"Twitter"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junchen","family":"Jiang","sequence":"additional","affiliation":[{"name":"University of Chicago"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Siddhartha","family":"Sen","sequence":"additional","affiliation":[{"name":"Microsoft Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aleksandrs","family":"Slivkins","sequence":"additional","affiliation":[{"name":"Microsoft Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amit","family":"Sharma","sequence":"additional","affiliation":[{"name":"Microsoft Research"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,11]]},"reference":[{"key":"e_1_3_2_2_1_1","first-page":"4","article-title":"CherryPick: Adaptively Unearthing the Best Cloud Configurations for Big Data Analytics","volume":"2","author":"Alipourfard Omid","year":"2017","unstructured":"Omid Alipourfard , Hongqiang Harry Liu , Jianshu Chen , Shivaram Venkataraman , Minlan Yu , and Ming Zhang . 2017 . CherryPick: Adaptively Unearthing the Best Cloud Configurations for Big Data Analytics .. In NSDI , Vol. 2. 4 -- 2 . Omid Alipourfard, Hongqiang Harry Liu, Jianshu Chen, Shivaram Venkataraman, Minlan Yu, and Ming Zhang. 2017. CherryPick: Adaptively Unearthing the Best Cloud Configurations for Big Data Analytics.. In NSDI, Vol. 2. 4--2.","journal-title":"NSDI"},{"key":"e_1_3_2_2_2_1","unstructured":"Noga Alon Nicol\u00c32 Cesa-Bianchi Claudio Gentile and Yishay Mansour. 2013. From Bandits to Experts: A Tale of Domination and Independence. In Advances in Neural Information Processing Systems (NIPS). 1610--1618.  Noga Alon Nicol\u00c32 Cesa-Bianchi Claudio Gentile and Yishay Mansour. 2013. From Bandits to Experts: A Tale of Domination and Independence. In Advances in Neural Information Processing Systems (NIPS). 1610--1618."},{"volume-title":"10th { USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 13). 185--198.","author":"Ananthanarayanan Ganesh","key":"e_1_3_2_2_3_1","unstructured":"Ganesh Ananthanarayanan , Ali Ghodsi , Scott Shenker , and Ion Stoica . 2013. Effective straggler mitigation: Attack of the clones . In 10th { USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 13). 185--198. Ganesh Ananthanarayanan, Ali Ghodsi, Scott Shenker, and Ion Stoica. 2013. Effective straggler mitigation: Attack of the clones. In 10th { USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 13). 185--198."},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3152434.3152448"},{"key":"e_1_3_2_2_5_1","volume-title":"Goodman","author":"Bingham Eli","year":"2018","unstructured":"Eli Bingham , Jonathan P. Chen , Martin Jankowiak , Fritz Obermeyer , Neeraj Pradhan , Theofanis Karaletsos , Rohit Singh , Paul Szerlip , Paul Horsfall , and Noah D . Goodman . 2018 . Pyro : Deep Universal Probabilistic Programming. Journal of Machine Learning Research ( 2018). Eli Bingham, Jonathan P. Chen, Martin Jankowiak, Fritz Obermeyer, Neeraj Pradhan, Theofanis Karaletsos, Rohit Singh, Paul Szerlip, Paul Horsfall, and Noah D. Goodman. 2018. Pyro: Deep Universal Probabilistic Programming. Journal of Machine Learning Research (2018)."},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/2567709.2567766"},{"key":"e_1_3_2_2_7_1","volume-title":"Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics. 208--214","author":"Chu Wei","year":"2011","unstructured":"Wei Chu , Lihong Li , Lev Reyzin , and Robert Schapire . 2011 . Contextual bandits with linear payoff functions . In Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics. 208--214 . Wei Chu, Lihong Li, Lev Reyzin, and Robert Schapire. 2011. Contextual bandits with linear payoff functions. In Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics. 208--214."},{"key":"e_1_3_2_2_8_1","volume-title":"Symposium on Networked Systems Design and Implementation (NSDI).","author":"Dong Mo","year":"2015","unstructured":"Mo Dong , Qingxi Li , Doron Zarchy , P Brighten Godfrey , and Michael Schapira . 2015 . PCC: Re-architecting congestion control for consistent high performance . In Symposium on Networked Systems Design and Implementation (NSDI). Mo Dong, Qingxi Li, Doron Zarchy, P Brighten Godfrey, and Michael Schapira. 2015. PCC: Re-architecting congestion control for consistent high performance. In Symposium on Networked Systems Design and Implementation (NSDI)."},{"key":"e_1_3_2_2_9_1","volume-title":"Symposium on Networked Systems Design and Implementation (NSDI).","author":"Dong Mo","year":"2018","unstructured":"Mo Dong , Tong Meng , Doron Zarchy , Engin Arslan , Yossi Gilad , Brighten Godfrey , and Michael Schapira . 2018 . PCC vivace: Online-learning congestion control . In Symposium on Networked Systems Design and Implementation (NSDI). Mo Dong, Tong Meng, Doron Zarchy, Engin Arslan, Yossi Gilad, Brighten Godfrey, and Michael Schapira. 2018. PCC vivace: Online-learning congestion control. In Symposium on Networked Systems Design and Implementation (NSDI)."},{"key":"e_1_3_2_2_10_1","unstructured":"Miroslav Dud\u00edk Dumitru Erhan John Langford and Lihong Li. 2014. Doubly robust policy evaluation and optimization. Statist. Sci. (2014) 485--511.  Miroslav Dud\u00edk Dumitru Erhan John Langford and Lihong Li. 2014. Doubly robust policy evaluation and optimization. Statist. Sci. (2014) 485--511."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/3020548.3020569"},{"key":"e_1_3_2_2_12_1","volume-title":"Bootstrap Methods: Another Look at the Jackknife. The Annals of Statistics","author":"Efron B","year":"1979","unstructured":"B Efron . 1979 . Bootstrap Methods: Another Look at the Jackknife. The Annals of Statistics (1979). B Efron. 1979. Bootstrap Methods: Another Look at the Jackknife. The Annals of Statistics (1979)."},{"key":"e_1_3_2_2_13_1","first-page":"1","article-title":"Effective Data-Race Detection for the Kernel","volume":"10","author":"Erickson John","year":"2010","unstructured":"John Erickson , Madanlal Musuvathi , Sebastian Burckhardt , and Kirk Olynyk . 2010 . Effective Data-Race Detection for the Kernel .. In OSDI , Vol. 10. 1 -- 16 . John Erickson, Madanlal Musuvathi, Sebastian Burckhardt, and Kirk Olynyk. 2010. Effective Data-Race Detection for the Kernel.. In OSDI, Vol. 10. 1--16.","journal-title":"OSDI"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/90.944338"},{"key":"e_1_3_2_2_15_1","unstructured":"Silvery Fu Saurabh Gupta Radhika Mittal and Sylvia Ratnasamy. 2021. On the Use of ML for Blackbox System Performance Prediction.. In NSDI. 763--784.  Silvery Fu Saurabh Gupta Radhika Mittal and Sylvia Ratnasamy. 2021. On the Use of ML for Blackbox System Performance Prediction.. In NSDI. 763--784."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1952.10483446"},{"key":"e_1_3_2_2_17_1","volume-title":"Rubin","author":"Imbens Guido W.","year":"2015","unstructured":"Guido W. Imbens and Donald B . Rubin . 2015 . Causal Inference for Statistics, Social , and Biomedical Sciences: An Introduction. Cambridge University Press . Guido W. Imbens and Donald B. Rubin. 2015. Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction. Cambridge University Press."},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2934872.2934907"},{"key":"e_1_3_2_2_19_1","volume-title":"CFA: A Practical Prediction System for Video QoE Optimization.. In NSDI. 137--150.","author":"Jiang Junchen","year":"2016","unstructured":"Junchen Jiang , Vyas Sekar , Henry Milner , Davis Shepherd , Ion Stoica , and Hui Zhang . 2016 . CFA: A Practical Prediction System for Video QoE Optimization.. In NSDI. 137--150. Junchen Jiang, Vyas Sekar, Henry Milner, Davis Shepherd, Ion Stoica, and Hui Zhang. 2016. CFA: A Practical Prediction System for Video QoE Optimization.. In NSDI. 137--150."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2934872.2934882"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"crossref","unstructured":"Thorsten Joachims and Adith Swaminathan. 2016. Tutorial on Counterfactual Evaluation and Learning for Search Recommendation and Ad Placement. http:\/\/www.cs.cornell.edu\/~adith\/CfactSIGIR2016\/ A tutorial at SIGIR 2016.  Thorsten Joachims and Adith Swaminathan. 2016. Tutorial on Counterfactual Evaluation and Learning for Search Recommendation and Ad Placement. http:\/\/www.cs.cornell.edu\/~adith\/CfactSIGIR2016\/ A tutorial at SIGIR 2016.","DOI":"10.1145\/2911451.2914803"},{"key":"e_1_3_2_2_22_1","volume-title":"Selecta: Heterogeneous cloud storage configuration for data analytics. In 2018 {USENIX} Annual Technical Conference ({USENIX}{ATC} 18). 759--773.","author":"Klimovic Ana","year":"2018","unstructured":"Ana Klimovic , Heiner Litz , and Christos Kozyrakis . 2018 . Selecta: Heterogeneous cloud storage configuration for data analytics. In 2018 {USENIX} Annual Technical Conference ({USENIX}{ATC} 18). 759--773. Ana Klimovic, Heiner Litz, and Christos Kozyrakis. 2018. Selecta: Heterogeneous cloud storage configuration for data analytics. In 2018 {USENIX} Annual Technical Conference ({USENIX}{ATC} 18). 759--773."},{"volume-title":"Encyclopedia of Machine Learning and Data Mining","author":"Kohavi Ron","key":"e_1_3_2_2_23_1","unstructured":"Ron Kohavi and Roger Longbotham . 2015. Online Controlled Experiments and A\/B Tests . In Encyclopedia of Machine Learning and Data Mining , Claude Sammut and Geoff Webb (Ed.). Springer . To appear. Ron Kohavi and Roger Longbotham. 2015. Online Controlled Experiments and A\/B Tests. In Encyclopedia of Machine Learning and Data Mining, Claude Sammut and Geoff Webb (Ed.). Springer. To appear."},{"key":"e_1_3_2_2_24_1","volume-title":"Henne","author":"Kohavi Ron","year":"2009","unstructured":"Ron Kohavi , Roger Longbotham , Dan Sommerfield , and Randal M . Henne . 2009 . Controlled experiments on the web: survey and practical guide. Data Min. Knowl. Discov . (2009). Ron Kohavi, Roger Longbotham, Dan Sommerfield, and Randal M. Henne. 2009. Controlled experiments on the web: survey and practical guide. Data Min. Knowl. Discov. (2009)."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2013.2281542"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901318.2901351"},{"key":"e_1_3_2_2_27_1","volume-title":"Exploration Scavenging. In Intl. Conf. on Machine Learning (ICML).","author":"Langford John","year":"2008","unstructured":"John Langford , Alexander Strehl , and Jennifer Wortman . 2008 . Exploration Scavenging. In Intl. Conf. on Machine Learning (ICML). John Langford, Alexander Strehl, and Jennifer Wortman. 2008. Exploration Scavenging. In Intl. Conf. on Machine Learning (ICML)."},{"key":"e_1_3_2_2_28_1","unstructured":"John Langford and Tong Zhang. 2007. The Epoch-Greedy Algorithm for Contextual Multi-armed Bandits. In Advances in Neural Information Processing Systems (NIPS).  John Langford and Tong Zhang. 2007. The Epoch-Greedy Algorithm for Contextual Multi-armed Bandits. In Advances in Neural Information Processing Systems (NIPS)."},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3152434.3152435"},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.14778\/3352063.3352129"},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772758"},{"key":"e_1_3_2_2_32_1","first-page":"1","article-title":"Efficiently Delivering Online Services over Integrated Infrastructure","volume":"1","author":"Liu Hongqiang Harry","year":"2016","unstructured":"Hongqiang Harry Liu , Raajay Viswanathan , Matt Calder , Aditya Akella , Ratul Mahajan , Jitendra Padhye , and Ming Zhang . 2016 . Efficiently Delivering Online Services over Integrated Infrastructure .. In NSDI , Vol. 1. 1 . Hongqiang Harry Liu, Raajay Viswanathan, Matt Calder, Aditya Akella, Ratul Mahajan, Jitendra Padhye, and Ming Zhang. 2016. Efficiently Delivering Online Services over Integrated Infrastructure.. In NSDI, Vol. 1. 1.","journal-title":"NSDI"},{"key":"e_1_3_2_2_33_1","unstructured":"Shie Mannor and Ohad Shamir. 2011. From Bandits to Experts: On the Value of Side-Observations. In Advances in Neural Information Processing Systems (NIPS). 684--692.  Shie Mannor and Ohad Shamir. 2011. From Bandits to Experts: On the Value of Side-Observations. In Advances in Neural Information Processing Systems (NIPS). 684--692."},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3098822.3098843"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3190508.3190517"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/82.4.805"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3405671.3405815"},{"key":"e_1_3_2_2_38_1","volume-title":"Off-policy evaluation for slate recommendation. CoRR","author":"Swaminathan Adith","year":"2016","unstructured":"Adith Swaminathan , Akshay Krishnamurthy , Alekh Agarwal , Miroslav Dud\u00edk , John Langford 0001, Damien Jose , and Imed Zitouni . 2016. Off-policy evaluation for slate recommendation. CoRR ( 2016 ). Adith Swaminathan, Akshay Krishnamurthy, Alekh Agarwal, Miroslav Dud\u00edk, John Langford 0001, Damien Jose, and Imed Zitouni. 2016. Off-policy evaluation for slate recommendation. CoRR (2016)."},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1402958.1402971"},{"key":"e_1_3_2_2_40_1","volume-title":"Reinforcement learning in autonomic computing: A manifesto and case studies","author":"Tesauro Gerald","year":"2007","unstructured":"Gerald Tesauro . 2007. Reinforcement learning in autonomic computing: A manifesto and case studies . IEEE Internet Computing 11, 1 ( 2007 ). Gerald Tesauro. 2007. Reinforcement learning in autonomic computing: A manifesto and case studies. IEEE Internet Computing 11, 1 (2007)."},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3035918.3064029"},{"key":"e_1_3_2_2_42_1","volume-title":"Ernest: Efficient performance prediction for large-scale advanced analytics. In 13th { USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 16). 363--378.","author":"Venkataraman Shivaram","year":"2016","unstructured":"Shivaram Venkataraman , Zongheng Yang , Michael Franklin , Benjamin Recht , and Ion Stoica . 2016 . Ernest: Efficient performance prediction for large-scale advanced analytics. In 13th { USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 16). 363--378. Shivaram Venkataraman, Zongheng Yang, Michael Franklin, Benjamin Recht, and Ion Stoica. 2016. Ernest: Efficient performance prediction for large-scale advanced analytics. In 13th { USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 16). 363--378."},{"key":"e_1_3_2_2_43_1","unstructured":"Vowpal Wabbit [n.d.]. Vowpal Wabbit (Fast Learning). http:\/\/hunch.net\/~vw\/.  Vowpal Wabbit [n.d.]. Vowpal Wabbit (Fast Learning). http:\/\/hunch.net\/~vw\/."},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3127479.3131614"},{"key":"e_1_3_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2785956.2787486"},{"key":"e_1_3_2_2_46_1","first-page":"7","article-title":"Improving MapReduce performance in heterogeneous environments","volume":"8","author":"Zaharia Matei","year":"2008","unstructured":"Matei Zaharia , Andy Konwinski , Anthony D Joseph , Randy H Katz , and Ion Stoica . 2008 . Improving MapReduce performance in heterogeneous environments .. In Osdi , Vol. 8. 7 . Matei Zaharia, Andy Konwinski, Anthony D Joseph, Randy H Katz, and Ion Stoica. 2008. Improving MapReduce performance in heterogeneous environments.. In Osdi, Vol. 8. 7.","journal-title":"Osdi"},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3300085"},{"key":"e_1_3_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3127479.3128605"}],"event":{"name":"SoCC '21: ACM Symposium on Cloud Computing","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGOPS ACM Special Interest Group on Operating Systems"],"location":"Seattle WA USA","acronym":"SoCC '21"},"container-title":["Proceedings of the ACM Symposium on Cloud Computing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3472883.3487001","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3472883.3487001","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:11:57Z","timestamp":1750191117000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3472883.3487001"}},"subtitle":["Using Implicit Feedback to Optimize System Policies"],"short-title":[],"issued":{"date-parts":[[2021,11]]},"references-count":48,"alternative-id":["10.1145\/3472883.3487001","10.1145\/3472883"],"URL":"https:\/\/doi.org\/10.1145\/3472883.3487001","relation":{},"subject":[],"published":{"date-parts":[[2021,11]]},"assertion":[{"value":"2021-11-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}