{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,29]],"date-time":"2026-03-29T15:22:57Z","timestamp":1774797777205,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":53,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,5,31]],"date-time":"2020-05-31T00:00:00Z","timestamp":1590883200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000185","name":"Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","award":["FA8750-17-2-0126"],"award-info":[{"award-number":["FA8750-17-2-0126"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,6,11]]},"DOI":"10.1145\/3318464.3386146","type":"proceedings-article","created":{"date-parts":[[2020,5,29]],"date-time":"2020-05-29T17:12:33Z","timestamp":1590772353000},"page":"785-800","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":30,"title":["The Machine Learning Bazaar: Harnessing the ML Ecosystem for Effective System Development"],"prefix":"10.1145","author":[{"given":"Micah J.","family":"Smith","sequence":"first","affiliation":[{"name":"Massachusetts Institute of Technology, Cambridge, MA, USA"}]},{"given":"Carles","family":"Sala","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, Cambridge, MA, USA"}]},{"given":"James Max","family":"Kanter","sequence":"additional","affiliation":[{"name":"Feature Labs, Boston, MA, USA"}]},{"given":"Kalyan","family":"Veeramachaneni","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, Cambridge, MA, USA"}]}],"member":"320","published-online":{"date-parts":[[2020,5,31]]},"reference":[{"key":"e_1_3_2_2_1_1","unstructured":"Mart\u00edn Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado Andy Davis Jeffrey Dean Matthieu Devin Sanjay Ghemawat Ian Goodfellow Andrew Harp GeoffreyIrving Michael Isard Yangqing Jia Rafal Jozefowicz Lukasz Kaiser Manjunath Kudlur Josh Levenberg Dandelion Man\u00e9 Rajat Monga Sherry Moore Derek Murray Chris Olah Mike Schuster JonathonShlens Benoit Steiner Ilya Sutskever Kunal Talwar Paul Tucker Vincent Vanhoucke Vijay Vasudevan Fernanda Vi\u00e9gas Oriol Vinyals Pete Warden Martin Wattenberg Martin Wicke Yuan Yu and Xi-aoqiang Zheng. 2015. TensorFlow: Large-Scale Machine Learningon Heterogeneous Systems. https:\/\/www.tensorflow.org\/ Software available from tensorflow.org.  Mart\u00edn Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado Andy Davis Jeffrey Dean Matthieu Devin Sanjay Ghemawat Ian Goodfellow Andrew Harp GeoffreyIrving Michael Isard Yangqing Jia Rafal Jozefowicz Lukasz Kaiser Manjunath Kudlur Josh Levenberg Dandelion Man\u00e9 Rajat Monga Sherry Moore Derek Murray Chris Olah Mike Schuster JonathonShlens Benoit Steiner Ilya Sutskever Kunal Talwar Paul Tucker Vincent Vanhoucke Vijay Vasudevan Fernanda Vi\u00e9gas Oriol Vinyals Pete Warden Martin Wattenberg Martin Wicke Yuan Yu and Xi-aoqiang Zheng. 2015. TensorFlow: Large-Scale Machine Learningon Heterogeneous Systems. https:\/\/www.tensorflow.org\/ Software available from tensorflow.org."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"crossref","unstructured":"Peter Auer Nicolo Cesa-Bianchi and Paul Fischer. 2002. Finite-time analysis of the multiarmed bandit problem. Machine learning47 2--3(2002) 235--256.  Peter Auer Nicolo Cesa-Bianchi and Paul Fischer. 2002. Finite-time analysis of the multiarmed bandit problem. Machine learning47 2--3(2002) 235--256.","DOI":"10.1023\/A:1013689704352"},{"key":"e_1_3_2_2_3_1","unstructured":"Denis Baylor Eric Breck Heng-Tze Cheng Noah Fiedel Chuan Yu Foo Zakaria Haque Salem Haykal Mustafa Ispir Vihan Jain Levent Koc Chiu Yuen Koo Lukasz Lew Clemens Mewald Akshay Naresh Modi Neoklis Polyzotis Sukriti Ramesh Sudip Roy Steven Euijong Whang Martin Wicke Jarek Wilkiewicz Xin Zhang and Martin Zinkevich. 2017. TFX: A TensorFlow-Based Production-Scale Machine Learning Platform. In KDD.  Denis Baylor Eric Breck Heng-Tze Cheng Noah Fiedel Chuan Yu Foo Zakaria Haque Salem Haykal Mustafa Ispir Vihan Jain Levent Koc Chiu Yuen Koo Lukasz Lew Clemens Mewald Akshay Naresh Modi Neoklis Polyzotis Sukriti Ramesh Sudip Roy Steven Euijong Whang Martin Wicke Jarek Wilkiewicz Xin Zhang and Martin Zinkevich. 2017. TFX: A TensorFlow-Based Production-Scale Machine Learning Platform. In KDD."},{"key":"e_1_3_2_2_4_1","first-page":"281","article-title":"Random Search for Hyper-Parameter Optimization","volume":"13","author":"Bergstra James","year":"2012","unstructured":"James Bergstra and Yoshua Bengio . 2012 . Random Search for Hyper-Parameter Optimization . JMLR 13 (2012), 281 -- 305 . James Bergstra and Yoshua Bengio. 2012. Random Search for Hyper-Parameter Optimization. JMLR 13 (2012), 281--305.","journal-title":"JMLR"},{"key":"e_1_3_2_2_5_1","unstructured":"James S Bergstra R\u00e9mi Bardenet Yoshua Bengio and Bal\u00e1zs K\u00e9gl. 2011. Algorithms for hyper-parameter optimization. In NIPS. 2546--2554.  James S Bergstra R\u00e9mi Bardenet Yoshua Bengio and Bal\u00e1zs K\u00e9gl. 2011. Algorithms for hyper-parameter optimization. In NIPS. 2546--2554."},{"key":"e_1_3_2_2_6_1","unstructured":"Anant Bhardwaj Souvik Bhattacherjee Amit Chavan Amol Deshpande Aaron J Elmore Samuel Madden and Aditya Parameswaran. 2015. DataHub: Collaborative Data Science & Dataset Version Management at Scale. In CIDR.  Anant Bhardwaj Souvik Bhattacherjee Amit Chavan Amol Deshpande Aaron J Elmore Samuel Madden and Aditya Parameswaran. 2015. DataHub: Collaborative Data Science & Dataset Version Management at Scale. In CIDR."},{"key":"e_1_3_2_2_7_1","volume-title":"Natural language processing with Python: analyzing text with the natural language toolkit","author":"Bird Steven","unstructured":"Steven Bird , Ewan Klein , and Edward Loper . 2009. Natural language processing with Python: analyzing text with the natural language toolkit . O'Reilly Media, Inc. Steven Bird, Ewan Klein, and Edward Loper. 2009. Natural language processing with Python: analyzing text with the natural language toolkit. O'Reilly Media, Inc."},{"key":"e_1_3_2_2_8_1","unstructured":"Bernd Bischl Giuseppe Casalicchio Matthias Feurer Frank Hutter Michel Lang Rafael G Mantovani Jan N van Rijn and Joaquin Vanschoren. 2017. OpenML benchmarking suites and the OpenML100. (2017). arXiv:arXiv:1708.03731  Bernd Bischl Giuseppe Casalicchio Matthias Feurer Frank Hutter Michel Lang Rafael G Mantovani Jan N van Rijn and Joaquin Vanschoren. 2017. OpenML benchmarking suites and the OpenML100. (2017). arXiv:arXiv:1708.03731"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.14778\/3007263.3007279"},{"key":"e_1_3_2_2_10_1","unstructured":"G. Bradski. 2000. The OpenCV Library. Dr. Dobb's Journal of Software Tools(2000).  G. Bradski. 2000. The OpenCV Library. Dr. Dobb's Journal of Software Tools(2000)."},{"key":"e_1_3_2_2_11_1","volume-title":"ECMLPKDD Workshop: Languages for Data Mining and Machine Learning. 108--122","author":"Buitinck Lars","year":"2013","unstructured":"Lars Buitinck , Gilles Louppe , Mathieu Blondel , Fabian Pedregosa , Andreas Mueller , Olivier Grisel , Vlad Niculae , Peter Prettenhofer , Alexandre Gramfort , Jaques Grobler , Robert Layton , Jake VanderPlas , ArnaudJoly, Brian Holt , and Ga\u00ebl Varoquaux . 2013 . API design for machine learning software: experiences from the scikit-learn project . In ECMLPKDD Workshop: Languages for Data Mining and Machine Learning. 108--122 . Lars Buitinck, Gilles Louppe, Mathieu Blondel, Fabian Pedregosa, Andreas Mueller, Olivier Grisel, Vlad Niculae, Peter Prettenhofer, Alexandre Gramfort, Jaques Grobler, Robert Layton, Jake VanderPlas, ArnaudJoly, Brian Holt, and Ga\u00ebl Varoquaux. 2013. API design for machine learning software: experiences from the scikit-learn project. In ECMLPKDD Workshop: Languages for Data Mining and Machine Learning. 108--122."},{"key":"e_1_3_2_2_12_1","volume-title":"Jordan","author":"Crankshaw Daniel","year":"2015","unstructured":"Daniel Crankshaw , Peter Bailis , Joseph E. Gonzalez , Haoyuan Li , Zhao Zhang , Michael J. Franklin , Ali Ghodsi , and Michael I . Jordan . 2015 . The Missing Piece in Complex Analytics : Low Latency, Scalable Model Management and Serving with Velox. InCIDR. Daniel Crankshaw, Peter Bailis, Joseph E. Gonzalez, Haoyuan Li, Zhao Zhang, Michael J. Franklin, Ali Ghodsi, and Michael I. Jordan. 2015. The Missing Piece in Complex Analytics: Low Latency, Scalable Model Management and Serving with Velox. InCIDR."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.14778\/2824032.2824045"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Dong Deng Raul Castro Fernandez Ziawasch Abedjan Sibo AhmedElmagarmid Ihab F Ilyas Samuel Madden Mourad Ouzzani and NanTang. 2017. The Data Civilizer System. CIDR(2017).  Dong Deng Raul Castro Fernandez Ziawasch Abedjan Sibo AhmedElmagarmid Ihab F Ilyas Samuel Madden Mourad Ouzzani and NanTang. 2017. The Data Civilizer System. CIDR(2017).","DOI":"10.1145\/3035918.3058740"},{"key":"e_1_3_2_2_15_1","volume-title":"ICML AutoML workshop 2011","author":"Dewancker Ian","year":"2016","unstructured":"Ian Dewancker , Michael McCourt , Scott Clark , Patrick Hayes , Alexandra Johnson , and George Ke . 2016 . A Strategy for Ranking Optimization Methods using Multiple Criteria . ICML AutoML workshop 2011 (2016),1--12. Ian Dewancker, Michael McCourt, Scott Clark, Patrick Hayes, Alexandra Johnson, and George Ke. 2016. A Strategy for Ranking Optimization Methods using Multiple Criteria. ICML AutoML workshop 2011 (2016),1--12."},{"key":"e_1_3_2_2_16_1","volume-title":"ICML 2018 AutoML Workshop, 1--8.","author":"Drori Iddo","year":"2018","unstructured":"Iddo Drori , Yamuna Krishnamurthy , Remi Rampin , Raoni De , Paula Lourenco , Jorge Piazentin Ono , Kyunghyun Cho , Claudio Silva , and Juliana Freire . 2018 . AlphaD3M: Machine Learning Pipeline Synthesis . ICML 2018 AutoML Workshop, 1--8. Iddo Drori, Yamuna Krishnamurthy, Remi Rampin, Raoni De, Paula Lourenco, Jorge Piazentin Ono, Kyunghyun Cho, Claudio Silva, and Juliana Freire. 2018. AlphaD3M: Machine Learning Pipeline Synthesis. ICML 2018 AutoML Workshop, 1--8."},{"key":"e_1_3_2_2_17_1","volume-title":"BOHB: Robust and Efficient Hyperparameter Optimization at Scale. In ICML. 1436--1445.","author":"Falkner Stefan","year":"2018","unstructured":"Stefan Falkner , Aaron Klein , and Frank Hutter . 2018 . BOHB: Robust and Efficient Hyperparameter Optimization at Scale. In ICML. 1436--1445. Stefan Falkner, Aaron Klein, and Frank Hutter. 2018. BOHB: Robust and Efficient Hyperparameter Optimization at Scale. In ICML. 1436--1445."},{"key":"e_1_3_2_2_18_1","unstructured":"Matthias Feurer Aaron Klein Katharina Eggensperger Jost Springen-berg etal 2015. Efficient and robust automated machine learning. In NIPS. 2962--2970.  Matthias Feurer Aaron Klein Katharina Eggensperger Jost Springen-berg et al. 2015. Efficient and robust automated machine learning. In NIPS. 2962--2970."},{"key":"e_1_3_2_2_19_1","volume-title":"An Open Source AutoML Benchmark. 6th ICML Workshop on Automated Machine Learning(2019)","author":"Gijsbers Pieter","year":"2019","unstructured":"Pieter Gijsbers , Erin Ledell , Janek Thomas , S\u00e9bastien Poirier , Bernd Bischl , and Joaquin Vanschoren . 2019 . An Open Source AutoML Benchmark. 6th ICML Workshop on Automated Machine Learning(2019) , 1--8. Pieter Gijsbers, Erin Ledell, Janek Thomas, S\u00e9bastien Poirier, Bernd Bischl, and Joaquin Vanschoren. 2019. An Open Source AutoML Benchmark. 6th ICML Workshop on Automated Machine Learning(2019), 1--8."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098043"},{"key":"e_1_3_2_2_21_1","first-page":"3","article-title":"Combining meta-learning and searchtechniques to select parameters for support vector machines","volume":"75","author":"Gomes Taciana A.F.","year":"2012","unstructured":"Taciana A.F. Gomes , Ricardo B.C. Prudcncio , Carlos Soares , Andr\u00e9 L.D. Rossi , and Andr\u00e9 Carvalho . 2012 . Combining meta-learning and searchtechniques to select parameters for support vector machines . Neuro-computing 75 , 1 (2012), 3 -- 13 . Taciana A.F. Gomes, Ricardo B.C. Prudcncio, Carlos Soares, Andr\u00e9 L.D.Rossi, and Andr\u00e9 Carvalho. 2012. Combining meta-learning and searchtechniques to select parameters for support vector machines. Neuro-computing 75, 1 (2012), 3--13.","journal-title":"Neuro-computing"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"crossref","unstructured":"Ming Gong Linjun Shou Wutao Lin Zhijie Sang Quanjia Yan Ze Yang and Daxin Jiang. 2019. Neuron Blocks -- Building Your NLP DNN Models Like Playing Lego. (2019). arXiv: arXiv:1904.09535  Ming Gong Linjun Shou Wutao Lin Zhijie Sang Quanjia Yan Ze Yang and Daxin Jiang. 2019. Neuron Blocks -- Building Your NLP DNN Models Like Playing Lego. (2019). arXiv: arXiv:1904.09535","DOI":"10.18653\/v1\/D19-3028"},{"key":"e_1_3_2_2_23_1","volume-title":"Sergio Escalera, Tin Kam Ho, N\u00faria Maci\u00e0, Bisakha Ray, Mehreen Saeed, Alexander Statnikov, and Evelyne Viegas.","author":"Guyon Isabelle","year":"2015","unstructured":"Isabelle Guyon , Kristin Bennett , Gavin Cawley , Hugo Jair Escalante , Sergio Escalera, Tin Kam Ho, N\u00faria Maci\u00e0, Bisakha Ray, Mehreen Saeed, Alexander Statnikov, and Evelyne Viegas. 2015 . Design of the 2015 ChaLearn AutoML challenge. In IJCNN. Isabelle Guyon, Kristin Bennett, Gavin Cawley, Hugo Jair Escalante, Sergio Escalera, Tin Kam Ho, N\u00faria Maci\u00e0, Bisakha Ray, Mehreen Saeed, Alexander Statnikov, and Evelyne Viegas. 2015. Design of the 2015 ChaLearn AutoML challenge. In IJCNN."},{"key":"e_1_3_2_2_24_1","volume-title":"Swart","author":"Hagberg Aric A.","year":"2008","unstructured":"Aric A. Hagberg , Daniel A. Schult , and Pieter J . Swart . 2008 . Exploring network structure, dynamics, and function using Network X. In SciPy, Ga\u00ebl Varoquaux, Travis Vaught, and Jarrod Millman (Eds .). 11--15. Aric A. Hagberg, Daniel A. Schult, and Pieter J. Swart. 2008. Exploring network structure, dynamics, and function using Network X. In SciPy, Ga\u00ebl Varoquaux, Travis Vaught, and Jarrod Millman (Eds.). 11--15."},{"key":"e_1_3_2_2_25_1","unstructured":"Martin Hirzel Kiran Kate Avraham Shinnar Subhrajit Roy and Parikshit Ram. 2019. Type-Driven Automated Learning with Lale. (May2019). arXiv:arXiv:1906.03957  Martin Hirzel Kiran Kate Avraham Shinnar Subhrajit Roy and Parikshit Ram. 2019. Type-Driven Automated Learning with Lale. (May2019). arXiv:arXiv:1906.03957"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"crossref","unstructured":"Kyle Hundman Valentino Constantinou Christopher Laporte Ian Colwell and Tom Soderstrom. 2018. Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding. In KDD.  Kyle Hundman Valentino Constantinou Christopher Laporte Ian Colwell and Tom Soderstrom. 2018. Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding. In KDD.","DOI":"10.1145\/3219819.3219845"},{"key":"e_1_3_2_2_27_1","unstructured":"Kevin Jamieson and Ameet Talwalkar. 2016. Non-stochastic Best Arm Identification and Hyperparameter Optimization. In AISTATS. 240--248.  Kevin Jamieson and Ameet Talwalkar. 2016. Non-stochastic Best Arm Identification and Hyperparameter Optimization. In AISTATS. 240--248."},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"crossref","unstructured":"James Max Kanter. 2015. Deep Feature Synthesis: Towards Automating Data Science Endeavors. In DSAA. 1--10.  James Max Kanter. 2015. Deep Feature Synthesis: Towards Automating Data Science Endeavors. In DSAA. 1--10.","DOI":"10.1109\/DSAA.2015.7344858"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"crossref","unstructured":"James Max Kanter Owen Gillespie and Kalyan Veeramachaneni. 2016. Label segment featurize: A cross domain framework for prediction engineering. In DSAA. 430--439.  James Max Kanter Owen Gillespie and Kalyan Veeramachaneni. 2016. Label segment featurize: A cross domain framework for prediction engineering. In DSAA. 430--439.","DOI":"10.1109\/DSAA.2016.54"},{"key":"e_1_3_2_2_30_1","volume-title":"Cognito: Automated feature engineering for su-pervised learning. In ICDMW. 1304--1307.","author":"Khurana Udayan","year":"2016","unstructured":"Udayan Khurana , Deepak Turaga , Horst Samulowitz , and Srinivasan Parthasrathy . 2016 . Cognito: Automated feature engineering for su-pervised learning. In ICDMW. 1304--1307. Udayan Khurana, Deepak Turaga, Horst Samulowitz, and Srinivasan Parthasrathy. 2016. Cognito: Automated feature engineering for su-pervised learning. In ICDMW. 1304--1307."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v028.i05"},{"key":"e_1_3_2_2_32_1","volume-title":"Proceedings of the 2nd Workshop on New Trendson Content-Based Recommender Systems","volume":"1448","author":"Kula Maciej","year":"2015","unstructured":"Maciej Kula . 2015 . Metadata Embeddings for User and Item Cold-start Recommendations . In Proceedings of the 2nd Workshop on New Trendson Content-Based Recommender Systems , Vol. 1448 . 14--21. Maciej Kula. 2015. Metadata Embeddings for User and Item Cold-start Recommendations. In Proceedings of the 2nd Workshop on New Trendson Content-Based Recommender Systems, Vol. 1448. 14--21."},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/3122009.3242042"},{"key":"e_1_3_2_2_34_1","unstructured":"Liam Li Kevin Jamieson Afshin Rostamizadeh Ekaterina Gonina Moritz Hardt Benjamin Recht and Ameet Talwalkar. 2018. Massively parallel hyperparameter tuning. (2018). arXiv:arXiv:1810.05934  Liam Li Kevin Jamieson Afshin Rostamizadeh Ekaterina Gonina Moritz Hardt Benjamin Recht and Ameet Talwalkar. 2018. Massively parallel hyperparameter tuning. (2018). arXiv:arXiv:1810.05934"},{"key":"e_1_3_2_2_35_1","volume-title":"NIPS Workshop on Artificial Intelligence for Data Science.","author":"Lippmann Richard","year":"2016","unstructured":"Richard Lippmann , William Campbell , and Joseph Campbell . 2016 . An Overview of the DARPA Data Driven Discovery of Models (D3M)Program . In NIPS Workshop on Artificial Intelligence for Data Science. Richard Lippmann, William Campbell, and Joseph Campbell. 2016. An Overview of the DARPA Data Driven Discovery of Models (D3M)Program. In NIPS Workshop on Artificial Intelligence for Data Science."},{"key":"e_1_3_2_2_36_1","unstructured":"Zachary C Lipton and Jacob Steinhardt. 2018. Troubling trends inmachine learning scholarship. (2018). arXiv:arXiv:1807.03341  Zachary C Lipton and Jacob Steinhardt. 2018. Troubling trends inmachine learning scholarship. (2018). arXiv:arXiv:1807.03341"},{"key":"e_1_3_2_2_37_1","unstructured":"Ilya Loshchilov and Frank Hutter. 2016. CMA-ES for Hyperparameter Optimization of Deep Neural Networks. (2016). arXiv:arXiv:1604.07269  Ilya Loshchilov and Frank Hutter. 2016. CMA-ES for Hyperparameter Optimization of Deep Neural Networks. (2016). arXiv:arXiv:1604.07269"},{"key":"e_1_3_2_2_38_1","volume-title":"Model-hub: Deep learning lifecycle management. In ICDE. 1393--1394.","author":"Miao Hui","year":"2017","unstructured":"Hui Miao , Ang Li , Larry S Davis , and Amol Deshpande . 2017 . Model-hub: Deep learning lifecycle management. In ICDE. 1393--1394. Hui Miao, Ang Li, Larry S Davis, and Amol Deshpande. 2017. Model-hub: Deep learning lifecycle management. In ICDE. 1393--1394."},{"key":"e_1_3_2_2_39_1","volume-title":"BOCK: Bayesian Optimization with Cylindrical Kernels.","author":"Oh Chang Yong","year":"2018","unstructured":"Chang Yong Oh , Efstratios Gavves , and Max Welling . 2018 . BOCK: Bayesian Optimization with Cylindrical Kernels. (2018). arXiv:arXiv:1806.01619 Chang Yong Oh, Efstratios Gavves, and Max Welling. 2018. BOCK: Bayesian Optimization with Cylindrical Kernels. (2018). arXiv:arXiv:1806.01619"},{"key":"e_1_3_2_2_40_1","volume-title":"Moore","author":"Olson Randal S.","year":"2016","unstructured":"Randal S. Olson , Nathan Bartley , Ryan J. Urbanowicz , and Jason H . Moore . 2016 . Evaluation of a Tree-based Pipeline Optimization Toolfor Automating Data Science. In GECCO. Randal S. Olson, Nathan Bartley, Ryan J. Urbanowicz, and Jason H. Moore. 2016. Evaluation of a Tree-based Pipeline Optimization Toolfor Automating Data Science. In GECCO."},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12130-999-1026-0"},{"key":"e_1_3_2_2_42_1","volume-title":"Dask: Parallel Computation with Blocked algorithms and Task Scheduling. InSciPy, Kathryn Huff and James Bergstra (Eds.). 130--136.","author":"Rocklin Matthew","year":"2015","unstructured":"Matthew Rocklin . 2015 . Dask: Parallel Computation with Blocked algorithms and Task Scheduling. InSciPy, Kathryn Huff and James Bergstra (Eds.). 130--136. Matthew Rocklin. 2015. Dask: Parallel Computation with Blocked algorithms and Task Scheduling. InSciPy, Kathryn Huff and James Bergstra (Eds.). 130--136."},{"key":"e_1_3_2_2_43_1","unstructured":"D Sculley Gary Holt Daniel Golovin Eugene Davydov Todd Phillips Dietmar Ebner Vinay Chaudhary Michael Young Jean-Francois Cre-spo and Dan Dennison. 2015. Hidden technical debt in machine learning systems. In NIPS. 2503--2511.  D Sculley Gary Holt Daniel Golovin Eugene Davydov Todd Phillips Dietmar Ebner Vinay Chaudhary Michael Young Jean-Francois Cre-spo and Dan Dennison. 2015. Hidden technical debt in machine learning systems. In NIPS. 2503--2511."},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"crossref","unstructured":"Zeyuan Shang Emanuel Zgraggen Benedetto Buratti Ferdinand Kossmann Philipp Eichmann Yeounoh Chung Carsten Binnig Eli Upfal and Tim Kraska. 2019. Democratizing data science through interactive curation of ml pipelines. In SIGMOD. 1171--1188.  Zeyuan Shang Emanuel Zgraggen Benedetto Buratti Ferdinand Kossmann Philipp Eichmann Yeounoh Chung Carsten Binnig Eli Upfal and Tim Kraska. 2019. Democratizing data science through interactive curation of ml pipelines. In SIGMOD. 1171--1188.","DOI":"10.1145\/3299869.3319863"},{"key":"e_1_3_2_2_45_1","first-page":"1002","article-title":"Evaluating end-to-end optimization for dataanalytics applications in weld","volume":"11","author":"Shoumik Palkar","year":"2018","unstructured":"Palkar Shoumik , James Thomas , Deepak Naryanan , Pratiskha Thaker , Rahul Palamuttam , Parimajan Negi , Anil Shanbhag , Malte Schwarzkopf , Holger Pirk , Saman Amarasinghe , Samuel Madden , and Matei Zaharia . 2018 . Evaluating end-to-end optimization for dataanalytics applications in weld . PVLDB 11 , 9 (2018), 1002 -- 1015 . Palkar Shoumik, James Thomas, Deepak Naryanan, Pratiskha Thaker, Rahul Palamuttam, Parimajan Negi, Anil Shanbhag, Malte Schwarzkopf, Holger Pirk, Saman Amarasinghe, Samuel Madden, and Matei Zaharia. 2018. Evaluating end-to-end optimization for dataanalytics applications in weld. PVLDB 11, 9 (2018), 1002--1015.","journal-title":"PVLDB"},{"key":"e_1_3_2_2_46_1","unstructured":"Jasper Snoek Hugo Larochelle and Ryan P Adams. 2012. Practical bayesian optimization of machine learning algorithms. In NIPS. 2951--2959.  Jasper Snoek Hugo Larochelle and Ryan P Adams. 2012. Practical bayesian optimization of machine learning algorithms. In NIPS. 2951--2959."},{"key":"e_1_3_2_2_47_1","volume-title":"ATM: A distributed, collaborative, scalable system for automated machine learning. In BigData.","author":"Swearingen Thomas","year":"2017","unstructured":"Thomas Swearingen , Will Drevo , Bennett Cyphers , 2017 . ATM: A distributed, collaborative, scalable system for automated machine learning. In BigData. Thomas Swearingen, Will Drevo, Bennett Cyphers, et al. 2017. ATM: A distributed, collaborative, scalable system for automated machine learning. In BigData."},{"key":"e_1_3_2_2_48_1","doi-asserted-by":"crossref","unstructured":"Chris Thornton Frank Hutter Holger H. Hoos and Kevin Leyton-Brown. 2013. Auto-WEKA: combined selection and hyperparameter optimization of classification algorithms. In KDD.  Chris Thornton Frank Hutter Holger H. Hoos and Kevin Leyton-Brown. 2013. Auto-WEKA: combined selection and hyperparameter optimization of classification algorithms. In KDD.","DOI":"10.1145\/2487575.2487629"},{"key":"e_1_3_2_2_49_1","doi-asserted-by":"crossref","unstructured":"Tom van der Weide Dimitris Papadopoulos Oleg Smirnov Michal Zielinski and Tim van Kasteren. 2017. Versioning for End-to-End Machine Learning Pipelines. In DEEM. 1--9.  Tom van der Weide Dimitris Papadopoulos Oleg Smirnov Michal Zielinski and Tim van Kasteren. 2017. Versioning for End-to-End Machine Learning Pipelines. In DEEM. 1--9.","DOI":"10.1145\/3076246.3076248"},{"key":"e_1_3_2_2_50_1","volume-title":"Pavel Brazdil, and Joaquin Vanschoren.","author":"van Rijn Jan N.","year":"2015","unstructured":"Jan N. van Rijn , Salisu Mamman Abdulrahman , Pavel Brazdil, and Joaquin Vanschoren. 2015 . Fast Algorithm Selection Using Learning Curves. InIDA. 298--309. Jan N. van Rijn, Salisu Mamman Abdulrahman, Pavel Brazdil, and Joaquin Vanschoren. 2015. Fast Algorithm Selection Using Learning Curves. InIDA. 298--309."},{"key":"e_1_3_2_2_51_1","doi-asserted-by":"crossref","unstructured":"Hao Wang Bas van Stein Michael Emmerich and Thomas Back. 2017.A new acquisition function for Bayesian optimization based on themoment-generating function. In SMC. 507--512.  Hao Wang Bas van Stein Michael Emmerich and Thomas Back. 2017.A new acquisition function for Bayesian optimization based on themoment-generating function. In SMC. 507--512.","DOI":"10.1109\/SMC.2017.8122656"},{"key":"e_1_3_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.14778\/3282495.3282499"},{"key":"e_1_3_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2934664"}],"event":{"name":"SIGMOD\/PODS '20: International Conference on Management of Data","location":"Portland OR USA","acronym":"SIGMOD\/PODS '20","sponsor":["SIGMOD ACM Special Interest Group on Management of Data"]},"container-title":["Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3318464.3386146","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3318464.3386146","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3318464.3386146","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:44Z","timestamp":1750199924000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3318464.3386146"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,31]]},"references-count":53,"alternative-id":["10.1145\/3318464.3386146","10.1145\/3318464"],"URL":"https:\/\/doi.org\/10.1145\/3318464.3386146","relation":{},"subject":[],"published":{"date-parts":[[2020,5,31]]},"assertion":[{"value":"2020-05-31","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}