{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T03:57:30Z","timestamp":1760587050912,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":63,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,12,7]],"date-time":"2020-12-07T00:00:00Z","timestamp":1607299200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,12,7]]},"DOI":"10.1145\/3423211.3425692","type":"proceedings-article","created":{"date-parts":[[2020,12,11]],"date-time":"2020-12-11T23:03:11Z","timestamp":1607727791000},"page":"89-104","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["PipeTune"],"prefix":"10.1145","author":[{"given":"Isabelly","family":"Rocha","sequence":"first","affiliation":[{"name":"University of Neuch\u00e2tel, Neuch\u00e2tel, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nathaniel","family":"Morris","sequence":"additional","affiliation":[{"name":"The Ohio State University Columbus, Ohio"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lydia Y.","family":"Chen","sequence":"additional","affiliation":[{"name":"TU Delft Delft, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pascal","family":"Felber","sequence":"additional","affiliation":[{"name":"University of Neuch\u00e2tel, Neuch\u00e2tel, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Robert","family":"Birke","sequence":"additional","affiliation":[{"name":"ABB Research Baden-D\u00e4ttwil, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Valerio","family":"Schiavoni","sequence":"additional","affiliation":[{"name":"University of Neuch\u00e2tel, Neuch\u00e2tel, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,12,11]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"2020. 20 Newsgroups. http:\/\/qwone.com\/~jason\/20Newsgroups. Accessed: 2020-14-09.  2020. 20 Newsgroups. http:\/\/qwone.com\/~jason\/20Newsgroups. Accessed: 2020-14-09."},{"key":"e_1_3_2_1_2_1","unstructured":"2020. Linux kernel profiling with perf. https:\/\/perf.wiki.kernel.org\/index.php\/Tutorial. Accessed: 2020-14-09.  2020. Linux kernel profiling with perf. https:\/\/perf.wiki.kernel.org\/index.php\/Tutorial. Accessed: 2020-14-09."},{"key":"e_1_3_2_1_3_1","unstructured":"2020. Perform Automatic Model Tuning. https:\/\/docs.aws.amazon.com\/sagemaker\/latest\/dg\/automatic-model-tuning.html. Accessed: 2020-14-09.  2020. Perform Automatic Model Tuning. https:\/\/docs.aws.amazon.com\/sagemaker\/latest\/dg\/automatic-model-tuning.html. Accessed: 2020-14-09."},{"key":"e_1_3_2_1_4_1","unstructured":"2020. TensorFlow ConvNets on a Budget with Bayesian Optimization. htps:\/\/sigopt.com\/blog\/tensorflow-convnets-on-a-budget-with-bayesian-optimization\/.  2020. TensorFlow ConvNets on a Budget with Bayesian Optimization. htps:\/\/sigopt.com\/blog\/tensorflow-convnets-on-a-budget-with-bayesian-optimization\/."},{"key":"e_1_3_2_1_5_1","volume-title":"Proceedings of the","author":"Aghaebrahimian Ahmad","year":"2019","unstructured":"Ahmad Aghaebrahimian and Mark Cieliebak . 2019. Hyperparameter Tuning for Deep Learning in Natural Language Processing . In Proceedings of the 4 th edition of the Swiss Text Analytics Conference, Swiss Text 2019 , Winterthur, Switzerland, June 18-19, 2019 (CEUR Workshop Proceedings), Mark Cieliebak, Don Tuggener, and Fernando Benites (Eds.), Vol. 2458 . CEUR-WS. org. http:\/\/ceur-ws.org\/Vol-2458\/paper5.pdf Ahmad Aghaebrahimian and Mark Cieliebak. 2019. Hyperparameter Tuning for Deep Learning in Natural Language Processing. In Proceedings of the 4th edition of the Swiss Text Analytics Conference, SwissText 2019, Winterthur, Switzerland, June 18-19, 2019 (CEUR Workshop Proceedings), Mark Cieliebak, Don Tuggener, and Fernando Benites (Eds.), Vol. 2458. CEUR-WS.org. http:\/\/ceur-ws.org\/Vol-2458\/paper5.pdf","edition":"4"},{"key":"e_1_3_2_1_6_1","article-title":"Deconstructing Amazon EC2 Spot Instance Pricing","volume":"1","author":"Ben-Yehuda Orna Agmon","year":"2013","unstructured":"Orna Agmon Ben-Yehuda , Muli Ben-Yehuda , Assaf Schuster , and Dan Tsafrir . 2013 . Deconstructing Amazon EC2 Spot Instance Pricing . ACM Trans. Economics and Comput. 1 , 3 (2013), 16:1-16:20. https:\/\/doi.org\/10.1145\/2509413.2509416 10.1145\/2509413.2509416 Orna Agmon Ben-Yehuda, Muli Ben-Yehuda, Assaf Schuster, and Dan Tsafrir. 2013. Deconstructing Amazon EC2 Spot Instance Pricing. ACM Trans. Economics and Comput. 1, 3 (2013), 16:1-16:20. https:\/\/doi.org\/10.1145\/2509413.2509416","journal-title":"ACM Trans. Economics and Comput."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1162\/089976600300015187"},{"key":"e_1_3_2_1_8_1","volume-title":"Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems","author":"Bergstra James","year":"2011","unstructured":"James Bergstra , R\u00e9mi Bardenet , Yoshua Bengio , and Bal\u00e1zs K\u00e9gl . 2011. Algorithms for Hyper-Parameter Optimization . In Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011 . Proceedings of a meeting held 12-14 December 2011, Granada, Spain, John Shawe-Taylor, Richard S. Zemel, Peter L. Bartlett, Fernando C. N. Pereira, and Kilian Q. Weinberger (Eds .). 2546--2554. http:\/\/papers.nips.cc\/paper\/4443-algorithms-for-hyper-parameter-optimization James Bergstra, R\u00e9mi Bardenet, Yoshua Bengio, and Bal\u00e1zs K\u00e9gl. 2011. Algorithms for Hyper-Parameter Optimization. In Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011. Proceedings of a meeting held 12-14 December 2011, Granada, Spain, John Shawe-Taylor, Richard S. Zemel, Peter L. Bartlett, Fernando C. N. Pereira, and Kilian Q. Weinberger (Eds.). 2546--2554. http:\/\/papers.nips.cc\/paper\/4443-algorithms-for-hyper-parameter-optimization"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/2188385.2188395"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/IISWC.2009.5306797"},{"key":"e_1_3_2_1_11_1","volume-title":"Luca Maria Gambardella, and J\u00fcrgen Schmidhuber","author":"Ciresan Dan C.","year":"2013","unstructured":"Dan C. Ciresan , Alessandro Giusti , Luca Maria Gambardella, and J\u00fcrgen Schmidhuber . 2013 . Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks. In Medical Image Computing and Computer-Assisted Intervention - MICCAI 2013 - 16th International Conference, Nagoya, Japan, September 22-26, 2013, Proceedings, Part II (Lecture Notes in Computer Science), Kensaku Mori, Ichiro Sakuma, Yoshinobu Sato, Christian Barillot, and Nassir Navab (Eds.), Vol. 8150 . Springer , 411--418. https:\/\/doi.org\/10.1007\/978-3-642-40763-5_51 10.1007\/978-3-642-40763-5_51 Dan C. Ciresan, Alessandro Giusti, Luca Maria Gambardella, and J\u00fcrgen Schmidhuber. 2013. Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks. In Medical Image Computing and Computer-Assisted Intervention - MICCAI 2013 - 16th International Conference, Nagoya, Japan, September 22-26, 2013, Proceedings, Part II (Lecture Notes in Computer Science), Kensaku Mori, Ichiro Sakuma, Yoshinobu Sato, Christian Barillot, and Nassir Navab (Eds.), Vol. 8150. Springer, 411--418. https:\/\/doi.org\/10.1007\/978-3-642-40763-5_51"},{"key":"e_1_3_2_1_12_1","volume-title":"Hyperparameter Search in Machine Learning. CoRR abs\/1502.02127","author":"Claesen Marc","year":"2015","unstructured":"Marc Claesen and Bart De Moor . 2015. Hyperparameter Search in Machine Learning. CoRR abs\/1502.02127 ( 2015 ). arXiv:1502.02127 htp:\/\/arxiv.org\/abs\/1502.02127 Marc Claesen and Bart De Moor. 2015. Hyperparameter Search in Machine Learning. CoRR abs\/1502.02127 (2015). arXiv:1502.02127 htp:\/\/arxiv.org\/abs\/1502.02127"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357223.3362707"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2013.6639344"},{"volume-title":"Deep learning in natural language processing","author":"Deng Li","key":"e_1_3_2_1_15_1","unstructured":"Li Deng and Yang Liu . 2018. Deep learning in natural language processing . Springer . Li Deng and Yang Liu. 2018. Deep learning in natural language processing. Springer."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1002\/widm.1257"},{"key":"e_1_3_2_1_17_1","volume-title":"Scalable Object Detection Using Deep Neural Networks. In 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014","author":"Erhan Dumitru","year":"2014","unstructured":"Dumitru Erhan , Christian Szegedy , Alexander Toshev , and Dragomir Anguelov . 2014 . Scalable Object Detection Using Deep Neural Networks. In 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014 , Columbus, OH, USA , June 23-28, 2014. IEEE Computer Society, 2155--2162. htps:\/\/doi.org\/10.1109\/CVPR.2014.276 10.1109\/CVPR.2014.276 Dumitru Erhan, Christian Szegedy, Alexander Toshev, and Dragomir Anguelov. 2014. Scalable Object Detection Using Deep Neural Networks. In 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014, Columbus, OH, USA, June 23-28, 2014. IEEE Computer Society, 2155--2162. htps:\/\/doi.org\/10.1109\/CVPR.2014.276"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1162\/089976600300015015"},{"key":"e_1_3_2_1_19_1","volume-title":"Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada, August 13 - 17","author":"Golovin Daniel","year":"2017","unstructured":"Daniel Golovin , Benjamin Solnik , Subhodeep Moitra , Greg Kochanski , John Karro , and D. Sculley . 2017. Google Vizier: A Service for Black-Box Optimization . In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada, August 13 - 17 , 2017 . ACM, 1487--1495. https:\/\/doi.org\/10.1145\/3097983.3098043 10.1145\/3097983.3098043 Daniel Golovin, Benjamin Solnik, Subhodeep Moitra, Greg Kochanski, John Karro, and D. Sculley. 2017. Google Vizier: A Service for Black-Box Optimization. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada, August 13 - 17, 2017. ACM, 1487--1495. https:\/\/doi.org\/10.1145\/3097983.3098043"},{"key":"e_1_3_2_1_20_1","volume-title":"Police across the US are training crimepredicting AIs on falsified data. MIT Technology Review. 13","author":"Hao Karen","year":"2019","unstructured":"Karen Hao . 2019. Police across the US are training crimepredicting AIs on falsified data. MIT Technology Review. 13 ( 2019 ). Karen Hao. 2019. Police across the US are training crimepredicting AIs on falsified data. MIT Technology Review. 13 (2019)."},{"volume-title":"Neural Networks: Tricks of the Trade -","author":"Hinton Geoffrey E.","key":"e_1_3_2_1_21_1","unstructured":"Geoffrey E. Hinton . 2012. A Practical Guide to Training Restricted Boltzmann Machines . In Neural Networks: Tricks of the Trade - Second Edition, Gr\u00e9goire Montavon, Genevieve B. Orr, and Klaus-Robert M\u00fcller (Eds.). Lecture Notes in Computer Science, Vol. 7700 . Springer , 599--619. htps:\/\/doi.org\/10.1007\/978-3-642-35289-8_32 10.1007\/978-3-642-35289-8_32 Geoffrey E. Hinton. 2012. A Practical Guide to Training Restricted Boltzmann Machines. In Neural Networks: Tricks of the Trade - Second Edition, Gr\u00e9goire Montavon, Genevieve B. Orr, and Klaus-Robert M\u00fcller (Eds.). Lecture Notes in Computer Science, Vol. 7700. Springer, 599--619. htps:\/\/doi.org\/10.1007\/978-3-642-35289-8_32"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302424.3303949"},{"key":"e_1_3_2_1_23_1","volume-title":"Ng","author":"Huval Brody","year":"2015","unstructured":"Brody Huval , Tao Wang , Sameep Tandon , Jeff Kiske , Will Song , Joel Pazhayampallil , Mykhaylo Andriluka , Pranav Rajpurkar , Toki Migimatsu , Royce Cheng-Yue , Fernando A. Mujica , Adam Coates , and Andrew Y . Ng . 2015 . An Empirical Evaluation of Deep Learning on Highway Driving. CoRR abs\/1504.01716 (2015). arXiv:1504.01716htp:\/\/arxiv.org\/abs\/1504.01716 Brody Huval, Tao Wang, Sameep Tandon, Jeff Kiske, Will Song, Joel Pazhayampallil, Mykhaylo Andriluka, Pranav Rajpurkar, Toki Migimatsu, Royce Cheng-Yue, Fernando A. Mujica, Adam Coates, and Andrew Y. Ng. 2015. An Empirical Evaluation of Deep Learning on Highway Driving. CoRR abs\/1504.01716 (2015). arXiv:1504.01716htp:\/\/arxiv.org\/abs\/1504.01716"},{"key":"e_1_3_2_1_24_1","volume-title":"Population Based Training of Neural Networks. CoRR abs\/1711.09846","author":"Jaderberg Max","year":"2017","unstructured":"Max Jaderberg , Valentin Dalibard , Simon Osindero , Wojciech M. Czarnecki , Jeff Donahue , Ali Razavi , Oriol Vinyals , Tim Green , Iain Dunning , Karen Simonyan , Chrisantha Fernando , and Koray Kavukcuoglu . 2017. Population Based Training of Neural Networks. CoRR abs\/1711.09846 ( 2017 ). arXiv:1711.09846 http:\/\/arxiv.org\/abs\/1711.09846 Max Jaderberg, Valentin Dalibard, Simon Osindero, Wojciech M. Czarnecki, Jeff Donahue, Ali Razavi, Oriol Vinyals, Tim Green, Iain Dunning, Karen Simonyan, Chrisantha Fernando, and Koray Kavukcuoglu. 2017. Population Based Training of Neural Networks. CoRR abs\/1711.09846 (2017). arXiv:1711.09846 http:\/\/arxiv.org\/abs\/1711.09846"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330648"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2744718"},{"key":"e_1_3_2_1_27_1","volume-title":"2019 USENIX Annual Technical Conference, USENIX ATC 2019","author":"Kim Jin Kyu","year":"2019","unstructured":"Jin Kyu Kim , Abutalib Aghayev , Garth A. Gibson , and Eric P. Xing . 2019. STRADS-AP: Simplifying Distributed Machine Learning Programming without Introducing a New Programming Model . In 2019 USENIX Annual Technical Conference, USENIX ATC 2019 , Renton, WA, USA , July 10-12, 2019 , Dahlia Malkhi and Dan Tsafrir (Eds.). USENIX Association, 207--222. https:\/\/www.usenix.org\/conference\/atc19\/presentation\/kim-jin Jin Kyu Kim, Abutalib Aghayev, Garth A. Gibson, and Eric P. Xing. 2019. STRADS-AP: Simplifying Distributed Machine Learning Programming without Introducing a New Programming Model. In 2019 USENIX Annual Technical Conference, USENIX ATC 2019, Renton, WA, USA, July 10-12, 2019, Dahlia Malkhi and Dan Tsafrir (Eds.). USENIX Association, 207--222. https:\/\/www.usenix.org\/conference\/atc19\/presentation\/kim-jin"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901318.2901331"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302424.3303957"},{"key":"e_1_3_2_1_30_1","unstructured":"Yann LeCun. 1998. The MNIST database of handwritten digits. http:\/\/yann.lecun.com\/exdb\/mnist\/ (1998).  Yann LeCun. 1998. The MNIST database of handwritten digits. http:\/\/yann.lecun.com\/exdb\/mnist\/ (1998)."},{"key":"e_1_3_2_1_31_1","unstructured":"Yann LeCun etal 2015. LeNet-5 convolutional neural networks. URL: http:\/\/yann.lecun.com\/exdb\/lenet 20 (2015) 5.  Yann LeCun et al. 2015. LeNet-5 convolutional neural networks. URL: http:\/\/yann.lecun.com\/exdb\/lenet 20 (2015) 5."},{"key":"e_1_3_2_1_32_1","article-title":"Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization","volume":"18","author":"Li Lisha","year":"2017","unstructured":"Lisha Li , Kevin G. Jamieson , Giulia DeSalvo , Afshin Rostamizadeh , and Ameet Talwalkar . 2017 . Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization . J. Mach. Learn. Res. 18 (2017), 185:1-185:52. http:\/\/jmlr.org\/papers\/v18\/16-558.html Lisha Li, Kevin G. Jamieson, Giulia DeSalvo, Afshin Rostamizadeh, and Ameet Talwalkar. 2017. Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization. J. Mach. Learn. Res. 18 (2017), 185:1-185:52. http:\/\/jmlr.org\/papers\/v18\/16-558.html","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_2_1_33_1","volume-title":"Scaling Distributed Machine Learning with the Parameter Server. In 11th USENIX Symposium on Operating Systems Design and Implementation, OSDI '14","author":"Li Mu","year":"2014","unstructured":"Mu Li , David G. Andersen , Jun Woo Park , Alexander J. Smola , Amr Ahmed , Vanja Josifovski , James Long , Eugene J. Shekita , and Bor-Yiing Su . 2014 . Scaling Distributed Machine Learning with the Parameter Server. In 11th USENIX Symposium on Operating Systems Design and Implementation, OSDI '14 , Broomfield, CO, USA , October 6-8, 2014, Jason Flinn and Hank Levy (Eds.). USENIX Association, 583--598. https:\/\/www.usenix.org\/conference\/osdi14\/technical-sessions\/presentation\/li_mu Mu Li, David G. Andersen, Jun Woo Park, Alexander J. Smola, Amr Ahmed, Vanja Josifovski, James Long, Eugene J. Shekita, and Bor-Yiing Su. 2014. Scaling Distributed Machine Learning with the Parameter Server. In 11th USENIX Symposium on Operating Systems Design and Implementation, OSDI '14, Broomfield, CO, USA, October 6-8, 2014, Jason Flinn and Hank Levy (Eds.). USENIX Association, 583--598. https:\/\/www.usenix.org\/conference\/osdi14\/technical-sessions\/presentation\/li_mu"},{"key":"e_1_3_2_1_34_1","volume-title":"Deep Reinforcement Learning: An Overview. CoRR abs\/1701.07274","author":"Yuxi Li.","year":"2017","unstructured":"Yuxi Li. 2017. Deep Reinforcement Learning: An Overview. CoRR abs\/1701.07274 ( 2017 ). arXiv:1701.07274 htp:\/\/arxiv.org\/abs\/1701.07274 Yuxi Li. 2017. Deep Reinforcement Learning: An Overview. CoRR abs\/1701.07274 (2017). arXiv:1701.07274 htp:\/\/arxiv.org\/abs\/1701.07274"},{"key":"e_1_3_2_1_35_1","volume-title":"Tune: A Research Platform for Distributed Model Selection and Training. CoRR abs\/1807.05118","author":"Liaw Richard","year":"2018","unstructured":"Richard Liaw , Eric Liang , Robert Nishihara , Philipp Moritz , Joseph E. Gonzalez , and Ion Stoica . 2018 . Tune: A Research Platform for Distributed Model Selection and Training. CoRR abs\/1807.05118 (2018). arXiv:1807.05118 http:\/\/arxiv.org\/abs\/1807.05118 Richard Liaw, Eric Liang, Robert Nishihara, Philipp Moritz, Joseph E. Gonzalez, and Ion Stoica. 2018. Tune: A Research Platform for Distributed Model Selection and Training. CoRR abs\/1807.05118 (2018). arXiv:1807.05118 http:\/\/arxiv.org\/abs\/1807.05118"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3386126"},{"key":"e_1_3_2_1_37_1","volume-title":"An analysis of the influence of deep neural network (DNN) topology in bottleneck feature based language recognition. PloS one 12, 8","author":"Lozano-Diez Alicia","year":"2017","unstructured":"Alicia Lozano-Diez , Ruben Zazo , Doroteo T Toledano , and Joaquin Gonzalez-Rodriguez . 2017. An analysis of the influence of deep neural network (DNN) topology in bottleneck feature based language recognition. PloS one 12, 8 ( 2017 ). Alicia Lozano-Diez, Ruben Zazo, Doroteo T Toledano, and Joaquin Gonzalez-Rodriguez. 2017. An analysis of the influence of deep neural network (DNN) topology in bottleneck feature based language recognition. PloS one 12, 8 (2017)."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3297858.3304009"},{"key":"e_1_3_2_1_39_1","volume-title":"2004 IEEE International Conference on Cluster Computing (CLUSTER 2004)","author":"Mamidala Amith R.","year":"2004","unstructured":"Amith R. Mamidala , Jiuxing Liu , and Dhabaleswar K. Panda . 2004. Efficient Barrier and Allreduce on Infiniband clusters using multicast and adaptive algorithms . In 2004 IEEE International Conference on Cluster Computing (CLUSTER 2004) , September 20-23 2004 , San Diego, California, USA. IEEE Computer Society, 135--144. https:\/\/doi.org\/10.1109\/CLUSTR. 2004.1392611 10.1109\/CLUSTR.2004.1392611 Amith R. Mamidala, Jiuxing Liu, and Dhabaleswar K. Panda. 2004. Efficient Barrier and Allreduce on Infiniband clusters using multicast and adaptive algorithms. In 2004 IEEE International Conference on Cluster Computing (CLUSTER 2004), September 20-23 2004, San Diego, California, USA. IEEE Computer Society, 135--144. https:\/\/doi.org\/10.1109\/CLUSTR.2004.1392611"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2010-343"},{"key":"e_1_3_2_1_41_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning, ICML 2017","author":"Molchanov Dmitry","year":"2017","unstructured":"Dmitry Molchanov , Arsenii Ashukha , and Dmitry P. Vetrov . 2017. Variational Dropout Sparsifies Deep Neural Networks . In Proceedings of the 34th International Conference on Machine Learning, ICML 2017 , Sydney, NSW, Australia , 6-11 August 2017 (Proceedings of Machine Learning Research), Doina Precup and Yee Whye Teh (Eds.), Vol. 70. PMLR, 2498--2507. http:\/\/proceedings.mlr.press\/v70\/molchanov17a.html Dmitry Molchanov, Arsenii Ashukha, and Dmitry P. Vetrov. 2017. Variational Dropout Sparsifies Deep Neural Networks. In Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6-11 August 2017 (Proceedings of Machine Learning Research), Doina Precup and Yee Whye Teh (Eds.), Vol. 70. PMLR, 2498--2507. http:\/\/proceedings.mlr.press\/v70\/molchanov17a.html"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341301.3359646"},{"key":"e_1_3_2_1_43_1","volume-title":"Proceedings of the 30th International Conference on Machine Learning, ICML 2013, Atlanta, GA, USA, 16-21 June 2013 (JMLR Workshop and Conference Proceedings)","volume":"28","author":"Pascanu Razvan","year":"2013","unstructured":"Razvan Pascanu , Tomas Mikolov , and Yoshua Bengio . 2013 . On the difficulty of training recurrent neural networks . In Proceedings of the 30th International Conference on Machine Learning, ICML 2013, Atlanta, GA, USA, 16-21 June 2013 (JMLR Workshop and Conference Proceedings) , Vol. 28 .JMLR.org, 1310--1318. Razvan Pascanu, Tomas Mikolov, and Yoshua Bengio. 2013. On the difficulty of training recurrent neural networks. In Proceedings of the 30th International Conference on Machine Learning, ICML 2013, Atlanta, GA, USA, 16-21 June 2013 (JMLR Workshop and Conference Proceedings), Vol. 28.JMLR.org, 1310--1318."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3190508.3190517"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341301.3359642"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLOUD.2019.00097"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3135974.3135994"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2015.2420092"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2015.2494218"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3297858.3304072"},{"key":"e_1_3_2_1_52_1","volume-title":"Adams","author":"Snoek Jasper","year":"2012","unstructured":"Jasper Snoek , Hugo Larochelle , and Ryan P . Adams . 2012 . Practical Bayesian Optimization of Machine Learning Algorithms. In Advances in Neural Information Processing Systems 25: 26th Annual Conference on Neural Information Processing Systems 2012. Proceedings of a meeting held December 3-6, 2012, Lake Tahoe, Nevada, United States, Peter L. Bartlett, Fernando C. N. Pereira, Christopher J. C. Burges, L\u00e9on Bottou, and Kilian Q. Weinberger (Eds .). 2960--2968. htp:\/\/papers.nips.cc\/paper\/4522-practical-bayesian-optimization-of-machine-learning-algorithms Jasper Snoek, Hugo Larochelle, and Ryan P. Adams. 2012. Practical Bayesian Optimization of Machine Learning Algorithms. In Advances in Neural Information Processing Systems 25: 26th Annual Conference on Neural Information Processing Systems 2012. Proceedings of a meeting held December 3-6, 2012, Lake Tahoe, Nevada, United States, Peter L. Bartlett, Fernando C. N. Pereira, Christopher J. C. Burges, L\u00e9on Bottou, and Kilian Q. Weinberger (Eds.). 2960--2968. htp:\/\/papers.nips.cc\/paper\/4522-practical-bayesian-optimization-of-machine-learning-algorithms"},{"key":"e_1_3_2_1_53_1","volume-title":"Amazon's face recognition falsely matched 28 members of Congress with mugshots","author":"Snow Jacob","year":"2018","unstructured":"Jacob Snow . 2018. Amazon's face recognition falsely matched 28 members of Congress with mugshots . American Civil Liberties Union 28 ( 2018 ). Jacob Snow. 2018. Amazon's face recognition falsely matched 28 members of Congress with mugshots. American Civil Liberties Union 28 (2018)."},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/PDP.2010.43"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2018\/755"},{"key":"e_1_3_2_1_56_1","volume-title":"DeepID3: Face Recognition with Very Deep Neural Networks. CoRR abs\/1502.00873","author":"Sun Yi","year":"2015","unstructured":"Yi Sun , Ding Liang , Xiaogang Wang , and Xiaoou Tang . 2015. DeepID3: Face Recognition with Very Deep Neural Networks. CoRR abs\/1502.00873 ( 2015 ). arXiv:1502.00873 htp:\/\/arxiv.org\/abs\/1502.00873 Yi Sun, Ding Liang, Xiaogang Wang, and Xiaoou Tang. 2015. DeepID3: Face Recognition with Very Deep Neural Networks. CoRR abs\/1502.00873 (2015). arXiv:1502.00873 htp:\/\/arxiv.org\/abs\/1502.00873"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132747.3132750"},{"key":"e_1_3_2_1_58_1","volume-title":"Proceedings of the Eighteenth International Conference on Machine Learning (ICML 2001","author":"Wagstaff Kiri","year":"2001","unstructured":"Kiri Wagstaff , Claire Cardie , Seth Rogers , and Stefan Schr\u00f6dl . 2001 . Constrained K-means Clustering with Background Knowledge . In Proceedings of the Eighteenth International Conference on Machine Learning (ICML 2001 ), Williams College, Williamstown, MA, USA, June 28- July 1, 2001, Carla E. Brodley and Andrea Pohoreckyj Danyluk (Eds.). Morgan Kaufmann, 577--584. Kiri Wagstaff, Claire Cardie, Seth Rogers, and Stefan Schr\u00f6dl. 2001. Constrained K-means Clustering with Background Knowledge. In Proceedings of the Eighteenth International Conference on Machine Learning (ICML 2001), Williams College, Williamstown, MA, USA, June 28-July 1, 2001, Carla E. Brodley and Andrea Pohoreckyj Danyluk (Eds.). Morgan Kaufmann, 577--584."},{"key":"e_1_3_2_1_59_1","volume-title":"Automating Dependence-Aware Parallelization of Machine Learning Training on Distributed Shared Memory. In Proceedings of the Fourteenth EuroSys Conference 2019","author":"Wei Jinliang","year":"2019","unstructured":"Jinliang Wei , Garth A. Gibson , Phillip B. Gibbons , and Eric P. Xing . 2019 . Automating Dependence-Aware Parallelization of Machine Learning Training on Distributed Shared Memory. In Proceedings of the Fourteenth EuroSys Conference 2019 , Dresden, Germany , March 25-28, 2019 , George Candea, Robbert van Renesse, and Christof Fetzer (Eds.). ACM, 42:1-42:17. htps:\/\/doi.org\/10.1145\/3302424.3303954 10.1145\/3302424.3303954 Jinliang Wei, Garth A. Gibson, Phillip B. Gibbons, and Eric P. Xing. 2019. Automating Dependence-Aware Parallelization of Machine Learning Training on Distributed Shared Memory. In Proceedings of the Fourteenth EuroSys Conference 2019, Dresden, Germany, March 25-28, 2019, George Candea, Robbert van Renesse, and Christof Fetzer (Eds.). ACM, 42:1-42:17. htps:\/\/doi.org\/10.1145\/3302424.3303954"},{"key":"e_1_3_2_1_60_1","volume-title":"Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms. CoRR abs\/1708.07747","author":"Xiao Han","year":"2017","unstructured":"Han Xiao , Kashif Rasul , and Roland Vollgraf . 2017. Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms. CoRR abs\/1708.07747 ( 2017 ). arXiv:1708.07747 htp:\/\/arxiv.org\/abs\/1708.07747 Han Xiao, Kashif Rasul, and Roland Vollgraf. 2017. Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms. CoRR abs\/1708.07747 (2017). arXiv:1708.07747 htp:\/\/arxiv.org\/abs\/1708.07747"},{"key":"e_1_3_2_1_61_1","volume-title":"Yimin Hua, Serge Gueroussov, Hamed S Najafabadi, Timothy R Hughes, et al.","author":"Xiong Hui Y","year":"2015","unstructured":"Hui Y Xiong , Babak Alipanahi , Leo J Lee , Hannes Bretschneider , Daniele Merico , Ryan KC Yuen , Yimin Hua, Serge Gueroussov, Hamed S Najafabadi, Timothy R Hughes, et al. 2015 . The human splicing code reveals new insights into the genetic determinants of disease. Science 347, 6218 (2015), 1254806. Hui Y Xiong, Babak Alipanahi, Leo J Lee, Hannes Bretschneider, Daniele Merico, Ryan KC Yuen, Yimin Hua, Serge Gueroussov, Hamed S Najafabadi, Timothy R Hughes, et al. 2015. The human splicing code reveals new insights into the genetic determinants of disease. Science 347, 6218 (2015), 1254806."},{"key":"e_1_3_2_1_62_1","volume-title":"Proceedings of the Workshop on Machine Learning in High-Performance Computing Environments, MLHPC 2015","author":"Young Steven R.","year":"2015","unstructured":"Steven R. Young , Derek C. Rose , Thomas P. Karnowski , Seung-Hwan Lim , and Robert M. Patton . 2015. Optimizing deep learning hyperparameters through an evolutionary algorithm . In Proceedings of the Workshop on Machine Learning in High-Performance Computing Environments, MLHPC 2015 , Austin, Texas, USA , November 15, 2015 . ACM, 4:1-4:5. htps:\/\/doi.org\/10.1145\/2834892.2834896 10.1145\/2834892.2834896 Steven R. Young, Derek C. Rose, Thomas P. Karnowski, Seung-Hwan Lim, and Robert M. Patton. 2015. Optimizing deep learning hyperparameters through an evolutionary algorithm. In Proceedings of the Workshop on Machine Learning in High-Performance Computing Environments, MLHPC 2015, Austin, Texas, USA, November 15, 2015. ACM, 4:1-4:5. htps:\/\/doi.org\/10.1145\/2834892.2834896"},{"key":"e_1_3_2_1_63_1","volume-title":"Learning Transferable Architectures for Scalable Image Recognition. In 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018","author":"Zoph Barret","year":"2018","unstructured":"Barret Zoph , Vijay Vasudevan , Jonathon Shlens , and Quoc V. Le . 2018 . Learning Transferable Architectures for Scalable Image Recognition. In 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018 , Salt Lake City, UT, USA , June 18-22, 2018 . IEEE Computer Society, 8697--8710. htps:\/\/doi.org\/10.1109\/CVPR.2018.00907 10.1109\/CVPR.2018.00907 Barret Zoph, Vijay Vasudevan, Jonathon Shlens, and Quoc V. Le. 2018. Learning Transferable Architectures for Scalable Image Recognition. In 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA, June 18-22, 2018. IEEE Computer Society, 8697--8710. htps:\/\/doi.org\/10.1109\/CVPR.2018.00907"}],"event":{"name":"Middleware '20: 21st International Middleware Conference","sponsor":["ACM Association for Computing Machinery","IFIP"],"location":"Delft Netherlands","acronym":"Middleware '20"},"container-title":["Proceedings of the 21st International Middleware Conference"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3423211.3425692","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3423211.3425692","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:57Z","timestamp":1750195497000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3423211.3425692"}},"subtitle":["Pipeline Parallelism of Hyper and System Parameters Tuning for Deep Learning Clusters"],"short-title":[],"issued":{"date-parts":[[2020,12,7]]},"references-count":63,"alternative-id":["10.1145\/3423211.3425692","10.1145\/3423211"],"URL":"https:\/\/doi.org\/10.1145\/3423211.3425692","relation":{},"subject":[],"published":{"date-parts":[[2020,12,7]]},"assertion":[{"value":"2020-12-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}