{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T10:50:41Z","timestamp":1753440641119,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":51,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,11,7]],"date-time":"2022-11-07T00:00:00Z","timestamp":1667779200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,11,7]]},"DOI":"10.1145\/3542929.3563485","type":"proceedings-article","created":{"date-parts":[[2022,11,7]],"date-time":"2022-11-07T20:19:18Z","timestamp":1667852358000},"page":"461-476","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Serving unseen deep learning models with near-optimal configurations"],"prefix":"10.1145","author":[{"given":"Yuewen","family":"Wu","sequence":"first","affiliation":[{"name":"Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Heng","family":"Wu","sequence":"additional","affiliation":[{"name":"Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Diaohan","family":"Luo","sequence":"additional","affiliation":[{"name":"University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuanjia","family":"Xu","sequence":"additional","affiliation":[{"name":"University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yi","family":"Hu","sequence":"additional","affiliation":[{"name":"University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenbo","family":"Zhang","sequence":"additional","affiliation":[{"name":"Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hua","family":"Zhong","sequence":"additional","affiliation":[{"name":"Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,11,7]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"12th USENIX symposium on operating systems design and implementation (OSDI 16)","author":"Abadi Mart\u00edn","year":"2016","unstructured":"Mart\u00edn Abadi , Paul Barham , Jianmin Chen , Zhifeng Chen , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Geoffrey Irving , Michael Isard , 2016 . {TensorFlow}: A System for {Large-Scale } Machine Learning . In 12th USENIX symposium on operating systems design and implementation (OSDI 16) . 265--283. Mart\u00edn Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, et al. 2016. {TensorFlow}: A System for {Large-Scale } Machine Learning. In 12th USENIX symposium on operating systems design and implementation (OSDI 16). 265--283."},{"key":"e_1_3_2_1_2_1","volume-title":"Jianshu Chen, Shivaram Venkataraman, Minlan Yu, and Ming Zhang.","author":"Alipourfard Omid","year":"2017","unstructured":"Omid Alipourfard , Hongqiang Harry Liu , Jianshu Chen, Shivaram Venkataraman, Minlan Yu, and Ming Zhang. 2017 . Cherrypick : Adaptively unearthing the best cloud configurations for big data analytics. In 14th {USENIX} Symposium on Networked Systems Design and Implementation ( {NSDI} 17). 469--482. Omid Alipourfard, Hongqiang Harry Liu, Jianshu Chen, Shivaram Venkataraman, Minlan Yu, and Ming Zhang. 2017. Cherrypick: Adaptively unearthing the best cloud configurations for big data analytics. In 14th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 17). 469--482."},{"key":"e_1_3_2_1_3_1","unstructured":"Amazon EC2 2022. Amazon EC2. https:\/\/aws.amazon.com\/  Amazon EC2 2022. Amazon EC2. https:\/\/aws.amazon.com\/"},{"key":"e_1_3_2_1_4_1","unstructured":"Amazon EC2 Instance Explorer 2022. Amazon EC2. https:\/\/aws.amazon.com\/cn\/ec2\/instance-explorer\/  Amazon EC2 Instance Explorer 2022. Amazon EC2. https:\/\/aws.amazon.com\/cn\/ec2\/instance-explorer\/"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364918755924"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2004.10934"},{"key":"e_1_3_2_1_7_1","volume-title":"13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18)","author":"Chen Tianqi","year":"2018","unstructured":"Tianqi Chen , Thierry Moreau , Ziheng Jiang , Lianmin Zheng , Eddie Yan , Haichen Shen , Meghan Cowan , Leyuan Wang , Yuwei Hu , Luis Ceze , 2018 . {TVM}: An Automated {End-to-End} Optimizing Compiler for Deep Learning . In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18) . 578--594. Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng, Eddie Yan, Haichen Shen, Meghan Cowan, Leyuan Wang, Yuwei Hu, Luis Ceze, et al. 2018. {TVM}: An Automated {End-to-End} Optimizing Compiler for Deep Learning. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18). 578--594."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458817.3476203"},{"key":"e_1_3_2_1_9_1","volume-title":"Scalable global optimization via local bayesian optimization. Advances in Neural Information Processing Systems 32","author":"Eriksson David","year":"2019","unstructured":"David Eriksson , Michael Pearce , Jacob Gardner , Ryan D Turner , and Matthias Poloczek . 2019. Scalable global optimization via local bayesian optimization. Advances in Neural Information Processing Systems 32 ( 2019 ). David Eriksson, Michael Pearce, Jacob Gardner, Ryan D Turner, and Matthias Poloczek. 2019. Scalable global optimization via local bayesian optimization. Advances in Neural Information Processing Systems 32 (2019)."},{"key":"e_1_3_2_1_10_1","unstructured":"Ori Hadary Luke Marshall Ishai Menache Abhisek Pan Esaias E Greeff David Dion Star Dorminey Shailesh Joshi Yang Chen Mark Russinovich etal 2020. Protean:{VM} Allocation Service at Scale. In 14th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 20). 845--861.  Ori Hadary Luke Marshall Ishai Menache Abhisek Pan Esaias E Greeff David Dion Star Dorminey Shailesh Joshi Yang Chen Mark Russinovich et al. 2020. Protean:{VM} Allocation Service at Scale. In 14th { USENIX } Symposium on Operating Systems Design and Implementation ( { OSDI } 20) . 845--861."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3464298.3476132"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00140"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLOUD.2018.00058"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472883.3486993"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIE.2021.3095790"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3419111.3421282"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPE.2017.2779554"},{"key":"e_1_3_2_1_19_1","volume-title":"Characterizing and modeling distributed training with transient cloud gpu servers. arXiv preprint arXiv:2004.03072","author":"Li Shijian","year":"2020","unstructured":"Shijian Li , Robert J Walls , and Tian Guo . 2020. Characterizing and modeling distributed training with transient cloud gpu servers. arXiv preprint arXiv:2004.03072 ( 2020 ). Shijian Li, Robert J Walls, and Tian Guo. 2020. Characterizing and modeling distributed training with transient cloud gpu servers. arXiv preprint arXiv:2004.03072 (2020)."},{"key":"e_1_3_2_1_20_1","volume-title":"SpotTune: Leveraging Transient Resources for Cost-efficient Hyper-parameter Tuning in the Public Cloud. arXiv preprint arXiv:2012.03576","author":"Li Yan","year":"2020","unstructured":"Yan Li , Bo An , Junming Ma , Donggang Cao , Yasha Wang , and Hong Mei . 2020. SpotTune: Leveraging Transient Resources for Cost-efficient Hyper-parameter Tuning in the Public Cloud. arXiv preprint arXiv:2012.03576 ( 2020 ). Yan Li, Bo An, Junming Ma, Donggang Cao, Yasha Wang, and Hong Mei. 2020. SpotTune: Leveraging Transient Resources for Cost-efficient Hyper-parameter Tuning in the Public Cloud. arXiv preprint arXiv:2012.03576 (2020)."},{"key":"e_1_3_2_1_21_1","first-page":"105","article-title":"PaddlePaddle: An open-source deep learning platform from industrial practice","volume":"1","author":"Ma Yanjun","year":"2019","unstructured":"Yanjun Ma , Dianhai Yu , Tian Wu , and Haifeng Wang . 2019 . PaddlePaddle: An open-source deep learning platform from industrial practice . Frontiers of Data and Domputing 1 , 1 (2019), 105 -- 115 . Yanjun Ma, Dianhai Yu, Tian Wu, and Haifeng Wang. 2019. PaddlePaddle: An open-source deep learning platform from industrial practice. Frontiers of Data and Domputing 1, 1 (2019), 105--115.","journal-title":"Frontiers of Data and Domputing"},{"volume-title":"14th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 20). 937--954.","author":"Mai Luo","key":"e_1_3_2_1_22_1","unstructured":"Luo Mai , Guo Li , Marcel Wagenl\u00e4nder , Konstantinos Fertakis , Andrei-Octavian Brabete , and Peter Pietzuch . 2020. KungFu: Making Training in Distributed Machine Learning Adaptive . In 14th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 20). 937--954. Luo Mai, Guo Li, Marcel Wagenl\u00e4nder, Konstantinos Fertakis, Andrei-Octavian Brabete, and Peter Pietzuch. 2020. KungFu: Making Training in Distributed Machine Learning Adaptive. In 14th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 20). 937--954."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2017.8057205"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS47924.2020.00090"},{"key":"e_1_3_2_1_25_1","first-page":"2","article-title":"Docker: lightweight linux containers for consistent development and deployment","volume":"2014","author":"Dirk Merkel","year":"2014","unstructured":"Dirk Merkel et al. 2014 . Docker: lightweight linux containers for consistent development and deployment . Linux journal 2014 , 239 (2014), 2 . Dirk Merkel et al. 2014. Docker: lightweight linux containers for consistent development and deployment. Linux journal 2014, 239 (2014), 2.","journal-title":"Linux journal"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/3488766.3488793"},{"key":"e_1_3_2_1_27_1","unstructured":"Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury Gregory Chanan Trevor Killeen Zeming Lin Natalia Gimelshein Luca Antiga etal 2019. PyTorch: An imperative style high-performance deep learning library. In Advances in Neural Information Processing Systems. 8024--8035.  Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury Gregory Chanan Trevor Killeen Zeming Lin Natalia Gimelshein Luca Antiga et al. 2019. PyTorch: An imperative style high-performance deep learning library. In Advances in Neural Information Processing Systems. 8024--8035."},{"key":"e_1_3_2_1_28_1","volume-title":"Suhas Jayaram Subramanya, Willie Neiswanger, Qirong Ho, Hao Zhang, Gregory R Ganger, and Eric P Xing.","author":"Qiao Aurick","year":"2021","unstructured":"Aurick Qiao , Sang Keun Choe , Suhas Jayaram Subramanya, Willie Neiswanger, Qirong Ho, Hao Zhang, Gregory R Ganger, and Eric P Xing. 2021 . Pollux : Co-adaptive cluster scheduling for goodput-optimized deep learning. In 15th {USENIX} Symposium on Operating Systems Design and Implementation ( {OSDI} 21). Aurick Qiao, Sang Keun Choe, Suhas Jayaram Subramanya, Willie Neiswanger, Qirong Ho, Hao Zhang, Gregory R Ganger, and Eric P Xing. 2021. Pollux: Co-adaptive cluster scheduling for goodput-optimized deep learning. In 15th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 21)."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISCA45697.2020.00045"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1804.02767"},{"key":"e_1_3_2_1_31_1","unstructured":"Mikita Sazanovich Anastasiya Nikolskaya Yury Belousov and Aleksei Shpilman. 2021. Solving Black-Box Optimization Challenge via Learning Search Space Partition for Local Bayesian Optimization. In NeurIPS 2020 Competition and Demonstration Track. PMLR 77--85.  Mikita Sazanovich Anastasiya Nikolskaya Yury Belousov and Aleksei Shpilman. 2021. Solving Black-Box Optimization Challenge via Learning Search Space Partition for Local Bayesian Optimization. In NeurIPS 2020 Competition and Demonstration Track. PMLR 77--85."},{"key":"e_1_3_2_1_32_1","unstructured":"Scikit-learn 2022. Machine Learning in Python. https:\/\/scikit-learn.org\/stable\/  Scikit-learn 2022. Machine Learning in Python. https:\/\/scikit-learn.org\/stable\/"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458817.3476197"},{"key":"e_1_3_2_1_34_1","volume-title":"Monte Carlo tree search: A review of recent modifications and applications. arXiv preprint arXiv.2103.04931","author":"\u015awiechowski Maciej","year":"2021","unstructured":"Maciej \u015awiechowski , Konrad Godlewski , Bartosz Sawicki , and Jacek Ma\u0144dziuk . 2021. Monte Carlo tree search: A review of recent modifications and applications. arXiv preprint arXiv.2103.04931 ( 2021 ). Maciej \u015awiechowski, Konrad Godlewski, Bartosz Sawicki, and Jacek Ma\u0144dziuk. 2021. Monte Carlo tree search: A review of recent modifications and applications. arXiv preprint arXiv.2103.04931 (2021)."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1602.07261"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.308"},{"key":"e_1_3_2_1_37_1","volume-title":"a repository of trained machine learning models","author":"Hub TensorFlow","year":"2022","unstructured":"TensorFlow Hub : a repository of trained machine learning models 2022 . TensorFlow Hub . https:\/\/www.tensorflow.org\/hub\/ TensorFlow Hub: a repository of trained machine learning models 2022. TensorFlow Hub. https:\/\/www.tensorflow.org\/hub\/"},{"key":"e_1_3_2_1_38_1","volume-title":"Proceedings of the 13th Usenix Conference on Networked Systems Design and Implementation","author":"Venkataraman Shivaram","year":"2016","unstructured":"Shivaram Venkataraman , Zongheng Yang , Michael Franklin , Benjamin Recht , and Ion Stoica . 2016 . Ernest: Efficient Performance Prediction for Large-Scale Advanced Analytics . In Proceedings of the 13th Usenix Conference on Networked Systems Design and Implementation ( Santa Clara, CA) (NSDI'16). USENIX Association, USA, 363--378. Shivaram Venkataraman, Zongheng Yang, Michael Franklin, Benjamin Recht, and Ion Stoica. 2016. Ernest: Efficient Performance Prediction for Large-Scale Advanced Analytics. In Proceedings of the 13th Usenix Conference on Networked Systems Design and Implementation (Santa Clara, CA) (NSDI'16). USENIX Association, USA, 363--378."},{"key":"e_1_3_2_1_39_1","volume-title":"Deep learning for computer vision: A brief review. Computational intelligence and neuroscience 2018","author":"Voulodimos Athanasios","year":"2018","unstructured":"Athanasios Voulodimos , Nikolaos Doulamis , Anastasios Doulamis , and Eftychios Protopapadakis . 2018. Deep learning for computer vision: A brief review. Computational intelligence and neuroscience 2018 ( 2018 ). Athanasios Voulodimos, Nikolaos Doulamis, Anastasios Doulamis, and Eftychios Protopapadakis. 2018. Deep learning for computer vision: A brief review. Computational intelligence and neuroscience 2018 (2018)."},{"key":"e_1_3_2_1_40_1","volume-title":"The progressive JavaScript framework","author":"VUE","year":"2022","unstructured":"VUE : The progressive JavaScript framework 2022 . VUE : The progressive JavaScript framework. https:\/\/vuejs.org\/ VUE: The progressive JavaScript framework 2022. VUE: The progressive JavaScript framework. https:\/\/vuejs.org\/"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2018.2842159"},{"key":"e_1_3_2_1_42_1","first-page":"19511","article-title":"Learning search space partition for black-box optimization using monte carlo tree search","volume":"33","author":"Wang Linnan","year":"2020","unstructured":"Linnan Wang , Rodrigo Fonseca , and Yuandong Tian . 2020 . Learning search space partition for black-box optimization using monte carlo tree search . Advances in Neural Information Processing Systems 33 (2020), 19511 -- 19522 . Linnan Wang, Rodrigo Fonseca, and Yuandong Tian. 2020. Learning search space partition for black-box optimization using monte carlo tree search. Advances in Neural Information Processing Systems 33 (2020), 19511--19522.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472883.3486987"},{"key":"e_1_3_2_1_44_1","volume-title":"Alphax: exploring neural architectures with deep neural networks and monte carlo tree search. arXiv preprint arXiv:1903.11059","author":"Wang Linnan","year":"2019","unstructured":"Linnan Wang , Yiyang Zhao , Yuu Jinnai , Yuandong Tian , and Rodrigo Fonseca . 2019. Alphax: exploring neural architectures with deep neural networks and monte carlo tree search. arXiv preprint arXiv:1903.11059 ( 2019 ). Linnan Wang, Yiyang Zhao, Yuu Jinnai, Yuandong Tian, and Rodrigo Fonseca. 2019. Alphax: exploring neural architectures with deep neural networks and monte carlo tree search. arXiv preprint arXiv:1903.11059 (2019)."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472456.3472488"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11390-021-0232-4"},{"key":"e_1_3_2_1_47_1","unstructured":"Neeraja J Yadwadkar Bharath Hariharan Joseph E Gonzalez Burton Smith and Randy H Katz. 2017. Selecting the best vm across multiple public clouds: A data-driven performance modeling approach. In SoCC. ACM 452--465.  Neeraja J Yadwadkar Bharath Hariharan Joseph E Gonzalez Burton Smith and Randy H Katz. 2017. Selecting the best vm across multiple public clouds: A data-driven performance modeling approach. In SoCC . ACM 452--465."},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS47924.2020.00051"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS47924.2020.00051"},{"key":"e_1_3_2_1_50_1","volume-title":"2019 USENIX Annual Technical Conference (USENIX ATC 19)","author":"Zhang Chengliang","year":"2019","unstructured":"Chengliang Zhang , Minchen Yu , Wei Wang , and Feng Yan . 2019 . {MArk}: Exploiting Cloud Services for {Cost-Effective}, {SLO-Aware} Machine Learning Inference Serving . In 2019 USENIX Annual Technical Conference (USENIX ATC 19) . 1049--1062. Chengliang Zhang, Minchen Yu, Wei Wang, and Feng Yan. 2019. {MArk}: Exploiting Cloud Services for {Cost-Effective}, {SLO-Aware} Machine Learning Inference Serving. In 2019 USENIX Annual Technical Conference (USENIX ATC 19). 1049--1062."},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458864.3467882"}],"event":{"name":"SoCC '22: ACM Symposium on Cloud Computing","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGOPS ACM Special Interest Group on Operating Systems"],"location":"San Francisco California","acronym":"SoCC '22"},"container-title":["Proceedings of the 13th Symposium on Cloud Computing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3542929.3563485","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3542929.3563485","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:31Z","timestamp":1750182571000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3542929.3563485"}},"subtitle":["a fast adaptive search approach"],"short-title":[],"issued":{"date-parts":[[2022,11,7]]},"references-count":51,"alternative-id":["10.1145\/3542929.3563485","10.1145\/3542929"],"URL":"https:\/\/doi.org\/10.1145\/3542929.3563485","relation":{},"subject":[],"published":{"date-parts":[[2022,11,7]]},"assertion":[{"value":"2022-11-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}