{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T20:38:25Z","timestamp":1780346305750,"version":"3.54.1"},"reference-count":68,"publisher":"Association for Computing Machinery (ACM)","issue":"5","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2024,1]]},"abstract":"<jats:p>The growing demand for advanced analytics beyond statistical aggregation calls for database systems that support effective model selection of deep neural networks (DNNs). However, existing model selection strategies are based on either training-based algorithms that deliver high-performing models at the expense of high computational cost, or training-free algorithms that enhance computational efficiency with reduced effectiveness. These strategies often disregard computational cost and response time Service-Level Objectives (SLOs), which are of concern to average or budget-conscious machine learning users. In addition, they lack a well-designed integration of the model selection algorithms with DBMSs, which hinders efficient in-database model selection. This paper presents TRAILS, a resource-efficient and SLO-aware in-database model selection system. To leverage the strengths of both training-free and training-based model selection, we first characterize nine state-of-the-art training-free model evaluation metrics and propose a more effective one named JacFlow, and then, restructure the conventional model selection procedure into two phases: filtering and refinement. A novel coordinator is also introduced to strike a balance between the high efficiency of train-free algorithms and the high effectiveness of training-based algorithms, ensuring high-performing model selection while adhering to target SLOs. Moreover, we incorporate the proposed algorithm into PostgreSQL to develop TRAILS, thereby both enhancing resource efficiency and reducing model selection latency. This integration establishes a foundation for declarative model definition and selection within DBMSs. Empirical results demonstrate that our TRAILS reduces model selection time and computational expenses considerably by up to 24.38x and 29.32x respectively compared to existing model selection systems.<\/jats:p>","DOI":"10.14778\/3641204.3641212","type":"journal-article","created":{"date-parts":[[2024,5,2]],"date-time":"2024-05-02T22:05:43Z","timestamp":1714687543000},"page":"1020-1033","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Database Native Model Selection: Harnessing Deep Neural Networks in Database Systems"],"prefix":"10.14778","volume":"17","author":[{"given":"Naili","family":"Xing","sequence":"first","affiliation":[{"name":"National University of Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shaofeng","family":"Cai","sequence":"additional","affiliation":[{"name":"National University of Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gang","family":"Chen","sequence":"additional","affiliation":[{"name":"Zhejiang University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhaojing","family":"Luo","sequence":"additional","affiliation":[{"name":"National University of Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Beng Chin","family":"Ooi","sequence":"additional","affiliation":[{"name":"National University of Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jian","family":"Pei","sequence":"additional","affiliation":[{"name":"Duke University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,5,2]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2023. Automate machine learning model selection with Azure Machine Learning. https:\/\/learn.microsoft.com\/en-us\/training\/modules\/automate-model-selection-with-azure-automl\/1-introduction."},{"key":"e_1_2_1_2_1","unstructured":"2023. AutoML: Train High-quality Custom Machine Learning Models with Minimal Effort and Machine Learning Expertise. https:\/\/cloud.google.com\/automl"},{"key":"e_1_2_1_3_1","unstructured":"2023. AWS AutoML Solutions. https:\/\/aws.amazon.com\/machine-learning\/automl\/."},{"key":"e_1_2_1_4_1","unstructured":"2023. PostgreSQL. https:\/\/www.postgresql.org\/."},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of The International Conference on Learning Representations.","author":"Abdelfattah Mohamed S.","year":"2021","unstructured":"Mohamed S. Abdelfattah, Abhinav Mehrotra, Lukasz Dudziak, and Nicholas Donald Lane. 2021. Zero-Cost Proxies for Lightweight NAS. In Proceedings of The International Conference on Learning Representations."},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of The International Conference on Data Engineering. 449--460","author":"Aberger Christopher R.","year":"2018","unstructured":"Christopher R. Aberger, Andrew Lamb, Kunle Olukotun, and Christopher R\u00e9. 2018. LevelHeaded: A Unified Engine for Business Intelligence and Linear Algebra Querying. In Proceedings of The International Conference on Data Engineering. 449--460."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.14778\/2078331.2078334"},{"key":"e_1_2_1_8_1","volume-title":"Best Arm Identification in Multi-Armed Bandits. In Conference on Learning Theory. 41--53","author":"Audibert Jean-Yves","year":"2010","unstructured":"Jean-Yves Audibert, S\u00e9bastien Bubeck, and R\u00e9mi Munos. 2010. Best Arm Identification in Multi-Armed Bandits. In Conference on Learning Theory. 41--53."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732286.2732292"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/978-3-642-04414-4_7","article-title":"Pure Exploration in Multi-armed Bandits Problems","volume":"5809","author":"Bubeck S\u00e9bastien","year":"2009","unstructured":"S\u00e9bastien Bubeck, R\u00e9mi Munos, and Gilles Stoltz. 2009. Pure Exploration in Multi-armed Bandits Problems. In Algorithmic Learning Theory, Vol. 5809. 23--37.","journal-title":"Algorithmic Learning Theory"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of The AAAI Conference on Artificial Intelligence. 2787--2794","author":"Cai Han","year":"2018","unstructured":"Han Cai, Tianyao Chen, Weinan Zhang, Yong Yu, and Jun Wang. 2018. Efficient Architecture Search by Network Transformation. In Proceedings of The AAAI Conference on Artificial Intelligence. 2787--2794."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.14778\/3364324.3364325"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of The International Conference on Management of Data.","author":"Cai Shaofeng","year":"2021","unstructured":"Shaofeng Cai, Kaiping Zheng, Gang Chen, H. V. Jagadish, Beng Chin Ooi, and Meihui Zhang. 2021. ARM-Net: Adaptive Relation Modeling Network for Structured Data. In Proceedings of The International Conference on Management of Data."},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of The International Conference on Management of Data. 2477--2489","author":"Cao Wei","year":"2021","unstructured":"Wei Cao, Yingqiang Zhang, Xinjun Yang, Feifei Li, Sheng Wang, Qingda Hu, Xuntao Cheng, Zongzhi Chen, Zhenjun Liu, Jing Fang, Bo Wang, Yuhui Wang, Haiqing Sun, Ze Yang, Zhushi Cheng, Sen Chen, Jian Wu, Wei Hu, Jianwei Zhao, Yusong Gao, Songlu Cai, Yunyang Zhang, and Jiawang Tong. 2021. PolarDB Serverless: A Cloud Native Database for Disaggregated Data Centers. In Proceedings of The International Conference on Management of Data. 2477--2489."},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of The International Conference on Learning Representations.","author":"Chen Wuyang","year":"2021","unstructured":"Wuyang Chen, Xinyu Gong, and Zhangyang Wang. 2021. Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective. In Proceedings of The International Conference on Learning Representations."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687553.1687576"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of The USENIX Symposium on Networked Systems Design and Implementation. 613--627","author":"Crankshaw Daniel","year":"2017","unstructured":"Daniel Crankshaw, Xin Wang, Giulio Zhou, Michael J. Franklin, Joseph E. Gonzalez, and Ion Stoica. 2017. Clipper: A Low-Latency Online Prediction Serving System. In Proceedings of The USENIX Symposium on Networked Systems Design and Implementation. 613--627."},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of The International Conference on Learning Representations.","author":"Dong Xuanyi","year":"2020","unstructured":"Xuanyi Dong and Yi Yang. 2020. NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search. In Proceedings of The International Conference on Learning Representations."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.14778\/3236187.3236194"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458817.3476203"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the International Conference on Machine Learning","volume":"80","author":"Falkner Stefan","year":"2018","unstructured":"Stefan Falkner, Aaron Klein, and Frank Hutter. 2018. BOHB: Robust and Efficient Hyperparameter Optimization at Scale. In Proceedings of the International Conference on Machine Learning, Vol. 80. 1436--1445."},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of The International Conference on Management of Data. 755--768","author":"Fard Arash","year":"2020","unstructured":"Arash Fard, Anh Le, George Larionov, Waqas Dhillon, and Chuck Bear. 2020. Vertica-ML: Distributed Machine Learning in Vertica Database. In Proceedings of The International Conference on Management of Data. 755--768."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.14778\/2367502.2367510"},{"key":"e_1_2_1_24_1","volume-title":"Deep Networks with Stochastic Depth. In Proceedings of The European Conference on Computer Vision","volume":"9908","author":"Huang Gao","unstructured":"Gao Huang, Yu Sun, Zhuang Liu, Daniel Sedra, and Kilian Q. Weinberger. 2016. Deep Networks with Stochastic Depth. In Proceedings of The European Conference on Computer Vision, Vol. 9908. 646--661."},{"key":"e_1_2_1_25_1","volume-title":"Non-stochastic Best Arm Identification and Hyperparameter Optimization. In Proceedings of The International Conference on Artificial Intelligence and Statistics","volume":"51","author":"Kevin","unstructured":"Kevin G. Jamieson and Ameet Talwalkar. 2016. Non-stochastic Best Arm Identification and Hyperparameter Optimization. In Proceedings of The International Conference on Artificial Intelligence and Statistics, Vol. 51. 240--248."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/356924.356928"},{"key":"e_1_2_1_27_1","first-page":"1","volume-title":"Proceedings of The International Conference on Management of Data 1","author":"Jia Peng","year":"2023","unstructured":"Peng Jia, Shaofeng Cai, Beng Chin Ooi, Pinghui Wang, and Yiyuan Xiong. 2023. Robust and Transferable Log-based Anomaly Detection. Proceedings of The International Conference on Management of Data 1, 1 (2023), 64:1--64:26."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.14778\/3297753.3297756"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of The Advances in Neural Information Processing Systems.","author":"Krishnakumar Arjun","year":"2022","unstructured":"Arjun Krishnakumar, Colin White, Arber Zela, Renbo Tu, Mahmoud Safari, and Frank Hutter. 2022. NAS-Bench-Suite-Zero: Accelerating Research on Zero Cost Proxies. In Proceedings of The Advances in Neural Information Processing Systems."},{"key":"e_1_2_1_30_1","unstructured":"Alex Krizhevsky Geoffrey Hinton et al. 2009. Learning multiple layers of features from tiny images. Technical report (2009)."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of The International Conference on Learning Representations.","author":"Lee Namhoon","unstructured":"Namhoon Lee, Thalaiyasingam Ajanthan, and Philip H. S. Torr. 2019. Snip: single-Shot Network Pruning based on Connection sensitivity. In Proceedings of The International Conference on Learning Representations."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.14778\/3476311.3476378"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.14778\/3137765.3137812"},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 337--346","author":"Lin Ming","year":"2021","unstructured":"Ming Lin, Pichao Wang, Zhenhong Sun, Hesen Chen, Xiuyu Sun, Qi Qian, Hao Li, and Rong Jin. 2021. Zen-NAS: A Zero-Shot NAS for High-Performance Image Recognition. In Proceedings of the IEEE International Conference on Computer Vision. 337--346."},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of The International Conference on Learning Representations.","author":"Liu Hanxiao","year":"2018","unstructured":"Hanxiao Liu, Karen Simonyan, Oriol Vinyals, Chrisantha Fernando, and Koray Kavukcuoglu. 2018. Hierarchical Representations for Efficient Architecture Search. In Proceedings of The International Conference on Learning Representations."},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of The International Conference on Learning Representations.","author":"Liu Hanxiao","year":"2019","unstructured":"Hanxiao Liu, Karen Simonyan, and Yiming Yang. 2019. DARTS: Differentiable Architecture Search. In Proceedings of The International Conference on Learning Representations."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i10.17067"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of The International Conference on Data Engineering. 485--496","author":"Luo Zhaojing","year":"2018","unstructured":"Zhaojing Luo, Shaofeng Cai, Jinyang Gao, Meihui Zhang, Kee Yuan Ngiam, Gang Chen, and Wang-Chien Lee. 2018. Adaptive Lightweight Regularization Tool for Complex Analytics. In Proceedings of The International Conference on Data Engineering. 485--496."},{"key":"e_1_2_1_39_1","first-page":"1","volume-title":"Proceedings of The International Conference on Management of Data 1","author":"Luo Zhaojing","year":"2023","unstructured":"Zhaojing Luo, Shaofeng Cai, Yatong Wang, and Beng Chin Ooi. 2023. Regularized Pairwise Relationship based Analytics for Structured Data. Proceedings of The International Conference on Management of Data 1, 1 (2023), 82:1--82:27."},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of The Annual Conference of the International Speech Communication Association. 1278--1282","author":"Mazzawi Hanna","year":"2019","unstructured":"Hanna Mazzawi, Xavi Gonzalvo, Aleks Kracun, Prashant Sridhar, Niranjan Subrahmanya, Ignacio Lopez-Moreno, Hyun-Jin Park, and Patrick Violette. 2019. Improving Keyword Spotting and Language Identification via Neural Architecture Search at Scale. In Proceedings of The Annual Conference of the International Speech Communication Association. 1278--1282."},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the International Conference on Machine Learning","volume":"139","author":"Mellor Joe","unstructured":"Joe Mellor, Jack Turner, Amos J. Storkey, and Elliot J. Crowley. 2021. Neural Architecture Search without Training. In Proceedings of the International Conference on Machine Learning, Vol. 139, 7588--7598."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.14778\/3407790.3407816"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the ACM International Conference on Multimedia. 685--688","author":"Ooi Beng Chin","year":"2015","unstructured":"Beng Chin Ooi, Kian-Lee Tan, Sheng Wang, Wei Wang, Qingchao Cai, Gang Chen, Jinyang Gao, Zhaojing Luo, Anthony K. H. Tung, Yuan Wang, Zhongle Xie, Meihui Zhang, and Kaiping Zheng. 2015. SINGA: A Distributed Deep Learning Platform. In Proceedings of the ACM International Conference on Multimedia. 685--688."},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of The Advances in Neural Information Processing Systems. 8024--8035","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas K\u00f6pf, Edward Z. Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Proceedings of The Advances in Neural Information Processing Systems. 8024--8035."},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of The AAAI Conference on Artificial Intelligence. 4780--4789","author":"Real Esteban","unstructured":"Esteban Real, Alok Aggarwal, Yanping Huang, and Quoc V. Le. 2019. Regularized Evolution for Image Classifier Architecture Search. In Proceedings of The AAAI Conference on Artificial Intelligence. 4780--4789."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-015-0816-y"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.14778\/3352063.3352083"},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of The International Conference on Learning Representations.","author":"Shu Yao","year":"2022","unstructured":"Yao Shu, Shaofeng Cai, Zhongxiang Dai, Beng Chin Ooi, and Bryan Kian Hsiang Low. 2022. NASI: Label- and Data-agnostic Neural Architecture Search at Initialization. In Proceedings of The International Conference on Learning Representations."},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of The Advances in Neural Information Processing Systems.","author":"Shu Yao","year":"2022","unstructured":"Yao Shu, Zhongxiang Dai, Zhaoxuan Wu, and Bryan Kian Hsiang Low. 2022. Unifying and Boosting Gradient-Based Training-Free Neural Architecture Search. In Proceedings of The Advances in Neural Information Processing Systems."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2013.19"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of The Advances in Neural Information Processing Systems.","author":"Tanaka Hidenori","year":"2020","unstructured":"Hidenori Tanaka, Daniel Kunin, Daniel L. K. Yamins, and Surya Ganguli. 2020. Pruning Neural Networks without Any Data by Iteratively Conserving Synaptic Flow. In Proceedings of The Advances in Neural Information Processing Systems."},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of The International Conference on Learning Representations.","author":"Wang Chaoqi","unstructured":"Chaoqi Wang, Guodong Zhang, and Roger B. Grosse. 2020. Picking Winning Tickets Before Training by Preserving Gradient Flow. In Proceedings of The International Conference on Learning Representations."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.14778\/3282495.3282499"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3003665.3003669"},{"key":"e_1_2_1_55_1","volume-title":"Neural Architecture Search: Insights from 1000 Papers. CoRR abs\/2301.08727","author":"White Colin","year":"2023","unstructured":"Colin White, Mahmoud Safari, Rhea Sukthanker, Binxin Ru, Thomas Elsken, Arber Zela, Debadeepta Dey, and Frank Hutter. 2023. Neural Architecture Search: Insights from 1000 Papers. CoRR abs\/2301.08727 (2023)."},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of The Advances in Neural Information Processing Systems. 28454--28469","author":"White Colin","year":"2021","unstructured":"Colin White, Arber Zela, Robin Ru, Yang Liu, and Frank Hutter. 2021. How Powerful are Performance Predictors in Neural Architecture Search?. In Proceedings of The Advances in Neural Information Processing Systems. 28454--28469."},{"key":"e_1_2_1_57_1","volume-title":"A Survey on Neural Architecture Search. CoRR abs\/1905.01392","author":"Wistuba Martin","year":"2019","unstructured":"Martin Wistuba, Ambrish Rawat, and Tejaswini Pedapati. 2019. A Survey on Neural Architecture Search. CoRR abs\/1905.01392 (2019)."},{"key":"e_1_2_1_58_1","volume-title":"Proceedings of The ACM International Conference on Multimedia. 1293--1302","author":"Xing Naili","year":"2021","unstructured":"Naili Xing, Sai Ho Yeung, Chenghao Cai, Teck Khim Ng, Wei Wang, Kaiyuan Yang, Nan Yang, Meihui Zhang, Gang Chen, and Beng Chin Ooi. 2021. SINGA-Easy: An Easy-to-Use Framework for MultiModal Analysis. In Proceedings of The ACM International Conference on Multimedia. 1293--1302."},{"key":"e_1_2_1_59_1","volume-title":"Proceedings of the International Conference on Machine Learning","volume":"139","author":"Xu Jingjing","year":"2021","unstructured":"Jingjing Xu, Liang Zhao, Junyang Lin, Rundong Gao, Xu Sun, and Hongxia Yang. 2021. KNAS: Green Neural Architecture Search. In Proceedings of the International Conference on Machine Learning, Vol. 139. 11613--11625."},{"key":"e_1_2_1_60_1","volume-title":"Proceedings of The International Conference on Management of Data. 1286--1300","author":"Xu Lijie","year":"2022","unstructured":"Lijie Xu, Shuang Qiu, Binhang Yuan, Jiawei Jiang, C\u00e9dric Renggli, Shaoduo Gan, Kaan Kara, Guoliang Li, Ji Liu, Wentao Wu, Jieping Ye, and Ce Zhang. 2022. In-Database Machine Learning with CorgiPile: Stochastic Gradient Descent without Full Data Shuffle. In Proceedings of The International Conference on Management of Data. 1286--1300."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.14778\/3415478.3415542"},{"key":"e_1_2_1_62_1","volume-title":"Proceedings of The Advances in Neural Information Processing Systems. 22534--22549","author":"Yan Shen","year":"2021","unstructured":"Shen Yan, Colin White, Yash Savani, and Frank Hutter. 2021. NAS-Bench-x11 and the Power of Learning Curves. In Proceedings of The Advances in Neural Information Processing Systems. 22534--22549."},{"key":"e_1_2_1_63_1","first-page":"11906","article-title":"TabNAS: Rejection Sampling for Neural Architecture Search on Tabular Datasets","volume":"35","author":"Yang Chengrun","year":"2022","unstructured":"Chengrun Yang, Gabriel Bender, Hanxiao Liu, Pieter-Jan Kindermans, Madeleine Udell, Yifeng Lu, Quoc V Le, and Da Huang. 2022. TabNAS: Rejection Sampling for Neural Architecture Search on Tabular Datasets. Proceedings of The Advances in Neural Information Processing Systems 35, 11906--11917.","journal-title":"Proceedings of The Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_64_1","volume-title":"Proceedings of The Winter Conference on Applications of Computer Vision. 4740--4749","author":"Yang Taojiannan","year":"2023","unstructured":"Taojiannan Yang, Linjie Yang, Xiaojie Jin, and Chen Chen. 2023. Revisiting Training-free NAS Metrics: An Efficient Training-based Method. In Proceedings of The Winter Conference on Applications of Computer Vision. 4740--4749."},{"key":"e_1_2_1_65_1","volume-title":"Proceedings of the International Conference on Machine Learning","volume":"97","author":"Ying Chris","year":"2019","unstructured":"Chris Ying, Aaron Klein, Eric Christiansen, Esteban Real, Kevin Murphy, and Frank Hutter. 2019. NAS-Bench-101: Towards Reproducible Neural Architecture Search. In Proceedings of the International Conference on Machine Learning, Vol. 97, 7105--7114."},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of The USENIX Annual Technical Conference. 1049--1062","author":"Zhang Chengliang","year":"2019","unstructured":"Chengliang Zhang, Minchen Yu, Wei Wang, and Feng Yan. 2019. MArk: Exploiting Cloud Services for Cost-Effective, SLO-Aware Machine Learning Inference Serving. In Proceedings of The USENIX Annual Technical Conference. 1049--1062."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.14778\/3467861.3467867"},{"key":"e_1_2_1_68_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8697--8710","author":"Zoph Barret","unstructured":"Barret Zoph, Vijay Vasudevan, Jonathon Shlens, and Quoc V. Le. 2018. Learning Transferable Architectures for Scalable Image Recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8697--8710."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3641204.3641212","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,2]],"date-time":"2024-05-02T22:07:49Z","timestamp":1714687669000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3641204.3641212"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1]]},"references-count":68,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,1]]}},"alternative-id":["10.14778\/3641204.3641212"],"URL":"https:\/\/doi.org\/10.14778\/3641204.3641212","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2024,1]]},"assertion":[{"value":"2024-05-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}