{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,12]],"date-time":"2025-12-12T13:09:40Z","timestamp":1765544980776,"version":"3.41.0"},"reference-count":116,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2025,4,26]],"date-time":"2025-04-26T00:00:00Z","timestamp":1745625600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2023YFB3107400"],"award-info":[{"award-number":["2023YFB3107400"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62006181, 62132011, 62161160337, 62206217, U20A20177, U21B2018"],"award-info":[{"award-number":["62006181, 62132011, 62161160337, 62206217, U20A20177, U21B2018"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Shaanxi Province Key Industry Innovation Program","award":["2021ZDLGY01-02, 2023-ZDLGY-38"],"award-info":[{"award-number":["2021ZDLGY01-02, 2023-ZDLGY-38"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2025,5,31]]},"abstract":"<jats:p>\n            Deep Learning models have become an integrated component of modern software systems. In response to the challenge of model design, researchers proposed Automated Machine Learning (AutoML) systems, which automatically search for model architecture and hyperparameters for a given task. Like other software systems, existing AutoML systems have shortcomings in their design. We identify two common and severe shortcomings in AutoML,\n            <jats:italic>performance issue<\/jats:italic>\n            (i.e., searching for the desired model takes an unreasonably long time) and\n            <jats:italic>ineffective search issue<\/jats:italic>\n            (i.e., AutoML systems are not able to find an accurate enough model). After analyzing the workflow of AutoML, we observe that existing AutoML systems overlook potential opportunities in search space, search method, and search feedback, which results in performance and ineffective search issues. Based on our analysis, we design and implement\n            <jats:sc>DREAM<\/jats:sc>\n            , an automatic and general-purpose tool to alleviate and repair the shortcomings of AutoML pipelines and conduct effective model searches for diverse tasks. It monitors the process of AutoML to collect detailed feedback and automatically repairs shortcomings by expanding search space and leveraging a feedback-driven search strategy. Our evaluation results show that\n            <jats:sc>DREAM<\/jats:sc>\n            can be applied on two state-of-the-art AutoML pipelines and effectively and efficiently repair their shortcomings.\n          <\/jats:p>","DOI":"10.1145\/3702992","type":"journal-article","created":{"date-parts":[[2024,11,6]],"date-time":"2024-11-06T14:52:13Z","timestamp":1730904733000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["DREAM: Debugging and Repairing AutoML Pipelines"],"prefix":"10.1145","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7010-6749","authenticated-orcid":false,"given":"Xiaoyu","family":"Zhang","sequence":"first","affiliation":[{"name":"Xi\u2019an Jiaotong University, Xi\u2019an, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5017-8016","authenticated-orcid":false,"given":"Juan","family":"Zhai","sequence":"additional","affiliation":[{"name":"University of Massachusetts, Amherst, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1551-8948","authenticated-orcid":false,"given":"Shiqing","family":"Ma","sequence":"additional","affiliation":[{"name":"University of Massachusetts, Amherst, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8826-0362","authenticated-orcid":false,"given":"Xiaohong","family":"Guan","sequence":"additional","affiliation":[{"name":"Xi\u2019an Jiaotong University, Xi\u2019an, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6959-0569","authenticated-orcid":false,"given":"Chao","family":"Shen","sequence":"additional","affiliation":[{"name":"Xi\u2019an Jiaotong University, Xi\u2019an, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,4,26]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"GitHub. 2020. Auto-Sklearn. Retrieved from https:\/\/github.com\/automl\/auto-sklearn"},{"key":"e_1_3_1_3_2","unstructured":"IMDb. 2020. IMDb Datasets. Retrieved from https:\/\/www.imdb.com\/interfaces\/"},{"key":"e_1_3_1_4_2","unstructured":"Precedence Research. 2022. Artificial Intelligence (AI) Software Market - Global Industry Analysis Size Share Growth Trends Regional Outlook and Forecast 2023\u20132032. Retrieved from https:\/\/www.precedenceresearch.com\/artificial-intelligence-software-market"},{"key":"e_1_3_1_5_2","unstructured":"CIFAR. 2022. CIFAR-100 Dataset. Retrieved from https:\/\/www.cs.toronto.edu\/kriz\/cifar.html"},{"key":"e_1_3_1_6_2","unstructured":"Google Cloud. 2022. Google Cloud Harvard Global Health Institute release improved COVID-19 Public Forecasts share lessons learned. Retrieved from https:\/\/cloud.google.com\/blog\/products\/ai-machine-learning\/google-and-harvard-improve-covid-19-forecasts"},{"key":"e_1_3_1_7_2","unstructured":"Keras. 2022. Image classification via fine-tuning with EfficientNet. Retrieved from https:\/\/keras.io\/examples\/vision\/image_classification_efficientnet_fine_tuning"},{"key":"e_1_3_1_8_2","unstructured":"Google Cloud. 2022. Imagia: Collaborating on AI-powered healthcare discovery. Retrieved from https:\/\/cloud.google.com\/customers\/imagia"},{"key":"e_1_3_1_9_2","unstructured":"Google Cloud. 2022. Meredith Digital: Entering a new era of data-driven publishing. Retrieved from https:\/\/cloud.google.com\/customers\/meredith"},{"key":"e_1_3_1_10_2","unstructured":"Microsoft. 2022. Providence creates chatbot to improve COVID-19 care and manage hospital resources. Retrieved from https:\/\/customers.microsoft.com\/en-in\/story\/1402681562485712847-providence-health-provider-azure-en-united-states"},{"key":"e_1_3_1_11_2","unstructured":"TensorFlow. 2022. Transfer learning and fine-tuning. Retrieved from https:\/\/www.tensorflow.org\/guide\/keras\/transfer_learning"},{"key":"e_1_3_1_12_2","unstructured":"GitHub. 2023. AutoPytorch selects only Dummy model. Retrieved from https:\/\/github.com\/automl\/Auto-PyTorch\/issues\/494"},{"key":"e_1_3_1_13_2","unstructured":"GitHub. 2023. Long refit time of AutoSklearn models. Retrieved from https:\/\/github.com\/automl\/auto-sklearn\/issues\/1683"},{"key":"e_1_3_1_14_2","unstructured":"GitHub. 2024. AutoKeras. Retrieved from https:\/\/github.com\/keras-team\/autokeras"},{"key":"e_1_3_1_15_2","unstructured":"Google Cloud. 2024. Google Cloud AutoML. Retrieved from https:\/\/cloud.google.com\/automl"},{"key":"e_1_3_1_16_2","unstructured":"Microsoft. 2024. Microsoft NNI. Retrieved from https:\/\/github.com\/microsoft\/nni"},{"key":"e_1_3_1_17_2","unstructured":"GitHub. 2024. Our repository with experiment data and the prototype of our system. Retrieved from https:\/\/github.com\/shiningrain\/DREAM"},{"key":"e_1_3_1_18_2","unstructured":"David D. Lewis. 2024. Reuters-21578 dataset. Retrieved from http:\/\/www.daviddlewis.com\/resources\/testcollections\/reuters21578\/"},{"key":"e_1_3_1_19_2","first-page":"265","article-title":"TensorFlow: A system for large-scale machine learning","author":"Abadi Mart\u00edn","year":"2016","unstructured":"Mart\u00edn Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, et al. 2016. TensorFlow: A system for large-scale machine learning. In Proceedings of the 12th \\(\\{\\) USENIX \\(\\}\\) Symposium on Operating Systems Design and Implementation ( \\(\\{\\) OSDI \\(\\}\\) \u201916), 265\u2013283.","journal-title":"Proceedings of the 12th \\(\\{\\) USENIX \\(\\}\\) Symposium on Operating Systems Design and Implementation ( \\(\\{\\) OSDI \\(\\}\\) \u201916)"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3651781.3651796"},{"key":"e_1_3_1_21_2","unstructured":"Isac Arnekvist J. Frederico Carvalho Danica Kragic and Johannes A. Stork. 2020. The effect of target normalization and momentum on dying ReLU. arXiv:2005.06195. Retrieved from https:\/\/arxiv.org\/abs\/2005.06195"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2021.3070549"},{"key":"e_1_3_1_23_2","volume-title":"Proceedings of the 5th International Conference on Learning Representations (ICLR \u201917)","author":"Baker Bowen","year":"2017","unstructured":"Bowen Baker, Otkrist Gupta, Nikhil Naik, and Ramesh Raskar. 2017. Designing neural network architectures using reinforcement learning. In Proceedings of the 5th International Conference on Learning Representations (ICLR \u201917). OpenReview.net. Retrieved from https:\/\/openreview.net\/forum?id=S1c2cvqee"},{"key":"e_1_3_1_24_2","article-title":"R\u00e9mi Bardenet, Yoshua Bengio, and Bal\u00e1zs K\u00e9gl","author":"Bergstra James","year":"2011","unstructured":"James Bergstra, R\u00e9mi Bardenet, Yoshua Bengio, and Bal\u00e1zs K\u00e9gl. 2011. Algorithms for hyper-parameter optimization. In Proceedings of the 24th International Conference on Neural Information Processing Systems.","journal-title":"Proceedings of the 24th International Conference on Neural Information Processing Systems"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.25080\/Majora-8b375195-003"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510057"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10599-4_29"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.5555\/176313.176316"},{"key":"e_1_3_1_29_2","volume-title":"Proceedings of the 7th International Conference on Learning Representations (ICLR \u201919)","author":"Cai Han","year":"2019","unstructured":"Han Cai, Ligeng Zhu, and Song Han. 2019. ProxylessNAS: Direct neural architecture search on target task and hardware. In Proceedings of the 7th International Conference on Learning Representations (ICLR \u201919). OpenReview.net. Retrieved from https:\/\/openreview.net\/forum?id=HylVB3AqYm"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/ESEM56168.2023.10304796"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2017.09.002"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3409700"},{"key":"e_1_3_1_33_2","unstructured":"Kartik Chandra Erik Meijer Samantha Andow Emilio Arroyo-Fang Irene Dea Johann George Melissa Grueter Basil Hosmer Steffi Stumpos Alanna Tempest et al. 2019. Gradient descent: The ultimate optimizer. arXiv:1909.13371. Retrieved from https:\/\/arxiv.org\/abs\/1909.13371"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.195"},{"key":"e_1_3_1_35_2","volume-title":"Deep Learning with Python","author":"Chollet Francois","year":"2021","unstructured":"Francois Chollet. 2021. Deep Learning with Python. Simon and Schuster."},{"key":"e_1_3_1_36_2","first-page":"215","volume-title":"Proceedings of the 14th International Conference on Artificial Intelligence and Statistics","author":"Coates Adam","year":"2011","unstructured":"Adam Coates, Andrew Ng, and Honglak Lee. 2011. An analysis of single-layer networks in unsupervised feature learning. In Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, 215\u2013223."},{"key":"e_1_3_1_37_2","first-page":"1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems","author":"Crisan Anamaria","year":"2021","unstructured":"Anamaria Crisan and Brittany Fiore-Gartland. 2021. Fits and starts: Enterprise use of automl and the role of humans in the loop. In Proceedings of the CHI Conference on Human Factors in Computing Systems, 1\u201315."},{"key":"e_1_3_1_38_2","first-page":"730","volume-title":"Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics","author":"Dikov Georgi","year":"2019","unstructured":"Georgi Dikov and Justin Bayer. 2019. Bayesian learning of neural network architectures. In Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics. PMLR, 730\u2013738."},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.5555\/2832581.2832731"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00186"},{"key":"e_1_3_1_41_2","unstructured":"Matthias Feurer Katharina Eggensperger Stefan Falkner Marius Lindauer and Frank Hutter. 2020. Auto-Sklearn 2.0: Hands-free AutoML via Meta-Learning. arXiv:2007.04074. Retrieved from https:\/\/arxiv.org\/abs\/2007.04074"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-05318-5_1"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-05318-5_6"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00028"},{"key":"e_1_3_1_45_2","volume-title":"Proceedings of the 33rd International Conference on Neural Information Processing Systems","author":"Ge Rong","year":"2019","unstructured":"Rong Ge, Sham M Kakade, Rahul Kidambi, and Praneeth Netrapalli. 2019. The step decay schedule: A near optimal, geometrically decaying learning rate procedure for least squares. In Proceedings of the 33rd International Conference on Neural Information Processing Systems."},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10710-017-9314-z"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58517-4_32"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-35488-8_1"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01201"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.123"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.106622"},{"key":"e_1_3_1_53_2","first-page":"2731","volume-title":"International Conference on Machine Learning","author":"Ho Daniel","year":"2019","unstructured":"Daniel Ho, Eric Liang, Xi Chen, Ion Stoica, and Pieter Abbeel. 2019. Population based augmentation: Efficient learning of augmentation policy schedules. In International Conference on Machine Learning. PMLR, 2731\u20132741."},{"issue":"1","key":"e_1_3_1_54_2","article-title":"Untersuchungen zu dynamischen neuronalen Netzen","volume":"91","author":"Hochreiter Sepp","year":"1991","unstructured":"Sepp Hochreiter. 1991. Untersuchungen zu dynamischen neuronalen Netzen. Diploma, Technische Universit\u00e4t M\u00fcnchen 91, 1 (1991).","journal-title":"Diploma, Technische Universit\u00e4t M\u00fcnchen"},{"key":"e_1_3_1_55_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2014\/795624","article-title":"SVM-RFE based feature selection and Taguchi parameters optimization for multiclass SVM classifier","volume":"2014","author":"Huang Mei-Ling","year":"2014","unstructured":"Mei-Ling Huang, Yung-Hsiang Hung, W. M. Lee, Rong-Kwei Li, and Bo-Ru Jiang. 2014. SVM-RFE based feature selection and Taguchi parameters optimization for multiclass SVM classifier. The Scientific World Journal 2014 (2014), 1\u20131. Retrieved from https:\/\/onlinelibrary.wiley.com\/doi\/epdf\/10.1155\/2014\/795624","journal-title":"The Scientific World Journal"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2019.06.005"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.11591\/ijeecs.v10.i3.pp1234-1243"},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330648"},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.5555\/1622737.1622748"},{"key":"e_1_3_1_60_2","first-page":"2020","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems","author":"Kandasamy Kirthevasan","year":"2018","unstructured":"Kirthevasan Kandasamy, Willie Neiswanger, Jeff Schneider, Barnab\u00e1s P\u00f3czos, and Eric P. Xing. 2018. Neural architecture search with Bayesian optimisation and optimal transport. In Proceedings of the Annual Conference on Neural Information Processing Systems. Samy Bengio, Hanna M. Wallach, Hugo Larochelle, Kristen Grauman, Nicol\u00f2 Cesa-Bianchi, and Roman Garnett (Eds.), 2020\u20132029. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/f33ba15effa5c10e873bf3842afb46a6-Abstract.html"},{"key":"e_1_3_1_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/SAI.2014.6918213"},{"key":"e_1_3_1_62_2","first-page":"971","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems","author":"Klambauer G\u00fcnter","year":"2017","unstructured":"G\u00fcnter Klambauer, Thomas Unterthiner, Andreas Mayr, and Sepp Hochreiter. 2017. Self-normalizing neural networks. In Proceedings of the 31st International Conference on Neural Information Processing Systems, 971\u2013980."},{"key":"e_1_3_1_63_2","first-page":"528","article-title":"Fast bayesian optimization of machine learning hyperparameters on large datasets","author":"Klein Aaron","year":"2017","unstructured":"Aaron Klein, Stefan Falkner, Simon Bartels, Philipp Hennig, and Frank Hutter. 2017. Fast bayesian optimization of machine learning hyperparameters on large datasets. In Artificial Intelligence and Statistics. PMLR, 528\u2013536.","journal-title":"Artificial Intelligence and Statistics"},{"key":"e_1_3_1_64_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Klein Aaron","year":"2016","unstructured":"Aaron Klein, Stefan Falkner, Jost Tobias Springenberg, and Frank Hutter. 2016. Learning curve prediction with Bayesian neural networks. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_1_65_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-05318-5_5"},{"key":"e_1_3_1_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2013.77"},{"key":"e_1_3_1_67_2","volume-title":"Learning Multiple Layers of Features from Tiny Images","author":"Krizhevsky Alex","year":"2009","unstructured":"Alex Krizhevsky and Geoffrey Hinton. 2009. Learning Multiple Layers of Features from Tiny Images. Master's thesis, University of Tront."},{"key":"e_1_3_1_68_2","unstructured":"Alexandre Lacoste Alexandra Luccioni Victor Schmidt and Thomas Dandres. 2019. Quantifying the carbon emissions of machine learning. arXiv:1910.09700. Retrieved from https:\/\/arxiv.org\/abs\/1910.09700"},{"key":"e_1_3_1_69_2","first-page":"769","volume-title":"Proceedings of the 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI \u201923)","author":"Lai Fan","year":"2023","unstructured":"Fan Lai, Yinwei Dai, Harsha V. Madhyastha, and Mosharaf Chowdhury. 2023. \\(\\{\\) ModelKeeper \\(\\}\\) : Accelerating \\(\\{\\) DNN \\(\\}\\) training via automated training warmup. In Proceedings of the 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI \u201923), 769\u2013785."},{"key":"e_1_3_1_70_2","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btz470"},{"issue":"7","key":"e_1_3_1_71_2","first-page":"3","article-title":"Tiny imagenet visual recognition challenge","volume":"7","author":"Le Ya","year":"2015","unstructured":"Ya Le and Xuan Yang. 2015. Tiny imagenet visual recognition challenge. CS 231N 7, 7 (2015), 3.","journal-title":"CS 231N"},{"key":"e_1_3_1_72_2","doi-asserted-by":"publisher","DOI":"10.5555\/3122009.3242042"},{"key":"e_1_3_1_73_2","doi-asserted-by":"publisher","DOI":"10.3115\/1072228.1072378"},{"key":"e_1_3_1_74_2","volume-title":"Proceedings of the 7th International Conference on Learning Representations (ICLR \u201919)","author":"Liu Hanxiao","year":"2018","unstructured":"Hanxiao Liu, Karen Simonyan, and Yiming Yang. 2018. Darts: Differentiable architecture search. In Proceedings of the 7th International Conference on Learning Representations (ICLR \u201919). OpenReview.net. Retrieved from https:\/\/openreview.net\/forum?id=S1eYHoC5FX"},{"key":"e_1_3_1_75_2","volume-title":"Proceedings of the 7th International Conference on Learning Representations (ICLR \u201919)","author":"Loshchilov Ilya","year":"2019","unstructured":"Ilya Loshchilov and Frank Hutter. 2019. Decoupled weight decay regularization. InProceedings of the 7th International Conference on Learning Representations (ICLR \u201919). OpenReview.net. Retrieved from https:\/\/openreview.net\/forum?id=Bkg6RiCqY7"},{"key":"e_1_3_1_76_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.492"},{"key":"e_1_3_1_77_2","doi-asserted-by":"publisher","DOI":"10.4208\/cicp.OA-2020-0165"},{"key":"e_1_3_1_78_2","first-page":"7816","volume-title":"Proceedings of the 32nd International Conference on Neural Information Processing Systems","author":"Luo Renqian","year":"2018","unstructured":"Renqian Luo, Fei Tian, Tao Qin, Enhong Chen, and Tie-Yan Liu. 2018. Neural architecture optimization. In Proceedings of the 32nd International Conference on Neural Information Processing Systems, 7816\u20137827."},{"key":"e_1_3_1_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/3236024.3236082"},{"key":"e_1_3_1_80_2","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00346"},{"key":"e_1_3_1_81_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-05318-5_7"},{"key":"e_1_3_1_82_2","volume-title":"Proceedings of the 7th International Conference on Learning Representations (ICLR \u201919)","author":"Miller John","year":"2018","unstructured":"John Miller and Moritz Hardt. 2018. Stable recurrent models. In Proceedings of the 7th International Conference on Learning Representations (ICLR \u201919). OpenReview.net. Retrieved from https:\/\/openreview.net\/forum?id=Hygxb2CqKm"},{"key":"e_1_3_1_83_2","doi-asserted-by":"publisher","DOI":"10.1145\/3341301.3359646"},{"key":"e_1_3_1_84_2","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3455517"},{"key":"e_1_3_1_85_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510052"},{"key":"e_1_3_1_86_2","doi-asserted-by":"publisher","DOI":"10.3390\/sym12040660"},{"key":"e_1_3_1_87_2","first-page":"737","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Pedregosa Fabian","year":"2016","unstructured":"Fabian Pedregosa. 2016. Hyperparameter optimization with approximate gradient. In Proceedings of the International Conference on Machine Learning. PMLR, 737\u2013746."},{"key":"e_1_3_1_88_2","first-page":"4095","volume-title":"International Conference on Machine Learning","author":"Pham Hieu","year":"2018","unstructured":"Hieu Pham, Melody Guan, Barret Zoph, Quoc Le, and Jeff Dean. 2018. Efficient neural architecture search via parameters sharing. In International Conference on Machine Learning. PMLR, 4095\u20134104."},{"key":"e_1_3_1_89_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(98)00116-6"},{"key":"e_1_3_1_90_2","doi-asserted-by":"publisher","DOI":"10.1109\/SAMI48414.2020.9108717"},{"key":"e_1_3_1_91_2","first-page":"2902","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Real Esteban","year":"2017","unstructured":"Esteban Real, Sherry Moore, Andrew Selle, Saurabh Saxena, Yutaka Leon Suematsu, Jie Tan, Quoc V. Le, and Alexey Kurakin. 2017. Large-scale evolution of image classifiers. In Proceedings of the International Conference on Machine Learning. PMLR, 2902\u20132911."},{"key":"e_1_3_1_92_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2019.2946162"},{"key":"e_1_3_1_93_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510226"},{"key":"e_1_3_1_94_2","first-page":"148","volume-title":"Proceedings of the IEEE","volume":"104","author":"Shahriari Bobak","year":"2015","unstructured":"Bobak Shahriari, Kevin Swersky, Ziyu Wang, Ryan P. Adams, and Nando De Freitas. 2015. Taking the human out of the loop: A review of Bayesian optimization. Proceedings of the IEEE 104, 1 (2015), 148\u2013175."},{"key":"e_1_3_1_95_2","unstructured":"Ahnjae Shin Do Yoon Kim Joo Seong Jeong and Byung-Gon Chun. 2020. Hippo: Taming hyper-parameter optimization of deep learning with stage trees. arXiv:2006.11972. Retrieved from https:\/\/arxiv.org\/abs\/2006.11972"},{"key":"e_1_3_1_96_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1331"},{"key":"e_1_3_1_97_2","doi-asserted-by":"publisher","DOI":"10.1145\/3071178.3071229"},{"key":"e_1_3_1_98_2","unstructured":"David Sussillo and L. F. Abbott. 2014. Random walk initialization for training very deep feedforward networks. arXiv:1412.6558. Retrieved from https:\/\/arxiv.org\/abs\/1412.6558"},{"key":"e_1_3_1_99_2","first-page":"6105","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Tan Mingxing","year":"2019","unstructured":"Mingxing Tan and Quoc Le. 2019. Efficientnet: Rethinking model scaling for convolutional neural networks. In Proceedings of the International Conference on Machine Learning. PMLR, 6105\u20136114."},{"key":"e_1_3_1_100_2","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2487629"},{"key":"e_1_3_1_101_2","volume-title":"Proceedings of the 8th ICML Workshop on Automated Machine Learning (AutoML)","author":"Van der Blom Koen","year":"2021","unstructured":"Koen Van der Blom, Alex Serban, Holger Hoos, and Joost Visser. 2021. AutoML adoption in ML software. In Proceedings of the 8th ICML Workshop on Automated Machine Learning (AutoML)."},{"key":"e_1_3_1_102_2","unstructured":"Ashish Vaswani. 2017. Attention is all you need. arXiv:1706.03762. Retrieved from https:\/\/arxiv.org\/abs\/1706.03762"},{"key":"e_1_3_1_103_2","doi-asserted-by":"publisher","DOI":"10.5555\/3157096.3157158"},{"key":"e_1_3_1_104_2","doi-asserted-by":"publisher","DOI":"10.1145\/3238147.3238206"},{"key":"e_1_3_1_105_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSR59073.2023.00019"},{"key":"e_1_3_1_106_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992698"},{"key":"e_1_3_1_107_2","doi-asserted-by":"publisher","DOI":"10.1609\/AAAI.V35I12.17233"},{"key":"e_1_3_1_108_2","unstructured":"Bichen Wu Yanghan Wang Peizhao Zhang Yuandong Tian Peter Vajda and Kurt Keutzer. 2018. Mixed precision quantization of convnets via differentiable neural architecture search. arXiv:1812.00090. Retrieved from https:\/\/arxiv.org\/abs\/1812.00090"},{"key":"e_1_3_1_109_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.154"},{"key":"e_1_3_1_110_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00137"},{"key":"e_1_3_1_111_2","volume-title":"Proceedings of the 5th International Conference on Learning Representations (ICLR \u201917)","author":"Xie Ziang","year":"2017","unstructured":"Ziang Xie, Sida I. Wang, Jiwei Li, Daniel L\u00e9vy, Aiming Nie, Dan Jurafsky, and Andrew Y. Ng. 2017. Data noising as smoothing in neural network language models. In Proceedings of the 5th International Conference on Learning Representations (ICLR \u201917). OpenReview.net. Retrieved from https:\/\/openreview.net\/forum?id=H1VyHY9gg"},{"key":"e_1_3_1_112_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2855449"},{"key":"e_1_3_1_113_2","unstructured":"Arber Zela Aaron Klein Stefan Falkner and Frank Hutter. 2018. Towards automated deep learning: Efficient joint neural architecture and hyperparameter search. arXiv:1807.06906. Retrieved from https:\/\/arxiv.org\/abs\/1807.06906"},{"key":"e_1_3_1_114_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00043"},{"key":"e_1_3_1_115_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2021.3067763"},{"key":"e_1_3_1_116_2","volume-title":"Proceedings of the 5th International Conference on Learning Representations (ICLR \u201917)","author":"Zoph Barret","year":"2017","unstructured":"Barret Zoph and Quoc V. Le. 2017. Neural Architecture Search with Reinforcement Learning. In Proceedings of the 5th International Conference on Learning Representations (ICLR \u201917). OpenReview.net. Retrieved from https:\/\/openreview.net\/forum?id=r1Ue8Hcxg"},{"key":"e_1_3_1_117_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00907"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3702992","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3702992","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:10:18Z","timestamp":1750295418000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3702992"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,26]]},"references-count":116,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,5,31]]}},"alternative-id":["10.1145\/3702992"],"URL":"https:\/\/doi.org\/10.1145\/3702992","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"type":"print","value":"1049-331X"},{"type":"electronic","value":"1557-7392"}],"subject":[],"published":{"date-parts":[[2025,4,26]]},"assertion":[{"value":"2024-04-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-10-23","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-04-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}