{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T15:18:35Z","timestamp":1787757515750,"version":"build-2784847793"},"reference-count":162,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,5,24]],"date-time":"2021-05-24T00:00:00Z","timestamp":1621814400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"ARC DECRA","award":["DE190100626"],"award-info":[{"award-number":["DE190100626"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2022,5,31]]},"abstract":"<jats:p>\n                    Deep learning has made substantial breakthroughs in many fields due to its powerful automatic representation capabilities. It has been proven that neural architecture design is crucial to the feature representation of data and the final performance. However, the design of the neural architecture heavily relies on the researchers\u2019 prior knowledge and experience. And due to the limitations of humans\u2019 inherent knowledge, it is difficult for people to jump out of their original thinking paradigm and design an optimal model. Therefore, an intuitive idea would be to reduce human intervention as much as possible and let the algorithm automatically design the neural architecture.\n                    <jats:italic>\n                      <jats:bold>Neural Architecture Search<\/jats:bold>\n                    <\/jats:italic>\n                    (\n                    <jats:bold>NAS<\/jats:bold>\n                    ) is just such a revolutionary algorithm, and the related research work is complicated and rich. Therefore, a comprehensive and systematic survey on the NAS is essential. Previously related surveys have begun to classify existing work mainly based on the key components of NAS: search space, search strategy, and evaluation strategy. While this classification method is more intuitive, it is difficult for readers to grasp the challenges and the landmark work involved. Therefore, in this survey, we provide a new perspective: beginning with an overview of the characteristics of the earliest NAS algorithms, summarizing the problems in these early NAS algorithms, and then providing solutions for subsequent related research work. In addition, we conduct a detailed and comprehensive analysis, comparison, and summary of these works. Finally, we provide some possible future research directions.\n                  <\/jats:p>","DOI":"10.1145\/3447582","type":"journal-article","created":{"date-parts":[[2021,5,24]],"date-time":"2021-05-24T03:22:25Z","timestamp":1621826545000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":540,"title":["A Comprehensive Survey of Neural Architecture Search"],"prefix":"10.1145","volume":"54","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9965-8088","authenticated-orcid":false,"given":"Pengzhen","family":"Ren","sequence":"first","affiliation":[{"name":"Northwest University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yun","family":"Xiao","sequence":"additional","affiliation":[{"name":"Northwest University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaojun","family":"Chang","sequence":"additional","affiliation":[{"name":"Monash University, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Po-yao","family":"Huang","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhihui","family":"Li","sequence":"additional","affiliation":[{"name":"Qilu University of Technology (Shandong Academy of Sciences), China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaojiang","family":"Chen","sequence":"additional","affiliation":[{"name":"Northwest University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Wang","sequence":"additional","affiliation":[{"name":"Northwest University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,5,24]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_1_2_1","unstructured":"M. X. Chen O. Firat A. Bapna M. Johnson W. Macherey G. Foster L. Jones N. Parmar M. Schuster Z. Chen Y. Wu and M. Hughes. 2018. The best of both worlds: Combining recent advances in neural machine translation. arXiv:1804.09849. Retrieved from https:\/\/arxiv.org\/pdf\/1804.09849.pdf. M. X. Chen O. Firat A. Bapna M. Johnson W. Macherey G. Foster L. Jones N. Parmar M. Schuster Z. Chen Y. Wu and M. Hughes. 2018. The best of both worlds: Combining recent advances in neural machine translation. arXiv:1804.09849. Retrieved from https:\/\/arxiv.org\/pdf\/1804.09849.pdf."},{"key":"e_1_2_1_3_1","volume-title":"Macherey et\u00a0al","author":"Wu Y.","year":"2016","unstructured":"Y. Wu , M. Schuster , Z. Chen , Q. V. Le , M. Norouzi , W. Macherey , M. Krikun , Y. Cao , Q. Gao , K. Macherey et\u00a0al . 2016 . Google\u2019s neural machine translation system: Bridging the gap between human and machine translation. arXiv:1609.08144. https:\/\/arxiv.org\/pdf\/1609.08144.pdf. Y. Wu, M. Schuster, Z. Chen, Q. V. Le, M. Norouzi, W. Macherey, M. Krikun, Y. Cao, Q. Gao, K. Macherey et\u00a0al. 2016. Google\u2019s neural machine translation system: Bridging the gap between human and machine translation. arXiv:1609.08144. https:\/\/arxiv.org\/pdf\/1609.08144.pdf."},{"key":"e_1_2_1_4_1","unstructured":"K. Simonyan and A. Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. ICLR. K. Simonyan and A. Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. ICLR."},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference. 497\u2013504","author":"Suganuma M.","unstructured":"M. Suganuma , S. Shirakawa , and T. Nagao . 2017. A genetic programming approach to designing convolutional neural network architectures . In Proceedings of the Genetic and Evolutionary Computation Conference. 497\u2013504 . M. Suganuma, S. Shirakawa, and T. Nagao. 2017. A genetic programming approach to designing convolutional neural network architectures. In Proceedings of the Genetic and Evolutionary Computation Conference. 497\u2013504."},{"key":"e_1_2_1_6_1","volume-title":"Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv:1704.04861. https:\/\/arxiv.org\/pdf\/1704.04861.pdf.","author":"Howard Andrew G.","year":"2017","unstructured":"Andrew G. Howard , Menglong Zhu , Bo Chen , Dmitry Kalenichenko , Weijun Wang , Tobias Weyand , Marco Andreetto , and Hartwig Adam . 2017 . Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv:1704.04861. https:\/\/arxiv.org\/pdf\/1704.04861.pdf. Andrew G. Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv:1704.04861. https:\/\/arxiv.org\/pdf\/1704.04861.pdf."},{"key":"e_1_2_1_7_1","unstructured":"A. Krizhevsky I. Sutskever and G. E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems. 1097\u20131105. A. Krizhevsky I. Sutskever and G. E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems. 1097\u20131105."},{"key":"e_1_2_1_8_1","unstructured":"S. Ren K. He R. Girshick and J. Sun. 2015. Faster R-CNN: Towards real-time object detection with region proposal networks. In Advances in Neural Information Processing Systems. 91\u201399. S. Ren K. He R. Girshick and J. Sun. 2015. Faster R-CNN: Towards real-time object detection with region proposal networks. In Advances in Neural Information Processing Systems. 91\u201399."},{"key":"e_1_2_1_9_1","volume-title":"SSD: Single shot multibox detector. In European Conference on Computer Vision","author":"Liu W.","year":"2016","unstructured":"W. Liu , D. Anguelov , D. Erhan , C. Szegedy , S. Reed , C. Y. Fu , and A. C. Berg . 2016 . SSD: Single shot multibox detector. In European Conference on Computer Vision . Springer , Cham ., 21\u201337. W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C. Y. Fu, and A. C. Berg. 2016. SSD: Single shot multibox detector. In European Conference on Computer Vision. Springer, Cham., 21\u201337."},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 2980\u20132988","author":"Lin T. Y.","unstructured":"T. Y. Lin , P. Goyal , R. Girshick , K. He , and Doll\u00e1r, P . 2017. Focal loss for dense object detection . In Proceedings of the IEEE International Conference on Computer Vision. 2980\u20132988 . T. Y. Lin, P. Goyal, R. Girshick, K. He, and Doll\u00e1r, P. 2017. Focal loss for dense object detection. In Proceedings of the IEEE International Conference on Computer Vision. 2980\u20132988."},{"key":"e_1_2_1_11_1","unstructured":"B. Zoph and Q. V. Le. 2017. Neural architecture search with reinforcement learning. ICLR. B. Zoph and Q. V. Le. 2017. Neural architecture search with reinforcement learning. ICLR."},{"key":"e_1_2_1_12_1","unstructured":"B. Baker O. Gupta N. Naik and R. Raskar. 2016. Designing neural network architectures using reinforcement learning. arXiv:1611.02167. B. Baker O. Gupta N. Naik and R. Raskar. 2016. Designing neural network architectures using reinforcement learning. arXiv:1611.02167."},{"key":"e_1_2_1_13_1","first-page":"886","article-title":"Histograms of oriented gradients for human detection. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905)","volume":"1","author":"Dalal N.","year":"2005","unstructured":"N. Dalal and B. Triggs . 2005 . Histograms of oriented gradients for human detection. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905) . IEEE , Vol. 1 , 886 \u2013 893 . N. Dalal and B. Triggs. 2005. Histograms of oriented gradients for human detection. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905). IEEE, Vol. 1, 886\u2013893.","journal-title":"IEEE"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.1999.790410"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning","volume":"70","author":"Real E.","unstructured":"E. Real , S. Moore , A. Selle , S. Saxena , Y. L. Suematsu , J. Tan , ... and A. Kurakin . 2017. Large-scale evolution of image classifiers . In Proceedings of the 34th International Conference on Machine Learning , Volume 70 , 2902\u20132911. JMLR. org. E. Real, S. Moore, A. Selle, S. Saxena, Y. L. Suematsu, J. Tan, ... and A. Kurakin. 2017. Large-scale evolution of image classifiers. In Proceedings of the 34th International Conference on Machine Learning, Volume 70, 2902\u20132911. JMLR. org."},{"key":"e_1_2_1_16_1","volume-title":"Genetic CNN. In Proceedings of the IEEE International Conference on Computer Vision. 1379\u20131388","author":"Xie L.","unstructured":"L. Xie and A. Yuille . 2017 . Genetic CNN. In Proceedings of the IEEE International Conference on Computer Vision. 1379\u20131388 . L. Xie and A. Yuille. 2017. Genetic CNN. In Proceedings of the IEEE International Conference on Computer Vision. 1379\u20131388."},{"key":"e_1_2_1_17_1","volume-title":"Darts: Differentiable architecture search. arXiv:1806.09055.","author":"Liu H.","year":"2018","unstructured":"H. Liu , K. Simonyan , and Y. Yang . 2018 . Darts: Differentiable architecture search. arXiv:1806.09055. H. Liu, K. Simonyan, and Y. Yang. 2018. Darts: Differentiable architecture search. arXiv:1806.09055."},{"key":"e_1_2_1_18_1","unstructured":"Y. Shu W. Wang and S. Cai. 2019. Understanding architectures learnt by cell-based neural architecture search. arXiv:1909.09569. Y. Shu W. Wang and S. Cai. 2019. Understanding architectures learnt by cell-based neural architecture search. arXiv:1909.09569."},{"key":"e_1_2_1_19_1","unstructured":"H. Pham M. Y. Guan B. Zoph Q. V. Le and J. Dean. 2018. Efficient neural architecture search via parameter sharing. arXiv:1802.03268. H. Pham M. Y. Guan B. Zoph Q. V. Le and J. Dean. 2018. Efficient neural architecture search via parameter sharing. arXiv:1802.03268."},{"key":"e_1_2_1_20_1","unstructured":"B. Baker O. Gupta R. Raskar and N. Naik. 2017. Accelerating neural architecture search using performance prediction. arXiv:1705.10823. B. Baker O. Gupta R. Raskar and N. Naik. 2017. Accelerating neural architecture search using performance prediction. arXiv:1705.10823."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 1989\u20131998","author":"Li C.","unstructured":"C. Li , J. Peng , L. Yuan , G. Wang , X. Liang , L. Lin , and X. Chang . 2020. Block-wisely supervised neural architecture search with knowledge distillation . In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 1989\u20131998 . C. Li, J. Peng, L. Yuan, G. Wang, X. Liang, L. Lin, and X. Chang. 2020. Block-wisely supervised neural architecture search with knowledge distillation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 1989\u20131998."},{"key":"e_1_2_1_22_1","first-page":"550","article-title":"Understanding and simplifying one-shot architecture search. In Proceedings of the 35th International Conference on Machine Learning","volume":"80","author":"Bender G.","year":"2018","unstructured":"G. Bender , P. Kindermans , B. Zoph , V. Vasudevan , and Q. Le . 2018 . Understanding and simplifying one-shot architecture search. In Proceedings of the 35th International Conference on Machine Learning . PMLR , 80 : 550 \u2013 559 . G. Bender, P. Kindermans, B. Zoph, V. Vasudevan, and Q. Le. 2018. Understanding and simplifying one-shot architecture search. In Proceedings of the 35th International Conference on Machine Learning. PMLR, 80:550\u2013559.","journal-title":"PMLR"},{"key":"e_1_2_1_23_1","volume-title":"Smash: One-shot model architecture search through hypernetworks. arXiv:1708.05344.","author":"Brock A.","year":"2017","unstructured":"A. Brock , T. Lim , J. M. Ritchie , and N. Weston . 2017 . Smash: One-shot model architecture search through hypernetworks. arXiv:1708.05344. A. Brock, T. Lim, J. M. Ritchie, and N. Weston. 2017. Smash: One-shot model architecture search through hypernetworks. arXiv:1708.05344."},{"key":"e_1_2_1_24_1","unstructured":"C. Sciuto K. Yu M. Jaggi C. Musat and M. Salzmann. 2019. Evaluating the search phase of neural architecture search. arXiv:1902.08142. C. Sciuto K. Yu M. Jaggi C. Musat and M. Salzmann. 2019. Evaluating the search phase of neural architecture search. arXiv:1902.08142."},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"M. Zhang H. Li S. Pan X. Chang and S. Su. 2020 Overcoming multi-model forgetting in one-shot NAS with diversity maximization. In Advances in Neural Information Processing Systems. M. Zhang H. Li S. Pan X. Chang and S. Su. 2020 Overcoming multi-model forgetting in one-shot NAS with diversity maximization. In Advances in Neural Information Processing Systems.","DOI":"10.1109\/CVPR42600.2020.00783"},{"key":"e_1_2_1_26_1","unstructured":"X. Cheng Y. Zhong M. Harandi Y. Dai X. Chang H. Li T. Drummond and Z. Ge. 2020. Hierarchical neural architecture search for deep stereo matching. In Advances in Neural Information Processing Systems. X. Cheng Y. Zhong M. Harandi Y. Dai X. Chang H. Li T. Drummond and Z. Ge. 2020. Hierarchical neural architecture search for deep stereo matching. In Advances in Neural Information Processing Systems."},{"key":"e_1_2_1_27_1","doi-asserted-by":"crossref","unstructured":"T. Elsken J. H. Metzen and F. Hutter. 2018. Neural architecture search: A survey. arXiv:1808.05377. T. Elsken J. H. Metzen and F. Hutter. 2018. Neural architecture search: A survey. arXiv:1808.05377.","DOI":"10.1007\/978-3-030-05318-5_3"},{"key":"e_1_2_1_28_1","unstructured":"M. Wistuba A. Rawat and T. Pedapati. 2019. A survey on neural architecture search. arXiv:1905.01392. M. Wistuba A. Rawat and T. Pedapati. 2019. A survey on neural architecture search. arXiv:1905.01392."},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2820\u20132828","author":"Tan M.","unstructured":"M. Tan , B. Chen , R. Pang , V. Vasudevan , M. Sandler , A. Howard , and Q. V. Le . 2019. MnasNet: Platform-aware neural architecture search for mobile . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2820\u20132828 . M. Tan, B. Chen, R. Pang, V. Vasudevan, M. Sandler, A. Howard, and Q. V. Le. 2019. MnasNet: Platform-aware neural architecture search for mobile. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2820\u20132828."},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770\u2013778","author":"He K.","unstructured":"K. He , X. Zhang , S. Ren , and J. Sun . 2016. Deep residual learning for image recognition . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770\u2013778 . K. He, X. Zhang, S. Ren, and J. Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770\u2013778."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1\u20139.","author":"Szegedy C.","unstructured":"C. Szegedy , W. Liu , Y. Jia , P. Sermanet , S. Reed , D. Anguelov , ... and A. Rabinovich . 2015. Going deeper with convolutions . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1\u20139. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, ... and A. Rabinovich. 2015. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1\u20139."},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8697\u20138710","author":"Zoph B.","unstructured":"B. Zoph , V. Vasudevan , J. Shlens , and Q. V. Le . 2018. Learning transferable architectures for scalable image recognition . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8697\u20138710 . B. Zoph, V. Vasudevan, J. Shlens, and Q. V. Le. 2018. Learning transferable architectures for scalable image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8697\u20138710."},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2423\u20132432","author":"Zhong Z.","unstructured":"Z. Zhong , J. Yan , W. Wu , J. Shao , and C. L. Liu . 2018. Practical block-wise neural network architecture generation . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2423\u20132432 . Z. Zhong, J. Yan, W. Wu, J. Shao, and C. L. Liu. 2018. Practical block-wise neural network architecture generation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2423\u20132432."},{"key":"e_1_2_1_34_1","unstructured":"H. Liu K. Simonyan O. Vinyals C. Fernando and K. Kavukcuoglu. 2017. Hierarchical representations for efficient architecture search. arXiv:1711.00436. H. Liu K. Simonyan O. Vinyals C. Fernando and K. Kavukcuoglu. 2017. Hierarchical representations for efficient architecture search. arXiv:1711.00436."},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV\u201918)","author":"Dong J. D.","unstructured":"J. D. Dong , A. C. Cheng , D. C. Juan , W. Wei , and M. Sun . 2018. DPP-Net: Device-aware progressive search for Pareto-optimal neural architectures . In Proceedings of the European Conference on Computer Vision (ECCV\u201918) . 517\u2013531. J. D. Dong, A. C. Cheng, D. C. Juan, W. Wei, and M. Sun. 2018. DPP-Net: Device-aware progressive search for Pareto-optimal neural architectures. In Proceedings of the European Conference on Computer Vision (ECCV\u201918). 517\u2013531."},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4700\u20134708","author":"Huang G.","unstructured":"G. Huang , Z. Liu , L. Van Der Maaten, and K. Q. Weinberger. 2017. Densely connected convolutional networks . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4700\u20134708 . G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger. 2017. Densely connected convolutional networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4700\u20134708."},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV\u201918)","author":"Liu C.","unstructured":"C. Liu , B. Zoph , M. Neumann , J. Shlens , W. Hua , L. J. Li , ... and K. Murphy . 2018. Progressive neural architecture search . In Proceedings of the European Conference on Computer Vision (ECCV\u201918) . 19\u201334. C. Liu, B. Zoph, M. Neumann, J. Shlens, W. Hua, L. J. Li, ... and K. Murphy. 2018. Progressive neural architecture search. In Proceedings of the European Conference on Computer Vision (ECCV\u201918). 19\u201334."},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 1812\u20131823","author":"Saikia T.","unstructured":"T. Saikia , Y. Marrakchi , A. Zela , F. Hutter , and T. Brox . 2019. AutoDispNet: Improving disparity estimation with AutoML . In Proceedings of the IEEE International Conference on Computer Vision. 1812\u20131823 . T. Saikia, Y. Marrakchi, A. Zela, F. Hutter, and T. Brox. 2019. AutoDispNet: Improving disparity estimation with AutoML. In Proceedings of the IEEE International Conference on Computer Vision. 1812\u20131823."},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 6509\u20136518","author":"Cui J.","unstructured":"J. Cui , P. Chen , R. Li , S. Liu , X. Shen , and J. Jia . 2019. Fast and practical neural architecture search . In Proceedings of the IEEE International Conference on Computer Vision. 6509\u20136518 . J. Cui, P. Chen, R. Li, S. Liu, X. Shen, and J. Jia. 2019. Fast and practical neural architecture search. In Proceedings of the IEEE International Conference on Computer Vision. 6509\u20136518."},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 1901\u20131910","author":"Xiong Y.","unstructured":"Y. Xiong , R. Mehta , and V. Singh . 2019. Resource constrained neural network architecture search: Will a submodularity assumption help? In Proceedings of the IEEE International Conference on Computer Vision. 1901\u20131910 . Y. Xiong, R. Mehta, and V. Singh. 2019. Resource constrained neural network architecture search: Will a submodularity assumption help? In Proceedings of the IEEE International Conference on Computer Vision. 1901\u20131910."},{"key":"e_1_2_1_41_1","unstructured":"M. S. Ryoo A. J. Piergiovanni M. Tan and A. Angelova. 2019. AssembleNet: Searching for multi-stream neural connectivity in video architectures. arXiv:1905.13209. M. S. Ryoo A. J. Piergiovanni M. Tan and A. Angelova. 2019. AssembleNet: Searching for multi-stream neural connectivity in video architectures. arXiv:1905.13209."},{"key":"e_1_2_1_42_1","unstructured":"J. Dean G. Corrado R. Monga K. Chen M. Devin M. Mao ... and Q. V. Le. 2012. Large scale distributed deep networks. In Advances in Neural Information Processing Systems. 1223\u20131231. J. Dean G. Corrado R. Monga K. Chen M. Devin M. Mao ... and Q. V. Le. 2012. Large scale distributed deep networks. In Advances in Neural Information Processing Systems. 1223\u20131231."},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"33","author":"Real E.","unstructured":"E. Real , A. Aggarwal , Y. Huang , and Q. V. Le . 2019. Regularized evolution for image classifier architecture search . In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 33 , 4780\u20134789. E. Real, A. Aggarwal, Y. Huang, and Q. V. Le. 2019. Regularized evolution for image classifier architecture search. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33, 4780\u20134789."},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 1294\u20131303","author":"Chen X.","unstructured":"X. Chen , L. Xie , J. Wu , and Q. Tian . 2019. Progressive differentiable architecture search: Bridging the depth gap between search and evaluation . In Proceedings of the IEEE International Conference on Computer Vision. 1294\u20131303 . X. Chen, L. Xie, J. Wu, and Q. Tian. 2019. Progressive differentiable architecture search: Bridging the depth gap between search and evaluation. In Proceedings of the IEEE International Conference on Computer Vision. 1294\u20131303."},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 1793\u20131802","author":"Piergiovanni A. J.","unstructured":"A. J. Piergiovanni , A. Angelova , A. Toshev , and M. S. Ryoo . 2019. Evolving space-time neural architectures for videos . In Proceedings of the IEEE International Conference on Computer Vision. 1793\u20131802 . A. J. Piergiovanni, A. Angelova, A. Toshev, and M. S. Ryoo. 2019. Evolving space-time neural architectures for videos. In Proceedings of the IEEE International Conference on Computer Vision. 1793\u20131802."},{"key":"e_1_2_1_46_1","volume-title":"SNAS: Stochastic neural architecture search. arXiv:1812.09926.","author":"Xie S.","year":"2018","unstructured":"S. Xie , H. Zheng , C. Liu , and L. Lin . 2018 . SNAS: Stochastic neural architecture search. arXiv:1812.09926. S. Xie, H. Zheng, C. Liu, and L. Lin. 2018. SNAS: Stochastic neural architecture search. arXiv:1812.09926."},{"key":"e_1_2_1_47_1","unstructured":"T. Chen I. Goodfellow and J. Shlens. 2015. Net2net: Accelerating learning via knowledge transfer. arXiv:1511.05641. T. Chen I. Goodfellow and J. Shlens. 2015. Net2net: Accelerating learning via knowledge transfer. arXiv:1511.05641."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/78.650093"},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 5320\u20135329","author":"Bashivan P.","unstructured":"P. Bashivan , M. Tensen , and J. J. DiCarlo . 2019. Teacher guided architecture search . In Proceedings of the IEEE International Conference on Computer Vision. 5320\u20135329 . P. Bashivan, M. Tensen, and J. J. DiCarlo. 2019. Teacher guided architecture search. In Proceedings of the IEEE International Conference on Computer Vision. 5320\u20135329."},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 1304\u20131313","author":"Zheng X.","unstructured":"X. Zheng , R. Ji , L. Tang , B. Zhang , J. Liu , and Q. Tian . 2019. Multinomial distribution learning for effective neural architecture search . In Proceedings of the IEEE International Conference on Computer Vision. 1304\u20131313 . X. Zheng, R. Ji, L. Tang, B. Zhang, J. Liu, and Q. Tian. 2019. Multinomial distribution learning for effective neural architecture search. In Proceedings of the IEEE International Conference on Computer Vision. 1304\u20131313."},{"key":"e_1_2_1_51_1","volume-title":"32nd AAAI Conference on Artificial Intelligence. 2787\u20132794","author":"Cai H.","unstructured":"H. Cai , T. Chen , W. Zhang , Y. Yu , and J. Wang . 2018. Efficient architecture search by network transformation . In 32nd AAAI Conference on Artificial Intelligence. 2787\u20132794 . H. Cai, T. Chen, W. Zhang, Y. Yu, and J. Wang. 2018. Efficient architecture search by network transformation. In 32nd AAAI Conference on Artificial Intelligence. 2787\u20132794."},{"key":"e_1_2_1_52_1","unstructured":"A. Ashok N. Rhinehart F. Beainy and K. M. Kitani. 2017. N2N learning: Network to network compression via policy gradient reinforcement learning. arXiv:1709.06030. A. Ashok N. Rhinehart F. Beainy and K. M. Kitani. 2017. N2N learning: Network to network compression via policy gradient reinforcement learning. arXiv:1709.06030."},{"key":"e_1_2_1_53_1","unstructured":"J. Mei Y. Li X. Lian X. Jin L. Yang A. Yuille and J. Yang. 2019. AtomNAS: Fine-grained end-to-end neural architecture search. arXiv:1912.09640. J. Mei Y. Li X. Lian X. Jin L. Yang A. Yuille and J. Yang. 2019. AtomNAS: Fine-grained end-to-end neural architecture search. arXiv:1912.09640."},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 3224\u20133234","author":"Gong X.","unstructured":"X. Gong , S. Chang , Y. Jiang , and Z. Wang . 2019. AutoGAN: Neural architecture search for generative adversarial networks . In Proceedings of the IEEE International Conference on Computer Vision. 3224\u20133234 . X. Gong, S. Chang, Y. Jiang, and Z. Wang. 2019. AutoGAN: Neural architecture search for generative adversarial networks. In Proceedings of the IEEE International Conference on Computer Vision. 3224\u20133234."},{"key":"e_1_2_1_55_1","doi-asserted-by":"crossref","unstructured":"R. Pasunuru and M. Bansal. 2019. Continual and multi-task architecture search. arXiv:1906.05226. R. Pasunuru and M. Bansal. 2019. Continual and multi-task architecture search. arXiv:1906.05226.","DOI":"10.18653\/v1\/P19-1185"},{"key":"e_1_2_1_56_1","unstructured":"G. Hinton O. Vinyals and J. Dean. 2015. Distilling the knowledge in a neural network. arXiv:1503.02531. G. Hinton O. Vinyals and J. Dean. 2015. Distilling the knowledge in a neural network. arXiv:1503.02531."},{"key":"e_1_2_1_57_1","unstructured":"H. Cai J. Yang W. Zhang S. Han and Y. Yu. 2018. Path-level network transformation for efficient architecture search. arXiv:1806.02639. H. Cai J. Yang W. Zhang S. Han and Y. Yu. 2018. Path-level network transformation for efficient architecture search. arXiv:1806.02639."},{"key":"e_1_2_1_58_1","volume-title":"31st AAAI Conference on Artificial Intelligence.","author":"Szegedy C.","unstructured":"C. Szegedy , S. Ioffe , V. Vanhoucke , and A. A. Alemi . 2017. Inception-v4, inception-ResNet and the impact of residual connections on learning . In 31st AAAI Conference on Artificial Intelligence. C. Szegedy, S. Ioffe, V. Vanhoucke, and A. A. Alemi. 2017. Inception-v4, inception-ResNet and the impact of residual connections on learning. In 31st AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_1_59_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2818\u20132826","author":"Szegedy C.","unstructured":"C. Szegedy , V. Vanhoucke , S. Ioffe , J. Shlens , and Z. Wojna . 2016. Rethinking the inception architecture for computer vision . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2818\u20132826 . C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna. 2016. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2818\u20132826."},{"key":"e_1_2_1_60_1","unstructured":"J. Fang Y. Sun K. Peng Q. Zhang Y. Li W. Liu and X. Wang. 2020. Fast neural network adaptation via parameter remapping and architecture search. arXiv:2001.02525. J. Fang Y. Sun K. Peng Q. Zhang Y. Li W. Liu and X. Wang. 2020. Fast neural network adaptation via parameter remapping and architecture search. arXiv:2001.02525."},{"key":"e_1_2_1_61_1","unstructured":"K. Kandasamy W. Neiswanger J. Schneider B. Poczos and E. P. Xing. 2018. Neural architecture search with Bayesian optimisation and optimal transport. In Advances in Neural Information Processing Systems. 2016\u20132025. K. Kandasamy W. Neiswanger J. Schneider B. Poczos and E. P. Xing. 2018. Neural architecture search with Bayesian optimisation and optimal transport. In Advances in Neural Information Processing Systems. 2016\u20132025."},{"key":"e_1_2_1_62_1","unstructured":"R. Negrinho and G. Gordon. 2017. DeepArchitect: Automatically designing and training deep architectures. arXiv:1704.08792. R. Negrinho and G. Gordon. 2017. DeepArchitect: Automatically designing and training deep architectures. arXiv:1704.08792."},{"key":"e_1_2_1_63_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 82\u201392","author":"Liu C.","unstructured":"C. Liu , L. C. Chen , F. Schroff , H. Adam , W. Hua , A. L. Yuille , and L. Fei-Fei . 2019. Auto-DeepLab: Hierarchical neural architecture search for semantic image segmentation . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 82\u201392 . C. Liu, L. C. Chen, F. Schroff, H. Adam, W. Hua, A. L. Yuille, and L. Fei-Fei. 2019. Auto-DeepLab: Hierarchical neural architecture search for semantic image segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 82\u201392."},{"key":"e_1_2_1_64_1","doi-asserted-by":"crossref","unstructured":"S. Ding T. Chen X. Gong W. Zha and Z. Wang. 2020. AutoSpeech: Neural architecture search for speaker recognition. arXiv:2005.03215. S. Ding T. Chen X. Gong W. Zha and Z. Wang. 2020. AutoSpeech: Neural architecture search for speaker recognition. arXiv:2005.03215.","DOI":"10.21437\/Interspeech.2020-1258"},{"key":"e_1_2_1_65_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 11641\u201311650","author":"Zhang Y.","unstructured":"Y. Zhang , Z. Qiu , J. Liu , T. Yao , D. Liu , and T. Mei . 2019. Customizable architecture search for semantic segmentation . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 11641\u201311650 . Y. Zhang, Z. Qiu, J. Liu, T. Yao, D. Liu, and T. Mei. 2019. Customizable architecture search for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 11641\u201311650."},{"key":"e_1_2_1_66_1","unstructured":"Y. Chen T. Yang X. Zhang G. Meng C. Pan and J. Sun. 2019. DetNAS: Neural architecture search on object detection. arXiv:1903.10979. Y. Chen T. Yang X. Zhang G. Meng C. Pan and J. Sun. 2019. DetNAS: Neural architecture search on object detection. arXiv:1903.10979."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02098169"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10479-007-0176-2"},{"key":"e_1_2_1_69_1","unstructured":"R. Shin C. Packer and D. Song. 2018. Differentiable Neural Network Architecture Search. ICLR. R. Shin C. Packer and D. Song. 2018. Differentiable Neural Network Architecture Search. ICLR."},{"key":"e_1_2_1_70_1","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV\u201918)","author":"Ahmed K.","unstructured":"K. Ahmed and L. Torresani . 2018. MaskConnect: Connectivity learning by gradient descent . In Proceedings of the European Conference on Computer Vision (ECCV\u201918) . 349\u2013365. K. Ahmed and L. Torresani. 2018. MaskConnect: Connectivity learning by gradient descent. In Proceedings of the European Conference on Computer Vision (ECCV\u201918). 349\u2013365."},{"key":"e_1_2_1_71_1","unstructured":"S. Saxena and J. Verbeek. 2016. Convolutional neural fabrics. In Advances in Neural Information Processing Systems. 4053\u20134061. S. Saxena and J. Verbeek. 2016. Convolutional neural fabrics. In Advances in Neural Information Processing Systems. 4053\u20134061."},{"key":"e_1_2_1_72_1","unstructured":"K. Ahmed and L. Torresani. 2017. Connectivity learning in multi-branch networks. arXiv:1709.09582. K. Ahmed and L. Torresani. 2017. Connectivity learning in multi-branch networks. arXiv:1709.09582."},{"key":"e_1_2_1_73_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3492\u20133500","author":"Veniat T.","unstructured":"T. Veniat and L. Denoyer . 2018. Learning time\/memory-efficient deep architectures with budgeted super networks . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3492\u20133500 . T. Veniat and L. Denoyer. 2018. Learning time\/memory-efficient deep architectures with budgeted super networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3492\u20133500."},{"key":"e_1_2_1_74_1","unstructured":"R. Luo F. Tian T. Qin E. Chen and T. Y. Liu. 2018. Neural architecture optimization. In Advances in Neural Information Processing Systems. 7816\u20137827. R. Luo F. Tian T. Qin E. Chen and T. Y. Liu. 2018. Neural architecture optimization. In Advances in Neural Information Processing Systems. 7816\u20137827."},{"key":"e_1_2_1_75_1","volume-title":"DATA: Differentiable ArchiTecture approximation. In Advances in Neural Information Processing Systems. 874\u2013884.","author":"Chang J.","year":"2019","unstructured":"J. Chang , Y. Guo , G. Meng , S. Xiang , and C. Pan . 2019 . DATA: Differentiable ArchiTecture approximation. In Advances in Neural Information Processing Systems. 874\u2013884. J. Chang, Y. Guo, G. Meng, S. Xiang, and C. Pan. 2019. DATA: Differentiable ArchiTecture approximation. In Advances in Neural Information Processing Systems. 874\u2013884."},{"key":"e_1_2_1_76_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7036\u20137045","author":"Ghiasi G.","unstructured":"G. Ghiasi , T. Y. Lin , and Q. V. Le . 2019. NAS-FPN: Learning scalable feature pyramid architecture for object detection . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7036\u20137045 . G. Ghiasi, T. Y. Lin, and Q. V. Le. 2019. NAS-FPN: Learning scalable feature pyramid architecture for object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7036\u20137045."},{"key":"e_1_2_1_77_1","unstructured":"D. Tran J. Ray Z. Shou S. F. Chang and M. Paluri. 2017. ConvNet architecture search for spatiotemporal feature learning. arXiv:1708.05038. D. Tran J. Ray Z. Shou S. F. Chang and M. Paluri. 2017. ConvNet architecture search for spatiotemporal feature learning. arXiv:1708.05038."},{"key":"e_1_2_1_78_1","unstructured":"L. C. Chen M. Collins Y. Zhu G. Papandreou B. Zoph F. Schroff ... and J. Shlens. 2018. Searching for efficient multi-scale architectures for dense image prediction. In Advances in Neural Information Processing Systems. 8699\u20138710. L. C. Chen M. Collins Y. Zhu G. Papandreou B. Zoph F. Schroff ... and J. Shlens. 2018. Searching for efficient multi-scale architectures for dense image prediction. In Advances in Neural Information Processing Systems. 8699\u20138710."},{"key":"e_1_2_1_79_1","unstructured":"C. Ying A. Klein E. Real E. Christiansen K. Murphy and F. Hutter. 2019. NAS-bench-101: Towards reproducible neural architecture search. arXiv:1902.09635. C. Ying A. Klein E. Real E. Christiansen K. Murphy and F. Hutter. 2019. NAS-bench-101: Towards reproducible neural architecture search. arXiv:1902.09635."},{"key":"e_1_2_1_80_1","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP\u201919)","author":"Jiang Y.","unstructured":"Y. Jiang , C. Hu , T. Xiao , C. Zhang , and J. Zhu . 2019. Improved differentiable architecture search for language modeling and named entity recognition . In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP\u201919) . 3576\u20133581. Y. Jiang, C. Hu, T. Xiao, C. Zhang, and J. Zhu. 2019. Improved differentiable architecture search for language modeling and named entity recognition. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP\u201919). 3576\u20133581."},{"key":"e_1_2_1_81_1","volume-title":"ICML 2001","author":"Lafferty J.","year":"2001","unstructured":"J. Lafferty , A. McCallum , and F. C. Pereira . 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data . ICML 2001 ( 2001 ), 282\u2013289. J. Lafferty, A. McCallum, and F. C. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. ICML 2001 (2001), 282\u2013289."},{"key":"e_1_2_1_82_1","unstructured":"D. Koller and N. Friedman. 2009. Probabilistic Graphical Models: Principles and Techniques. MIT Press. D. Koller and N. Friedman. 2009. Probabilistic Graphical Models: Principles and Techniques. MIT Press."},{"key":"e_1_2_1_83_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1761\u20131770","author":"Dong X.","unstructured":"X. Dong and Y. Yang . 2019. Searching for a robust neural architecture in four GPU hours . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1761\u20131770 . X. Dong and Y. Yang. 2019. Searching for a robust neural architecture in four GPU hours. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1761\u20131770."},{"key":"e_1_2_1_84_1","unstructured":"Y. Xu L. Xie X. Zhang X. Chen G. Qi Q. Tian and H. Xiong. 2019. PC-DARTS: Partial channel connections for memory-efficient architecture search. arXiv:abs\/1907.05737. Y. Xu L. Xie X. Zhang X. Chen G. Qi Q. Tian and H. Xiong. 2019. PC-DARTS: Partial channel connections for memory-efficient architecture search. arXiv:abs\/1907.05737."},{"key":"e_1_2_1_85_1","unstructured":"T. Elsken J. H. Metzen and F. Hutter. 2017. Simple and efficient architecture search for convolutional neural networks. arXiv:1711.04528. T. Elsken J. H. Metzen and F. Hutter. 2017. Simple and efficient architecture search for convolutional neural networks. arXiv:1711.04528."},{"key":"e_1_2_1_86_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 806\u2013813","author":"Razavian A. Sharif","unstructured":"A. Sharif Razavian , H. Azizpour , J. Sullivan , and S. Carlsson . 2014. CNN features off-the-shelf: An astounding baseline for recognition . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 806\u2013813 . A. Sharif Razavian, H. Azizpour, J. Sullivan, and S. Carlsson. 2014. CNN features off-the-shelf: An astounding baseline for recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 806\u2013813."},{"key":"e_1_2_1_87_1","doi-asserted-by":"crossref","unstructured":"B. Zoph D. Yuret J. May and K. Knight. 2016. Transfer learning for low-resource neural machine translation. arXiv:1604.02201. B. Zoph D. Yuret J. May and K. Knight. 2016. Transfer learning for low-resource neural machine translation. arXiv:1604.02201.","DOI":"10.18653\/v1\/D16-1163"},{"key":"e_1_2_1_88_1","unstructured":"M. T. Luong Q. V. Le I. Sutskever O. Vinyals and L. Kaiser. 2015. Multi-task sequence to sequence learning. arXiv:1511.06114. M. T. Luong Q. V. Le I. Sutskever O. Vinyals and L. Kaiser. 2015. Multi-task sequence to sequence learning. arXiv:1511.06114."},{"key":"e_1_2_1_89_1","unstructured":"D. Ha A. Dai and Q. V. Le. 2016. Hypernetworks. arXiv:1609.09106. D. Ha A. Dai and Q. V. Le. 2016. Hypernetworks. arXiv:1609.09106."},{"key":"e_1_2_1_90_1","volume-title":"International Conference on Learning Representations 2017 (ICLR\u201917)","author":"Li L.","unstructured":"L. Li , K. Jamieson , G. DeSalvo , A. Rostamizadeh , and A. Talwalkar . 2017. Hyperband: Bandit-based configuration evaluation for hyperparameter optimization . In International Conference on Learning Representations 2017 (ICLR\u201917) . L. Li, K. Jamieson, G. DeSalvo, A. Rostamizadeh, and A. Talwalkar. 2017. Hyperband: Bandit-based configuration evaluation for hyperparameter optimization. In International Conference on Learning Representations 2017 (ICLR\u201917)."},{"key":"e_1_2_1_91_1","unstructured":"C. Zhang M. Ren and R. Urtasun. 2018. Graph hypernetworks for neural architecture search. arXiv:1810.05749. C. Zhang M. Ren and R. Urtasun. 2018. Graph hypernetworks for neural architecture search. arXiv:1810.05749."},{"key":"e_1_2_1_92_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 3681\u20133690","author":"Dong X.","unstructured":"X. Dong and Y. Yang . 2019. One-shot neural architecture search via self-evaluated template network . In Proceedings of the IEEE International Conference on Computer Vision. 3681\u20133690 . X. Dong and Y. Yang. 2019. One-shot neural architecture search via self-evaluated template network. In Proceedings of the IEEE International Conference on Computer Vision. 3681\u20133690."},{"key":"e_1_2_1_93_1","unstructured":"M. Mirza and S. Osindero. 2014. Conditional generative adversarial nets. arXiv:1411.1784. M. Mirza and S. Osindero. 2014. Conditional generative adversarial nets. arXiv:1411.1784."},{"key":"e_1_2_1_94_1","unstructured":"T. Salimans I. Goodfellow W. Zaremba V. Cheung A. Radford and X. Chen. 2016. Improved techniques for training gans. In Advances in Neural Information Processing Systems. 2234\u20132242. T. Salimans I. Goodfellow W. Zaremba V. Cheung A. Radford and X. Chen. 2016. Improved techniques for training gans. In Advances in Neural Information Processing Systems. 2234\u20132242."},{"key":"e_1_2_1_95_1","unstructured":"T. Karras T. Aila S. Laine and J. Lehtinen. 2017. Progressive growing of GANs for improved quality stability and variation. arXiv:1710.10196. T. Karras T. Aila S. Laine and J. Lehtinen. 2017. Progressive growing of GANs for improved quality stability and variation. arXiv:1710.10196."},{"key":"e_1_2_1_96_1","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV\u201918)","author":"Tran N. T.","unstructured":"N. T. Tran , T. A. Bui , and N. M. Cheung . 2018. Dist-GAN: An improved GAN using distance constraints . In Proceedings of the European Conference on Computer Vision (ECCV\u201918) . 370\u2013385. N. T. Tran, T. A. Bui, and N. M. Cheung. 2018. Dist-GAN: An improved GAN using distance constraints. In Proceedings of the European Conference on Computer Vision (ECCV\u201918). 370\u2013385."},{"key":"e_1_2_1_97_1","unstructured":"W. Wang Y. Sun and S. Halgamuge. 2018. Improving MMD-GAN training with repulsive loss function. arXiv:1812.09916. W. Wang Y. Sun and S. Halgamuge. 2018. Improving MMD-GAN training with repulsive loss function. arXiv:1812.09916."},{"key":"e_1_2_1_98_1","volume-title":"MGAN: Training generative adversarial nets with multiple generators. In ICLR.","author":"Hoang Q.","year":"2018","unstructured":"Q. Hoang , T. D. Nguyen , T. Le , and D. Phung . 2018 . MGAN: Training generative adversarial nets with multiple generators. In ICLR. Q. Hoang, T. D. Nguyen, T. Le, and D. Phung. 2018. MGAN: Training generative adversarial nets with multiple generators. In ICLR."},{"key":"e_1_2_1_99_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7036\u20137045","author":"Ghiasi G.","unstructured":"G. Ghiasi , T. Y. Lin , and Q. V. Le . 2019. NAS-FPN: Learning scalable feature pyramid architecture for object detection . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7036\u20137045 . G. Ghiasi, T. Y. Lin, and Q. V. Le. 2019. NAS-FPN: Learning scalable feature pyramid architecture for object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7036\u20137045."},{"key":"e_1_2_1_100_1","unstructured":"H. Cai C. Gan and S. Han. 2019. Once for all: Train one network and specialize it for efficient deployment. arXiv:1908.09791. H. Cai C. Gan and S. Han. 2019. Once for all: Train one network and specialize it for efficient deployment. arXiv:1908.09791."},{"key":"e_1_2_1_101_1","unstructured":"X. Chu B. Zhang R. Xu and J. Li. 2019. FairNAS: Rethinking evaluation fairness of weight sharing neural architecture search. arXiv:1907.01845. X. Chu B. Zhang R. Xu and J. Li. 2019. FairNAS: Rethinking evaluation fairness of weight sharing neural architecture search. arXiv:1907.01845."},{"key":"e_1_2_1_102_1","doi-asserted-by":"crossref","unstructured":"X. Li C. Lin C. Li M. Sun W. Wu J. Yan and W. Ouyang. 2019. Improving one-shot NAS by suppressing the posterior fading. arXiv:1910.02543. X. Li C. Lin C. Li M. Sun W. Wu J. Yan and W. Ouyang. 2019. Improving one-shot NAS by suppressing the posterior fading. arXiv:1910.02543.","DOI":"10.1109\/CVPR42600.2020.01385"},{"key":"e_1_2_1_103_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 10734\u201310742","author":"Wu B.","unstructured":"B. Wu , X. Dai , P. Zhang , Y. Wang , F. Sun , Y. Wu , ... and K. Keutzer . 2019. FBNet: Hardware-aware efficient ConvNet design via differentiable neural architecture search . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 10734\u201310742 . B. Wu, X. Dai, P. Zhang, Y. Wang, F. Sun, Y. Wu, ... and K. Keutzer. 2019. FBNet: Hardware-aware efficient ConvNet design via differentiable neural architecture search. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 10734\u201310742."},{"key":"e_1_2_1_104_1","unstructured":"H. Cai L. Zhu and S. Han. 2018. ProxylessNAS: Direct neural architecture search on target task and hardware. arXiv:1812.00332. H. Cai L. Zhu and S. Han. 2018. ProxylessNAS: Direct neural architecture search on target task and hardware. arXiv:1812.00332."},{"key":"e_1_2_1_105_1","unstructured":"L. Li and A. Talwalkar. 2019. Random search and reproducibility for neural architecture search. arXiv:1902.07638. L. Li and A. Talwalkar. 2019. Random search and reproducibility for neural architecture search. arXiv:1902.07638."},{"key":"e_1_2_1_106_1","doi-asserted-by":"crossref","unstructured":"Z. Guo X. Zhang H. Mu W. Heng Z. Liu Y. Wei and J. Sun. 2019. Single path one-shot neural architecture search with uniform sampling. arXiv:1904.00420. Z. Guo X. Zhang H. Mu W. Heng Z. Liu Y. Wei and J. Sun. 2019. Single path one-shot neural architecture search with uniform sampling. arXiv:1904.00420.","DOI":"10.1007\/978-3-030-58517-4_32"},{"key":"e_1_2_1_107_1","volume-title":"24th International Joint Conference on Artificial Intelligence.","author":"Domhan T.","unstructured":"T. Domhan , J. T. Springenberg , and F. Hutter . 2015. Speeding up automatic hyperparameter optimization of deep neural networks by extrapolation of learning curves . In 24th International Joint Conference on Artificial Intelligence. T. Domhan, J. T. Springenberg, and F. Hutter. 2015. Speeding up automatic hyperparameter optimization of deep neural networks by extrapolation of learning curves. In 24th International Joint Conference on Artificial Intelligence."},{"key":"e_1_2_1_108_1","volume-title":"International Conference on Learning Representation. 184--194","author":"Klein A.","unstructured":"A. Klein , S. Falkner , J. T. Springenberg , and F. Hutter . 2016. Learning curve prediction with Bayesian neural networks . In International Conference on Learning Representation. 184--194 . A. Klein, S. Falkner, J. T. Springenberg, and F. Hutter. 2016. Learning curve prediction with Bayesian neural networks. In International Conference on Learning Representation. 184--194."},{"key":"e_1_2_1_109_1","volume-title":"Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, Cham, 477\u2013492","author":"Chandrashekaran A.","unstructured":"A. Chandrashekaran and I. R. Lane . 2017. Speeding up hyper-parameter optimization by extrapolation of learning curves using previous builds . In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, Cham, 477\u2013492 . A. Chandrashekaran and I. R. Lane. 2017. Speeding up hyper-parameter optimization by extrapolation of learning curves using previous builds. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, Cham, 477\u2013492."},{"key":"e_1_2_1_110_1","volume-title":"Peephole: Predicting network performance before training. arXiv:1712.03351.","author":"Deng B.","year":"2017","unstructured":"B. Deng , J. Yan , and D. Lin . 2017 . Peephole: Predicting network performance before training. arXiv:1712.03351. B. Deng, J. Yan, and D. Lin. 2017. Peephole: Predicting network performance before training. arXiv:1712.03351."},{"key":"e_1_2_1_111_1","unstructured":"A. Zela T. Elsken T. Saikia Y. Marrakchi T. Brox and F. Hutter. 2020. Understanding and robustifying differentiable architecture search. In ICLR. A. Zela T. Elsken T. Saikia Y. Marrakchi T. Brox and F. Hutter. 2020. Understanding and robustifying differentiable architecture search. In ICLR."},{"key":"e_1_2_1_112_1","unstructured":"J. Peng M. Sun Z. X. Zhang T. Tan and J. Yan. 2019. Efficient neural architecture transformation search in channel-level for object detection. In Advances in Neural Information Processing Systems. 14290\u201314299. J. Peng M. Sun Z. X. Zhang T. Tan and J. Yan. 2019. Efficient neural architecture transformation search in channel-level for object detection. In Advances in Neural Information Processing Systems. 14290\u201314299."},{"key":"e_1_2_1_113_1","volume-title":"Deep subdomain adaptation network for image classification","author":"\u00a0al Y. Zhu","unstructured":"Y. Zhu et \u00a0al . [n.d.]. Deep subdomain adaptation network for image classification . In IEEE Transactions on Neural Networks and Learning Systems . DOI: 10.1109\/TNNLS.2020.2988928. 10.1109\/TNNLS.2020.2988928 Y. Zhu et\u00a0al. [n.d.]. Deep subdomain adaptation network for image classification. In IEEE Transactions on Neural Networks and Learning Systems. DOI: 10.1109\/TNNLS.2020.2988928."},{"key":"e_1_2_1_114_1","volume-title":"One-shot neural architecture search: Maximising diversity to overcome catastrophic forgetting","author":"Zhang Miao","unstructured":"Miao Zhang , Huiqi Li , Shirui Pan , Xiaojun Chang , Chuan Zhou , Zongyuan Ge , and Steven W. Su . One-shot neural architecture search: Maximising diversity to overcome catastrophic forgetting . IEEE Transactions on Pattern Analysis and Machine Intelligence . DOI:10.1109\/TPAMI.2020.3035351 10.1109\/TPAMI.2020.3035351 Miao Zhang, Huiqi Li, Shirui Pan, Xiaojun Chang, Chuan Zhou, Zongyuan Ge, and Steven W. Su. One-shot neural architecture search: Maximising diversity to overcome catastrophic forgetting. IEEE Transactions on Pattern Analysis and Machine Intelligence. DOI:10.1109\/TPAMI.2020.3035351"},{"key":"e_1_2_1_115_1","volume-title":"XNAS: Neural architecture search with expert advice. In Advances in Neural Information Processing Systems. 1975\u20131985.","author":"Nayman N.","year":"2019","unstructured":"N. Nayman , A. Noy , T. Ridnik , I. Friedman , R. Jin , and L. Zelnik . 2019 . XNAS: Neural architecture search with expert advice. In Advances in Neural Information Processing Systems. 1975\u20131985. N. Nayman, A. Noy, T. Ridnik, I. Friedman, R. Jin, and L. Zelnik. 2019. XNAS: Neural architecture search with expert advice. In Advances in Neural Information Processing Systems. 1975\u20131985."},{"key":"e_1_2_1_116_1","unstructured":"S. Cao X. Wang and K. M. Kitani. 2019. Learnable embedding space for efficient neural architecture compression. arXiv:1902.00383. S. Cao X. Wang and K. M. Kitani. 2019. Learnable embedding space for efficient neural architecture compression. arXiv:1902.00383."},{"key":"e_1_2_1_117_1","unstructured":"T. Elsken J. H. Metzen and F. Hutter. 2018. Efficient multi-objective neural architecture search via Lamarckian evolution. arXiv:1804.09081. T. Elsken J. H. Metzen and F. Hutter. 2018. Efficient multi-objective neural architecture search via Lamarckian evolution. arXiv:1804.09081."},{"key":"e_1_2_1_118_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 9145\u20139153","author":"Li X.","unstructured":"X. Li , Y. Zhou , Z. Pan , and J. Feng . 2019. Partial order pruning: For best speed\/accuracy trade-off in neural architecture search . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 9145\u20139153 . X. Li, Y. Zhou, Z. Pan, and J. Feng. 2019. Partial order pruning: For best speed\/accuracy trade-off in neural architecture search. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 9145\u20139153."},{"key":"e_1_2_1_119_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 11398\u201311407","author":"Dai X.","unstructured":"X. Dai , P. Zhang , B. Wu , H. Yin , F. Sun , Y. Wang , ... and P. Vajda . 2019. ChamNet: Towards efficient network design through platform-aware model adaptation . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 11398\u201311407 . X. Dai, P. Zhang, B. Wu, H. Yin, F. Sun, Y. Wang, ... and P. Vajda. 2019. ChamNet: Towards efficient network design through platform-aware model adaptation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 11398\u201311407."},{"key":"e_1_2_1_120_1","unstructured":"F. Liang C. Lin R. Guo M. Sun W. Wu J. Yan and W. Ouyang. 2019. Computation reallocation for object detection. arXiv:1912.11234. F. Liang C. Lin R. Guo M. Sun W. Wu J. Yan and W. Ouyang. 2019. Computation reallocation for object detection. arXiv:1912.11234."},{"key":"e_1_2_1_121_1","volume-title":"Sparse: Sparse architecture search for CNNs on resource-constrained microcontrollers. In Advances in Neural Information Processing Systems. 4978\u20134990.","author":"Fedorov I.","year":"2019","unstructured":"I. Fedorov , R. P. Adams , M. Mattina , and P. Whatmough . 2019 . Sparse: Sparse architecture search for CNNs on resource-constrained microcontrollers. In Advances in Neural Information Processing Systems. 4978\u20134990. I. Fedorov, R. P. Adams, M. Mattina, and P. Whatmough. 2019. Sparse: Sparse architecture search for CNNs on resource-constrained microcontrollers. In Advances in Neural Information Processing Systems. 4978\u20134990."},{"key":"e_1_2_1_122_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 9126\u20139135","author":"Nekrasov V.","unstructured":"V. Nekrasov , H. Chen , C. Shen , and I. Reid . 2019. Fast neural architecture search of compact semantic segmentation models via auxiliary cells . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 9126\u20139135 . V. Nekrasov, H. Chen, C. Shen, and I. Reid. 2019. Fast neural architecture search of compact semantic segmentation models via auxiliary cells. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 9126\u20139135."},{"key":"e_1_2_1_123_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 113\u2013123","author":"Cubuk E. D.","unstructured":"E. D. Cubuk , B. Zoph , D. Mane , V. Vasudevan , and Q. V. Le . 2019. Autoaugment: Learning augmentation strategies from data . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 113\u2013123 . E. D. Cubuk, B. Zoph, D. Mane, V. Vasudevan, and Q. V. Le. 2019. Autoaugment: Learning augmentation strategies from data. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 113\u2013123."},{"key":"e_1_2_1_124_1","unstructured":"M. Tan and Q. V. Le. 2019. EfficientNet: Rethinking model scaling for convolutional neural networks. arXiv:1905.11946. M. Tan and Q. V. Le. 2019. EfficientNet: Rethinking model scaling for convolutional neural networks. arXiv:1905.11946."},{"key":"e_1_2_1_125_1","unstructured":"X. Zhang Q. Wang J. Zhang and Z. Zhong. 2019. Adversarial AutoAugment. arXiv:1912.11188. X. Zhang Q. Wang J. Zhang and Z. Zhong. 2019. Adversarial AutoAugment. arXiv:1912.11188."},{"key":"e_1_2_1_126_1","unstructured":"X. Dong and Y. Yang. 2019. Network pruning via transformable architecture search. In Advances in Neural Information Processing Systems. 759\u2013770. X. Dong and Y. Yang. 2019. Network pruning via transformable architecture search. In Advances in Neural Information Processing Systems. 759\u2013770."},{"key":"e_1_2_1_127_1","doi-asserted-by":"crossref","unstructured":"Z. Lu I. Whalen V. Boddeti Y. D. Dhebar K. Deb E. D. Goodman and W. Banzhaf. 2018. NSGA-NET: A multi-objective genetic algorithm for neural architecture search. Computer Vision and Pattern Recognition. Z. Lu I. Whalen V. Boddeti Y. D. Dhebar K. Deb E. D. Goodman and W. Banzhaf. 2018. NSGA-NET: A multi-objective genetic algorithm for neural architecture search. Computer Vision and Pattern Recognition.","DOI":"10.1145\/3321707.3321729"},{"key":"e_1_2_1_128_1","doi-asserted-by":"crossref","unstructured":"X. Dong L. Liu K. Musial and B. Gabrys. 2020. NATS-Bench: Benchmarking NAS algorithms for architecture topology and size. arXiv:2009.00437. X. Dong L. Liu K. Musial and B. Gabrys. 2020. NATS-Bench: Benchmarking NAS algorithms for architecture topology and size. arXiv:2009.00437.","DOI":"10.1109\/TPAMI.2021.3054824"},{"key":"e_1_2_1_129_1","unstructured":"A. Yang P. M. Esperan\u00e7a and F. M. Carlucci. 2019. NAS evaluation is frustratingly hard. arXiv:1912.12522. A. Yang P. M. Esperan\u00e7a and F. M. Carlucci. 2019. NAS evaluation is frustratingly hard. arXiv:1912.12522."},{"key":"e_1_2_1_130_1","volume-title":"Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, Cham, 243\u2013258","author":"Wistuba M.","year":"2018","unstructured":"M. Wistuba . 2018 . Deep learning architecture search by neuro-cell-based evolution with function-preserving mutations . In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, Cham, 243\u2013258 . M. Wistuba. 2018. Deep learning architecture search by neuro-cell-based evolution with function-preserving mutations. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, Cham, 243\u2013258."},{"key":"e_1_2_1_131_1","unstructured":"T. DeVries and G. W. Taylor. 2017. Improved regularization of convolutional neural networks with cutout. arXiv:1708.04552. T. DeVries and G. W. Taylor. 2017. Improved regularization of convolutional neural networks with cutout. arXiv:1708.04552."},{"key":"e_1_2_1_132_1","unstructured":"F. P. Casale J. Gordon and N. Fusi. 2019. Probabilistic neural architecture search. arXiv:abs\/1902.05116. F. P. Casale J. Gordon and N. Fusi. 2019. Probabilistic neural architecture search. arXiv:abs\/1902.05116."},{"key":"e_1_2_1_133_1","doi-asserted-by":"crossref","unstructured":"S. Zagoruyko and N. Komodakis. 2016. Wide residual networks. arXiv:1605.07146. S. Zagoruyko and N. Komodakis. 2016. Wide residual networks. arXiv:1605.07146.","DOI":"10.5244\/C.30.87"},{"key":"e_1_2_1_134_1","unstructured":"X. Gastaldi. 2017. Shake-shake regularization. arXiv:1705.07485. X. Gastaldi. 2017. Shake-shake regularization. arXiv:1705.07485."},{"key":"e_1_2_1_135_1","unstructured":"Y. Yamada M. Iwamura and K. Kise. 2016. Deep pyramidal residual networks with separated stochastic depth. arXiv:1612.01230. Y. Yamada M. Iwamura and K. Kise. 2016. Deep pyramidal residual networks with separated stochastic depth. arXiv:1612.01230."},{"key":"e_1_2_1_136_1","volume-title":"European Conference on Computer Vision. Springer, Cham, 646\u2013661","author":"Huang G.","unstructured":"G. Huang , Y. Sun , Z. Liu , D. Sedra , and K. Q. Weinberger . 2016. Deep networks with stochastic depth . In European Conference on Computer Vision. Springer, Cham, 646\u2013661 . G. Huang, Y. Sun, Z. Liu, D. Sedra, and K. Q. Weinberger. 2016. Deep networks with stochastic depth. In European Conference on Computer Vision. Springer, Cham, 646\u2013661."},{"key":"e_1_2_1_137_1","unstructured":"G. Larsson M. Maire and G. Shakhnarovich. 2016. FractalNet: Ultra-deep neural networks without residuals. arXiv:1605.07648. G. Larsson M. Maire and G. Shakhnarovich. 2016. FractalNet: Ultra-deep neural networks without residuals. arXiv:1605.07648."},{"key":"e_1_2_1_138_1","unstructured":"H. Zhou M. Yang J. Wang and W. Pan. 2019. BayesNAS: A Bayesian approach for neural architecture search. arXiv:1905.04919. H. Zhou M. Yang J. Wang and W. Pan. 2019. BayesNAS: A Bayesian approach for neural architecture search. arXiv:1905.04919."},{"key":"e_1_2_1_139_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 6848\u20136856","author":"Zhang X.","unstructured":"X. Zhang , X. Zhou , M. Lin , and J. Sun . 2018. Shufflenet: An extremely efficient convolutional neural network for mobile devices . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 6848\u20136856 . X. Zhang, X. Zhou, M. Lin, and J. Sun. 2018. Shufflenet: An extremely efficient convolutional neural network for mobile devices. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 6848\u20136856."},{"key":"e_1_2_1_140_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1492\u20131500","author":"Xie S.","unstructured":"S. Xie , R. Girshick , P. Doll\u00e1r , Z. Tu , and K. He . 2017. Aggregated residual transformations for deep neural networks . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1492\u20131500 . S. Xie, R. Girshick, P. Doll\u00e1r, Z. Tu, and K. He. 2017. Aggregated residual transformations for deep neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1492\u20131500."},{"key":"e_1_2_1_141_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 718\u2013726","author":"Zhang X.","unstructured":"X. Zhang , Z. Li , C. Change Loy , and D. Lin . 2017. PolyNet: A pursuit of structural diversity in very deep networks . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 718\u2013726 . X. Zhang, Z. Li, C. Change Loy, and D. Lin. 2017. PolyNet: A pursuit of structural diversity in very deep networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 718\u2013726."},{"key":"e_1_2_1_142_1","unstructured":"Y. Chen J. Li H. Xiao X. Jin S. Yan and J. Feng. 2017. Dual path networks. In Advances in Neural Information Processing Systems. 4467\u20134475. Y. Chen J. Li H. Xiao X. Jin S. Yan and J. Feng. 2017. Dual path networks. In Advances in Neural Information Processing Systems. 4467\u20134475."},{"key":"e_1_2_1_143_1","volume-title":"BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805.","author":"Devlin J.","year":"2018","unstructured":"J. Devlin , M. W. Chang , K. Lee , and K. Toutanova . 2018 . BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805. J. Devlin, M. W. Chang, K. Lee, and K. Toutanova. 2018. BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805."},{"key":"e_1_2_1_144_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3431\u20133440","author":"Long J.","unstructured":"J. Long , E. Shelhamer , and T. Darrell . 2015. Fully convolutional networks for semantic segmentation . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3431\u20133440 . J. Long, E. Shelhamer, and T. Darrell. 2015. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3431\u20133440."},{"key":"e_1_2_1_145_1","volume-title":"Proceedings of the 7th Asia International Symposium on Mechatronics","author":"Sun W.","unstructured":"W. Sun , Z. Huang , M. Liang , T. Shao , and H. Bi . 2020. Cocoon image segmentation method based on fully convolutional networks . In Proceedings of the 7th Asia International Symposium on Mechatronics . Springer, Singapore, 832\u2013843. W. Sun, Z. Huang, M. Liang, T. Shao, and H. Bi. 2020. Cocoon image segmentation method based on fully convolutional networks. In Proceedings of the 7th Asia International Symposium on Mechatronics. Springer, Singapore, 832\u2013843."},{"key":"e_1_2_1_146_1","volume-title":"[n.d.]. MASK-RL: Multiagent video object segmentation framework through reinforcement learning","author":"Vecchio G.","unstructured":"G. Vecchio , S. Palazzo , D. Giordano , F. Rundo , and C. Spampinato . [n.d.]. MASK-RL: Multiagent video object segmentation framework through reinforcement learning . In IEEE Transactions on Neural Networks and Learning Systems . DOI: 10.1109\/TNNLS.2019.2963282. 10.1109\/TNNLS.2019.2963282 G. Vecchio, S. Palazzo, D. Giordano, F. Rundo, and C. Spampinato. [n.d.]. MASK-RL: Multiagent video object segmentation framework through reinforcement learning. In IEEE Transactions on Neural Networks and Learning Systems. DOI: 10.1109\/TNNLS.2019.2963282."},{"key":"e_1_2_1_147_1","volume-title":"[n.d.]. Deep attentive video summarization with distribution consistency learning","author":"Ji Z.","unstructured":"Z. Ji , Y. Zhao , Y. Pang , X. Li and J. Han . [n.d.]. Deep attentive video summarization with distribution consistency learning . In IEEE Transactions on Neural Networks and Learning Systems . DOI: 10.1109\/TNNLS.2020.2991083. 10.1109\/TNNLS.2020.2991083 Z. Ji, Y. Zhao, Y. Pang, X. Li and J. Han. [n.d.]. Deep attentive video summarization with distribution consistency learning. In IEEE Transactions on Neural Networks and Learning Systems. DOI: 10.1109\/TNNLS.2020.2991083."},{"key":"e_1_2_1_148_1","volume-title":"[n.d.]. From discriminant to complete: Reinforcement searching-agent learning for weakly supervised object detection","author":"Zhang D.","unstructured":"D. Zhang , J. Han , L. Zhao , and T. Zhao . [n.d.]. From discriminant to complete: Reinforcement searching-agent learning for weakly supervised object detection . In IEEE Transactions on Neural Networks and Learning Systems . DOI: 10.1109\/TNNLS.2020.2969483. 10.1109\/TNNLS.2020.2969483 D. Zhang, J. Han, L. Zhao, and T. Zhao. [n.d.]. From discriminant to complete: Reinforcement searching-agent learning for weakly supervised object detection. In IEEE Transactions on Neural Networks and Learning Systems. DOI: 10.1109\/TNNLS.2020.2969483."},{"key":"e_1_2_1_149_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2019.2929059"},{"key":"e_1_2_1_150_1","volume-title":"[n.d.]. Evolutionary compression of deep neural networks for biomedical image segmentation","author":"Zhou Y.","unstructured":"Y. Zhou , G. G. Yen , and Z. Yi . [n.d.]. Evolutionary compression of deep neural networks for biomedical image segmentation . In IEEE Transactions on Neural Networks and Learning Systems . DOI: 10.1109\/TNNLS.2019.2933879. 10.1109\/TNNLS.2019.2933879 Y. Zhou, G. G. Yen, and Z. Yi. [n.d.]. Evolutionary compression of deep neural networks for biomedical image segmentation. In IEEE Transactions on Neural Networks and Learning Systems. DOI: 10.1109\/TNNLS.2019.2933879."},{"key":"e_1_2_1_151_1","volume-title":"[n.d.]. Neural machine translation with GRU-gated attention model","author":"Zhang B.","unstructured":"B. Zhang , D. Xiong , J. Xie , and J. Su . [n.d.]. Neural machine translation with GRU-gated attention model . In IEEE Transactions on Neural Networks and Learning Systems . DOI: 10.1109\/TNNLS.2019.2957276. 10.1109\/TNNLS.2019.2957276 B. Zhang, D. Xiong, J. Xie, and J. Su. [n.d.]. Neural machine translation with GRU-gated attention model. In IEEE Transactions on Neural Networks and Learning Systems. DOI: 10.1109\/TNNLS.2019.2957276."},{"key":"e_1_2_1_152_1","doi-asserted-by":"crossref","unstructured":"M. Guo Y. Yang R. Xu and Z. Liu. 2019. When NAS meets robustness: In search of robust architectures against adversarial attacks. arXiv:abs\/1911.10695. M. Guo Y. Yang R. Xu and Z. Liu. 2019. When NAS meets robustness: In search of robust architectures against adversarial attacks. arXiv:abs\/1911.10695.","DOI":"10.1109\/CVPR42600.2020.00071"},{"key":"e_1_2_1_153_1","volume-title":"SGAS: Sequential greedy architecture search. arXiv:1912.00195.","author":"Li G.","year":"2019","unstructured":"G. Li , G. Qian , I. C. Delgadillo , M. M\u00fcller , A. Thabet , and B. Ghanem . 2019 . SGAS: Sequential greedy architecture search. arXiv:1912.00195. G. Li, G. Qian, I. C. Delgadillo, M. M\u00fcller, A. Thabet, and B. Ghanem. 2019. SGAS: Sequential greedy architecture search. arXiv:1912.00195."},{"key":"e_1_2_1_154_1","doi-asserted-by":"crossref","unstructured":"J. Fang Y. Sun Q. Zhang Y. Li W. Liu and X. Wang. 2019. Densely connected search space for more flexible neural architecture search. arXiv:1906.09607. J. Fang Y. Sun Q. Zhang Y. Li W. Liu and X. Wang. 2019. Densely connected search space for more flexible neural architecture search. arXiv:1906.09607.","DOI":"10.1109\/CVPR42600.2020.01064"},{"key":"e_1_2_1_155_1","unstructured":"D. So C. Liang and Q. V. Le. 2019. The evolved transformer. arXiv:abs\/1901.11117. D. So C. Liang and Q. V. Le. 2019. The evolved transformer. arXiv:abs\/1901.11117."},{"key":"e_1_2_1_156_1","unstructured":"A. Zela J. Siems and F. Hutter. 2020. NAS-Bench-1Shot1: Benchmarking and dissecting one-shot neural architecture search. arXiv:2001.10422. A. Zela J. Siems and F. Hutter. 2020. NAS-Bench-1Shot1: Benchmarking and dissecting one-shot neural architecture search. arXiv:2001.10422."},{"key":"e_1_2_1_157_1","doi-asserted-by":"crossref","unstructured":"X. Dai A. Wan P. Zhang B. Wu Z. He Z. Wei ... and J. E. Gonzalez. 2020. FBNetV3: Joint architecture-recipe search using neural acquisition function. arXiv:2006.02049. X. Dai A. Wan P. Zhang B. Wu Z. He Z. Wei ... and J. E. Gonzalez. 2020. FBNetV3: Joint architecture-recipe search using neural acquisition function. arXiv:2006.02049.","DOI":"10.1109\/CVPR46437.2021.01601"},{"key":"e_1_2_1_158_1","unstructured":"X. Dong M. Tan A. W. Yu D. Peng B. Gabrys and Q. V. Le. 2020. AutoHAS: Differentiable hyper-parameter and architecture search. arXiv:2006.03656. X. Dong M. Tan A. W. Yu D. Peng B. Gabrys and Q. V. Le. 2020. AutoHAS: Differentiable hyper-parameter and architecture search. arXiv:2006.03656."},{"key":"e_1_2_1_159_1","unstructured":"H. Zhang M. Cisse Y. N. Dauphin and D. Lopez-Paz. 2017. mixup: Beyond empirical risk minimization. arXiv:1710.09412. H. Zhang M. Cisse Y. N. Dauphin and D. Lopez-Paz. 2017. mixup: Beyond empirical risk minimization. arXiv:1710.09412."},{"key":"e_1_2_1_160_1","volume-title":"European Conference on Computer Vision. Springer, Cham, 646\u2013661","author":"Huang G.","unstructured":"G. Huang , Y. Sun , Z. Liu , D. Sedra , and K. Q. Weinberger . 2016. Deep networks with stochastic depth . In European Conference on Computer Vision. Springer, Cham, 646\u2013661 . G. Huang, Y. Sun, Z. Liu, D. Sedra, and K. Q. Weinberger. 2016. Deep networks with stochastic depth. In European Conference on Computer Vision. Springer, Cham, 646\u2013661."},{"key":"e_1_2_1_161_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1012771025575"},{"key":"e_1_2_1_162_1","volume-title":"International Conference on Learning and Intelligent Optimization. Springer","author":"Hutter F.","unstructured":"F. Hutter , H. H. Hoos , and K. Leyton-Brown . 2011. Sequential model-based optimization for general algorithm configuration . In International Conference on Learning and Intelligent Optimization. Springer , Berlin, 507\u2013523. F. Hutter, H. H. Hoos, and K. Leyton-Brown. 2011. Sequential model-based optimization for general algorithm configuration. In International Conference on Learning and Intelligent Optimization. Springer, Berlin, 507\u2013523."}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447582","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447582","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:28:37Z","timestamp":1750181317000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447582"}},"subtitle":["Challenges and Solutions"],"short-title":[],"issued":{"date-parts":[[2021,5,24]]},"references-count":162,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,5,31]]}},"alternative-id":["10.1145\/3447582"],"URL":"https:\/\/doi.org\/10.1145\/3447582","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,24]]},"assertion":[{"value":"2020-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-05-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}