{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T16:06:26Z","timestamp":1791821186990,"version":"4.3.4"},"reference-count":217,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T00:00:00Z","timestamp":1614902400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"PGMO project and University of Luxembourg"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2022,3,31]]},"abstract":"<jats:p>In recent years, research in applying optimization approaches in the automatic design of deep neural networks has become increasingly popular. Although various approaches have been proposed, there is a lack of a comprehensive survey and taxonomy on this hot research topic. In this article, we propose a unified way to describe the various optimization algorithms that focus on common and important search components of optimization algorithms: representation, objective function, constraints, initial solution(s), and variation operators. In addition to large-scale search space, the problem is characterized by its variable mixed design space, it is very expensive, and it has multiple blackbox objective functions. Hence, this unified methodology has been extended to advanced optimization approaches, such as surrogate-based, multi-objective, and parallel optimization.<\/jats:p>","DOI":"10.1145\/3439730","type":"journal-article","created":{"date-parts":[[2021,3,6]],"date-time":"2021-03-06T04:09:57Z","timestamp":1615003797000},"page":"1-37","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":52,"title":["Automated Design of Deep Neural Networks"],"prefix":"10.1145","volume":"54","author":[{"given":"El-Ghazali","family":"Talbi","sequence":"first","affiliation":[{"name":"University of Lille, CNRS, INRIA, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,3,5]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the 12th USENIX Symposium. 265--283","author":"Abadi M.","unstructured":"M. Abadi , P. Barham , J. Chen , Z. Chen , A. Davis , J. Dean , M. Devin , S. Ghemawat , G. Irving , and M. Isard . 2016. Tensorflow: A system for large-scale machine learning . In Proceedings of the 12th USENIX Symposium. 265--283 . M. Abadi, P. Barham, J. Chen, Z. Chen, A. Davis, J. Dean, M. Devin, S. Ghemawat, G. Irving, and M. Isard. 2016. Tensorflow: A system for large-scale machine learning. In Proceedings of the 12th USENIX Symposium. 265--283."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV\u201918)","author":"Ahmed K.","unstructured":"K. Ahmed and L. Torresani . 2018. Maskconnect: Connectivity learning by gradient descent . In Proceedings of the European Conference on Computer Vision (ECCV\u201918) . 349--365. K. Ahmed and L. Torresani. 2018. Maskconnect: Connectivity learning by gradient descent. In Proceedings of the European Conference on Computer Vision (ECCV\u201918). 349--365."},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 6th International Conference on Learning Representations (ICLR\u201918)","author":"Ashok A.","unstructured":"A. Ashok , N. Rhinehart , F. Beainy , and K. M. Kitani . 2018. N2N learning: Network to network compression via policy gradient reinforcement learning . In Proceedings of the 6th International Conference on Learning Representations (ICLR\u201918) . A. Ashok, N. Rhinehart, F. Beainy, and K. M. Kitani. 2018. N2N learning: Network to network compression via policy gradient reinforcement learning. In Proceedings of the 6th International Conference on Learning Representations (ICLR\u201918)."},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the 21st European Conference on Genetic Programming (EuroGP\u201918)","volume":"10781","author":"Assun\u00e7\u00e3o F.","unstructured":"F. Assun\u00e7\u00e3o , N. Louren\u00e7o , P. Machado , and B. Ribeiro . 2018. Evolving the topology of large-scale deep neural networks . In Proceedings of the 21st European Conference on Genetic Programming (EuroGP\u201918) , Vol. 10781 . 19--34. F. Assun\u00e7\u00e3o, N. Louren\u00e7o, P. Machado, and B. Ribeiro. 2018. Evolving the topology of large-scale deep neural networks. In Proceedings of the 21st European Conference on Genetic Programming (EuroGP\u201918), Vol. 10781. 19--34."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10710-018-9339-y"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. 193--205","author":"Awan A.","unstructured":"A. Awan , K. Hamidouche , J. Hashmi , and D. Panda . 2017. S-caffe: Co-designing MPI runtimes and caffe for scalable deep learning on modern GPU clusters . In Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. 193--205 . A. Awan, K. Hamidouche, J. Hashmi, and D. Panda. 2017. S-caffe: Co-designing MPI runtimes and caffe for scalable deep learning on modern GPU clusters. In Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. 193--205."},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the 5th International Conference on Learning Representations (ICLR\u201917)","author":"Baker B.","unstructured":"B. Baker , O. Gupta , N. Naik , and R. Raskar . 2017. Designing neural network architectures using reinforcement learning . In Proceedings of the 5th International Conference on Learning Representations (ICLR\u201917) . B. Baker, O. Gupta, N. Naik, and R. Raskar. 2017. Designing neural network architectures using reinforcement learning. In Proceedings of the 5th International Conference on Learning Representations (ICLR\u201917)."},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the 6th International Conference on Learning Representations (ICLR\u201918)","author":"Baker B.","unstructured":"B. Baker , O. Gupta , R. Raskar , and N. Naik . 2018. Accelerating neural architecture search using performance prediction . In Proceedings of the 6th International Conference on Learning Representations (ICLR\u201918) . B. Baker, O. Gupta, R. Raskar, and N. Naik. 2018. Accelerating neural architecture search using performance prediction. In Proceedings of the 6th International Conference on Learning Representations (ICLR\u201918)."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the International Conference of Pioneering Computer Scientists, Engineers and Educators. 594--604","author":"Bao Z.","unstructured":"Z. Bao , Q. Luo , and W. Zhang . 2017. An implementation and improvement of convolutional neural networks on HSA platform . In Proceedings of the International Conference of Pioneering Computer Scientists, Engineers and Educators. 594--604 . Z. Bao, Q. Luo, and W. Zhang. 2017. An implementation and improvement of convolutional neural networks on HSA platform. In Proceedings of the International Conference of Pioneering Computer Scientists, Engineers and Educators. 594--604."},{"key":"e_1_2_1_10_1","volume-title":"Studies in Computational Intelligence","volume":"833","author":"Bartz-Beielstein T.","year":"2020","unstructured":"T. Bartz-Beielstein , B. Filipic , P. Korosec , and E.-G. Talbi ( Eds .). 2020 . High-performance Simulation-based Optimization . Studies in Computational Intelligence , Vol. 833 . Springer. T. Bartz-Beielstein, B. Filipic, P. Korosec, and E.-G. Talbi (Eds.). 2020. High-performance Simulation-based Optimization. Studies in Computational Intelligence, Vol. 833. Springer."},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 19th International Conference Artificial Neural Networks (ICANN\u201909)","volume":"5769","author":"Bayer J.","unstructured":"J. Bayer , D. Wierstra , J. Togelius , and J. Schmidhuber . 2009. Evolving memory cell structures for sequence learning . In Proceedings of the 19th International Conference Artificial Neural Networks (ICANN\u201909) , Vol. 5769 . 755--764. J. Bayer, D. Wierstra, J. Togelius, and J. Schmidhuber. 2009. Evolving memory cell structures for sequence learning. In Proceedings of the 19th International Conference Artificial Neural Networks (ICANN\u201909), Vol. 5769. 755--764."},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","unstructured":"T. Ben-Nun and T. Hoefler. 2019. Demystifying parallel and distributed deep learning: An in-depth concurrency analysis. ACM Comput. Surv. 52 4 (2019) 65:1--65:43.  T. Ben-Nun and T. Hoefler. 2019. Demystifying parallel and distributed deep learning: An in-depth concurrency analysis. ACM Comput. Surv. 52 4 (2019) 65:1--65:43.","DOI":"10.1145\/3320060"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning (ICML\u201918)","author":"Bender G.","unstructured":"G. Bender , P-J Kindermans , W. Zoph , V. Vasudevan , and Q. V. Le . 2018. Understanding and simplifying one-shot architecture search . In Proceedings of the 35th International Conference on Machine Learning (ICML\u201918) . 549--558. G. Bender, P-J Kindermans, W. Zoph, V. Vasudevan, and Q. V. Le. 2018. Understanding and simplifying one-shot architecture search. In Proceedings of the 35th International Conference on Machine Learning (ICML\u201918). 549--558."},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the 25th Annual Conference on Neural Information Processing Systems. 2546--2554","author":"Bergstra J.","unstructured":"J. Bergstra , R. Bardenet , Y. Bengio , and B. K\u00e9gl . 2011. Algorithms for hyper-parameter optimization . In Proceedings of the 25th Annual Conference on Neural Information Processing Systems. 2546--2554 . J. Bergstra, R. Bardenet, Y. Bengio, and B. K\u00e9gl. 2011. Algorithms for hyper-parameter optimization. In Proceedings of the 25th Annual Conference on Neural Information Processing Systems. 2546--2554."},{"key":"e_1_2_1_15_1","volume-title":"Random search for hyper-parameter optimization. J. Mach. Learn. Res. 13 (Feb","author":"Bergstra James","year":"2012","unstructured":"James Bergstra and Yoshua Bengio . 2012. Random search for hyper-parameter optimization. J. Mach. Learn. Res. 13 (Feb . 2012 ), 281--305. James Bergstra and Yoshua Bengio. 2012. Random search for hyper-parameter optimization. J. Mach. Learn. Res. 13 (Feb. 2012), 281--305."},{"key":"e_1_2_1_16_1","volume-title":"International Conference on Machine Learning PMLR. 115--123","author":"Bergstra J.","unstructured":"J. Bergstra , D. Yamins , and D. D. Cox . 2013. Making a science of model search: Hyperparameter optimization in hundreds of dimensions for vision architectures . In International Conference on Machine Learning PMLR. 115--123 . J. Bergstra, D. Yamins, and D. D. Cox. 2013. Making a science of model search: Hyperparameter optimization in hundreds of dimensions for vision architectures. In International Conference on Machine Learning PMLR. 115--123."},{"key":"e_1_2_1_17_1","unstructured":"H. Bilen and A. Vedaldi. 2017. Universal representations: The missing link between faces text planktons and cat breeds. CoRR abs\/1701.07275.  H. Bilen and A. Vedaldi. 2017. Universal representations: The missing link between faces text planktons and cat breeds. CoRR abs\/1701.07275."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1162\/EVCO_a_00069"},{"key":"e_1_2_1_19_1","unstructured":"D. Blalock J. G. Ortiz J. Frankle and J. Guttag. 2020. What is the state of neural network pruning? Retrieved from https:\/\/Arxiv:2003.03033 (2020).  D. Blalock J. G. Ortiz J. Frankle and J. Guttag. 2020. What is the state of neural network pruning? Retrieved from https:\/\/Arxiv:2003.03033 (2020)."},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the 32nd International Conference on Machine Learning (ICML\u201915)","volume":"37","author":"Blundell C.","unstructured":"C. Blundell , J. Cornebise , K. Kavukcuoglu , and D. Wierstra . 2015. Weight uncertainty in neural network . In Proceedings of the 32nd International Conference on Machine Learning (ICML\u201915) , Vol. 37 . 1613--1622. C. Blundell, J. Cornebise, K. Kavukcuoglu, and D. Wierstra. 2015. Weight uncertainty in neural network. In Proceedings of the 32nd International Conference on Machine Learning (ICML\u201915), Vol. 37. 1613--1622."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 6th International Conference on Learning Representations (ICLR\u201918)","author":"Brock A.","unstructured":"A. Brock , T. Lim , J. M. Ritchie , and N. Weston . 2018. Smash: One-shot model architecture search through hypernetworks . In Proceedings of the 6th International Conference on Learning Representations (ICLR\u201918) . A. Brock, T. Lim, J. M. Ritchie, and N. Weston. 2018. Smash: One-shot model architecture search through hypernetworks. In Proceedings of the 6th International Conference on Learning Representations (ICLR\u201918)."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2004.04.004"},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"E. Byla and W. Pang. 2019. DeepSwarm: Optimising convolutional neural networks using swarm intelligence. In Advances in Computational Intelligence Systems. 119--130.  E. Byla and W. Pang. 2019. DeepSwarm: Optimising convolutional neural networks using swarm intelligence. In Advances in Computational Intelligence Systems. 119--130.","DOI":"10.1007\/978-3-030-29933-0_10"},{"key":"e_1_2_1_24_1","volume-title":"Neuralpower: Predict and deploy energy-efficient convolutional neural networks.","author":"Cai E.","year":"2017","unstructured":"E. Cai , D-C. Juan , D. Stamoulis , and D. Marculescu . 2017 . Neuralpower: Predict and deploy energy-efficient convolutional neural networks. Retrieved from https:\/\/Arxiv:1710.05420. E. Cai, D-C. Juan, D. Stamoulis, and D. Marculescu. 2017. Neuralpower: Predict and deploy energy-efficient convolutional neural networks. Retrieved from https:\/\/Arxiv:1710.05420."},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI\u201918)","author":"Cai H.","unstructured":"H. Cai , T. Chen , W. Zhang , Y. Yu , and J. Wang . 2018. Efficient architecture search by network transformation . In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI\u201918) . 2787--2794. H. Cai, T. Chen, W. Zhang, Y. Yu, and J. Wang. 2018. Efficient architecture search by network transformation. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI\u201918). 2787--2794."},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201918)","author":"Cai H.","unstructured":"H. Cai , J. Yang , W. Zhang , S. Han , and Y. Yu . 2018. Path-level network transformation for efficient architecture search . In Proceedings of the International Conference on Machine Learning (ICML\u201918) . 677--686. H. Cai, J. Yang, W. Zhang, S. Han, and Y. Yu. 2018. Path-level network transformation for efficient architecture search. In Proceedings of the International Conference on Machine Learning (ICML\u201918). 677--686."},{"key":"e_1_2_1_27_1","unstructured":"A. Camero H. Wang E. Alba and T. B\u00e4ck. 2020. Bayesian neural architecture search using a training-free performance metric. Retrieved from https:\/\/Arxiv:2001.10726.  A. Camero H. Wang E. Alba and T. B\u00e4ck. 2020. Bayesian neural architecture search using a training-free performance metric. Retrieved from https:\/\/Arxiv:2001.10726."},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the 7th International Conference on Learning Representations (ICLR\u201919)","author":"Cao S.","unstructured":"S. Cao , X. Wang , and K. M. Kitani . 2019. Learnable embedding space for efficient neural architecture compression . In Proceedings of the 7th International Conference on Learning Representations (ICLR\u201919) . S. Cao, X. Wang, and K. M. Kitani. 2019. Learnable embedding space for efficient neural architecture compression. In Proceedings of the 7th International Conference on Learning Representations (ICLR\u201919)."},{"key":"e_1_2_1_29_1","unstructured":"F. P. Paolo Casale J. Gordon and N. Fusi. 2019. Probabilistic neural architecture search. CoRR abs\/1902.05116.  F. P. Paolo Casale J. Gordon and N. Fusi. 2019. Probabilistic neural architecture search. CoRR abs\/1902.05116."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10852-005-9020-3"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV\u201918)","author":"Chen C.","unstructured":"C. Chen , F. Tung , N. Vedula , and G. Mori . 2018. Constraint-aware deep neural network compression . In Proceedings of the European Conference on Computer Vision (ECCV\u201918) . 400--415. C. Chen, F. Tung, N. Vedula, and G. Mori. 2018. Constraint-aware deep neural network compression. In Proceedings of the European Conference on Computer Vision (ECCV\u201918). 400--415."},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201918)","author":"Chen L-C.","unstructured":"L-C. Chen , M. Collins , Y. Zhu , G. Papandreou , B. Zoph , F. Schroff , H. Adam , and J. Shlens . 2018. Searching for efficient multi-scale architectures for dense image prediction . In Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201918) . 8699--8710. L-C. Chen, M. Collins, Y. Zhu, G. Papandreou, B. Zoph, F. Schroff, H. Adam, and J. Shlens. 2018. Searching for efficient multi-scale architectures for dense image prediction. In Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201918). 8699--8710."},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 4th International Conference on Learning Representations (ICLR\u201916)","author":"Chen T.","unstructured":"T. Chen , I. J. Goodfellow , and J. Shlens . 2016. Net2Net: Accelerating learning via knowledge transfer . In Proceedings of the 4th International Conference on Learning Representations (ICLR\u201916) . T. Chen, I. J. Goodfellow, and J. Shlens. 2016. Net2Net: Accelerating learning via knowledge transfer. In Proceedings of the 4th International Conference on Learning Representations (ICLR\u201916)."},{"key":"e_1_2_1_34_1","unstructured":"Y. Chen T-J. Yang J. Emer and V. Sze. 2018. Understanding the limitations of existing energy-efficient design approaches for deep neural networks. Energy 2 1 (2018).  Y. Chen T-J. Yang J. Emer and V. Sze. 2018. Understanding the limitations of existing energy-efficient design approaches for deep neural networks. Energy 2 1 (2018)."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2019.2910603"},{"key":"e_1_2_1_36_1","unstructured":"P. Chrabaszcz I. Loshchilov and F. Hutter. 2017. A downsampled variant of imagenet as an alternative to the cifar datasets. Retrieved from https:\/\/Arxiv:1707.08819.  P. Chrabaszcz I. Loshchilov and F. Hutter. 2017. A downsampled variant of imagenet as an alternative to the cifar datasets. Retrieved from https:\/\/Arxiv:1707.08819."},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 30th International Conference on Machine Learning (ICML\u201913)","author":"Coates A.","unstructured":"A. Coates , B. Huval , T. Wang , D. J. Wu , B. Catanzaro , and A. Y. Ng . 2013. Deep learning with COTS HPC systems . In Proceedings of the 30th International Conference on Machine Learning (ICML\u201913) . 1337--1345. A. Coates, B. Huval, T. Wang, D. J. Wu, B. Catanzaro, and A. Y. Ng. 2013. Deep learning with COTS HPC systems. In Proceedings of the 30th International Conference on Machine Learning (ICML\u201913). 1337--1345."},{"key":"e_1_2_1_38_1","unstructured":"M. D. Collins and M. Kohli. 2014. Memory bounded deep convolutional networks. CoRR abs\/1412.1442.  M. D. Collins and M. Kohli. 2014. Memory bounded deep convolutional networks. CoRR abs\/1412.1442."},{"key":"e_1_2_1_39_1","volume-title":"Evoapplications International Conference on Applications of Evolutionary Computation","volume":"11454","author":"Costa V.","unstructured":"V. Costa , N. Louren\u00e7o , and P. Machado . [n.d.]. Coevolution of generative adversarial networks . In Evoapplications International Conference on Applications of Evolutionary Computation , Vol. 11454 . 473--487. V. Costa, N. Louren\u00e7o, and P. Machado. [n.d.]. Coevolution of generative adversarial networks. In Evoapplications International Conference on Applications of Evolutionary Computation, Vol. 11454. 473--487."},{"key":"e_1_2_1_40_1","volume-title":"Advances in Neural Information Processing Systems","author":"Courbariaux M.","unstructured":"M. Courbariaux , Y. Bengio , and J-P. David . 2015. BinaryConnect: Training deep neural networks with binary weights during propagations . In Advances in Neural Information Processing Systems . MIT Press , 3123--3131. M. Courbariaux, Y. Bengio, and J-P. David. 2015. BinaryConnect: Training deep neural networks with binary weights during propagations. In Advances in Neural Information Processing Systems. MIT Press, 3123--3131."},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the European Conference on Computer Systems (EuroSys\u201916)","author":"Cui H.","unstructured":"H. Cui , H. Zhang , G. R. Ganger , P. B. Gibbons , and E. P. Xing . 2016. GeePS: Scalable deep learning on distributed GPUs with a GPU-specialized parameter server . In Proceedings of the European Conference on Computer Systems (EuroSys\u201916) . 1--16. H. Cui, H. Zhang, G. R. Ganger, P. B. Gibbons, and E. P. Xing. 2016. GeePS: Scalable deep learning on distributed GPUs with a GPU-specialized parameter server. In Proceedings of the European Conference on Computer Systems (EuroSys\u201916). 1--16."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-019-09719-2"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the 18th Conference of the International Speech Communication Association. 2073--2077","author":"Das A.","unstructured":"A. Das , M. Hasegawa-Johnson , and K. Vesel\u00fd . 2017. Deep auto-encoder based multi-task learning using probabilistic transcriptions . In Proceedings of the 18th Conference of the International Speech Communication Association. 2073--2077 . A. Das, M. Hasegawa-Johnson, and K. Vesel\u00fd. 2017. Deep auto-encoder based multi-task learning using probabilistic transcriptions. In Proceedings of the 18th Conference of the International Speech Communication Association. 2073--2077."},{"key":"e_1_2_1_44_1","unstructured":"D. Dasgupta and Z. Michalewicz. 2013. Evolutionary Algorithms in Engineering Applications. Springer.  D. Dasgupta and Z. Michalewicz. 2013. Evolutionary Algorithms in Engineering Applications. Springer."},{"key":"e_1_2_1_45_1","volume-title":"Advances in Neural Information Processing Systems","author":"\u00a0al J. Dean","unstructured":"J. Dean et \u00a0al . 2012. Large-scale distributed deep networks . In Advances in Neural Information Processing Systems . MIT Press , 1223--1231. J. Dean et\u00a0al. 2012. Large-scale distributed deep networks. In Advances in Neural Information Processing Systems. MIT Press, 1223--1231."},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the 15th European Conference Evolutionary Computation in Combinatorial Optimization (EvoCOP\u201915)","author":"Desell T.","unstructured":"T. Desell , S. Clachar , J. Higgins , and B. Wild . 2015. Evolving deep recurrent neural networks using ant colony optimization . In Proceedings of the 15th European Conference Evolutionary Computation in Combinatorial Optimization (EvoCOP\u201915) . 86--98. T. Desell, S. Clachar, J. Higgins, and B. Wild. 2015. Evolving deep recurrent neural networks using ant colony optimization. In Proceedings of the 15th European Conference Evolutionary Computation in Combinatorial Optimization (EvoCOP\u201915). 86--98."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cie.2019.02.024"},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence.","author":"Domhan T.","unstructured":"T. Domhan , J. T. Springenberg , and F. Hutter . 2015. Speeding up automatic hyperparameter optimization of deep neural networks by extrapolation of learning curves . In Proceedings of the International Joint Conference on Artificial Intelligence. T. Domhan, J. T. Springenberg, and F. Hutter. 2015. Speeding up automatic hyperparameter optimization of deep neural networks by extrapolation of learning curves. In Proceedings of the International Joint Conference on Artificial Intelligence."},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the 15th European Conference on Computer Vision (ECCV\u201918)","author":"Dong J.-D.","unstructured":"J.-D. Dong , A.-C. Cheng , D.-H. Juan , W. Wei , and M. Sun . 2018. DPP-Net: Device-aware progressive search for Pareto-optimal neural architectures . In Proceedings of the 15th European Conference on Computer Vision (ECCV\u201918) . 540--555. J.-D. Dong, A.-C. Cheng, D.-H. Juan, W. Wei, and M. Sun. 2018. DPP-Net: Device-aware progressive search for Pareto-optimal neural architectures. In Proceedings of the 15th European Conference on Computer Vision (ECCV\u201918). 540--555."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCI.2006.329691"},{"key":"e_1_2_1_51_1","volume-title":"Aluminum: An Asynchronous","author":"Dryden N.","year":"2018","unstructured":"N. Dryden , N. Maruyama , T. Moon , T. Benson , A. Yoo , M. Snir , and B. Van Essen . 2018 . Aluminum: An Asynchronous , GPU-aware Communication Library Optimized for Large-scale Training of Deep Neural Networks on HPC Systems. Technical Report, Lawrence Livermore National Laboratory, Livermore, CA. N. Dryden, N. Maruyama, T. Moon, T. Benson, A. Yoo, M. Snir, and B. Van Essen. 2018. Aluminum: An Asynchronous, GPU-aware Communication Library Optimized for Large-scale Training of Deep Neural Networks on HPC Systems. Technical Report, Lawrence Livermore National Laboratory, Livermore, CA."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2018.09.013"},{"key":"e_1_2_1_53_1","unstructured":"T. Elsken J. Hendrik and F. Hutter. 2018. Efficient multi-objective neural architecture search via lamarckian evolution. Retrieved from https:\/\/Arxiv:1804.09081.  T. Elsken J. Hendrik and F. Hutter. 2018. Efficient multi-objective neural architecture search via lamarckian evolution. Retrieved from https:\/\/Arxiv:1804.09081."},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the 6th International Conference on Learning Representations (ICLR\u201918)","author":"Elsken T.","unstructured":"T. Elsken , J-H. Metzen , and F. Hutter . 2018. Simple and efficient architecture search for convolutional neural networks . In Proceedings of the 6th International Conference on Learning Representations (ICLR\u201918) . T. Elsken, J-H. Metzen, and F. Hutter. 2018. Simple and efficient architecture search for convolutional neural networks. In Proceedings of the 6th International Conference on Learning Representations (ICLR\u201918)."},{"key":"e_1_2_1_55_1","article-title":"Neural architecture search: A survey","volume":"20","author":"Elsken T.","year":"2019","unstructured":"T. Elsken , J. H. Metzen , and F. Hutter . 2019 . Neural architecture search: A survey . J. Mach. Learn. Res. 20 (2019), 55:1--55:21. T. Elsken, J. H. Metzen, and F. Hutter. 2019. Neural architecture search: A survey. J. Mach. Learn. Res. 20 (2019), 55:1--55:21.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_2_1_56_1","unstructured":"R. S. Engelmore and A. Morgan. 1988. Blackboard Systems. Addison-Wesley.  R. S. Engelmore and A. Morgan. 1988. Blackboard Systems. Addison-Wesley."},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning (ICML\u201918)","author":"Falkner S.","unstructured":"S. Falkner , A. Klein , and F. Hutter . 2018. BOHB: Robust and efficient hyperparameter optimization at scale . In Proceedings of the 35th International Conference on Machine Learning (ICML\u201918) . 1436--1445. S. Falkner, A. Klein, and F. Hutter. 2018. BOHB: Robust and efficient hyperparameter optimization at scale. In Proceedings of the 35th International Conference on Machine Learning (ICML\u201918). 1436--1445."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.vlsi.2019.07.005"},{"key":"e_1_2_1_59_1","volume-title":"Pathnet: Evolution channels gradient descent in super neural networks.","author":"Fernando C.","year":"2017","unstructured":"C. Fernando , D. Banarse , C. Blundell , Y. Zwols , D. Ha , A. Rusu , A. Pritzel , and D. Wierstra . 2017 . Pathnet: Evolution channels gradient descent in super neural networks. Retrieved from https:\/\/Arxiv:1701.08734. C. Fernando, D. Banarse, C. Blundell, Y. Zwols, D. Ha, A. Rusu, A. Pritzel, and D. Wierstra. 2017. Pathnet: Evolution channels gradient descent in super neural networks. Retrieved from https:\/\/Arxiv:1701.08734."},{"key":"e_1_2_1_60_1","doi-asserted-by":"crossref","unstructured":"M. Feurer and F. Hutter. 2019. Hyperparameter optimization. In Automated Machine Learning. Springer 3--33.  M. Feurer and F. Hutter. 2019. Hyperparameter optimization. In Automated Machine Learning. Springer 3--33.","DOI":"10.1007\/978-3-030-05318-5_1"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2880416"},{"key":"e_1_2_1_62_1","volume-title":"Progress in Intelligent Computing Techniques","author":"Fong S.","unstructured":"S. Fong , S. Deb , and X-S. Yang . 2018. How meta-heuristic algorithms contribute to deep learning in the hype of big data analytics . In Progress in Intelligent Computing Techniques . Springer , 3--25. S. Fong, S. Deb, and X-S. Yang. 2018. How meta-heuristic algorithms contribute to deep learning in the hype of big data analytics. In Progress in Intelligent Computing Techniques. Springer, 3--25."},{"key":"e_1_2_1_63_1","volume-title":"Proceedings of the Conference on Advances in Neural Information Processing Systems (NeurIPS\u201919)","author":"Gaier A.","unstructured":"A. Gaier and D. Ha . 2019. Weight agnostic neural networks . In Proceedings of the Conference on Advances in Neural Information Processing Systems (NeurIPS\u201919) . 5365--5379. A. Gaier and D. Ha. 2019. Weight agnostic neural networks. In Proceedings of the Conference on Advances in Neural Information Processing Systems (NeurIPS\u201919). 5365--5379."},{"key":"e_1_2_1_64_1","volume-title":"Proceedings of the 13th International Conference on Artificial Intelligence and Statistics. 249--256","author":"Glorot X.","unstructured":"X. Glorot and Y. Bengio . 2010. Understanding the difficulty of training deep feedforward neural networks . In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics. 249--256 . X. Glorot and Y. Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics. 249--256."},{"key":"e_1_2_1_65_1","volume-title":"Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1487--1495","author":"Golovin D.","unstructured":"D. Golovin , B. Solnik , S. Moitra , G. Kochanski , J. Karro , and D. Sculley . 2017. Google vizier: A service for black-box optimization . In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1487--1495 . D. Golovin, B. Solnik, S. Moitra, G. Kochanski, J. Karro, and D. Sculley. 2017. Google vizier: A service for black-box optimization. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1487--1495."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2943604"},{"key":"e_1_2_1_67_1","unstructured":"I. Goodfellow Y. Bengio and A. Courville. 2016. Deep Learning. MIT Press.  I. Goodfellow Y. Bengio and A. Courville. 2016. Deep Learning. MIT Press."},{"key":"e_1_2_1_68_1","volume-title":"Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS\u201914)","author":"Goodfellow I. J.","unstructured":"I. J. Goodfellow , J. Pouget-Abadie , M. Mirza , B. Xu , D. Warde-Farley , S. Ozair , A. C. Courville , and Y. Bengio . 2014. Generative adversarial nets . In Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS\u201914) . 2672--2680. I. J. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. C. Courville, and Y. Bengio. 2014. Generative adversarial nets. In Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS\u201914). 2672--2680."},{"key":"e_1_2_1_69_1","unstructured":"P. Goyal and other. 2017. Accurate large minibatch SGD: Training imagenet in 1 hour. Retrieved from https:\/\/Arxiv:1706.02677.  P. Goyal and other. 2017. Accurate large minibatch SGD: Training imagenet in 1 hour. Retrieved from https:\/\/Arxiv:1706.02677."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.5555\/645513.657409"},{"key":"e_1_2_1_71_1","volume-title":"Proceedings of the 5th Asia-Pacific Workshop on Systems. 1--7.","author":"Gu J.","unstructured":"J. Gu , M. Zhu , Z. Zhou , F. Zhang , Z. Lin , Q. Zhang , and M. Breternitz . 2014. Implementation and evaluation of deep neural networks (DNN) on mainstream heterogeneous systems . In Proceedings of the 5th Asia-Pacific Workshop on Systems. 1--7. J. Gu, M. Zhu, Z. Zhou, F. Zhang, Z. Lin, Q. Zhang, and M. Breternitz. 2014. Implementation and evaluation of deep neural networks (DNN) on mainstream heterogeneous systems. In Proceedings of the 5th Asia-Pacific Workshop on Systems. 1--7."},{"key":"e_1_2_1_72_1","volume-title":"Proceedings of the Conference on Advances in Neural Information Processing Systems. 1135--1143","author":"Han S.","unstructured":"S. Han , J. Pool , J. Tran , and W. J. Dally . 2015. Learning both weights and connections for efficient neural network . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 1135--1143 . S. Han, J. Pool, J. Tran, and W. J. Dally. 2015. Learning both weights and connections for efficient neural network. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 1135--1143."},{"key":"e_1_2_1_73_1","volume-title":"Proceedings of the IEEE International Conference on Computer Design (ICCD\u201916)","author":"Han X.","unstructured":"X. Han , D. Zhou , S. Wang , and S. Kimura . 2016. CNN-MERP: An FPGA-based memory-efficient reconfigurable processor for forward and backward propagation of convolutional neural networks . In Proceedings of the IEEE International Conference on Computer Design (ICCD\u201916) . 320--327. X. Han, D. Zhou, S. Wang, and S. Kimura. 2016. CNN-MERP: An FPGA-based memory-efficient reconfigurable processor for forward and backward propagation of convolutional neural networks. In Proceedings of the IEEE International Conference on Computer Design (ICCD\u201916). 320--327."},{"key":"e_1_2_1_74_1","volume-title":"Pipedream: Fast and efficient pipeline parallel dnn training.","author":"Harlap A.","year":"2018","unstructured":"A. Harlap , D. Narayanan , A. Phanishayee , V. Seshadri , N. Devanur , G. Ganger , and P. Gibbons . 2018 . Pipedream: Fast and efficient pipeline parallel dnn training. Retrieved from https:\/\/Arxiv:1806.03377. A. Harlap, D. Narayanan, A. Phanishayee, V. Seshadri, N. Devanur, G. Ganger, and P. Gibbons. 2018. Pipedream: Fast and efficient pipeline parallel dnn training. Retrieved from https:\/\/Arxiv:1806.03377."},{"key":"e_1_2_1_75_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201915)","author":"He K.","unstructured":"K. He and J. Sun . 2015. Convolutional neural networks at constrained time cost . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201915) . K. He and J. Sun. 2015. Convolutional neural networks at constrained time cost. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201915)."},{"key":"e_1_2_1_76_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770--778","author":"He K.","unstructured":"K. He , X. Zhang , S. Ren , and J. Sun . 2016. Deep residual learning for image recognition . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770--778 . K. He, X. Zhang, S. Ren, and J. Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770--778."},{"key":"e_1_2_1_77_1","volume-title":"Proceedings of the NIPS Workshop on Bayesian Optimization.","author":"Hern\u00e1ndez-Lobato J. M.","unstructured":"J. M. Hern\u00e1ndez-Lobato , M. A. Gelbart , B. Reagen , R. Adolf , D. Hern\u00e1ndez-Lobato , P. N. Whatmough , D. Brooks , G-Y. Wei , and R. P. Adams . 2016. Designing neural network hardware accelerators with decoupled objective evaluations . In Proceedings of the NIPS Workshop on Bayesian Optimization. J. M. Hern\u00e1ndez-Lobato, M. A. Gelbart, B. Reagen, R. Adolf, D. Hern\u00e1ndez-Lobato, P. N. Whatmough, D. Brooks, G-Y. Wei, and R. P. Adams. 2016. Designing neural network hardware accelerators with decoupled objective evaluations. In Proceedings of the NIPS Workshop on Bayesian Optimization."},{"key":"e_1_2_1_78_1","unstructured":"J. M. Hern\u00e1ndez-Lobato M. W. Hoffman and Z. Ghahramani. 2014. Predictive entropy search for efficient global optimization of black-box functions. In Advances in Neural Information Processing Systems. MIT Press 918--926.  J. M. Hern\u00e1ndez-Lobato M. W. Hoffman and Z. Ghahramani. 2014. Predictive entropy search for efficient global optimization of black-box functions. In Advances in Neural Information Processing Systems. MIT Press 918--926."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2006.18.7.1527"},{"key":"e_1_2_1_80_1","volume-title":"Neural Networks: Tricks of the Trade, G. Montavon, G. B. Orr, and K-R M\u00fcller (Eds.).","author":"Hinton G. E.","unstructured":"G. E. Hinton . 2012. A practical guide to training restricted boltzmann machines . In Neural Networks: Tricks of the Trade, G. Montavon, G. B. Orr, and K-R M\u00fcller (Eds.). Vol. 7700 . 599--619. G. E. Hinton. 2012. A practical guide to training restricted boltzmann machines. In Neural Networks: Tricks of the Trade, G. Montavon, G. B. Orr, and K-R M\u00fcller (Eds.). Vol. 7700. 599--619."},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2006.18.7.1527"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1142\/S1469026818500086"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_1_84_1","volume-title":"Monas: Multi-objective neural architecture search using reinforcement learning.","author":"Hsu C. H.","year":"2018","unstructured":"C. H. Hsu , S. H. Chang , J. H. Liang , H. P. Chou , C. H. Liu , S. C. Chang , J. Y. Pan , Y. T. Chen , W. Wei , and D. C. Juan . 2018 . Monas: Multi-objective neural architecture search using reinforcement learning. Retrieved from https:\/\/Arxiv:1806.10332. C. H. Hsu, S. H. Chang, J. H. Liang, H. P. Chou, C. H. Liu, S. C. Chang, J. Y. Pan, Y. T. Chen, W. Wei, and D. C. Juan. 2018. Monas: Multi-objective neural architecture search using reinforcement learning. Retrieved from https:\/\/Arxiv:1806.10332."},{"key":"e_1_2_1_85_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4700--4708","author":"Huang G.","unstructured":"G. Huang , Z. Liu , L. Van Der Maaten, and K. Q. Weinberger. 2017. Densely connected convolutional networks . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4700--4708 . G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger. 2017. Densely connected convolutional networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4700--4708."},{"key":"e_1_2_1_86_1","volume-title":"Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201919)","author":"Huang Y.","unstructured":"Y. Huang , Y. Cheng , A. Bapna , O. Firat , D. Chen , M. Chen , H. Lee , J. Ngiam , Q. V. Le , and Y. Wu . 2019. Gpipe: Efficient training of giant neural networks using pipeline parallelism . In Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201919) . 103--112. Y. Huang, Y. Cheng, A. Bapna, O. Firat, D. Chen, M. Chen, H. Lee, J. Ngiam, Q. V. Le, and Y. Wu. 2019. Gpipe: Efficient training of giant neural networks using pipeline parallelism. In Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201919). 103--112."},{"key":"e_1_2_1_87_1","doi-asserted-by":"crossref","unstructured":"F. Hutter L. Kotthoff and J. Vanschoren. 2019. Automated Machine Learning. Springer.  F. Hutter L. Kotthoff and J. Vanschoren. 2019. Automated Machine Learning. Springer.","DOI":"10.1007\/978-3-030-05318-5"},{"key":"e_1_2_1_88_1","unstructured":"Md I. M. Shahriar J. Su L. Kotthoff and P. Jamshidi. 2020. FlexiBO: Cost-aware multi-objective optimization of deep neural networks. arXiv preprint arXiv:2001.06588.  Md I. M. Shahriar J. Su L. Kotthoff and P. Jamshidi. 2020. FlexiBO: Cost-aware multi-objective optimization of deep neural networks. arXiv preprint arXiv:2001.06588."},{"key":"e_1_2_1_89_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2592--2600","author":"Iandola F.","unstructured":"F. Iandola , M. Moskewicz , K. Ashraf , and K. Keutzer . 2016. Firecaffe: Near-linear acceleration of deep neural network training on compute clusters . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2592--2600 . F. Iandola, M. Moskewicz, K. Ashraf, and K. Keutzer. 2016. Firecaffe: Near-linear acceleration of deep neural network training on compute clusters. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2592--2600."},{"key":"e_1_2_1_90_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence.","author":"Ilievski I.","unstructured":"I. Ilievski , T. Akhtar , J. Feng , and C. A. Shoemaker . 2017. Efficient hyperparameter optimization for deep learning algorithms using deterministic RBF surrogates . In Proceedings of the AAAI Conference on Artificial Intelligence. I. Ilievski, T. Akhtar, J. Feng, and C. A. Shoemaker. 2017. Efficient hyperparameter optimization for deep learning algorithms using deterministic RBF surrogates. In Proceedings of the AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2019.06.005"},{"key":"e_1_2_1_92_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning (ICML\u201917)","author":"Jenatton R.","unstructured":"R. Jenatton , C. Archambeau , J. Gonz\u00e1lez , and M. W. Seeger . 2017. Bayesian optimization with tree-structured dependencies . In Proceedings of the 34th International Conference on Machine Learning (ICML\u201917) . 1655--1664. R. Jenatton, C. Archambeau, J. Gonz\u00e1lez, and M. W. Seeger. 2017. Bayesian optimization with tree-structured dependencies. In Proceedings of the 34th International Conference on Machine Learning (ICML\u201917). 1655--1664."},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2019.12.005"},{"key":"e_1_2_1_94_1","volume-title":"Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1946--1956","author":"Jin H.","unstructured":"H. Jin , Q. Song , and X. Hu . 2019. Auto-keras: An efficient neural architecture search system . In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1946--1956 . H. Jin, Q. Song, and X. Hu. 2019. Auto-keras: An efficient neural architecture search system. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1946--1956."},{"key":"e_1_2_1_95_1","volume-title":"Surrogate-assisted evolutionary computation: Recent advances and future challenges. Swarm Evolution. Comput. 1 (06","author":"Jin Y.","year":"2011","unstructured":"Y. Jin . 2011. Surrogate-assisted evolutionary computation: Recent advances and future challenges. Swarm Evolution. Comput. 1 (06 2011 ), 61--70. Y. Jin. 2011. Surrogate-assisted evolutionary computation: Recent advances and future challenges. Swarm Evolution. Comput. 1 (06 2011), 61--70."},{"key":"e_1_2_1_97_1","volume-title":"Proceedings of the 32nd International Conference on Machine Learning (ICML\u201915)","author":"J\u00f3zefowicz R.","unstructured":"R. J\u00f3zefowicz , W. Zaremba , and I. Sutskever . 2015. An empirical exploration of recurrent network architectures . In Proceedings of the 32nd International Conference on Machine Learning (ICML\u201915) . 2342--2350. R. J\u00f3zefowicz, W. Zaremba, and I. Sutskever. 2015. An empirical exploration of recurrent network architectures. In Proceedings of the 32nd International Conference on Machine Learning (ICML\u201915). 2342--2350."},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.swevo.2019.05.010"},{"key":"e_1_2_1_99_1","unstructured":"L. Kaiser A. N. Gomez N. Shazeer A. Vaswani N. Parmar L. Jones and J. Uszkoreit. 2017. One model to learn them all. CoRR abs\/1706.05137.  L. Kaiser A. N. Gomez N. Shazeer A. Vaswani N. Parmar L. Jones and J. Uszkoreit. 2017. One model to learn them all. CoRR abs\/1706.05137."},{"key":"e_1_2_1_100_1","unstructured":"K. Kandasamy W. Neiswanger J. Schneider B. Poczos and E. P. Xing. 2018. Neural architecture search with bayesian optimisation and optimal transport. In Advances in Neural Information Processing Systems. MIT Press 2016--2025.  K. Kandasamy W. Neiswanger J. Schneider B. Poczos and E. P. Xing. 2018. Neural architecture search with bayesian optimisation and optimal transport. In Advances in Neural Information Processing Systems. MIT Press 2016--2025."},{"key":"e_1_2_1_101_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201918)","author":"Kendall A.","unstructured":"A. Kendall , Y. Gal , and R. Cipolla . 2018. Multi-task learning using uncertainty to weigh losses for scene geometry and semantics . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201918) . 7482--7491. A. Kendall, Y. Gal, and R. Cipolla. 2018. Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201918). 7482--7491."},{"key":"e_1_2_1_102_1","volume-title":"34th International Conference on Machine Learning ICML. 1--8.","author":"Kim Y. H.","unstructured":"Y. H. Kim , B. Reddy , S. Yun , and C. Seo . 2017. Nemo: Neuro-evolution with multiobjective optimization of deep neural network for speed and accuracy . In 34th International Conference on Machine Learning ICML. 1--8. Y. H. Kim, B. Reddy, S. Yun, and C. Seo. 2017. Nemo: Neuro-evolution with multiobjective optimization of deep neural network for speed and accuracy. In 34th International Conference on Machine Learning ICML. 1--8."},{"key":"e_1_2_1_103_1","volume-title":"Proceedings of the International Conference on Artificial Intelligence and Statistics. 528--536","author":"Klein A.","unstructured":"A. Klein , S. Falkner , S. Bartels , P. Hennig , and F. Hutter . 2017. Fast bayesian optimization of machine learning hyperparameters on large datasets . In Proceedings of the International Conference on Artificial Intelligence and Statistics. 528--536 . A. Klein, S. Falkner, S. Bartels, P. Hennig, and F. Hutter. 2017. Fast bayesian optimization of machine learning hyperparameters on large datasets. In Proceedings of the International Conference on Artificial Intelligence and Statistics. 528--536."},{"key":"e_1_2_1_104_1","unstructured":"A. Krizhevsky. 2014. One weird trick for parallelizing convolutional neural networks. CoRR abs\/1404.5997.  A. Krizhevsky. 2014. One weird trick for parallelizing convolutional neural networks. CoRR abs\/1404.5997."},{"key":"e_1_2_1_105_1","unstructured":"A. Krizhevsky I. Sutskever and G. E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems. MIT Press 1106--1114.  A. Krizhevsky I. Sutskever and G. E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems. MIT Press 1106--1114."},{"key":"e_1_2_1_106_1","volume-title":"Estimation of Distribution Algorithms","author":"Larranaga Pedro","unstructured":"Pedro Larranaga . 2002. A review on estimation of distribution algorithms . In Estimation of Distribution Algorithms . Springer , 57--100. Pedro Larranaga. 2002. A review on estimation of distribution algorithms. In Estimation of Distribution Algorithms. Springer, 57--100."},{"key":"e_1_2_1_107_1","unstructured":"L. Li and T. Ameet. 2019. Random search and reproducibility for neural architecture search. Retrieved from https:\/\/Arxiv:1902.07638.  L. Li and T. Ameet. 2019. Random search and reproducibility for neural architecture search. Retrieved from https:\/\/Arxiv:1902.07638."},{"key":"e_1_2_1_108_1","doi-asserted-by":"publisher","DOI":"10.5555\/3122009.3242042"},{"key":"e_1_2_1_109_1","volume-title":"Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI\u201919)","author":"Li L.","unstructured":"L. Li and A. Talwalkar . 2019. Random search and reproducibility for neural architecture search . In Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI\u201919) . 129. L. Li and A. Talwalkar. 2019. Random search and reproducibility for neural architecture search. In Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI\u201919). 129."},{"key":"e_1_2_1_110_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 11933--11942","author":"Li Z.","unstructured":"Z. Li , T. Xi , J. Deng , G. Zhang , S. Wen , and R. He . 2020. GP-NAS: Gaussian process based neural architecture search . In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 11933--11942 . Z. Li, T. Xi, J. Deng, G. Zhang, S. Wen, and R. He. 2020. GP-NAS: Gaussian process based neural architecture search. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 11933--11942."},{"key":"e_1_2_1_111_1","volume-title":"Proceedings of the Conference on Advances in Neural Information Processing Systems (NeurIPS\u201919). 12037","author":"Lin X.","year":"2047","unstructured":"X. Lin , H.-L. Zhen , Z. Li , Q.-F. Zhang , and S. Kwong . 2019. Pareto multi-task learning . In Proceedings of the Conference on Advances in Neural Information Processing Systems (NeurIPS\u201919). 12037 --1 2047 . X. Lin, H.-L. Zhen, Z. Li, Q.-F. Zhang, and S. Kwong. 2019. Pareto multi-task learning. In Proceedings of the Conference on Advances in Neural Information Processing Systems (NeurIPS\u201919). 12037--12047."},{"key":"e_1_2_1_112_1","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV\u201918)","author":"Liu C.","year":"2018","unstructured":"C. Liu , Z. Barret , N. Maxim , S. Jonathon , H. Wei , L. Li-Jia , F.-F. Li , Y. Alan , H. Jonathan , and M. Kevin . 2018. Progressive neural architecture search . In Proceedings of the European Conference on Computer Vision (ECCV\u201918) . 19--34, 2018 . C. Liu, Z. Barret, N. Maxim, S. Jonathon, H. Wei, L. Li-Jia, F.-F. Li, Y. Alan, H. Jonathan, and M. Kevin. 2018. Progressive neural architecture search. In Proceedings of the European Conference on Computer Vision (ECCV\u201918). 19--34, 2018."},{"key":"e_1_2_1_113_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00017"},{"key":"e_1_2_1_114_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 82--92","author":"Liu C.","unstructured":"C. Liu , L.-C. Chen , F. Schroff , H. Adam , W. Hua , A. L. Yuille , and L. Fei-Fei . 2019. Auto-deeplab: Hierarchical neural architecture search for semantic image segmentation . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 82--92 . C. Liu, L.-C. Chen, F. Schroff, H. Adam, W. Hua, A. L. Yuille, and L. Fei-Fei. 2019. Auto-deeplab: Hierarchical neural architecture search for semantic image segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 82--92."},{"key":"e_1_2_1_115_1","volume-title":"Proceedings of the 15th Conference International Speech Communication (INTERSPEECH). 1092--1095","author":"Liu C.","unstructured":"C. Liu , Z. Zhang , and D. Wang . [n.d.]. Pruning deep neural networks by optimal brain damage . In Proceedings of the 15th Conference International Speech Communication (INTERSPEECH). 1092--1095 . C. Liu, Z. Zhang, and D. Wang. [n.d.]. Pruning deep neural networks by optimal brain damage. In Proceedings of the 15th Conference International Speech Communication (INTERSPEECH). 1092--1095."},{"key":"e_1_2_1_116_1","unstructured":"H. Liu K. Simonyan O. Vinyals C. Fernando and K. Kavukcuoglu. 2017. Hierarchical representations for efficient architecture search. Retrieved from https:\/\/Arxiv:1711.00436.  H. Liu K. Simonyan O. Vinyals C. Fernando and K. Kavukcuoglu. 2017. Hierarchical representations for efficient architecture search. Retrieved from https:\/\/Arxiv:1711.00436."},{"key":"e_1_2_1_117_1","volume-title":"Darts: Differentiable architecture search.","author":"Liu H.","year":"2018","unstructured":"H. Liu , K. Simonyan , and Y. Yang . 2018 . Darts: Differentiable architecture search. Retrieved from https:\/\/Arxiv:1806.09055. H. Liu, K. Simonyan, and Y. Yang. 2018. Darts: Differentiable architecture search. Retrieved from https:\/\/Arxiv:1806.09055."},{"key":"e_1_2_1_118_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2017.2695223"},{"key":"e_1_2_1_119_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201919). 1871","author":"Liu S.","year":"1880","unstructured":"S. Liu , E. Johns , and A. J. Davison . 2019. End-to-end multi-task learning with attention . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201919). 1871 -- 1880 . S. Liu, E. Johns, and A. J. Davison. 2019. End-to-end multi-task learning with attention. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201919). 1871--1880."},{"key":"e_1_2_1_120_1","volume-title":"Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ReQuEST@ASPLOS\u201918)","author":"Lokhmotov A.","unstructured":"A. Lokhmotov , N. Chunosov , F. Vella , and G. Fursin . 2018. Multi-objective autotuning of mobileNets across the full software\/hardware stack . In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ReQuEST@ASPLOS\u201918) . 6--16. A. Lokhmotov, N. Chunosov, F. Vella, and G. Fursin. 2018. Multi-objective autotuning of mobileNets across the full software\/hardware stack. In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ReQuEST@ASPLOS\u201918). 6--16."},{"key":"e_1_2_1_121_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.micpro.2020.102989"},{"key":"e_1_2_1_122_1","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference (GECCO\u201918)","author":"Lorenzo P. R.","unstructured":"P. R. Lorenzo and J. Nalepa . 2018. Memetic evolution of deep neural networks . In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO\u201918) . 505--512. P. R. Lorenzo and J. Nalepa. 2018. Memetic evolution of deep neural networks. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO\u201918). 505--512."},{"key":"e_1_2_1_123_1","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference. 1864--1871","author":"Lorenzo R. R.","unstructured":"R. R. Lorenzo , J. Nalepa , L. S. Ramos , and J. R. Pastor . 2017. Hyperparameter selection in deep neural networks using parallel particle swarm optimization . In Proceedings of the Genetic and Evolutionary Computation Conference. 1864--1871 . R. R. Lorenzo, J. Nalepa, L. S. Ramos, and J. R. Pastor. 2017. Hyperparameter selection in deep neural networks using parallel particle swarm optimization. In Proceedings of the Genetic and Evolutionary Computation Conference. 1864--1871."},{"key":"e_1_2_1_124_1","unstructured":"I. Loshchilov and F. Hutter. 2016. CMA-ES for hyperparameter optimization of deep neural networks. CoRR abs\/1604.07269.  I. Loshchilov and F. Hutter. 2016. CMA-ES for hyperparameter optimization of deep neural networks. CoRR abs\/1604.07269."},{"key":"e_1_2_1_125_1","doi-asserted-by":"crossref","unstructured":"Z. Lu I. Whalen V. Boddeti Y. D. Dhebar K. Deb E. D. Goodman and W. Banzhaf. 2018. NSGA-NET: A multi-objective genetic algorithm for neural architecture search. CoRR abs\/1810.03522.  Z. Lu I. Whalen V. Boddeti Y. D. Dhebar K. Deb E. D. Goodman and W. Banzhaf. 2018. NSGA-NET: A multi-objective genetic algorithm for neural architecture search. CoRR abs\/1810.03522.","DOI":"10.1145\/3321707.3321729"},{"key":"e_1_2_1_126_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13721-016-0125-6"},{"key":"e_1_2_1_127_1","unstructured":"R. Luo T. Fei Q. Tao Qin C. Enhong and L. Tie-Yan. 2018. Neural architecture optimization. In Advances in Neural Information Processing Systems. MIT Press 7816--7827.  R. Luo T. Fei Q. Tao Qin C. Enhong and L. Tie-Yan. 2018. Neural architecture optimization. In Advances in Neural Information Processing Systems. MIT Press 7816--7827."},{"key":"e_1_2_1_128_1","volume-title":"Proceedings of the International Conference on Web Intelligence (WI\u201919)","author":"Ma L.","unstructured":"L. Ma , J. Cui , and B. Yang . 2019. Deep neural architecture search with deep graph bayesian optimization . In Proceedings of the International Conference on Web Intelligence (WI\u201919) . 500--507. L. Ma, J. Cui, and B. Yang. 2019. Deep neural architecture search with deep graph bayesian optimization. In Proceedings of the International Conference on Web Intelligence (WI\u201919). 500--507."},{"key":"e_1_2_1_129_1","volume-title":"Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201914)","author":"Marquet G.","year":"2014","unstructured":"G. Marquet , B. Derbel , A. Liefooghe , and E-G. Talbi . 2014 . Shake them all! - rethinking selection and replacement in MOEA\/D . In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201914) . Springer, 641--651. G. Marquet, B. Derbel, A. Liefooghe, and E-G. Talbi. 2014. Shake them all! - rethinking selection and replacement in MOEA\/D. In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201914). Springer, 641--651."},{"key":"e_1_2_1_130_1","volume-title":"Proceedings of the IEEE\/ACM Conference on Machine Learning in HPC Environments. 57--66","author":"Martinez D.","unstructured":"D. Martinez , W. Brewer , G. Behm , A. Strelzoff , A. Wilson , and D. Wade . 2018. Deep learning evolutionary optimization for regression of rotorcraft vibrational spectra . In Proceedings of the IEEE\/ACM Conference on Machine Learning in HPC Environments. 57--66 . D. Martinez, W. Brewer, G. Behm, A. Strelzoff, A. Wilson, and D. Wade. 2018. Deep learning evolutionary optimization for regression of rotorcraft vibrational spectra. In Proceedings of the IEEE\/ACM Conference on Machine Learning in HPC Environments. 57--66."},{"key":"e_1_2_1_131_1","volume-title":"Proceedings of the International Joint Conferences on Artificial Intelligence (IJCAI\u201918)","author":"Masanori S.","unstructured":"S. Masanori , S. Shinichi , and N. Tomoharu . 2018. A genetic programming approach to designing convolutional neural network architectures . In Proceedings of the International Joint Conferences on Artificial Intelligence (IJCAI\u201918) . S. Masanori, S. Shinichi, and N. Tomoharu. 2018. A genetic programming approach to designing convolutional neural network architectures. In Proceedings of the International Joint Conferences on Artificial Intelligence (IJCAI\u201918)."},{"key":"e_1_2_1_132_1","volume-title":"Proceedings of the International Conference on Intelligent Data Engineering and Automated Learning. 594--602","author":"Masood N. M.","unstructured":"N. M. Masood and G. M. Khan . 2018. Signal reconstruction using evolvable recurrent neural networks . In Proceedings of the International Conference on Intelligent Data Engineering and Automated Learning. 594--602 . N. M. Masood and G. M. Khan. 2018. Signal reconstruction using evolvable recurrent neural networks. In Proceedings of the International Conference on Intelligent Data Engineering and Automated Learning. 594--602."},{"key":"e_1_2_1_133_1","volume-title":"Proceedings of the Workshop on Automatic Machine Learning. 58--65","author":"Mendoza H.","unstructured":"H. Mendoza , A. Klein , M. Feurer , J. T. Springenberg , and F. Hutter . 2016. Towards automatically tuned neural networks . In Proceedings of the Workshop on Automatic Machine Learning. 58--65 . H. Mendoza, A. Klein, M. Feurer, J. T. Springenberg, and F. Hutter. 2016. Towards automatically tuned neural networks. In Proceedings of the Workshop on Automatic Machine Learning. 58--65."},{"key":"e_1_2_1_134_1","volume-title":"Nonlinear Multiobjective Optimization","author":"Miettinen K.","unstructured":"K. Miettinen . 1999. Nonlinear Multiobjective Optimization . Springer . K. Miettinen. 1999. Nonlinear Multiobjective Optimization. Springer."},{"key":"e_1_2_1_135_1","unstructured":"R. Miikkulainen J. Z. Liang E. Meyerson A. Rawal D. Fink O. Francon B. Raju H. Shahrzad A. Navruzyan N. Duffy and B. Hodjat. 2017. Evolving deep neural networks. CoRR abs\/1703.00548.  R. Miikkulainen J. Z. Liang E. Meyerson A. Rawal D. Fink O. Francon B. Raju H. Shahrzad A. Navruzyan N. Duffy and B. Hodjat. 2017. Evolving deep neural networks. CoRR abs\/1703.00548."},{"key":"e_1_2_1_136_1","first-page":"1","article-title":"A survey of FPGA-based accelerators for convolutional neural networks","volume":"32","author":"Mittal S.","year":"2018","unstructured":"S. Mittal . 2018 . A survey of FPGA-based accelerators for convolutional neural networks . Neural Comput. Appl. 32 , 4 (2018), 1 -- 31 . S. Mittal. 2018. A survey of FPGA-based accelerators for convolutional neural networks. Neural Comput. Appl. 32, 4 (2018), 1--31.","journal-title":"Neural Comput. Appl."},{"key":"e_1_2_1_137_1","unstructured":"P. Molchanov S. Tyree T. Karras T. Aila and J. Kautz. 2016. Pruning convolutional neural networks for resource efficient transfer learning. CoRR abs\/1611.06440.  P. Molchanov S. Tyree T. Karras T. Aila and J. Kautz. 2016. Pruning convolutional neural networks for resource efficient transfer learning. CoRR abs\/1611.06440."},{"key":"e_1_2_1_138_1","volume-title":"Deeparchitect: Automatically designing and training deep architectures.","author":"Negrinho R.","year":"2017","unstructured":"R. Negrinho and G. Gordon . 2017 . Deeparchitect: Automatically designing and training deep architectures. Retrieved from https:\/\/Arxiv:1704.08792. R. Negrinho and G. Gordon. 2017. Deeparchitect: Automatically designing and training deep architectures. Retrieved from https:\/\/Arxiv:1704.08792."},{"key":"e_1_2_1_139_1","unstructured":"K. Ni R. Pearce K. Boakye B. Van Essen D. Borth B. Chen and E. Wang. 2015. Large-scale deep learning on the YFCC100M dataset. Retrieved from https:\/\/Arxiv:1502.03409.  K. Ni R. Pearce K. Boakye B. Van Essen D. Borth B. Chen and E. Wang. 2015. Large-scale deep learning on the YFCC100M dataset. Retrieved from https:\/\/Arxiv:1502.03409."},{"key":"e_1_2_1_140_1","volume-title":"Particle Swarm Optimization: Theory, Techniques and Applications","author":"Olsson A. E.","unstructured":"A. E. Olsson . 2010. Particle Swarm Optimization: Theory, Techniques and Applications . Nova Science Publishers . A. E. Olsson. 2010. Particle Swarm Optimization: Theory, Techniques and Applications. Nova Science Publishers."},{"key":"e_1_2_1_141_1","volume-title":"Proceedings of the 2nd International Conference on Learning Representations (ICLR\u201914)","author":"Paine T.","unstructured":"T. Paine , H. Jin , J. Yang , Z. Lin , and T. S. Huang . 2014. GPU asynchronous stochastic gradient descent to speed up neural network training . In Proceedings of the 2nd International Conference on Learning Representations (ICLR\u201914) . T. Paine, H. Jin, J. Yang, Z. Lin, and T. S. Huang. 2014. GPU asynchronous stochastic gradient descent to speed up neural network training. In Proceedings of the 2nd International Conference on Learning Representations (ICLR\u201914)."},{"key":"e_1_2_1_142_1","doi-asserted-by":"publisher","DOI":"10.1109\/72.839013"},{"key":"e_1_2_1_143_1","volume-title":"Proceedings of the International Conference on Hardware\/Software Codesign and System Synthesis (CODES+ISSS\u201915)","author":"Park E.","unstructured":"E. Park , D. Kim , S. Kim , Y-D Kim , G. Kim , S. Yoon , and S. Yoo . 2015. Big\/little deep neural network for ultra low power inference . In Proceedings of the International Conference on Hardware\/Software Codesign and System Synthesis (CODES+ISSS\u201915) , G. Nicolescu and A. Gerstlauer (Eds.). 124--132. E. Park, D. Kim, S. Kim, Y-D Kim, G. Kim, S. Yoon, and S. Yoo. 2015. Big\/little deep neural network for ultra low power inference. In Proceedings of the International Conference on Hardware\/Software Codesign and System Synthesis (CODES+ISSS\u201915), G. Nicolescu and A. Gerstlauer (Eds.). 124--132."},{"key":"e_1_2_1_144_1","volume-title":"Proceedings of the World Congress of Structural and Multidisciplinary Optimization (WCSMO\u201917)","author":"Pelamatti J.","unstructured":"J. Pelamatti , L. Brevault , M. Balesdent , E-G. Talbi , and Y. Guerin . 2017. How to deal with mixed-variable optimization problems: An overview of algorithms and formulations . In Proceedings of the World Congress of Structural and Multidisciplinary Optimization (WCSMO\u201917) . 64--82. J. Pelamatti, L. Brevault, M. Balesdent, E-G. Talbi, and Y. Guerin. 2017. How to deal with mixed-variable optimization problems: An overview of algorithms and formulations. In Proceedings of the World Congress of Structural and Multidisciplinary Optimization (WCSMO\u201917). 64--82."},{"key":"e_1_2_1_145_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11081-020-09520-z"},{"key":"e_1_2_1_146_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML)","volume":"80","author":"Pham H.","unstructured":"H. Pham , M. Y. Guan , B. Zoph , Q. V. Le , and J. Dean . [n.d.]. Efficient neural architecture search via parameter sharing . In Proceedings of the International Conference on Machine Learning (ICML) , Vol. 80 . 4092--4101. H. Pham, M. Y. Guan, B. Zoph, Q. V. Le, and J. Dean. [n.d.]. Efficient neural architecture search via parameter sharing. In Proceedings of the International Conference on Machine Learning (ICML), Vol. 80. 4092--4101."},{"key":"e_1_2_1_147_1","volume-title":"Proceedings of the 5th International Conference on Learning Representations (ICLR\u201917)","author":"Qi H.","unstructured":"H. Qi , E. R. Sparks , and A. Talwalkar . 2017. Paleo: A performance model for deep neural networks . In Proceedings of the 5th International Conference on Learning Representations (ICLR\u201917) . H. Qi, E. R. Sparks, and A. Talwalkar. 2017. Paleo: A performance model for deep neural networks. In Proceedings of the 5th International Conference on Learning Representations (ICLR\u201917)."},{"key":"e_1_2_1_148_1","unstructured":"A. Rawal and R. Miikkulainen. 2018. From nodes to networks: Evolving recurrent neural networks. Retrieved from https:\/\/Arxiv:1803.04439.  A. Rawal and R. Miikkulainen. 2018. From nodes to networks: Evolving recurrent neural networks. Retrieved from https:\/\/Arxiv:1803.04439."},{"key":"e_1_2_1_149_1","first-page":"647","article-title":"Hybrid stochastic GA-Bayesian search for deep convolutional neural network model selection","volume":"25","author":"Rawat W.","year":"2019","unstructured":"W. Rawat and Z. Wang . 2019 . Hybrid stochastic GA-Bayesian search for deep convolutional neural network model selection . J. Univ. Comput. Sci. 25 , 6 (2019), 647 -- 666 . W. Rawat and Z. Wang. 2019. Hybrid stochastic GA-Bayesian search for deep convolutional neural network model selection. J. Univ. Comput. Sci. 25, 6 (2019), 647--666.","journal-title":"J. Univ. Comput. Sci."},{"key":"e_1_2_1_150_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence.","author":"Real E.","unstructured":"E. Real , A. Aggarwal , Y. Huang , and Q. V. Le . 2019. Aging evolution for image classifier architecture search . In Proceedings of the AAAI Conference on Artificial Intelligence. E. Real, A. Aggarwal, Y. Huang, and Q. V. Le. 2019. Aging evolution for image classifier architecture search. In Proceedings of the AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_1_151_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"33","author":"Real E.","unstructured":"E. Real , A. Aggarwal , Y. Huang , and Q. V. Le . 2019. Regularized evolution for image classifier architecture search . In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 33 . 4780--4789. E. Real, A. Aggarwal, Y. Huang, and Q. V. Le. 2019. Regularized evolution for image classifier architecture search. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 4780--4789."},{"key":"e_1_2_1_152_1","volume-title":"Proceedings of the International Conference on Machine Learning. 2902--2911","author":"Real E.","unstructured":"E. Real , S. Moore , A. Selle , S. Saxena , Y. L. Suematsu , J. Tan , Q. V. Le , and A. Kurakin . 2017. Large-scale evolution of image classifiers . In Proceedings of the International Conference on Machine Learning. 2902--2911 . E. Real, S. Moore, A. Selle, S. Saxena, Y. L. Suematsu, J. Tan, Q. V. Le, and A. Kurakin. 2017. Large-scale evolution of image classifiers. In Proceedings of the International Conference on Machine Learning. 2902--2911."},{"key":"e_1_2_1_153_1","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201915)","author":"Romero A.","unstructured":"A. Romero , N. Ballas , S. E. Kahou , A. Chassang , C. Gatta , and Y. Bengio . 2015. FitNets: Hints for thin deep nets . In Proceedings of the International Conference on Learning Representations (ICLR\u201915) . A. Romero, N. Ballas, S. E. Kahou, A. Chassang, C. Gatta, and Y. Bengio. 2015. FitNets: Hints for thin deep nets. In Proceedings of the International Conference on Learning Representations (ICLR\u201915)."},{"key":"e_1_2_1_154_1","volume-title":"Proceedings of the International Symposium on Low Power Electronics and Design (ISLPED\u201916)","author":"Rouhani B. B.","unstructured":"B. B. Rouhani , A. Mirhoseini , and F. Koushanfar . [n.d.]. DeLight: Adding energy dimension to deep neural networks . In Proceedings of the International Symposium on Low Power Electronics and Design (ISLPED\u201916) . 112--117. B. B. Rouhani, A. Mirhoseini, and F. Koushanfar. [n.d.]. DeLight: Adding energy dimension to deep neural networks. In Proceedings of the International Symposium on Low Power Electronics and Design (ISLPED\u201916). 112--117."},{"key":"e_1_2_1_155_1","volume-title":"An overview of multi-task learning in deep neural networks.","author":"Ruder Sebastian","year":"2017","unstructured":"Sebastian Ruder . 2017. An overview of multi-task learning in deep neural networks. Retrieved from https:\/\/Arxiv:1706.05098 ( 2017 ). Sebastian Ruder. 2017. An overview of multi-task learning in deep neural networks. Retrieved from https:\/\/Arxiv:1706.05098 (2017)."},{"key":"e_1_2_1_156_1","unstructured":"S. Saxena and J. Verbeek. 2016. Convolutional neural fabrics. In Advances in Neural Information Processing Systems. MIT Press 4053--4061.  S. Saxena and J. Verbeek. 2016. Convolutional neural fabrics. In Advances in Neural Information Processing Systems. MIT Press 4053--4061."},{"key":"e_1_2_1_157_1","unstructured":"C. Sciuto K. Yu M. Jaggi C. Musat and M. Salzmann. 2019. Evaluating the search phase of neural architecture search. Retrieved from https:\/\/Arxiv:1902.08142.  C. Sciuto K. Yu M. Jaggi C. Musat and M. Salzmann. 2019. Evaluating the search phase of neural architecture search. Retrieved from https:\/\/Arxiv:1902.08142."},{"key":"e_1_2_1_158_1","unstructured":"C. Sciuto K. Yu M. Jaggi C. Musat and M. Salzmann. 2019. Evaluating the search phase of neural architecture search. CoRR abs\/1902.08142.  C. Sciuto K. Yu M. Jaggi C. Musat and M. Salzmann. 2019. Evaluating the search phase of neural architecture search. CoRR abs\/1902.08142."},{"key":"e_1_2_1_159_1","unstructured":"A. Sener and V. Koltun. 2018. Multi-task learning as multi-objective optimization. In Advances in Neural Information Processing Systems. MIT Press 527--538.  A. Sener and V. Koltun. 2018. Multi-task learning as multi-objective optimization. In Advances in Neural Information Processing Systems. MIT Press 527--538."},{"key":"e_1_2_1_160_1","volume-title":"Horovod: Fast and easy distributed deep learning in tensorflow.","author":"Sergeev A.","year":"2018","unstructured":"A. Sergeev and M. Del Balso . 2018 . Horovod: Fast and easy distributed deep learning in tensorflow. Retrieved from https:\/\/Arxiv:1802.05799. A. Sergeev and M. Del Balso. 2018. Horovod: Fast and easy distributed deep learning in tensorflow. Retrieved from https:\/\/Arxiv:1802.05799."},{"key":"e_1_2_1_161_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2015.2494218"},{"key":"e_1_2_1_162_1","volume-title":"Advances in Neural Information Processing Systems","volume":"33","author":"Zhang M.","unstructured":"M. Zhang , H. Li , and S. Pan . 2020. Differentiable neural architecture search in equivalent space with exploration enhancement . Advances in Neural Information Processing Systems , vol. 33 . M. Zhang, H. Li, and S. Pan. 2020. Differentiable neural architecture search in equivalent space with exploration enhancement. Advances in Neural Information Processing Systems, vol. 33."},{"key":"e_1_2_1_163_1","volume-title":"Proceedings of the 6th International Conference on Learning Representations (ICLR\u201918)","author":"Shin R.","unstructured":"R. Shin , C. Packer , and D. Song . 2018. Differentiable neural network architecture search . In Proceedings of the 6th International Conference on Learning Representations (ICLR\u201918) . R. Shin, C. Packer, and D. Song. 2018. Differentiable neural network architecture search. In Proceedings of the 6th International Conference on Learning Representations (ICLR\u201918)."},{"key":"e_1_2_1_164_1","volume-title":"Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP\u201915)","author":"Shinozaki T.","unstructured":"T. Shinozaki and S. Watanabe . 2015. Structure discovery of deep neural network based on evolutionary algorithms . In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP\u201915) . 4979--4983. T. Shinozaki and S. Watanabe. 2015. Structure discovery of deep neural network based on evolutionary algorithms. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP\u201915). 4979--4983."},{"key":"e_1_2_1_165_1","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201915)","author":"Simonyan K.","unstructured":"K. Simonyan and A. Zisserman . 2015. Very deep convolutional networks for large-scale image recognition . In Proceedings of the International Conference on Learning Representations (ICLR\u201915) . K. Simonyan and A. Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. In Proceedings of the International Conference on Learning Representations (ICLR\u201915)."},{"key":"e_1_2_1_166_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2014.05.062"},{"key":"e_1_2_1_167_1","volume-title":"Proceedings of the International Conference on Computer-Aided Design (ICCAD\u201916)","author":"Smithson S. C.","unstructured":"S. C. Smithson , G. Yang , W. J. Gross , and B. H. Meyer . 2016. Neural networks designing neural networks: Multi-objective hyper-parameter optimization . In Proceedings of the International Conference on Computer-Aided Design (ICCAD\u201916) . 104. S. C. Smithson, G. Yang, W. J. Gross, and B. H. Meyer. 2016. Neural networks designing neural networks: Multi-objective hyper-parameter optimization. In Proceedings of the International Conference on Computer-Aided Design (ICCAD\u201916). 104."},{"key":"e_1_2_1_168_1","unstructured":"J. Snoek H. Larochelle and R. P. Adams. 2012. Practical bayesian optimization of machine learning algorithms. In Advances in Neural Information Processing Systems. MIT Press 2951--2959.  J. Snoek H. Larochelle and R. P. Adams. 2012. Practical bayesian optimization of machine learning algorithms. In Advances in Neural Information Processing Systems. MIT Press 2951--2959."},{"key":"e_1_2_1_169_1","volume-title":"Proceedings of the International Conference on Machine Learning. 2171--2180","author":"Snoek J.","unstructured":"J. Snoek , O. Rippel , K. Swersky , R. Kiros , N. Satish , N. Sundaram , M. A. P. Prabhat , and R. P. Adams . 2015. Scalable bayesian optimization using deep neural networks . In Proceedings of the International Conference on Machine Learning. 2171--2180 . J. Snoek, O. Rippel, K. Swersky, R. Kiros, N. Satish, N. Sundaram, M. A. P. Prabhat, and R. P. Adams. 2015. Scalable bayesian optimization using deep neural networks. In Proceedings of the International Conference on Machine Learning. 2171--2180."},{"key":"e_1_2_1_170_1","unstructured":"J. T. Springenberg A. Klein S. Falkner and F. Hutter. 2016. Bayesian optimization with robust bayesian neural networks. In Advances in Neural Information Processing Systems. MIT Press 4134--4142.  J. T. Springenberg A. Klein S. Falkner and F. Hutter. 2016. Bayesian optimization with robust bayesian neural networks. In Advances in Neural Information Processing Systems. MIT Press 4134--4142."},{"key":"e_1_2_1_171_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01165154"},{"key":"e_1_2_1_172_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-018-0006-z"},{"key":"e_1_2_1_173_1","doi-asserted-by":"publisher","DOI":"10.1162\/106365602320169811"},{"key":"e_1_2_1_174_1","volume-title":"Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201919)","author":"Strumberger I.","unstructured":"I. Strumberger , E. Tuba , N. Bacanin , R. Jovanovic , and M. Tuba . 2019. Convolutional neural network architecture design by the tree growth algorithm framework . In Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201919) . 1--8. I. Strumberger, E. Tuba, N. Bacanin, R. Jovanovic, and M. Tuba. 2019. Convolutional neural network architecture design by the tree growth algorithm framework. In Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201919). 1--8."},{"key":"e_1_2_1_175_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201918)","author":"Suganuma M.","unstructured":"M. Suganuma , M. Ozay , and T. Okatani . 2018. Exploiting the potential of standard convolutional autoencoders for image restoration by evolutionary search . In Proceedings of the International Conference on Machine Learning (ICML\u201918) . 4778--4787. M. Suganuma, M. Ozay, and T. Okatani. 2018. Exploiting the potential of standard convolutional autoencoders for image restoration by evolutionary search. In Proceedings of the International Conference on Machine Learning (ICML\u201918). 4778--4787."},{"key":"e_1_2_1_176_1","volume-title":"Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR\u201916)","author":"Sun Y.","unstructured":"Y. Sun , X. Wang , and X. Tang . 2016. Sparsifying neural network connections for face recognition . In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR\u201916) . 4856--4864. Y. Sun, X. Wang, and X. Tang. 2016. Sparsifying neural network connections for face recognition. In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR\u201916). 4856--4864."},{"key":"e_1_2_1_177_1","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201918)","author":"Sun Y.","unstructured":"Y. Sun , B. Xue , M. Zhang , and G. Yen . 2018. An experimental study on hyper-parameter optimization for stacked auto-encoders . In Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201918) . 1--8. Y. Sun, B. Xue, M. Zhang, and G. Yen. 2018. An experimental study on hyper-parameter optimization for stacked auto-encoders. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201918). 1--8."},{"key":"e_1_2_1_178_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2018.2881143"},{"key":"e_1_2_1_179_1","unstructured":"K. Swersky D. Duvenaud J. Snoek F. Hutter and M. A. Osborne. 2014. Raiders of the lost architecture: Kernels for Bayesian optimization in conditional parameter spaces. Retrieved from https:\/\/Arxiv:1409.4011.  K. Swersky D. Duvenaud J. Snoek F. Hutter and M. A. Osborne. 2014. Raiders of the lost architecture: Kernels for Bayesian optimization in conditional parameter spaces. Retrieved from https:\/\/Arxiv:1409.4011."},{"key":"e_1_2_1_180_1","volume-title":"Proceedings of the Conference on Computer Vision and Pattern Recognition. 1--9.","author":"Szegedy C.","unstructured":"C. Szegedy , W. Liu , Y. Jia , P. Sermanet , S. Reed , D. Anguelov , D. Erhan , V. Vanhoucke , and A. Rabinovich . 2015. Going deeper with convolutions . In Proceedings of the Conference on Computer Vision and Pattern Recognition. 1--9. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. 2015. Going deeper with convolutions. In Proceedings of the Conference on Computer Vision and Pattern Recognition. 1--9."},{"key":"e_1_2_1_181_1","volume-title":"Proceedings of the Conference on Computer Vision and Pattern Recognition. 2818--2826","author":"Szegedy C.","unstructured":"C. Szegedy , V. Vanhoucke , S. Ioffe , J. Shlens , and Z. Wojna . 2016. Rethinking the inception architecture for computer vision . In Proceedings of the Conference on Computer Vision and Pattern Recognition. 2818--2826 . C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna. 2016. Rethinking the inception architecture for computer vision. In Proceedings of the Conference on Computer Vision and Pattern Recognition. 2818--2826."},{"key":"e_1_2_1_182_1","volume-title":"Metaheuristics: from Design to Implementation","author":"Talbi E.-G.","unstructured":"E.-G. Talbi . 2009. Metaheuristics: from Design to Implementation . Wiley . E.-G. Talbi. 2009. Metaheuristics: from Design to Implementation. Wiley."},{"key":"e_1_2_1_183_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2018.04.012"},{"key":"e_1_2_1_184_1","volume-title":"Computer Vision and Pattern Recognition Conference. 2820--2828","author":"Tan M.","unstructured":"M. Tan , B. Chen , R. Pang , V. Vasudevan , M. Sandler , A. Howard , and Q. V. Le . 2019. Mnasnet: Platform-aware neural architecture search for mobile . Computer Vision and Pattern Recognition Conference. 2820--2828 . M. Tan, B. Chen, R. Pang, V. Vasudevan, M. Sandler, A. Howard, and Q. V. Le. 2019. Mnasnet: Platform-aware neural architecture search for mobile. Computer Vision and Pattern Recognition Conference. 2820--2828."},{"key":"e_1_2_1_185_1","volume-title":"Efficientnet: Rethinking model scaling for convolutional neural networks.","author":"Tan M.","year":"2019","unstructured":"M. Tan and Q. V. Le . 2019 . Efficientnet: Rethinking model scaling for convolutional neural networks. Retrieved from https:\/\/Arxiv:1905.11946. M. Tan and Q. V. Le. 2019. Efficientnet: Rethinking model scaling for convolutional neural networks. Retrieved from https:\/\/Arxiv:1905.11946."},{"key":"e_1_2_1_186_1","volume-title":"Proceedings of the International Conference on Knowledge Discovery and Data Mining. 847--855","author":"Thornton C.","unstructured":"C. Thornton , F. Hutter , H. Hoos , and K. Leyton-Brown . 2013. Auto-WEKA: Combined selection and hyperparameter optimization of classification algorithms . In Proceedings of the International Conference on Knowledge Discovery and Data Mining. 847--855 . C. Thornton, F. Hutter, H. Hoos, and K. Leyton-Brown. 2013. Auto-WEKA: Combined selection and hyperparameter optimization of classification algorithms. In Proceedings of the International Conference on Knowledge Discovery and Data Mining. 847--855."},{"key":"e_1_2_1_188_1","volume-title":"Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR\u201918)","author":"Veniat T.","unstructured":"T. Veniat and L. Denoyer . 2018. Learning time\/memory-efficient deep architectures with budgeted supernetworks . In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR\u201918) . 3492--3500. T. Veniat and L. Denoyer. 2018. Learning time\/memory-efficient deep architectures with budgeted supernetworks. In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR\u201918). 3492--3500."},{"key":"e_1_2_1_189_1","volume-title":"Proceedings of the Congress on Evolutionary Computation (CEC\u201918)","author":"Wang B.","unstructured":"B. Wang , Y. Sun , B. Xue , and M. Zhang . 2018. Evolving deep convolutional neural networks by variable-length particle swarm optimization for image classification . In Proceedings of the Congress on Evolutionary Computation (CEC\u201918) . 1--8. B. Wang, Y. Sun, B. Xue, and M. Zhang. 2018. Evolving deep convolutional neural networks by variable-length particle swarm optimization for image classification. In Proceedings of the Congress on Evolutionary Computation (CEC\u201918). 1--8."},{"key":"e_1_2_1_190_1","volume-title":"Proceedings of the Australasian Joint Conference on Artificial Intelligence. 237--250","author":"Wang B.","unstructured":"B. Wang , Y. Sun , B. Xue , and M. Zhang . 2018. A hybrid differential evolution approach to designing deep convolutional neural networks for image classification . In Proceedings of the Australasian Joint Conference on Artificial Intelligence. 237--250 . B. Wang, Y. Sun, B. Xue, and M. Zhang. 2018. A hybrid differential evolution approach to designing deep convolutional neural networks for image classification. In Proceedings of the Australasian Joint Conference on Artificial Intelligence. 237--250."},{"key":"e_1_2_1_191_1","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference. 490--498","author":"Wang B.","unstructured":"B. Wang , Y. Sun , B. Xue , and M. Zhang . 2019. Evolving deep neural networks by multi-objective particle swarm optimization for image classification . In Proceedings of the Genetic and Evolutionary Computation Conference. 490--498 . B. Wang, Y. Sun, B. Xue, and M. Zhang. 2019. Evolving deep neural networks by multi-objective particle swarm optimization for image classification. In Proceedings of the Genetic and Evolutionary Computation Conference. 490--498."},{"key":"e_1_2_1_192_1","first-page":"513","article-title":"DLAU: A scalable deep learning accelerator unit on FPGA","volume":"36","author":"Wang C.","year":"2016","unstructured":"C. Wang , L. Gong , Q. Yu , X. Li , Y. Xie , and X. Zhou . 2016 . DLAU: A scalable deep learning accelerator unit on FPGA . IEEE Trans. Comput.-Aided Design Integr. Circ. Syst. 36 , 3 (2016), 513 -- 517 . C. Wang, L. Gong, Q. Yu, X. Li, Y. Xie, and X. Zhou. 2016. DLAU: A scalable deep learning accelerator unit on FPGA. IEEE Trans. Comput.-Aided Design Integr. Circ. Syst. 36, 3 (2016), 513--517.","journal-title":"IEEE Trans. Comput.-Aided Design Integr. Circ. Syst."},{"key":"e_1_2_1_193_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2019.2895748"},{"key":"e_1_2_1_194_1","unstructured":"L. Wang Y. Zhao Y. Jinnai Y. Tian and R. Fonseca. 2019. AlphaX: Exploring neural architectures with deep neural networks and monte carlo tree search. CoRR abs\/1903.11059.  L. Wang Y. Zhao Y. Jinnai Y. Tian and R. Fonseca. 2019. AlphaX: Exploring neural architectures with deep neural networks and monte carlo tree search. CoRR abs\/1903.11059."},{"key":"e_1_2_1_195_1","volume-title":"Proceedings of the International Conference on Machine Learning. 564--572","author":"Wei T.","unstructured":"T. Wei , C. Wang , Y. Rui , and C. W. Chen . 2016. Network morphism . In Proceedings of the International Conference on Machine Learning. 564--572 . T. Wei, C. Wang, Y. Rui, and C. W. Chen. 2016. Network morphism. In Proceedings of the International Conference on Machine Learning. 564--572."},{"key":"e_1_2_1_196_1","doi-asserted-by":"crossref","unstructured":"K. Weiss T. Khoshgoftaar and D. Wang. 2016. A survey of transfer learning. J. Big data 3 1 (2016) 9.  K. Weiss T. Khoshgoftaar and D. Wang. 2016. A survey of transfer learning. J. Big data 3 1 (2016) 9.","DOI":"10.1186\/s40537-016-0043-6"},{"key":"e_1_2_1_197_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2908991"},{"key":"e_1_2_1_198_1","volume-title":"BANANAS: Bayesian optimization with neural architectures for neural architecture search.","author":"White C.","year":"2019","unstructured":"C. White , W. Neiswanger , and Y. Savani . 2019 . BANANAS: Bayesian optimization with neural architectures for neural architecture search. Retrieved from https:\/\/Arxiv:1910.11858. C. White, W. Neiswanger, and Y. Savani. 2019. BANANAS: Bayesian optimization with neural architectures for neural architecture search. Retrieved from https:\/\/Arxiv:1910.11858."},{"key":"e_1_2_1_199_1","unstructured":"J. Wilson F. Hutter and M. Deisenroth. 2018. Maximizing acquisition functions for bayesian optimization. In Advances in Neural Information Processing Systems. MIT Press 9884--9895.  J. Wilson F. Hutter and M. Deisenroth. 2018. Maximizing acquisition functions for bayesian optimization. In Advances in Neural Information Processing Systems. MIT Press 9884--9895."},{"key":"e_1_2_1_200_1","unstructured":"M. Wistuba A. Rawat and T. Pedapati. 2019. A survey on neural architecture search. CoRR abs\/1905.01392.  M. Wistuba A. Rawat and T. Pedapati. 2019. A survey on neural architecture search. CoRR abs\/1905.01392."},{"key":"e_1_2_1_201_1","unstructured":"J. Wu S. Toscano-Palmerin P. Frazier and A. G. Wilson. 2020. Practical multi-fidelity bayesian optimization for hyperparameter tuning. In Uncertainty in Artificial Intelligence. North-Holland 788--798.  J. Wu S. Toscano-Palmerin P. Frazier and A. G. Wilson. 2020. Practical multi-fidelity bayesian optimization for hyperparameter tuning. In Uncertainty in Artificial Intelligence. North-Holland 788--798."},{"key":"e_1_2_1_202_1","volume-title":"Genetic CNN. In Proceedings of the IEEE International Conference on Computer Vision. 1379--1388","author":"Xie L.","unstructured":"L. Xie and A. Yuille . 2017 . Genetic CNN. In Proceedings of the IEEE International Conference on Computer Vision. 1379--1388 . L. Xie and A. Yuille. 2017. Genetic CNN. In Proceedings of the IEEE International Conference on Computer Vision. 1379--1388."},{"key":"e_1_2_1_203_1","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201919)","author":"Xie S.","unstructured":"S. Xie , H. Zheng , C. Liu , and L. Lin . 2019. SNAS: Stochastic neural architecture search . In Proceedings of the International Conference on Learning Representations (ICLR\u201919) . S. Xie, H. Zheng, C. Liu, and L. Lin. 2019. SNAS: Stochastic neural architecture search. In Proceedings of the International Conference on Learning Representations (ICLR\u201919)."},{"key":"e_1_2_1_204_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2856832"},{"key":"e_1_2_1_205_1","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201914)","author":"Yadan O.","unstructured":"O. Yadan , K. Adams , Y. Taigman , and M. Ranzato . 2014. Multi-GPU training of convnets . In Proceedings of the International Conference on Learning Representations (ICLR\u201914) . O. Yadan, K. Adams, Y. Taigman, and M. Ranzato. 2014. Multi-GPU training of convnets. In Proceedings of the International Conference on Learning Representations (ICLR\u201914)."},{"key":"e_1_2_1_206_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5687--5695","author":"Yang T.-J.","unstructured":"T.-J. Yang , Y.-H. Chen , and V. Sze . 2017. Designing energy-efficient convolutional neural networks using energy-aware pruning . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5687--5695 . T.-J. Yang, Y.-H. Chen, and V. Sze. 2017. Designing energy-efficient convolutional neural networks using energy-aware pruning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5687--5695."},{"key":"e_1_2_1_207_1","unstructured":"C. Ying A. Klein E. Real E. Christiansen K. Murphy and F. Hutter. 2019. Nas-bench-101: Towards reproducible neural architecture search. Retrieved from https:\/\/Arxiv:1902.09635.  C. Ying A. Klein E. Real E. Christiansen K. Murphy and F. Hutter. 2019. Nas-bench-101: Towards reproducible neural architecture search. Retrieved from https:\/\/Arxiv:1902.09635."},{"key":"e_1_2_1_208_1","volume-title":"Proceedings of the Workshop on Machine Learning in HPC Environments. 41--45","author":"Young S. R.","unstructured":"S. R. Young , D. C. Rose , T. P. Karnowski , S.-H. Lim , and R. M. Patton . 2015. Optimizing deep learning hyper-parameters through an evolutionary algorithm . In Proceedings of the Workshop on Machine Learning in HPC Environments. 41--45 . S. R. Young, D. C. Rose, T. P. Karnowski, S.-H. Lim, and R. M. Patton. 2015. Optimizing deep learning hyper-parameters through an evolutionary algorithm. In Proceedings of the Workshop on Machine Learning in HPC Environments. 41--45."},{"key":"e_1_2_1_209_1","unstructured":"A. Zela A. Klein S. Falkner and F. Hutter. 2018. Towards automated deep learning: Efficient joint neural architecture and hyperparameter search. Retrieved from https:\/\/Arxiv:1807.06906.  A. Zela A. Klein S. Falkner and F. Hutter. 2018. Towards automated deep learning: Efficient joint neural architecture and hyperparameter search. Retrieved from https:\/\/Arxiv:1807.06906."},{"key":"e_1_2_1_210_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2007.892759"},{"key":"e_1_2_1_211_1","unstructured":"X. Zhang Z. Huang and N. Wang. 2018. You only search once: Single shot neural architecture search via direct sparse optimization. CoRR abs\/1811.01567.  X. Zhang Z. Huang and N. Wang. 2018. You only search once: Single shot neural architecture search via direct sparse optimization. CoRR abs\/1811.01567."},{"key":"e_1_2_1_212_1","volume-title":"Proceedings of the IEEE International Conference on Cluster Computing (CLUSTER\u201917)","author":"Zhang Y.","unstructured":"Y. Zhang , C. Wang , L. Gong , Y. Lu , F. Sun , C. Xu , X. Li , and X. Zhou . 2017. A power-efficient accelerator based on FPGAs for LSTM network . In Proceedings of the IEEE International Conference on Cluster Computing (CLUSTER\u201917) . 629--630. Y. Zhang, C. Wang, L. Gong, Y. Lu, F. Sun, C. Xu, X. Li, and X. Zhou. 2017. A power-efficient accelerator based on FPGAs for LSTM network. In Proceedings of the IEEE International Conference on Cluster Computing (CLUSTER\u201917). 629--630."},{"key":"e_1_2_1_213_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2019.11.098"},{"key":"e_1_2_1_214_1","unstructured":"Z. Zhong J. Yan and C.-L. Liu. 2017. Practical network blocks design with q-learning. CoRR abs\/1708.05552.  Z. Zhong J. Yan and C.-L. Liu. 2017. Practical network blocks design with q-learning. CoRR abs\/1708.05552."},{"key":"e_1_2_1_215_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00257"},{"key":"e_1_2_1_216_1","unstructured":"Y. Zhou S. Arik H. Yu H. Liu and G. Diamos. 2018. Resource-efficient neural architect. Retrieved from https:\/\/Arxiv:1806.07912.  Y. Zhou S. Arik H. Yu H. Liu and G. Diamos. 2018. Resource-efficient neural architect. Retrieved from https:\/\/Arxiv:1806.07912."},{"key":"e_1_2_1_217_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 413--422","author":"Zhuang B.","unstructured":"B. Zhuang , C. Shen , M. Tan , L. Liu , and I. D. Reid . 2019. Structured binary neural networks for accurate image classification and semantic segmentation . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 413--422 . B. Zhuang, C. Shen, M. Tan, L. Liu, and I. D. Reid. 2019. Structured binary neural networks for accurate image classification and semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 413--422."},{"key":"e_1_2_1_218_1","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201917)","author":"Zoph B.","unstructured":"B. Zoph and Q. V. Le . 2017. Neural architecture search with reinforcement learning . In Proceedings of the International Conference on Learning Representations (ICLR\u201917) . B. Zoph and Q. V. Le. 2017. Neural architecture search with reinforcement learning. In Proceedings of the International Conference on Learning Representations (ICLR\u201917)."},{"key":"e_1_2_1_219_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8697--8710","author":"Zoph B.","unstructured":"B. Zoph , V. Vasudevan , J. Shlens , and Q. V. Le . 2018. Learning transferable architectures for scalable image recognition . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8697--8710 . B. Zoph, V. Vasudevan, J. Shlens, and Q. V. Le. 2018. Learning transferable architectures for scalable image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8697--8710."}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3439730","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3439730","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:01:52Z","timestamp":1750197712000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3439730"}},"subtitle":["A Survey and Unified Taxonomy"],"short-title":[],"issued":{"date-parts":[[2021,3,5]]},"references-count":217,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,3,31]]}},"alternative-id":["10.1145\/3439730"],"URL":"https:\/\/doi.org\/10.1145\/3439730","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,5]]},"assertion":[{"value":"2020-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-03-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}