{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T05:09:06Z","timestamp":1755839346691,"version":"3.37.3"},"reference-count":53,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,6,25]],"date-time":"2022-06-25T00:00:00Z","timestamp":1656115200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,6,25]],"date-time":"2022-06-25T00:00:00Z","timestamp":1656115200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003995","name":"Natural Science Foundation of Anhui Province","doi-asserted-by":"publisher","award":["No.19908085MF218","No.2108085MF193"],"award-info":[{"award-number":["No.19908085MF218","No.2108085MF193"]}],"id":[{"id":"10.13039\/501100003995","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2023,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In recent years, neural architecture search (NAS) has achieved unprecedented development because of its ability to automatically achieve high-performance neural networks in various tasks. Among these, the evolutionary neural architecture search (ENAS) has impressed the researchers due to the excellent heuristic exploration capability. However, the evolutionary algorithm-based NAS are prone to the loss of population diversity in the search process, causing that the structure of the surviving individuals is exceedingly similar, which will lead to premature convergence and fail to explore the search space comprehensively and effectively. To address this issue, we propose a novel indicator, named architecture entropy, which is used to measure the architecture diversity of population. Based on this indicator, an effective sampling strategy is proposed to select the candidate individuals with the potential to maintain the population diversity for environmental selection. In addition, an unified encoding scheme of topological structure and computing operation is designed to efficiently express the search space, and the corresponding population update strategies are suggested to promote the convergence. The experimental results on several image classification benchmark datasets CIFAR-10 and CIFAR-100 demonstrate the superiority of our proposed method over the state-of-the-art comparison ones. To further validate the effectiveness of our method in real applications, our proposed NAS method is applied in the identification of lumbar spine X-ray images for osteoporosis diagnosis, and can achieve a better performance than the commonly used methods. Our source codes are available at <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/github.com\/LabyrinthineLeo\/AEMONAS.\">https:\/\/github.com\/LabyrinthineLeo\/AEMONAS.<\/jats:ext-link><\/jats:p>","DOI":"10.1007\/s40747-022-00794-7","type":"journal-article","created":{"date-parts":[[2022,6,25]],"date-time":"2022-06-25T03:21:31Z","timestamp":1656127291000},"page":"213-231","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Architecture entropy sampling-based evolutionary neural architecture search and its application in osteoporosis diagnosis"],"prefix":"10.1007","volume":"9","author":[{"given":"Jianjun","family":"Chu","sequence":"first","affiliation":[]},{"given":"Xiaoshan","family":"Yu","sequence":"additional","affiliation":[]},{"given":"Shangshang","family":"Yang","sequence":"additional","affiliation":[]},{"given":"Jianfeng","family":"Qiu","sequence":"additional","affiliation":[]},{"given":"Qijun","family":"Wang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,6,25]]},"reference":[{"key":"794_CR1","unstructured":"Awad N, Mallik N, Hutter F (2020) Differential evolution for neural architecture search. arXiv:2012.06400"},{"key":"794_CR2","unstructured":"Baker B, Gupta O, Naik N, et\u00a0al (2016) Designing neural network architectures using reinforcement learning. arXiv:1611.02167"},{"key":"794_CR3","doi-asserted-by":"crossref","unstructured":"Chen Y, Meng G, Zhang Q et\u00a0al (2019) Renas: Reinforced evolutionary neural architecture search. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp 4787\u20134796","DOI":"10.1109\/CVPR.2019.00492"},{"issue":"3","key":"794_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2480741.2480752","volume":"45","author":"M \u010crepin\u0161ek","year":"2013","unstructured":"\u010crepin\u0161ek M, Liu SH, Mernik M (2013) Exploration and exploitation in evolutionary algorithms: a survey. ACM Comput Surv (CSUR) 45(3):1\u201333","journal-title":"ACM Comput Surv (CSUR)"},{"issue":"2","key":"794_CR5","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1109\/4235.996017","volume":"6","author":"K Deb","year":"2002","unstructured":"Deb K, Pratap A, Agarwal S et al (2002) A fast and elitist multiobjective genetic algorithm: Nsga-ii. IEEE Trans Evtolution Comput 6(2):182\u2013197","journal-title":"IEEE Trans Evtolution Comput"},{"key":"794_CR6","doi-asserted-by":"crossref","unstructured":"Elsken T, Metzen JH, Hutter F (2018) Efficient multi-objective neural architecture search via lamarckian evolution. arXiv:1804.09081","DOI":"10.1007\/978-3-030-05318-5_3"},{"key":"794_CR7","doi-asserted-by":"crossref","unstructured":"Gao Z, Xie J, Wang Q, et\u00a0al (2019) Global second-order pooling convolutional networks. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 3024\u20133033","DOI":"10.1109\/CVPR.2019.00314"},{"key":"794_CR8","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, et\u00a0al (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"794_CR9","doi-asserted-by":"crossref","unstructured":"Hoa K, Gilberta A, Jinb H et\u00a0al (2021) Neural architecture search for deep image prior. Comput Graph","DOI":"10.1016\/j.cag.2021.05.013"},{"key":"794_CR10","doi-asserted-by":"crossref","unstructured":"Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132\u20137141","DOI":"10.1109\/CVPR.2018.00745"},{"key":"794_CR11","doi-asserted-by":"crossref","unstructured":"Huang G, Liu Z, Van Der\u00a0Maaten L et\u00a0al (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700\u20134708","DOI":"10.1109\/CVPR.2017.243"},{"key":"794_CR12","unstructured":"Krizhevsky A, Hinton G et\u00a0al (2009) Learning multiple layers of features from tiny images"},{"issue":"4","key":"794_CR13","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1007\/s00256-019-03342-6","volume":"49","author":"S Lee","year":"2020","unstructured":"Lee S, Choe EK, Kang HY et al (2020) The exploration of feature extraction and machine learning for predicting bone density from simple spine X-ray images in a korean population. Skeletal Radiol 49(4):613\u2013618","journal-title":"Skeletal Radiol"},{"key":"794_CR14","doi-asserted-by":"crossref","unstructured":"Lin TY, RoyChowdhury A, Maji S (2015) Bilinear cnn models for fine-grained visual recognition. In: Proceedings of the IEEE international conference on computer vision, pp 1449\u20131457","DOI":"10.1109\/ICCV.2015.170"},{"key":"794_CR15","doi-asserted-by":"crossref","unstructured":"Liu C, Zoph B, Neumann M, et\u00a0al (2018) Progressive neural architecture search. In: Proceedings of the European conference on computer vision (ECCV), pp 19\u201334","DOI":"10.1007\/978-3-030-01246-5_2"},{"key":"794_CR16","unstructured":"Liu H, Simonyan K, Vinyals O, et\u00a0al (2017) Hierarchical representations for efficient architecture search. arXiv:1711.00436"},{"key":"794_CR17","unstructured":"Liu H, Simonyan K, Yang Y (2018) Darts: differentiable architecture search. arXiv:1806.09055"},{"key":"794_CR18","doi-asserted-by":"crossref","unstructured":"Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431\u20133440","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"794_CR19","doi-asserted-by":"crossref","unstructured":"Lu Z, Whalen I, Boddeti V et\u00a0al (2019) Nsga-net: neural architecture search using multi-objective genetic algorithm. In: Proceedings of the genetic and evolutionary computation conference, pp 419\u2013427","DOI":"10.1145\/3321707.3321729"},{"issue":"2","key":"794_CR20","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1109\/TEVC.2020.3024708","volume":"25","author":"Z Lu","year":"2020","unstructured":"Lu Z, Whalen I, Dhebar Y et al (2020) Multiobjective evolutionary design of deep convolutional neural networks for image classification. IEEE Trans Evol Comput 25(2):277\u2013291","journal-title":"IEEE Trans Evol Comput"},{"key":"794_CR21","unstructured":"Luo R, Tian F, Qin T, et\u00a0al (2018) Neural architecture optimization. arXiv:1808.07233"},{"key":"794_CR22","doi-asserted-by":"crossref","unstructured":"Mambrini A, Sudholt D, Yao X (2012) Homogeneous and heterogeneous island models for the set cover problem. In: International conference on parallel problem solving from nature, Springer, pp 11\u201320","DOI":"10.1007\/978-3-642-32937-1_2"},{"key":"794_CR23","doi-asserted-by":"crossref","unstructured":"Neumann F, Oliveto PS, Rudolph G, et\u00a0al (2011) On the effectiveness of crossover for migration in parallel evolutionary algorithms. In: Proceedings of the 13th annual conference on Genetic and evolutionary computation, pp 1587\u20131594","DOI":"10.1145\/2001576.2001790"},{"key":"794_CR24","unstructured":"Niepert M, Ahmed M, Kutzkov K (2016) Learning convolutional neural networks for graphs. In: International conference on machine learning, PMLR, pp 2014\u20132023"},{"key":"794_CR25","unstructured":"Pham H, Guan M, Zoph B et\u00a0al (2018) Efficient neural architecture search via parameters sharing. In: International conference on machine learning, PMLR, pp 4095\u20134104"},{"key":"794_CR26","unstructured":"Real E, Moore S, Selle A, et\u00a0al (2017) Large-scale evolution of image classifiers. In: International conference on machine learning, PMLR, pp 2902\u20132911"},{"key":"794_CR27","doi-asserted-by":"crossref","unstructured":"Real E, Aggarwal A, Huang Y, et\u00a0al (2019) Regularized evolution for image classifier architecture search. In: Proceedings of the aaai conference on artificial intelligence, pp 4780\u20134789","DOI":"10.1609\/aaai.v33i01.33014780"},{"key":"794_CR28","first-page":"91","volume":"28","author":"S Ren","year":"2015","unstructured":"Ren S, He K, Girshick R et al (2015) Faster r-cnn: towards real-time object detection with region proposal networks. Adv Neural Inf Process Syst 28:91\u201399","journal-title":"Adv Neural Inf Process Syst"},{"key":"794_CR29","doi-asserted-by":"crossref","unstructured":"Sandler M, Howard A, Zhu M, et\u00a0al (2018) Mobilenetv2: Inverted residuals and linear bottlenecks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4510\u20134520","DOI":"10.1109\/CVPR.2018.00474"},{"key":"794_CR30","doi-asserted-by":"crossref","unstructured":"Sudholt D (2020) The benefits of population diversity in evolutionary algorithms: a survey of rigorous runtime analyses. Theory Evolut Comput pp 359\u2013404","DOI":"10.1007\/978-3-030-29414-4_8"},{"issue":"4","key":"794_CR31","doi-asserted-by":"publisher","first-page":"1242","DOI":"10.1109\/TNNLS.2019.2919608","volume":"31","author":"Y Sun","year":"2019","unstructured":"Sun Y, Xue B, Zhang M et al (2019) Completely automated cnn architecture design based on blocks. IEEE transactions on neural networks and learning systems 31(4):1242\u20131254","journal-title":"IEEE transactions on neural networks and learning systems"},{"issue":"2","key":"794_CR32","doi-asserted-by":"publisher","first-page":"394","DOI":"10.1109\/TEVC.2019.2916183","volume":"24","author":"Y Sun","year":"2019","unstructured":"Sun Y, Xue B, Zhang M et al (2019) Evolving deep convolutional neural networks for image classification. IEEE Trans Evol Comput 24(2):394\u2013407","journal-title":"IEEE Trans Evol Comput"},{"issue":"9","key":"794_CR33","doi-asserted-by":"publisher","first-page":"3840","DOI":"10.1109\/TCYB.2020.2983860","volume":"50","author":"Y Sun","year":"2020","unstructured":"Sun Y, Xue B, Zhang M et al (2020) Automatically designing cnn architectures using the genetic algorithm for image classification. IEEE Trans Cybern 50(9):3840\u20133854","journal-title":"IEEE Trans Cybern"},{"key":"794_CR34","unstructured":"Sutton RS, Barto AG (2018) Reinforcement learning: an introduction. MIT Press"},{"key":"794_CR35","doi-asserted-by":"crossref","unstructured":"Szegedy C, Liu W, Jia Y, et\u00a0al (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1\u20139","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"794_CR36","doi-asserted-by":"crossref","unstructured":"Tian Y, Peng S, Yang S et\u00a0al (2021) Action command encoding for surrogate assisted neural architecture search. IEEE transactions on cognitive and developmental systems","DOI":"10.1109\/TCDS.2021.3107555"},{"issue":"3","key":"794_CR37","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1007\/BF00276067","volume":"13","author":"SD Tuljapurkar","year":"1982","unstructured":"Tuljapurkar SD (1982) Why use population entropy? it determines the rate of convergence. J Math Biol 13(3):325\u2013337","journal-title":"J Math Biol"},{"key":"794_CR38","doi-asserted-by":"crossref","unstructured":"Watson RA, Jansen T (2007) A building-block royal road where crossover is provably essential. In: Proceedings of the 9th annual conference on genetic and evolutionary computation, pp 1452\u20131459","DOI":"10.1145\/1276958.1277224"},{"key":"794_CR39","doi-asserted-by":"crossref","unstructured":"Wei J, Zhu G, Fan Z, et\u00a0al (2021) Genetic u-net: automatically designed deep networks for retinal vessel segmentation using a genetic algorithm. IEEE Trans Med Imaging","DOI":"10.1109\/TMI.2021.3111679"},{"key":"794_CR40","doi-asserted-by":"crossref","unstructured":"Xie L, Yuille A (2017) Genetic cnn. In: Proceedings of the IEEE international conference on computer vision, pp 1379\u20131388","DOI":"10.1109\/ICCV.2017.154"},{"key":"794_CR41","unstructured":"Yang S, Tian Y, Xiang X, et\u00a0al (2021) Accelerating evolutionary neural architecture search via multi-fidelity evaluation. arXiv:2108.04541"},{"key":"794_CR42","doi-asserted-by":"crossref","unstructured":"Yang Z, Wang Y, Chen X, et\u00a0al (2020) Cars: Continuous evolution for efficient neural architecture search. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 1829\u20131838","DOI":"10.1109\/CVPR42600.2020.00190"},{"key":"794_CR43","doi-asserted-by":"crossref","unstructured":"Zagoruyko S, Komodakis N (2016) Wide residual networks. arXiv:1605.07146","DOI":"10.5244\/C.30.87"},{"key":"794_CR44","unstructured":"Zaremba W, Sutskever I, Vinyals O (2014) Recurrent neural network regularization. arXiv:1409.2329"},{"issue":"115","key":"794_CR45","first-page":"561","volume":"140","author":"B Zhang","year":"2020","unstructured":"Zhang B, Yu K, Ning Z et al (2020) Deep learning of lumbar spine x-ray for osteopenia and osteoporosis screening: a multicenter retrospective cohort study. Bone 140(115):561","journal-title":"Bone"},{"issue":"2","key":"794_CR46","doi-asserted-by":"publisher","first-page":"371","DOI":"10.1109\/TEVC.2020.3040272","volume":"25","author":"H Zhang","year":"2020","unstructured":"Zhang H, Jin Y, Cheng R et al (2020) Efficient evolutionary search of attention convolutional networks via sampled training and node inheritance. IEEE Trans Evol Comput 25(2):371\u2013385","journal-title":"IEEE Trans Evol Comput"},{"key":"794_CR47","doi-asserted-by":"crossref","unstructured":"Zhang X, Zhou X, Lin M, et\u00a0al (2018) Shufflenet: An extremely efficient convolutional neural network for mobile devices. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6848\u20136856","DOI":"10.1109\/CVPR.2018.00716"},{"key":"794_CR48","doi-asserted-by":"crossref","unstructured":"Zhang Y, Dai G, Zuo M et\u00a0al (2019) A population entropy based adaptation strategy for differential evolution. In: Proceedings of the genetic and evolutionary computation conference companion, pp 330\u2013331","DOI":"10.1145\/3319619.3321981"},{"key":"794_CR49","doi-asserted-by":"crossref","unstructured":"Zhong Z, Yan J, Wu W, et\u00a0al (2018) Practical block-wise neural network architecture generation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2423\u20132432","DOI":"10.1109\/CVPR.2018.00257"},{"key":"794_CR50","doi-asserted-by":"crossref","unstructured":"Zhou B, Khosla A, Lapedriza A, et\u00a0al (2016) Learning deep features for discriminative localization. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2921\u20132929","DOI":"10.1109\/CVPR.2016.319"},{"key":"794_CR51","doi-asserted-by":"crossref","unstructured":"Zhou D, Zhou X, Zhang W, et\u00a0al (2020) Econas: finding proxies for economical neural architecture search. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 11,396\u201311,404","DOI":"10.1109\/CVPR42600.2020.01141"},{"key":"794_CR52","unstructured":"Zoph B, Le QV (2016) Neural architecture search with reinforcement learning. arXiv:1611.01578"},{"key":"794_CR53","doi-asserted-by":"crossref","unstructured":"Zoph B, Vasudevan V, Shlens J, et\u00a0al (2018) Learning transferable architectures for scalable image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 8697\u20138710","DOI":"10.1109\/CVPR.2018.00907"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-022-00794-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-022-00794-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-022-00794-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,22]],"date-time":"2023-02-22T18:48:01Z","timestamp":1677091681000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-022-00794-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,25]]},"references-count":53,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,2]]}},"alternative-id":["794"],"URL":"https:\/\/doi.org\/10.1007\/s40747-022-00794-7","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"type":"print","value":"2199-4536"},{"type":"electronic","value":"2198-6053"}],"subject":[],"published":{"date-parts":[[2022,6,25]]},"assertion":[{"value":"21 January 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 May 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 June 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}