{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T15:08:49Z","timestamp":1777043329656,"version":"3.51.4"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T00:00:00Z","timestamp":1627603200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T00:00:00Z","timestamp":1627603200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2022,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In recent years, evolutionary algorithms have shown great advantages in the field of feature selection because of their simplicity and potential global search capability. However, most of the existing feature selection algorithms based on evolutionary computation are wrapper methods, which are computationally expensive, especially for high-dimensional biomedical data. To significantly reduce the computational cost, it is essential to study an effective evaluation method. In this paper, a two-stage improved gray wolf optimization (IGWO) algorithm for feature selection on high-dimensional data is proposed. In the first stage, a multilayer perceptron (MLP) network with group lasso regularization terms is first trained to construct an integer optimization problem using the proposed algorithm for pre-selection of features and optimization of the hidden layer structure. The dataset is compressed using the feature subset obtained in the first stage. In the second stage, a multilayer perceptron network with group lasso regularization terms is retrained using the compressed dataset, and the proposed algorithm is employed to construct the discrete optimization problem for feature selection. Meanwhile, a rapid evaluation strategy is constructed to mitigate the evaluation cost and improve the evaluation efficiency in the feature selection process. The effectiveness of the algorithm was analyzed on ten gene expression datasets. The experimental results show that the proposed algorithm not only removes almost more than 95.7% of the features in all datasets, but also has better classification accuracy on the test set. In addition, the advantages of the proposed algorithm in terms of time consumption, classification accuracy and feature subset size become more and more prominent as the dimensionality of the feature selection problem increases. This indicates that the proposed algorithm is particularly suitable for solving high-dimensional feature selection problems.<\/jats:p>","DOI":"10.1007\/s40747-021-00452-4","type":"journal-article","created":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T09:03:06Z","timestamp":1627635786000},"page":"2769-2789","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":52,"title":["Two-stage improved Grey Wolf optimization algorithm for feature selection on high-dimensional classification"],"prefix":"10.1007","volume":"8","author":[{"given":"Chaonan","family":"Shen","sequence":"first","affiliation":[]},{"given":"Kai","family":"Zhang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,7,30]]},"reference":[{"key":"452_CR1","doi-asserted-by":"crossref","unstructured":"Bai X, Gao X, Xue B (2018) Particle swarm optimization based two-stage feature selection in text mining. In: 2018 IEEE congress on evolutionary computation (CEC), pp 1\u20138","DOI":"10.1109\/CEC.2018.8477773"},{"key":"452_CR2","doi-asserted-by":"publisher","first-page":"10312","DOI":"10.1038\/srep10312","volume":"5","author":"ML Bermingham","year":"2015","unstructured":"Bermingham ML, Pong-Wong R, Spiliopoulou A et al (2015) Application of high-dimensional feature selection: evaluation for genomic prediction in man. Sci Rep 5:10312. https:\/\/doi.org\/10.1038\/srep10312","journal-title":"Sci Rep"},{"key":"452_CR3","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1006\/jvci.1999.0413","volume":"10","author":"Y Rui","year":"1999","unstructured":"Rui Y, Huang T, Chang S (1999) Image retrieval: current techniques, promising directions, and open issues. J Vis Commun Image Represent 10:39\u201362","journal-title":"J Vis Commun Image Represent"},{"key":"452_CR4","doi-asserted-by":"publisher","first-page":"1616","DOI":"10.1109\/JIOT.2017.2787959","volume":"5","author":"S Egea","year":"2018","unstructured":"Egea S, Rego Ma\u00f1ez A, Carro B et al (2018) Intelligent IoT traffic classification using novel search strategy for fast-based-correlation feature selection in industrial environments. IEEE Internet Things J 5:1616\u20131624. https:\/\/doi.org\/10.1109\/JIOT.2017.2787959","journal-title":"IEEE Internet Things J"},{"key":"452_CR5","doi-asserted-by":"crossref","unstructured":"Dash M (1997) Feature selection via set cover. In: Proceedings 1997 IEEE knowledge and data engineering exchange workshop, pp 165\u2013171","DOI":"10.1109\/KDEX.1997.629862"},{"key":"452_CR6","doi-asserted-by":"publisher","first-page":"1080","DOI":"10.1109\/TCBB.2010.103","volume":"8","author":"F Yang","year":"2011","unstructured":"Yang F, Mao KZ (2011) Robust feature selection for microarray data based on multicriterion fusion. IEEE\/ACM Trans Comput Biol Bioinform 8:1080\u20131092. https:\/\/doi.org\/10.1109\/TCBB.2010.103","journal-title":"IEEE\/ACM Trans Comput Biol Bioinform"},{"key":"452_CR7","first-page":"1157","volume":"3","author":"I Guyon","year":"2003","unstructured":"Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3:1157\u20131182","journal-title":"J Mach Learn Res"},{"key":"452_CR8","doi-asserted-by":"crossref","unstructured":"Molina LC, Belanche L, Nebot A (2002) Feature selection algorithms: a survey and experimental evaluation. In: 2002 IEEE international conference on data mining, 2002. Proceedings, pp 306\u2013313","DOI":"10.1109\/ICDM.2002.1183917"},{"key":"452_CR9","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1109\/TKDE.2005.66","volume":"17","author":"H Liu","year":"2005","unstructured":"Liu H, Lei Yu (2005) Toward integrating feature selection algorithms for classification and clustering. IEEE Trans Knowl Data Eng 17:491\u2013502. https:\/\/doi.org\/10.1109\/TKDE.2005.66","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"452_CR10","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1007\/1-84628-102-4_3","volume-title":"Research and development in intelligent systems XXI","author":"J Loughrey","year":"2005","unstructured":"Loughrey J, Cunningham P (2005) Overfitting in wrapper-based feature subset selection: the harder you try the worse it gets. In: Bramer M, Coenen F, Allen T (eds) Research and development in intelligent systems XXI. Springer, London, pp 33\u201343"},{"key":"452_CR11","doi-asserted-by":"crossref","unstructured":"Jakulin A, Bratko I (2004) Testing the significance of attribute interactions. In: Proceedings of the twenty-first international conference on machine learning. association for computing machinery, New York, NY, USA, p 52","DOI":"10.1145\/1015330.1015377"},{"key":"452_CR12","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1016\/j.advengsoft.2013.12.007","volume":"69","author":"S Mirjalili","year":"2014","unstructured":"Mirjalili S, Mirjalili SM, Lewis A (2014) Grey Wolf optimizer. Adv Eng Softw 69:46\u201361. https:\/\/doi.org\/10.1016\/j.advengsoft.2013.12.007","journal-title":"Adv Eng Softw"},{"key":"452_CR13","doi-asserted-by":"crossref","unstructured":"Wong LI, Sulaiman MH, Mohamed MR, Hong MS (2014) Grey Wolf optimizer for solving economic dispatch problems. In: 2014 IEEE international conference on power and energy (PECon). pp 150\u2013154","DOI":"10.1109\/PECON.2014.7062431"},{"key":"452_CR14","doi-asserted-by":"publisher","first-page":"166","DOI":"10.1007\/978-3-319-48490-7_20","volume-title":"Genetic and evolutionary computing","author":"P-W Tsai","year":"2017","unstructured":"Tsai P-W, Nguyen T-T, Dao T-K (2017) Robot path planning optimization based on multiobjective Grey Wolf optimizer. In: Wang C-H, Jiang XH, Pan J-S, Lin JC-W (eds) Genetic and evolutionary computing. Springer International Publishing, Cham, pp 166\u2013173"},{"key":"452_CR15","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1016\/j.engappai.2016.10.013","volume":"57","author":"C Lu","year":"2017","unstructured":"Lu C, Gao L, Li X, Xiao S (2017) A hybrid multi-objective grey wolf optimizer for dynamic scheduling in a real-world welding industry. Eng Appl Artif Intell 57:61\u201379. https:\/\/doi.org\/10.1016\/j.engappai.2016.10.013","journal-title":"Eng Appl Artif Intell"},{"key":"452_CR16","doi-asserted-by":"publisher","first-page":"371","DOI":"10.1016\/j.neucom.2015.06.083","volume":"172","author":"E Emary","year":"2016","unstructured":"Emary E, Zawbaa HM, Hassanien AE (2016) Binary grey wolf optimization approaches for feature selection. Neurocomputing 172:371\u2013381. https:\/\/doi.org\/10.1016\/j.neucom.2015.06.083","journal-title":"Neurocomputing"},{"key":"452_CR17","doi-asserted-by":"publisher","first-page":"2108","DOI":"10.1049\/iet-gtd.2015.1141","volume":"10","author":"J Zhou","year":"2016","unstructured":"Zhou J, Zhu W, Zheng Y, Li C (2016) Precise equivalent model of small hydro generator cluster and its parameter identification using improved Grey Wolf optimiser. IET Gener Transm Distrib 10:2108\u20132117. https:\/\/doi.org\/10.1049\/iet-gtd.2015.1141","journal-title":"IET Gener Transm Distrib"},{"key":"452_CR18","unstructured":"J. Kennedy, R. C. Eberhart (1997) A discrete binary version of the particle swarm algorithm. In: 1997 IEEE International conference on systems, man, and cybernetics. computational cybernetics and simulation, vol 5, pp 4104\u20134108"},{"key":"452_CR19","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1109\/TCYB.2014.2322602","volume":"45","author":"R Cheng","year":"2015","unstructured":"Cheng R, Jin Y (2015) A competitive swarm optimizer for large scale optimization. IEEE Trans Cybern 45:191\u2013204. https:\/\/doi.org\/10.1109\/TCYB.2014.2322602","journal-title":"IEEE Trans Cybern"},{"key":"452_CR20","doi-asserted-by":"publisher","first-page":"811","DOI":"10.1007\/s00500-016-2385-6","volume":"22","author":"S Gu","year":"2018","unstructured":"Gu S, Cheng R, Jin Y (2018) Feature selection for high-dimensional classification using a competitive swarm optimizer. Soft Comput 22:811\u2013822. https:\/\/doi.org\/10.1007\/s00500-016-2385-6","journal-title":"Soft Comput"},{"key":"452_CR21","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.03.119","author":"X Wang","year":"2020","unstructured":"Wang X, Wang J, Zhang K et al (2020) Convergence and objective functions of noise-injected multilayer perceptrons with hidden multipliers. Neurocomputing. https:\/\/doi.org\/10.1016\/j.neucom.2020.03.119","journal-title":"Neurocomputing"},{"key":"452_CR22","unstructured":"Agarap AF (2018) Deep learning using rectified linear units (relu). arXiv:1803.08375"},{"key":"452_CR23","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1016\/j.neucom.2017.02.029","volume":"241","author":"S Scardapane","year":"2017","unstructured":"Scardapane S, Comminiello D, Hussain A, Uncini A (2017) Group sparse regularization for deep neural networks. Neurocomputing 241:81\u201389. https:\/\/doi.org\/10.1016\/j.neucom.2017.02.029","journal-title":"Neurocomputing"},{"key":"452_CR24","doi-asserted-by":"publisher","first-page":"2012","DOI":"10.1109\/TNNLS.2017.2748585","volume":"29","author":"J Wang","year":"2018","unstructured":"Wang J, Xu C, Yang X, Zurada JM (2018) A novel Pruning algorithm for smoothing feedforward neural networks based on group Lasso method. IEEE Trans Neural Netw Learn Syst 29:2012\u20132024. https:\/\/doi.org\/10.1109\/TNNLS.2017.2748585","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"452_CR25","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1016\/j.patrec.2005.07.009","volume":"27","author":"J-H Hong","year":"2006","unstructured":"Hong J-H, Cho S-B (2006) Efficient huge-scale feature selection with speciated genetic algorithm. Pattern Recognit Lett 27:143\u2013150. https:\/\/doi.org\/10.1016\/j.patrec.2005.07.009","journal-title":"Pattern Recognit Lett"},{"key":"452_CR26","doi-asserted-by":"publisher","first-page":"11663","DOI":"10.1007\/s00500-019-04628-6","volume":"24","author":"Y Ding","year":"2020","unstructured":"Ding Y, Zhou K, Bi W (2020) Feature selection based on hybridization of genetic algorithm and competitive swarm optimizer. Soft Comput 24:11663\u201311672. https:\/\/doi.org\/10.1007\/s00500-019-04628-6","journal-title":"Soft Comput"},{"key":"452_CR27","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.114072","volume":"166","author":"F Amini","year":"2021","unstructured":"Amini F, Hu G (2021) A two-layer feature selection method using Genetic Algorithm and Elastic Net. Expert Syst Appl 166:114072. https:\/\/doi.org\/10.1016\/j.eswa.2020.114072","journal-title":"Expert Syst Appl"},{"key":"452_CR28","doi-asserted-by":"publisher","DOI":"10.1145\/3340848","author":"Y Xue","year":"2019","unstructured":"Xue Y, Xue B, Zhang M (2019) Self-adaptive particle swarm optimization for large-scale feature selection in classification. ACM Trans Knowl Discov Data. https:\/\/doi.org\/10.1145\/3340848","journal-title":"ACM Trans Knowl Discov Data"},{"key":"452_CR29","doi-asserted-by":"crossref","unstructured":"Tran B, Xue B, Zhang M (2019) Adaptive multi-subswarm optimisation for feature selection on high-dimensional classification. In: Proceedings of the genetic and evolutionary computation conference. association for computing machinery, New York, NY, USA, pp 481\u2013489","DOI":"10.1145\/3321707.3321713"},{"key":"452_CR30","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2019.106031","volume":"88","author":"Y Xue","year":"2020","unstructured":"Xue Y, Tang T, Pang W, Liu AX (2020) Self-adaptive parameter and strategy based particle swarm optimization for large-scale feature selection problems with multiple classifiers. Appl Soft Comput 88:106031. https:\/\/doi.org\/10.1016\/j.asoc.2019.106031","journal-title":"Appl Soft Comput"},{"key":"452_CR31","doi-asserted-by":"publisher","DOI":"10.1007\/s12065-020-00441-5","author":"J Too","year":"2020","unstructured":"Too J, Abdullah AR (2020) Opposition based competitive grey wolf optimizer for EMG feature selection. Evol Intell. https:\/\/doi.org\/10.1007\/s12065-020-00441-5","journal-title":"Evol Intell"},{"key":"452_CR32","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.105746","volume":"195","author":"P Hu","year":"2020","unstructured":"Hu P, Pan J-S, Chu S-C (2020) Improved binary Grey Wolf optimizer and Its application for feature selection. Knowl-Based Syst 195:105746. https:\/\/doi.org\/10.1016\/j.knosys.2020.105746","journal-title":"Knowl-Based Syst"},{"key":"452_CR33","doi-asserted-by":"publisher","first-page":"12201","DOI":"10.1007\/s00521-019-04368-6","volume":"32","author":"H Chantar","year":"2020","unstructured":"Chantar H, Mafarja M, Alsawalqah H et al (2020) Feature selection using binary grey wolf optimizer with elite-based crossover for Arabic text classification. Neural Comput Appl 32:12201\u201312220. https:\/\/doi.org\/10.1007\/s00521-019-04368-6","journal-title":"Neural Comput Appl"},{"key":"452_CR34","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1016\/j.eswa.2018.07.022","volume":"113","author":"MA Al-Betar","year":"2018","unstructured":"Al-Betar MA, Awadallah MA, Faris H et al (2018) Natural selection methods for Grey Wolf Optimizer. Expert Syst Appl 113:481\u2013498. https:\/\/doi.org\/10.1016\/j.eswa.2018.07.022","journal-title":"Expert Syst Appl"},{"key":"452_CR35","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.ins.2014.08.039","volume":"291","author":"R Cheng","year":"2015","unstructured":"Cheng R, Jin Y (2015) A social learning particle swarm optimization algorithm for scalable optimization. Inf Sci 291:43\u201360. https:\/\/doi.org\/10.1016\/j.ins.2014.08.039","journal-title":"Inf Sci"},{"key":"452_CR36","doi-asserted-by":"crossref","unstructured":"M. Gutlein, E. Frank, M. Hall, A. Karwath (2009) Large-scale attribute selection using wrappers. In: 2009 IEEE symposium on computational intelligence and data mining, pp 332\u2013339","DOI":"10.1109\/CIDM.2009.4938668"},{"key":"452_CR37","unstructured":"Hall MA (2000) Correlation-based feature selection for discrete and numeric class machine learning. In: Proceedings of the seventeenth international conference on machine learning. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, pp 359\u2013366"},{"key":"452_CR38","doi-asserted-by":"publisher","first-page":"725","DOI":"10.1093\/bioinformatics\/18.5.725","volume":"18","author":"J Li","year":"2002","unstructured":"Li J, Wong L (2002) Identifying good diagnostic gene groups from gene expression profiles using the concept of emerging patterns. Bioinformatics 18:725\u2013734. https:\/\/doi.org\/10.1093\/bioinformatics\/18.5.725","journal-title":"Bioinformatics"},{"key":"452_CR39","doi-asserted-by":"publisher","first-page":"140","DOI":"10.1016\/j.eswa.2019.03.039","volume":"128","author":"K Chen","year":"2019","unstructured":"Chen K, Zhou F-Y, Yuan X-F (2019) Hybrid particle swarm optimization with spiral-shaped mechanism for feature selection. Expert Syst Appl 128:140\u2013156. https:\/\/doi.org\/10.1016\/j.eswa.2019.03.039","journal-title":"Expert Syst Appl"},{"key":"452_CR40","doi-asserted-by":"publisher","first-page":"179317","DOI":"10.1109\/ACCESS.2020.3028012","volume":"8","author":"E-SM El-Kenawy","year":"2020","unstructured":"El-Kenawy E-SM, Ibrahim A, Mirjalili S et al (2020) Novel feature selection and voting classifier algorithms for COVID-19 classification in CT images. IEEE Access 8:179317\u2013179335. https:\/\/doi.org\/10.1109\/ACCESS.2020.3028012","journal-title":"IEEE Access"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-021-00452-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-021-00452-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-021-00452-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,3]],"date-time":"2022-08-03T10:23:47Z","timestamp":1659522227000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-021-00452-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,30]]},"references-count":40,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,8]]}},"alternative-id":["452"],"URL":"https:\/\/doi.org\/10.1007\/s40747-021-00452-4","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"value":"2199-4536","type":"print"},{"value":"2198-6053","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,30]]},"assertion":[{"value":"28 December 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 June 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 July 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}}]}}