{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T06:55:30Z","timestamp":1777704930924,"version":"3.51.4"},"reference-count":54,"publisher":"SAGE Publications","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IFS"],"published-print":{"date-parts":[[2021,8,11]]},"abstract":"<jats:p>Feature selection (FS) is a vital data preprocessing task which aims at selecting a small subset of features while maintaining a high level of classification accuracy. FS is a challenging optimization problem due to the large search space and the existence of local optimal solutions. Particle swarm optimization (PSO) is a promising technique in selecting optimal feature subset due to its rapid convergence speed and global search ability. But PSO suffers from stagnation or premature convergence in complex FS problems. In this paper, a novel three layer PSO (TLPSO) is proposed for solving FS problem. In the TLPSO, the particles in the swarm are divided into three layers according to their evolution status and particles in different layers are treated differently to fully investigate their potential. Instead of learning from those historical best positions, the TLPSO uses a random learning exemplar selection strategy to enrich the searching behavior of the swarm and enhance the population diversity. Further, a local search operator based on the Gaussian distribution is performed on the elite particles to improve the exploitation ability. Therefore, TLPSO is able to keep a balance between population diversity and convergence speed. Extensive comparisons with seven state-of-the-art meta-heuristic based FS methods are conducted on 18 datasets. The experimental results demonstrate the competitive and reliable performance of TLPSO in terms of improving the classification accuracy and reducing the number of features.<\/jats:p>","DOI":"10.3233\/jifs-202647","type":"journal-article","created":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T12:39:45Z","timestamp":1614947985000},"page":"2469-2483","source":"Crossref","is-referenced-by-count":4,"title":["A novel three layer particle swarm optimization for feature selection"],"prefix":"10.1177","volume":"41","author":[{"given":"Chenye","family":"Qiu","sequence":"first","affiliation":[{"name":"School of Internet of Things, Nanjing University of Posts and Telecommunications, Nanjing, Jiangsu, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ning","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Internet of Things, Nanjing University of Posts and Telecommunications, Nanjing, Jiangsu, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"issue":"3","key":"10.3233\/JIFS-202647_ref1","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1007\/s10115-017-1059-8","article-title":"Recent advances in feature selection and its applications","volume":"53","author":"Li","year":"2017","journal-title":"Knowledge and Information Systems"},{"issue":"3","key":"10.3233\/JIFS-202647_ref2","doi-asserted-by":"crossref","first-page":"131","DOI":"10.3233\/IDA-1997-1302","article-title":"Feature selection for classification","volume":"1","author":"Dash","year":"1997","journal-title":"Intelligent Data Analysis"},{"issue":"4","key":"10.3233\/JIFS-202647_ref3","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1109\/TKDE.2005.66","article-title":"Toward integrating feature selection algorithms for classification and clustering","volume":"17","author":"Liu","year":"2005","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"issue":"4","key":"10.3233\/JIFS-202647_ref4","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1109\/TEVC.2015.2504420","article-title":"A survey on evolutionary computation approaches to feature selection","volume":"20","author":"Xue","year":"2016","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"10.3233\/JIFS-202647_ref5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.patrec.2017.03.018","article-title":"A new feature selection method based on a validity index of feature subset","volume":"92","author":"Liu","year":"2017","journal-title":"Pattern Recognition Letters"},{"key":"10.3233\/JIFS-202647_ref6","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.patcog.2017.01.026","article-title":"A new maximum relevance-minimum multi-collinearity method for feature selection and ranking","volume":"67","author":"Senawi","year":"2017","journal-title":"Pattern Recognition"},{"issue":"8","key":"10.3233\/JIFS-202647_ref7","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1109\/TPAMI.2005.159","article-title":"Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy","volume":"27","author":"Peng","year":"2005","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"10.3233\/JIFS-202647_ref8","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/j.patcog.2016.11.003","article-title":"A survey on semi-supervised feature selection methods","volume":"64","author":"Sheikhpour","year":"2017","journal-title":"Pattern Recognition"},{"issue":"17","key":"10.3233\/JIFS-202647_ref9","doi-asserted-by":"crossref","first-page":"2914","DOI":"10.1016\/j.neucom.2011.03.034","article-title":"A new local search based hybrid genetic algorithm for feature selection","volume":"74","author":"Kabir","year":"2011","journal-title":"Neurocomputing"},{"issue":"13","key":"10.3233\/JIFS-202647_ref10","doi-asserted-by":"crossref","first-page":"1825","DOI":"10.1016\/j.patrec.2007.05.011","article-title":"A hybrid genetic algorithm for feature selection wrapper based on mutual information","volume":"28","author":"Huang","year":"2007","journal-title":"Pattern Recognition Letters"},{"issue":"3","key":"10.3233\/JIFS-202647_ref11","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1109\/TEVC.2018.2869405","article-title":"Variable-length particle swarm optimization for feature selection on high-dimensional classification","volume":"23","author":"Tran","year":"2019","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"10.3233\/JIFS-202647_ref12","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/j.neucom.2014.06.067","article-title":"An advanced aco algorithm for feature subset selection","volume":"147","author":"Kashef","year":"2015","journal-title":"Neurocomputing"},{"issue":"3","key":"10.3233\/JIFS-202647_ref13","first-page":"1","article-title":"A hybrid two-stage feature selection method based on differential evolution","volume":"39","author":"Qiu","journal-title":"Journal of Intelligent & Fuzzy System"},{"key":"10.3233\/JIFS-202647_ref14","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1016\/j.asoc.2015.07.023","article-title":"A binary abc algorithm based on advanced similarity scheme for feature selection","volume":"36","author":"Hancer","year":"2015","journal-title":"Applied Soft Computing"},{"key":"10.3233\/JIFS-202647_ref17","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1016\/j.compind.2018.03.035","article-title":"ABC algorithm based optimization of 1-D hidden Markov model for hand gesture recognition applications","volume":"99","author":"Sagayam","year":"2018","journal-title":"Computers in Industry"},{"issue":"7","key":"10.3233\/JIFS-202647_ref19","first-page":"1571","article-title":"A Modified Approach for Face Recognition using PSO and ABC Optimization","volume":"8","author":"Subramaniyam","year":"2019","journal-title":"International Journal of Innovative Technology and Exploring Engineering"},{"key":"10.3233\/JIFS-202647_ref20","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1016\/j.ins.2016.04.050","article-title":"Topology selection for particle swarm optimization","volume":"363","author":"Liu","year":"2016","journal-title":"Information Sciences"},{"key":"10.3233\/JIFS-202647_ref21","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1016\/j.ins.2014.10.042","article-title":"Metaheuristics in large-scale global continues optimization: A survey","volume":"295","author":"Mahdavi","year":"2015","journal-title":"Information Sciences"},{"issue":"3","key":"10.3233\/JIFS-202647_ref22","first-page":"636","article-title":"Multimodal estimation of distribution algorithms","volume":"47","author":"Yang","year":"2017","journal-title":"IEEE Transactions on Systems Man and Cybernetics"},{"issue":"4","key":"10.3233\/JIFS-202647_ref23","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1109\/TEVC.2017.2743016","article-title":"A level-based learning swarm optimizer for large-scale optimization","volume":"22","author":"Yang","year":"2018","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"10.3233\/JIFS-202647_ref24","first-page":"1942","article-title":"Particle swarm optimization","volume":"4","author":"Kennedy","year":"1995","journal-title":"In: Proceedings of ICNN\u201995 - International Conference on Neural Networks"},{"key":"10.3233\/JIFS-202647_ref25","first-page":"315","article-title":"Genetic algorithm with fuzzy fitness function for feature selection","volume":"1","author":"Chakraborty","year":"2002","journal-title":"In: IEEE International Symposium on Industrial Electronics"},{"key":"10.3233\/JIFS-202647_ref26","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1016\/j.asoc.2017.04.042","article-title":"A tribe competition-based genetic algorithm for feature selection in pattern classification","volume":"58","author":"Ma","year":"2017","journal-title":"Applied Soft Computing"},{"key":"10.3233\/JIFS-202647_ref27","doi-asserted-by":"crossref","first-page":"24109","DOI":"10.1109\/ACCESS.2019.2900078","article-title":"Binary differential evolution based on individual entropy for feature subset optimization","volume":"7","author":"Li","year":"2019","journal-title":"IEEE Access"},{"key":"10.3233\/JIFS-202647_ref28","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.eswa.2016.06.004","article-title":"hybrid approach of differential evolution and artificial bee colony for feature selection","volume":"62","author":"Zorarpaci","year":"2016","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/JIFS-202647_ref29","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1016\/j.asoc.2016.08.011","article-title":"A feature selection method based on modified binary coded ant colony optimization algorithm","volume":"49","author":"Wan","year":"2016","journal-title":"Applied Soft Computing"},{"key":"10.3233\/JIFS-202647_ref30","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.swevo.2017.04.002","article-title":"A hybrid algorithm using ant and bee colony optimization for feature selection and classification (ac-abc hybrid)","volume":"36","author":"Shunmugapriya","year":"2017","journal-title":"Swarm and Evolutionary Computation"},{"issue":"8","key":"10.3233\/JIFS-202647_ref31","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1016\/j.neucom.2015.06.083","article-title":"Binary grey wolf optimization approaches for feature selection","volume":"172","author":"Emary","year":"2016","journal-title":"Neurocomputing"},{"key":"10.3233\/JIFS-202647_ref32","doi-asserted-by":"crossref","first-page":"112824","DOI":"10.1016\/j.eswa.2019.112824","article-title":"A new fusion of grey wolf optimizer algorithm with a two-phase mutation for feature selection","volume":"139","author":"Abdel-Basset","year":"2019","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/JIFS-202647_ref33","doi-asserted-by":"crossref","first-page":"105866","DOI":"10.1016\/j.asoc.2019.105866","article-title":"New feature selection methods based on opposition-based learning and self-adaptive cohort intelligence for predicting patient no-shows","volume":"86","author":"Aladeemy","year":"2020","journal-title":"Applied Soft Computing"},{"key":"10.3233\/JIFS-202647_ref34","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.knosys.2018.05.009","article-title":"An efficient binary salp swarm algorithm with crossover scheme for feature selection problems","volume":"154","author":"Faris","year":"2018","journal-title":"Knowledge Based Systems"},{"issue":"1","key":"10.3233\/JIFS-202647_ref35","doi-asserted-by":"crossref","first-page":"6779","DOI":"10.1504\/IJMHEUR.2018.091880","article-title":"Binary whale optimisation: an effective swarm algorithm for feature selection","volume":"7","author":"Eid","year":"2018","journal-title":"International Journal of Metaheuristics"},{"issue":"10","key":"10.3233\/JIFS-202647_ref36","doi-asserted-by":"crossref","first-page":"1821","DOI":"10.3390\/math8101821","article-title":"Binary Whale Optimization Algorithm for Dimensionality Reduction","volume":"8","author":"Hussien","year":"2020","journal-title":"Mathematics"},{"issue":"10","key":"10.3233\/JIFS-202647_ref37","doi-asserted-by":"crossref","first-page":"3462","DOI":"10.1007\/s10489-018-1158-6","article-title":"A novel chaotic salp swarm algorithm for global optimization and feature selection","volume":"48","author":"Sayed","year":"2018","journal-title":"Applied Intelligence"},{"key":"10.3233\/JIFS-202647_ref38","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1016\/j.eswa.2018.09.015","article-title":"Binary grasshopper optimisation algorithm approaches for feature selection problems","volume":"117","author":"Mafarja","year":"2019","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/JIFS-202647_ref39","doi-asserted-by":"crossref","first-page":"147160","DOI":"10.1016\/j.eswa.2018.08.051","article-title":"Binary butterfly optimization approaches for feature selection","volume":"116","author":"Arora","year":"2019","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/JIFS-202647_ref40","doi-asserted-by":"crossref","first-page":"100663","DOI":"10.1016\/j.swevo.2020.100663","article-title":"A survey on swarm intelligence approaches to feature selection in data mining","volume":"54","author":"Nguyen","year":"2020","journal-title":"Swarm and Evolutionary Computation"},{"issue":"10","key":"10.3233\/JIFS-202647_ref41","doi-asserted-by":"crossref","first-page":"12699","DOI":"10.1016\/j.eswa.2011.04.057","article-title":"Improved binary particle swarm optimization using catfish effect for feature selection","volume":"38","author":"Chuang","year":"2011","journal-title":"Expert Systems with Applications"},{"issue":"8","key":"10.3233\/JIFS-202647_ref42","doi-asserted-by":"crossref","first-page":"3494","DOI":"10.1016\/j.asoc.2013.03.021","article-title":"Modified binary pso for feature selection using svm applied to mortality prediction of septic patients","volume":"13","author":"Vieira","year":"2013","journal-title":"Applied Soft Computing"},{"key":"10.3233\/JIFS-202647_ref43","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/j.asoc.2013.09.018","article-title":"Particle swarm optimisation for feature selection in classification: Novel initialisation and updating mechanisms","volume":"18","author":"Xue","year":"2014","journal-title":"Applied Soft Computing"},{"key":"10.3233\/JIFS-202647_ref44","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.asoc.2016.01.044","article-title":"A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy","volume":"43","author":"Moradi","year":"2016","journal-title":"Applied Soft Computing"},{"issue":"6","key":"10.3233\/JIFS-202647_ref46","doi-asserted-by":"crossref","first-page":"1496","DOI":"10.1109\/TCYB.2016.2549639","article-title":"A micro-ga embedded pso feature selection approach to intelligent facial emotion recognition","volume":"47","author":"Mistry","year":"2017","journal-title":"Transactions on Cybernetics"},{"issue":"6","key":"10.3233\/JIFS-202647_ref47","first-page":"1733","article-title":"A new representation in pso for discretization-based feature selection","volume":"48","author":"Tran","year":"2018","journal-title":"and Cybernetics"},{"key":"10.3233\/JIFS-202647_ref48","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1016\/j.engappai.2019.06.008","article-title":"Set based particle swarm optimization for the feature selection problem","volume":"85","author":"Engelbrecht","year":"2019","journal-title":"Engineering Applications of Artificial Intelligence"},{"issue":"4","key":"10.3233\/JIFS-202647_ref49","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1007\/s10710-019-09358-0","article-title":"A novel multi-swarm particle swarm optimization for feature selection","volume":"20","author":"Qiu","year":"2019","journal-title":"Genetic Programming and Evolvable Machines"},{"key":"10.3233\/JIFS-202647_ref50","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1016\/j.neucom.2015.06.068","article-title":"Feature selection using multimodal optimization techniques","volume":"171","author":"Kamyab","year":"2016","journal-title":"Neurocomputing"},{"issue":"4","key":"10.3233\/JIFS-202647_ref52","doi-asserted-by":"crossref","first-page":"518","DOI":"10.1109\/TEVC.2016.2638437","article-title":"Seeking multiple solutions: An updated survey on niching methods and their applications","volume":"21","author":"Li","year":"2017","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"10.3233\/JIFS-202647_ref53","doi-asserted-by":"crossref","first-page":"832","DOI":"10.1016\/j.asoc.2017.08.051","article-title":"A novel multi-swarm particle swarm optimization with dynamic learning strategy","volume":"61","author":"Ye","year":"2017","journal-title":"Applied Soft Computing"},{"issue":"3","key":"10.3233\/JIFS-202647_ref54","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1080\/00031305.1992.10475879","article-title":"An introduction to kernel and nearest-neighbor nonparametric regression","volume":"46","author":"Altman","year":"1992","journal-title":"The American Statistician"},{"key":"10.3233\/JIFS-202647_ref55","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.ins.2014.08.039","article-title":"A social learning particle swarm optimization algorithm for scalable optimization","volume":"291","author":"Cheng","year":"2015","journal-title":"Information Sciences"},{"issue":"2","key":"10.3233\/JIFS-202647_ref56","first-page":"191","article-title":"A competitive swarm optimizer for large scale optimization","volume":"45","author":"Cheng","year":"2015","journal-title":"IEEE Transactions on Systems Man and Cybernetics"},{"key":"10.3233\/JIFS-202647_ref57","doi-asserted-by":"crossref","first-page":"4104","DOI":"10.1109\/ICSMC.1997.637339","article-title":"A discrete binary version of the particle swarm algorithm","volume":"5","author":"Kennedy","year":"1997","journal-title":"1997 IEEE International Conference on Systems Man and Cybernetics"},{"issue":"12","key":"10.3233\/JIFS-202647_ref58","doi-asserted-by":"crossref","first-page":"1482","DOI":"10.4249\/scholarpedia.1482","article-title":"Genetic algorithms","volume":"7","author":"Holland","year":"2012","journal-title":"Scholarpedia"},{"key":"10.3233\/JIFS-202647_ref59","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1016\/j.asoc.2017.11.006","article-title":"Whale optimization approaches for wrapper feature selection","volume":"62","author":"Mafarja","year":"2018","journal-title":"Applied Soft Computing"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/JIFS-202647","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:42:26Z","timestamp":1777455746000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/JIFS-202647"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,11]]},"references-count":54,"journal-issue":{"issue":"1"},"URL":"https:\/\/doi.org\/10.3233\/jifs-202647","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,11]]}}}