{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T14:54:22Z","timestamp":1770044062331,"version":"3.49.0"},"reference-count":45,"publisher":"SAGE Publications","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IFS"],"published-print":{"date-parts":[[2021,12,16]]},"abstract":"<jats:p>It is easy to lead to poor generalization in machine learning tasks using real-world data directly, since such data is usually high-dimensional dimensionality and limited. Through learning the low dimensional representations of high-dimensional data, feature selection can retain useful features for machine learning tasks. Using these useful features effectively trains machine learning models. Hence, it is a challenge for feature selection from high-dimensional data. To address this issue, in this paper, a hybrid approach consisted of an autoencoder and Bayesian methods is proposed for a novel feature selection. Firstly, Bayesian methods are embedded in the proposed autoencoder as a special hidden layer. This of doing is to increase the precision during selecting non-redundant features. Then, the other hidden layers of the autoencoder are used for non-redundant feature selection. Finally, compared with the mainstream approaches for feature selection, the proposed method outperforms them. We find that the way consisted of autoencoders and probabilistic correction methods is more meaningful than that of stacking architectures or adding constraints to autoencoders as regards feature selection. We also demonstrate that stacked autoencoders are more suitable for large-scale feature selection, however, sparse autoencoders are beneficial for a smaller number of feature selection. We indicate that the value of the proposed method provides a theoretical reference to analyze the optimality of feature selection.<\/jats:p>","DOI":"10.3233\/jifs-211348","type":"journal-article","created":{"date-parts":[[2021,8,17]],"date-time":"2021-08-17T13:27:04Z","timestamp":1629206824000},"page":"7397-7406","source":"Crossref","is-referenced-by-count":0,"title":["Feature selection using autoencoders with Bayesian methods to high-dimensional data"],"prefix":"10.1177","volume":"41","author":[{"given":"Lei","family":"Shu","sequence":"first","affiliation":[{"name":"Chongqing Aerospace Polytechnic, Chongqing, China"}]},{"given":"Kun","family":"Huang","sequence":"additional","affiliation":[{"name":"Urban Vocational College of Sichuan, P.R. China"}]},{"given":"Wenhao","family":"Jiang","sequence":"additional","affiliation":[{"name":"Chongqing Aerospace Polytechnic, Chongqing, China"}]},{"given":"Wenming","family":"Wu","sequence":"additional","affiliation":[{"name":"Chongqing Aerospace Polytechnic, Chongqing, China"}]},{"given":"Hongling","family":"Liu","sequence":"additional","affiliation":[{"name":"Chongqing Aerospace Polytechnic, Chongqing, China"}]}],"member":"179","reference":[{"issue":"9","key":"10.3233\/JIFS-211348_ref1","doi-asserted-by":"crossref","first-page":"2508","DOI":"10.1109\/TKDE.2016.2563436","article-title":"Toward Optimal Feature Selection in Naive Bayes for Text Categorization [J]","volume":"28","author":"Tang","year":"2016","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"issue":"3","key":"10.3233\/JIFS-211348_ref2","doi-asserted-by":"crossref","first-page":"766","DOI":"10.1109\/TCYB.2015.2415032","article-title":"Adversarial Feature Selection against Evasion Attacks [J]","volume":"6","author":"Zhang","year":"2014","journal-title":"IEEE Transactions on Cybernetics"},{"issue":"4","key":"10.3233\/JIFS-211348_ref3","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1109\/TEVC.2015.2504420","article-title":"A Survey on Evolutionary Computation Approaches to Feature Selection [J]","volume":"20","author":"Xue","year":"2015","journal-title":"IEEE Transactions on Evolutionary Computation"},{"issue":"2","key":"10.3233\/JIFS-211348_ref4","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1109\/TCYB.2015.2404806","article-title":"Pa and N.R. A Multiobjective Genetic Programming-Based Ensemble for Simultaneous Feature Selection and Classification[J]","volume":"46","author":"Nag","year":"2015","journal-title":"IEEE Transactions on Cybernetics"},{"issue":"6","key":"10.3233\/JIFS-211348_ref5","first-page":"94","article-title":"Feature Selection: A Data Perspective [J]","volume":"50","author":"Li","year":"2016","journal-title":"ACM Computing Surveys"},{"key":"10.3233\/JIFS-211348_ref6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.patcog.2016.02.013","article-title":"Feature Selection in Mixed Data: A Method using a Novel Fuzzy Rough Set-Based Information Entropy [J],(1)","volume":"56","author":"Zhang","year":"2016","journal-title":"Pattern Recognition"},{"issue":"2","key":"10.3233\/JIFS-211348_ref7","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1109\/TNNLS.2014.2314123","article-title":"Semisupervised Feature Selection via Spline Regression for Video Semantic Recognition [J]","volume":"26","author":"Han","year":"2015","journal-title":"IEEE Transactions Neural Network. Learning System"},{"issue":"7","key":"10.3233\/JIFS-211348_ref8","doi-asserted-by":"crossref","first-page":"1388","DOI":"10.1109\/TNNLS.2014.2341627","article-title":"FREL: A Stable Feature Selection Algorithm [J]","volume":"26","author":"Li","year":"2015","journal-title":"IEEE Transactions Neural Network. Learning System"},{"issue":"4","key":"10.3233\/JIFS-211348_ref9","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1109\/TNNLS.2015.2424721","article-title":"Effective Discriminative Feature Selection With Nontrivial Solution [J]","volume":"27","author":"Tao","year":"2016","journal-title":"IEEE Transactions Neural Network Learning System"},{"issue":"4","key":"10.3233\/JIFS-211348_ref10","doi-asserted-by":"crossref","first-page":"944","DOI":"10.1109\/TNNLS.2017.2650978","article-title":"Adaptive Unsupervised Feature Selection With Structure Regularization [J]","volume":"29","author":"Luo","year":"2018","journal-title":"IEEE Transactions Neural Network. Learning System"},{"issue":"6","key":"10.3233\/JIFS-211348_ref11","doi-asserted-by":"crossref","first-page":"1217","DOI":"10.1109\/TPAMI.2015.2478471","article-title":"Local Feature Selection for Data Classification [J]","volume":"38","author":"Armanfard","year":"2016","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"7","key":"10.3233\/JIFS-211348_ref12","doi-asserted-by":"crossref","first-page":"1490","DOI":"10.1109\/TNNLS.2016.2551724","article-title":"Feature Selection Based on Structured Sparsity: A Comprehensive Study [J]","volume":"28","author":"Gui","year":"2017","journal-title":"IEEE Transactions Neural Network Learning System"},{"key":"10.3233\/JIFS-211348_ref13","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.ymeth.2016.08.014","article-title":"Feature selection methods for big data bioinformatics: A survey from the search perspective [J]","volume":"111","author":"Wang","year":"2016","journal-title":"Methods"},{"issue":"1","key":"10.3233\/JIFS-211348_ref14","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1109\/TNNLS.2014.2308902","article-title":"Feature Selection Using a Neural Framework With Controlled Redundancy [J]","volume":"26","author":"Chakraborty","year":"2015","journal-title":"IEEE Transactions Neural Network Learning System"},{"issue":"5","key":"10.3233\/JIFS-211348_ref15","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1109\/TCBB.2015.2478454","article-title":"Supervised, Unsupervised and Semi-supervised Feature Selection: A Review on Gene Selection [J]","volume":"13","author":"Chin","year":"2016","journal-title":"IEEE Transactions on Computational Biology and Bioinformatics"},{"issue":"4","key":"10.3233\/JIFS-211348_ref16","doi-asserted-by":"crossref","first-page":"1106","DOI":"10.1109\/TCBB.2012.33","article-title":"A survey on filter techniques for feature selection in gene expression microarray analysis [J]","volume":"9","author":"Lazar","year":"2012","journal-title":"IEEE-ACM Transactions on Computational Biology and Bioinformatics"},{"issue":"16-18","key":"10.3233\/JIFS-211348_ref17","doi-asserted-by":"crossref","first-page":"3273","DOI":"10.1016\/j.neucom.2010.04.003","article-title":"A new wrapper feature selection approach using neural network [J]","volume":"73","author":"Kabir","year":"2010","journal-title":"Neurocomputing"},{"issue":"2","key":"10.3233\/JIFS-211348_ref20","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1109\/TCYB.2015.2404806","article-title":"A Multiobjective Genetic Programming-Based Ensemble for Simultaneous Feature Selection and Classification [J]","volume":"46","author":"Nag","year":"2016","journal-title":"IEEE Transactions on Cybernetics"},{"issue":"8","key":"10.3233\/JIFS-211348_ref21","doi-asserted-by":"crossref","first-page":"1259","DOI":"10.1109\/TCYB.2013.2281820","article-title":"Feature Selection Inspired Classifier Ensemble Reduction[J]","volume":"44","author":"Diao","year":"2017","journal-title":"IEEE Transactions on Cybernetics"},{"key":"10.3233\/JIFS-211348_ref22","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.ins.2003.03.019","article-title":"Genetic Wrappers for Feature Selection in Decision Tree Induction and Variable Ordering in Bayesian Network Structure Learning [J]","volume":"163","author":"Hsu","year":"2004","journal-title":"Information Sciences"},{"key":"10.3233\/JIFS-211348_ref23","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1023\/A:1012487302797","article-title":"Gene Selection for Cancer Classification using Support Vector Machines [J]","volume":"46","author":"Guyon","year":"2002","journal-title":"Machine Learning"},{"key":"10.3233\/JIFS-211348_ref24","first-page":"27","article-title":"Conditional likelihood maximisation: A unifying framework for information theoretic feature selection [J]","volume":"13","author":"Brown","year":"2012","journal-title":"The Journal of Machine Learning Research"},{"issue":"9","key":"10.3233\/JIFS-211348_ref25","doi-asserted-by":"crossref","first-page":"11515","DOI":"10.1016\/j.eswa.2011.03.028","article-title":"Feature subset selection using differential evolution and a statistical repair mechanism [J]","volume":"38","author":"Khushaba","year":"2011","journal-title":"Expert Systems with Applications"},{"issue":"1","key":"10.3233\/JIFS-211348_ref26","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1109\/TNNLS.2014.2308902","article-title":"Feature Selection Using a Neural Framework With Controlled Redundancy [J]","volume":"26","author":"Chakraborty","year":"2015","journal-title":"IEEE Transactions Neural Networks Learning System"},{"issue":"6","key":"10.3233\/JIFS-211348_ref27","doi-asserted-by":"crossref","first-page":"1386","DOI":"10.1109\/TNNLS.2016.2542866","article-title":"Design and Application of a Variable Selection Method for Multilayer Perceptron Neural Network With LASSO [J]","volume":"28","author":"Sun","year":"2017","journal-title":"IEEE Transactions Neural Networks Learning System"},{"key":"10.3233\/JIFS-211348_ref28","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1016\/j.ins.2016.11.020","article-title":"Convergence analyses on sparse feedforward neural networks via group lasso regularization [J]","volume":"381","author":"Wang","year":"2017","journal-title":"Information Sciences"},{"issue":"5","key":"10.3233\/JIFS-211348_ref29","doi-asserted-by":"crossref","first-page":"2012","DOI":"10.1109\/TNNLS.2017.2748585","article-title":"A Novel Pruning Algorithm for Smoothing Feedforward Neural Networks Based on Group Lasso Method [J]","volume":"29","author":"Wang","year":"2018","journal-title":"IEEE Transactions Neural Networks Learning System"},{"key":"10.3233\/JIFS-211348_ref30","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.neucom.2017.02.029","article-title":"Group sparse regularization for deep neural networks [J]","volume":"241","author":"Scardapane","year":"2017","journal-title":"Neurocomputing"},{"issue":"8","key":"10.3233\/JIFS-211348_ref32","doi-asserted-by":"crossref","first-page":"1798","DOI":"10.1109\/TPAMI.2013.50","article-title":"Representation learning:A review and new perspectives [J]","volume":"35","author":"Bengio","year":"2013","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"10.3233\/JIFS-211348_ref33","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.patcog.2016.03.028","article-title":"High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning [J]","volume":"58","author":"Sarah","year":"2016","journal-title":"Pattern Recognition"},{"key":"10.3233\/JIFS-211348_ref34","doi-asserted-by":"crossref","first-page":"1936","DOI":"10.1109\/TMM.2015.2477058","article-title":"Heterogeneous Feature Selection with Multi-Modal Deep Neural Networks and Sparse Group Lasso [J]","volume":"17","author":"Zhao","year":"2015","journal-title":"IEEE Transactions on Multimedia"},{"issue":"5","key":"10.3233\/JIFS-211348_ref38","doi-asserted-by":"crossref","first-page":"1827","DOI":"10.1016\/j.patcog.2014.10.021","article-title":"Sparse discriminative feature selection [J]","volume":"48","author":"Yan","year":"2015","journal-title":"Pattern Recognition"},{"issue":"3","key":"10.3233\/JIFS-211348_ref39","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1016\/j.patcog.2014.09.010","article-title":"Deep sparse feature selection for computer aided endoscopy diagnosis [J]","volume":"48","author":"Cong","year":"2015","journal-title":"Pattern Recognition"},{"key":"10.3233\/JIFS-211348_ref40","doi-asserted-by":"crossref","first-page":"1930","DOI":"10.1109\/TPAMI.2012.277","article-title":"Stacked autoencoders for unsupervised feature learning and multiple organ detection in a pilot study using 4D patient data [J]","volume":"35","author":"Shin","year":"2013","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"6","key":"10.3233\/JIFS-211348_ref42","doi-asserted-by":"crossref","first-page":"1602","DOI":"10.1109\/TKDE.2016.2522427","article-title":"A Bayesian Classification Approach Using Class-Specific Features for Text Categorization [J]","volume":"28","author":"Tang","year":"2016","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"issue":"6","key":"10.3233\/JIFS-211348_ref43","doi-asserted-by":"crossref","first-page":"1327","DOI":"10.1109\/TCBB.2016.2570216","article-title":"Improving Biochemical Named Entity Recognition Using PSO Classifier Selection and Bayesian Combination Methods [J]","volume":"14","author":"Akkasi","year":"2017","journal-title":"IEEE\/ACM Transactions on Computational Biology and Bioinformatics"},{"issue":"2","key":"10.3233\/JIFS-211348_ref44","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1109\/TCBB.2015.2440244","article-title":"Bayesian Multiresolution Variable Selection for Ultra-High Dimensional Neuroimaging Data [J]","volume":"15","author":"Zhao","year":"2018","journal-title":"IEEE\/ACM Transactions on Computational Biology and Bioinformatics"},{"issue":"9","key":"10.3233\/JIFS-211348_ref47","doi-asserted-by":"crossref","first-page":"767","DOI":"10.1111\/j.1467-9280.2006.01780.x","article-title":"Optimal predictions in everyday cognition [J]","volume":"17","author":"Griffiths","year":"2006","journal-title":"Psychological science"},{"issue":"3","key":"10.3233\/JIFS-211348_ref48","first-page":"303","article-title":"Children\u2019s causal inferences from indirect evidence: Backwards blocking and bayesian reasoning in preschoolers [J]","volume":"28","author":"Sobel","year":"2004","journal-title":"Cognitive science"},{"issue":"3","key":"10.3233\/JIFS-211348_ref49","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1207\/s15516709cog2703_6","article-title":"Inferring causal networks from observations and interventions [J]","volume":"27","author":"Steyvers","year":"2003","journal-title":"Cognitive Science"},{"issue":"7","key":"10.3233\/JIFS-211348_ref50","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/j.tics.2006.05.009","article-title":"Theory-based bayesian models of inductive learning and reasoning [J]","volume":"10","author":"Tenenbaum","year":"2006","journal-title":"Trends in Cognitive Sciences"},{"issue":"2","key":"10.3233\/JIFS-211348_ref52","doi-asserted-by":"crossref","first-page":"145","DOI":"10.2307\/2981918","article-title":"Comparison of discriminant techniques applied to a complex data set of head injured patients [J]","volume":"144","author":"Titterington","year":"1981","journal-title":"J. Royal Statistical Society"},{"key":"10.3233\/JIFS-211348_ref53","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning [J]","volume":"521","author":"Le Cun,","year":"2015","journal-title":"Nature"},{"key":"10.3233\/JIFS-211348_ref54","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-018-07210-0","article-title":"Deep learning for universal linear embeddings of nonlinear dynamics [J]","volume":"9","author":"Lusch","year":"2018","journal-title":"Nature Communications"},{"key":"10.3233\/JIFS-211348_ref55","doi-asserted-by":"crossref","first-page":"604","DOI":"10.1038\/nature25978","article-title":"Planning chemical syntheses with deep neural networks and symbolic AI [J]","volume":"555","author":"Segler","year":"2018","journal-title":"Nature"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/JIFS-211348","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T03:17:17Z","timestamp":1770002237000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/JIFS-211348"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,16]]},"references-count":45,"journal-issue":{"issue":"6"},"URL":"https:\/\/doi.org\/10.3233\/jifs-211348","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,16]]}}}