{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T13:34:54Z","timestamp":1777988094756,"version":"3.51.4"},"reference-count":43,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2022,10,31]],"date-time":"2022-10-31T00:00:00Z","timestamp":1667174400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"DFG\u2014Deutsche Forschungsgemeinschaft","award":["RTG 2543\/1"],"award-info":[{"award-number":["RTG 2543\/1"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>Selecting only the relevant subsets from all gathered data has never been as challenging as it is in these times of big data and sensor fusion. Multiple complementary methods have emerged for the observation of similar phenomena; oftentimes, many of these techniques are superimposed in order to make the best possible decisions. A pathologist, for example, uses microscopic and spectroscopic techniques to discriminate between healthy and cancerous tissue. Especially in the field of spectroscopy in medicine, an immense number of frequencies are recorded and appropriately sized datasets are rarely acquired due to the time-intensive measurements and the lack of patients. In order to cope with the curse of dimensionality in machine learning, it is necessary to reduce the overhead from irrelevant or redundant features. In this article, we propose a feature selection callback algorithm (FeaSel-Net) that can be embedded in deep neural networks. It recursively prunes the input nodes after the optimizer in the neural network achieves satisfying results. We demonstrate the performance of the feature selection algorithm on different publicly available datasets and compare it to existing feature selection methods. Our algorithm combines the advantages of neural networks\u2019 nonlinear learning ability and the embedding of the feature selection algorithm into the actual classifier optimization.<\/jats:p>","DOI":"10.3390\/make4040049","type":"journal-article","created":{"date-parts":[[2022,11,1]],"date-time":"2022-11-01T06:01:28Z","timestamp":1667282488000},"page":"968-993","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["FeaSel-Net: A Recursive Feature Selection Callback in Neural Networks"],"prefix":"10.3390","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5676-6871","authenticated-orcid":false,"given":"Felix","family":"Fischer","sequence":"first","affiliation":[{"name":"Institute of Applied Optics, University of Stuttgart, 70569 Stuttgart, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexander","family":"Birk","sequence":"additional","affiliation":[{"name":"Institute of Applied Optics, University of Stuttgart, 70569 Stuttgart, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Somers","sequence":"additional","affiliation":[{"name":"Institute for System Dynamics, University of Stuttgart, 70563 Stuttgart, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Karsten","family":"Frenner","sequence":"additional","affiliation":[{"name":"Institute of Applied Optics, University of Stuttgart, 70569 Stuttgart, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cristina","family":"Tar\u00edn","sequence":"additional","affiliation":[{"name":"Institute for System Dynamics, University of Stuttgart, 70563 Stuttgart, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5355-722X","authenticated-orcid":false,"given":"Alois","family":"Herkommer","sequence":"additional","affiliation":[{"name":"Institute of Applied Optics, University of Stuttgart, 70569 Stuttgart, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"6931789","DOI":"10.1155\/2016\/6931789","article-title":"Challenges and issues in multisensor fusion approach for fall detection: Review paper","volume":"2016","author":"Koshmak","year":"2016","journal-title":"J. Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1038\/nmeth.3968","article-title":"Model selection and overfitting","volume":"13","author":"Lever","year":"2016","journal-title":"Nat. Methods"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"758","DOI":"10.1007\/11494669_93","article-title":"The curse of dimensionality in data mining and time series prediction","volume":"Volume 3512","author":"Cabestany","year":"2005","journal-title":"Computational Intelligence and Bioinspired Systems"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1080\/14786440109462720","article-title":"LIII. On lines and planes of closest fit to systems of points in space","volume":"2","author":"Pearson","year":"1901","journal-title":"Lond. Edinb. Dublin Philos."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1037\/h0071325","article-title":"Analysis of a complex of statistical variables into principal components","volume":"24","author":"Hotelling","year":"1933","journal-title":"J. Educ. Psychol."},{"key":"ref_6","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Hinton","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_7","unstructured":"McInnes, L., Healy, J., and Melville, J. (2020). UMAP: Uniform manifold approximation and projection for dimension reduction. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Masci, J., Meier, U., Cire\u015fan, D., and Schmidhuber, J. (2011). Stacked convolutional auto-encoders for hierarchical feature extraction. International Conference on Artificial Neural Networks, Springer.","DOI":"10.1007\/978-3-642-21735-7_7"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neucom.2015.11.044","article-title":"Novel segmented stacked autoencoder for effective dimensionality reduction and feature extraction in hyperspectral imaging","volume":"185","author":"Zabalza","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2507","DOI":"10.1093\/bioinformatics\/btm344","article-title":"A review of feature selection techniques in bioinformatics","volume":"23","author":"Saeys","year":"2007","journal-title":"Bioinformatics"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"14797","DOI":"10.1109\/ACCESS.2017.2724555","article-title":"Optimal Feature Selection and Deep Learning Ensembles Method for Emotion Recognition From Human Brain EEG Sensors","volume":"5","author":"Du","year":"2017","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). XGBoost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"28936","DOI":"10.1109\/ACCESS.2018.2837654","article-title":"Integrating Feature Selection and Feature Extraction Methods With Deep Learning to Predict Clinical Outcome of Breast Cancer","volume":"6","author":"Zhang","year":"2018","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Figueroa Barraza, J., L\u00f3pez Droguett, E., and Martins, M.R. (2021). Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks. Sensors, 21.","DOI":"10.3390\/s21175888"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Liu, Z., Yu, Y., and Sun, Z. (2019, January 6\u20139). A hidden feature selection method based on l2,0-norm regularization for training single-hidden-layer Neural Networks. Proceedings of the 2019 IEEE Symposium Series on Computational Intelligence (SSCI), Xiamen, China.","DOI":"10.1109\/SSCI44817.2019.9002808"},{"key":"ref_17","unstructured":"Yamada, Y., Lindenbaum, O., Negahban, S., and Kluger, Y. (2020, January 13\u201318). Feature Selection using Stochastic Gates. Proceedings of the 37th International Conference on Machine Learning, Virtual."},{"key":"ref_18","unstructured":"Chang, C.H., Rampasek, L., and Goldenberg, A. (2017). Dropout feature ranking for deep learning models. arXiv."},{"key":"ref_19","unstructured":"Louizos, C., Welling, M., and Kingma, D.P. (2017). Learning sparse neural networks through l0 regularization. arXiv."},{"key":"ref_20","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1023\/A:1012487302797","article-title":"Gene selection for cancer classification using support vector machines","volume":"46","author":"Guyon","year":"2002","journal-title":"Mach. Learn."},{"key":"ref_22","unstructured":"Dua, D., and Graff, C. (2022, October 11). UCI Machine Learning Repository. University of California, Irvine, School of Information and Computer Sciences. Available online: http:\/\/archive.ics.uci.edu\/ml."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1517","DOI":"10.1109\/TIM.2004.834070","article-title":"PCA-based feature selection scheme for machine defect classification","volume":"53","author":"Malhi","year":"2004","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Song, F., Guo, Z., and Mei, D. (2010, January 12\u201314). Feature selection using principal component analysis. Proceedings of the 2010 International Conference on System Science, Engineering Design and Manufacturing Informatization, Yichang, China.","DOI":"10.1109\/ICSEM.2010.14"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3028","DOI":"10.1039\/C5AN00182J","article-title":"A novel method for the analysis of clinical biomarkers to investigate the effect of diet on health in a rat model","volume":"140","author":"Hopes","year":"2015","journal-title":"Analyst"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Han, H. (2010). Nonnegative principal component analysis for mass spectral serum profiles and biomarker discovery. BMC Bioinform., 11.","DOI":"10.1186\/1471-2105-11-S1-S1"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Tarpley, L., Duran, A.L., Kebrom, T.H., and Sumner, L.W. (2005). Biomarker metabolites capturing the metabolite variance present in a rice plant developmental period. BMC Plant Biol., 5.","DOI":"10.1186\/1471-2229-5-8"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"22445","DOI":"10.1073\/pnas.1906995116","article-title":"Data-driven discovery of coordinates and governing equations","volume":"116","author":"Champion","year":"2019","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1038\/323533a0","article-title":"Learning representations by back-propagating errors","volume":"323","author":"Rumelhart","year":"1986","journal-title":"Nature"},{"key":"ref_30","unstructured":"Kingma, D.P., and Ba, J.L. (2017). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1017\/jwe.2020.35","article-title":"Classification of wines using principal component analysis","volume":"16","author":"Barth","year":"2021","journal-title":"J. Wine Econ."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2818","DOI":"10.3390\/s120302818","article-title":"Pattern classification using an olfactory model with PCA feature selection in electronic noses: Study and application","volume":"12","author":"Fu","year":"2012","journal-title":"Sensors"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1165","DOI":"10.1007\/978-981-15-2780-7_120","article-title":"A deep neural network approach to predict the wine taste preferences","volume":"Volume 1125","author":"Solanki","year":"2020","journal-title":"Intelligent Computing in Engineering. Advances in Intelligent Systems and Computing"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"707","DOI":"10.1109\/TNB.2015.2477407","article-title":"A dimensionally reduced clustering methodology for heterogeneous occupational medicine data mining","volume":"14","author":"Bertrand","year":"2015","journal-title":"IEEE Trans. Nanobiosci."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Song, F., Mei, D., and Li, H. (2010, January 13\u201314). Feature selection based on linear discriminant analysis. Proceedings of the 2010 International Conference on Intelligent System Design and Engineering Application, Changsha, China.","DOI":"10.1109\/ISDEA.2010.311"},{"key":"ref_36","unstructured":"Glorot, X., and Bengio, Y. (2010, January 13\u201315). Understanding the difficulty of training deep feedforward neural networks. Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, Sardinia, Italy."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1111\/j.1469-1809.1936.tb02137.x","article-title":"The use of multiple measurements in taxonomix problems","volume":"7","author":"Fisher","year":"1936","journal-title":"Ann. Eugen."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Higuera, C., Gardiner, K.J., and Cios, K.J. (2015). Self-organizing feature maps identify proteins critical to learning in a mouse model of down syndrome. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0129126"},{"key":"ref_39","unstructured":"Guyon, I., Gunn, S., Ben-Hur, A., and Dror, G. (2004). Result analysis of the NIPS 2003 feature selection challenge. Advances in Neural Information Processing Systems 17 (NIPS 2004), MIT Press."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Becker, L., Fischer, F., Fleck, J.L., Harland, N., Herkommer, A., Stenzl, A., Aicher, W.K., Schenke-Layland, K., and Marzi, J. (2022). Data-Driven Identification of Biomarkers for In Situ Monitoring of Drug Treatment in Bladder Cancer Organoids. Int. J. Mol. Sci., 23.","DOI":"10.3390\/ijms23136956"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1038\/234034a0","article-title":"Distance between sets","volume":"234","author":"Levandowsky","year":"1971","journal-title":"Nature"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Thai-Nghe, N., Gantner, Z., and Schmidt-Thieme, L. (2010, January 18\u201323). Cost-sensitive learning methods for imbalanced data. Proceedings of the 2010 International Joint Conference on Neural Networks, Barcelona, Spain.","DOI":"10.1109\/IJCNN.2010.5596486"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Yan, Y., Chen, M., Shyu, M.L., and Chen, S.C. (2015, January 14\u201316). Deep learning for imbalanced multimedia data classification. Proceedings of the 2015 IEEE International Symposium on Multimedia (ISM), Miami, FL, USA.","DOI":"10.1109\/ISM.2015.126"}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/4\/4\/49\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:06:59Z","timestamp":1760144819000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/4\/4\/49"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,31]]},"references-count":43,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["make4040049"],"URL":"https:\/\/doi.org\/10.3390\/make4040049","relation":{"has-preprint":[{"id-type":"doi","id":"10.36227\/techrxiv.19803520","asserted-by":"object"},{"id-type":"doi","id":"10.36227\/techrxiv.19803520.v1","asserted-by":"object"}]},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,31]]}}}