{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T16:57:35Z","timestamp":1783529855585,"version":"3.55.0"},"reference-count":58,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,2,7]],"date-time":"2023-02-07T00:00:00Z","timestamp":1675728000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012550","name":"National Research, Development and Innovation Fund","doi-asserted-by":"publisher","award":["KDP-2021"],"award-info":[{"award-number":["KDP-2021"]}],"id":[{"id":"10.13039\/501100012550","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Driver fatigue reduces the safety of traditional driving and limits the widespread adoption of self-driving cars; hence, the monitoring and early detection of drivers\u2019 drowsiness plays a key role in driving automation. When representing the drowsiness indicators as large feature vectors, fitting a machine learning model to the problem becomes challenging, and the problem\u2019s perspicuity decreases, making dimensionality reduction crucial in practice. For this reason, we propose an embedded feature selection algorithm that can be later utilized as a building block in the system development of a neural network-based drowsiness detector. We have adopted a technique: a so-called Feature Prune Layer is placed in front of the first layer in the architecture; as a result, its weights change regarding the importance of the corresponding input features and are deleted iteratively until the desired number is reached. We test the algorithm on EEG data, as it is one of the best indicators of drowsiness based on the literature. The proposed FS algorithm is able to reduce the original feature set by 95% with only 1% degradation in precision, while the precision increases by 1.5% and 2.7% respectively when selecting the top 10% and top 20% of the initial features. Moreover, the proposed method outperforms the widely popular Principal Component Analysis and the Chi-squared test when reducing the original feature set by 95%: it achieves 24.3% and 3.2% higher precision respectively.<\/jats:p>","DOI":"10.3390\/s23041874","type":"journal-article","created":{"date-parts":[[2023,2,8]],"date-time":"2023-02-08T02:04:16Z","timestamp":1675821856000},"page":"1874","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Designing an Embedded Feature Selection Algorithm for a Drowsiness Detector Model Based on Electroencephalogram Data"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0777-6509","authenticated-orcid":false,"given":"Blanka","family":"Bencsik","sequence":"first","affiliation":[{"name":"Department of Control Engineering and Information Technology, Budapest University of Technology and Economics, Magyar Tud\u00f3sok K\u00f6r\u00fatja 2, 1117 Budapest, Hungary"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4670-2406","authenticated-orcid":false,"given":"Istv\u00e1n","family":"Rem\u00e9nyi","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Faculty of Informatics, ELTE E\u00f6tv\u00f6s Lor\u00e1nd University, P\u00e1zm\u00e1ny P\u00e9ter S\u00e9t\u00e1ny 1\/A, 1117 Budapest, Hungary"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1397-6080","authenticated-orcid":false,"given":"M\u00e1rton","family":"Szemenyei","sequence":"additional","affiliation":[{"name":"Department of Control Engineering and Information Technology, Budapest University of Technology and Economics, Magyar Tud\u00f3sok K\u00f6r\u00fatja 2, 1117 Budapest, Hungary"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7838-6148","authenticated-orcid":false,"given":"J\u00e1nos","family":"Botzheim","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Faculty of Informatics, ELTE E\u00f6tv\u00f6s Lor\u00e1nd University, P\u00e1zm\u00e1ny P\u00e9ter S\u00e9t\u00e1ny 1\/A, 1117 Budapest, Hungary"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"6652","DOI":"10.1016\/j.promfg.2015.11.005","article-title":"The Interaction Between Highly Automated Driving and the Development of Drowsiness","volume":"3","author":"Hargutt","year":"2015","journal-title":"Procedia Manuf."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Li, G., and Chung, W.Y. (2022). Electroencephalogram-Based Approaches for Driver Drowsiness Detection and Management: A Review. Sensors, 22.","DOI":"10.3390\/s22031100"},{"key":"ref_3","first-page":"641","article-title":"The Effect of Different Dimensionality Reduction Techniques on Machine Learning Overfitting Problem","volume":"12","author":"Salam","year":"2021","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1080\/00949658208810560","article-title":"Algorithmic complexity: Three NP- hard problems in computational statistics","volume":"15","author":"Welch","year":"1982","journal-title":"J. Stat. Comput. Simul."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1109\/TBME.2010.2077291","article-title":"Driver Drowsiness Classification Using Fuzzy Wavelet-Packet-Based Feature-Extraction Algorithm","volume":"58","author":"Khushaba","year":"2011","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"61904","DOI":"10.1109\/ACCESS.2019.2914373","article-title":"A Survey on State-of-the-Art Drowsiness Detection Techniques","volume":"7","author":"Ramzan","year":"2019","journal-title":"IEEE Access"},{"key":"ref_7","unstructured":"Brown, T., Lee, J., Schwarz, C., Fiorentino, D., and Mcdonald, A. (2014). Assessing the Feasibility of Vehicle-Based Sensors to Detect Drowsy Driving, National Advanced Driving Simulator, The University of Iowa."},{"key":"ref_8","first-page":"1730","article-title":"Subject independent emotion recognition from EEG using VMD and deep learning","volume":"34","author":"Pandey","year":"2022","journal-title":"J. King Saud Univ.-Comput. Inf. Sci."},{"key":"ref_9","unstructured":"Kaplan, P.W., Benbadis, S.R., Husain, A.M., and Tatum, W.O. (2007). Handbook of EEG Interpretation, Springer."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Soufineyestani, M., Dowling, D., and Khan, A. (2020). Electroencephalography (EEG) Technology Applications and Available Devices. Appl. Sci., 10.","DOI":"10.3390\/app10217453"},{"key":"ref_11","first-page":"3","article-title":"The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology","volume":"52","author":"Klem","year":"1999","journal-title":"Electroencephalogr. Clin. Neurophysiol. Suppl."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Yeom, S., Fazli, S., M\u00fcller, K., and Lee, S. (2014). An Efficient ERP-Based Brain-Computer Interface Using Random Set Presentation and Face Familiarity. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0111157"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Stancin, I., Cifrek, M., and Jovi\u0107, A. (2021). A Review of EEG Signal Features and Their Application in Driver Drowsiness Detection Systems. Sensors, 21.","DOI":"10.3390\/s21113786"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"113331","DOI":"10.1016\/j.eswa.2020.113331","article-title":"Multitaper-based method for automatic k-complex detection in human sleep EEG","volume":"151","author":"Oliveira","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1109\/TAU.1967.1161901","article-title":"The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms","volume":"15","author":"Welch","year":"1967","journal-title":"IEEE Trans. Audio Electroacoust."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/S0165-0270(02)00340-0","article-title":"Analysis of EEG records in an epileptic patient using wavelet transform","volume":"123","author":"Adeli","year":"2003","journal-title":"J. Neurosci. Methods"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1016\/S0013-4694(98)00024-8","article-title":"Time\u2013frequency analysis using the matching pursuit algorithm applied to seizures originating from the mesial temporal lobe","volume":"106","author":"Franaszczuk","year":"1998","journal-title":"Electroencephalogr. Clin. Neurophysiol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.eswa.2018.07.054","article-title":"Automatic driver sleepiness detection using EEG, EOG and contextual information","volume":"115","author":"Barua","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1109\/TITS.2018.2814207","article-title":"Driver Sleepiness Classification Based on Physiological Data and Driving Performance From Real Road Driving","volume":"20","author":"Keelan","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hastie, T.J., Tibshirani, R., and Friedman, J.H. (2001). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer. [2nd ed.].","DOI":"10.1007\/978-0-387-21606-5"},{"key":"ref_21","first-page":"1","article-title":"Feature Selection: A Data Perspective","volume":"50","author":"Li","year":"2017","journal-title":"ACM Comput. Surv."},{"key":"ref_22","unstructured":"Witten, I.H., Frank, E., and Hall, M.A. (2011). Data Mining: Practical Machine Learning Tools and Techniques, Morgan Kaufmann. [3rd ed.]."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liu, H., and Motoda, H. (1998). Feature Selection for Knowledge Discovery and Data Mining, Springer.","DOI":"10.1007\/978-1-4615-5689-3"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Liu, H., and Motoda, H. (2008). Computational Methods of Feature Selection, CRC Press.","DOI":"10.1201\/9781584888796"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10489-021-02550-9","article-title":"A comprehensive survey on feature selection in the various fields of machine learning","volume":"52","author":"Dhal","year":"2022","journal-title":"Appl. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Islam, D.M.R., Rahim, M., Islam, M.R., and Shin, J. (2019). Genetic Algorithm Based Optimal Feature Selection Extracted by Time-Frequency Analysis for Enhanced Sleep Disorder Diagnosis Using EEG Signal, Springer International Publishing.","DOI":"10.1007\/978-3-030-29513-4_65"},{"key":"ref_27","unstructured":"Masaeli, M., Fung, G., and Dy, J.G. (2010, January 21\u201324). From Transformation-Based Dimensionality Reduction to Feature Selection. Proceedings of the 27th International Conference on International Conference on Machine Learning, ICML\u201910, Haifa, Israel."},{"key":"ref_28","unstructured":"Gu, Q., Li, Z., and Han, J. (2011, January 14\u201317). Generalized Fisher Score for Feature Selection. Proceedings of the 27th Conference on Uncertainty in Artificial Intelligence, UAI 2011, Barcelona, Spain."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Song, F., Mei, D., and Li, H. (2010, January 13\u201314). Feature Selection Based on Linear Discriminant Analysis. Proceedings of the 2010 International Conference on Intelligent System Design and Engineering Application, Changsha, China.","DOI":"10.1109\/ISDEA.2010.311"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1016\/S0004-3702(97)00043-X","article-title":"Wrappers for feature subset selection","volume":"97","author":"Kohavi","year":"1997","journal-title":"Artif. Intell."},{"key":"ref_31","unstructured":"Botzheim, J., Drobics, M., and K\u00f3czy, L.T. (, January July). Feature selection using bacterial optimization. Proceedings of the International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems, IPMU 2004, Perugia, Italy."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zhou, D., Fang, Y., Botzheim, J., Kubota, N., and Liu, H. (2016, January 6\u20139). Bacterial memetic algorithm based feature selection for surface EMG based hand motion recognition in long-term use. Proceedings of the 2016 IEEE Symposium Series on Computational Intelligence (SSCI), Athens, Greece.","DOI":"10.1109\/SSCI.2016.7850241"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"917","DOI":"10.1109\/TC.1977.1674939","article-title":"A Branch and Bound Algorithm for Feature Subset Selection","volume":"C-26","author":"Narendra","year":"1977","journal-title":"IEEE Trans. Comput."},{"key":"ref_34","first-page":"1157","article-title":"An Introduction to Variable and Feature Selection","volume":"3","author":"Guyon","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_35","unstructured":"Sandri, M., and Zuccolotto, P. (2006). Studies in Classification, Data Analysis, and Knowledge Organization, Springer."},{"key":"ref_36","unstructured":"Shlens, J. (2014). A Tutorial on Principal Component Analysis. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1016\/S0167-9473(97)84761-5","article-title":"A Guide to Chi-Squared Testing: Greenwood, P.E. and Nikulin, M.S. New York: John Wiley & Sons, Inc., pp. 280 +XII, ISBN 0-471-55779-X. AMS 1991 Classification: 62-02, 62F03, 62H15","volume":"23","author":"Antoch","year":"1997","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Ross, B.C. (2014). Mutual Information between Discrete and Continuous Data Sets. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0087357"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1080\/10618600.2021.1938585","article-title":"The Chi-Square Test of Distance Correlation","volume":"31","author":"Shen","year":"2022","journal-title":"J. Comput. Graph. Stat."},{"key":"ref_40","first-page":"1203","article-title":"A computationally efficient estimator for mutual information","volume":"464","author":"Evans","year":"2008","journal-title":"Proc. R. Soc. A Math. Phys. Eng. Sci."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1023\/A:1012487302797","article-title":"Gene Selection for Cancer Classification using Support Vector Machines","volume":"46","author":"Subramanian","year":"2002","journal-title":"Mach. Learn."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/BF00116251","article-title":"Induction of Decision Trees","volume":"1","author":"Quinlan","year":"1986","journal-title":"Mach. Learn."},{"key":"ref_43","unstructured":"Varma, V. (2020). Embedded methods for feature selection in neural networks. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"927312","DOI":"10.3389\/fbinf.2022.927312","article-title":"A Review of Feature Selection Methods for Machine Learning-Based Disease Risk Prediction","volume":"2","author":"Pudjihartono","year":"2022","journal-title":"Front. Bioinform."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fnins.2013.00267","article-title":"MEG and EEG Data Analysis with MNE-Python","volume":"7","author":"Gramfort","year":"2013","journal-title":"Front. Neurosci."},{"key":"ref_46","first-page":"8024","article-title":"PyTorch: An Imperative Style, High-Performance Deep Learning Library","volume":"32","author":"Paszke","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_47","unstructured":"Cui, J. (2022, October 20). EEG Driver Drowsiness Dataset. Available online: https:\/\/figshare.com\/articles\/dataset\/EEG_driver_drowsiness_dataset\/14273687\/3."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1038\/s41597-019-0027-4","article-title":"Multi-channel EEG recordings during a sustained-attention driving task","volume":"6","author":"Cao","year":"2019","journal-title":"Sci. Data"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1109\/TNSRE.2018.2790359","article-title":"Toward Drowsiness Detection Using Non-hair-Bearing EEG-Based Brain-Computer Interfaces","volume":"26","author":"Wei","year":"2018","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Cui, J., Lan, Z., Zheng, T., Liu, Y., Sourina, O., Wang, L., and M\u00fcller-Wittig, W. (2021, January 28\u201330). Subject-Independent Drowsiness Recognition from Single-Channel EEG with an Interpretable CNN-LSTM model. Proceedings of the 2021 International Conference on Cyberworlds (CW), Caen, France.","DOI":"10.1109\/CW52790.2021.00041"},{"key":"ref_51","first-page":"23584","article-title":"PSD Computations Using Welch\u2019s Method. [Power Spectral Density (PSD)]","volume":"92","author":"Solomon","year":"1991","journal-title":"NASA STI\/Recon Tech. Rep."},{"key":"ref_52","first-page":"129","article-title":"What is the State of Neural Network Pruning?","volume":"2","author":"Blalock","year":"2020","journal-title":"Proc. Mach. Learn. Syst."},{"key":"ref_53","unstructured":"Hinton, G.E., Srivastava, N., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R.R. (2012). Improving neural networks by preventing co-adaptation of feature detectors. arXiv."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Post, M.J., van der Putten, P., and van Rijn, J.N. (2016, January 13\u201315). Does Feature Selection Improve Classification? A Large Scale Experiment in OpenML. Proceedings of the Advances in Intelligent Data Analysis XV: 15th International Symposium, Stockholm, Sweden.","DOI":"10.1007\/978-3-319-46349-0_14"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Guo, M., Li, S., Wang, L., Chai, M., Chen, F., and Wei, Y. (2016). Research on the Relationship between Reaction Ability and Mental State for Online Assessment of Driving Fatigue. Int. J. Environ. Res. Public Health, 13.","DOI":"10.3390\/ijerph13121174"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"17915","DOI":"10.3390\/s141017915","article-title":"Mobile Healthcare for Automatic Driving Sleep-Onset Detection Using Wavelet-Based EEG and Respiration Signals","volume":"14","author":"Lee","year":"2014","journal-title":"Sensors"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"016003","DOI":"10.1088\/1741-2560\/8\/1\/016003","article-title":"Detection of lapses in responsiveness from the EEG","volume":"8","author":"Peiris","year":"2011","journal-title":"J. Neural Eng."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/S0301-0511(00)00085-5","article-title":"A critical review of the psychophysiology of driver fatigue","volume":"55","author":"Lal","year":"2001","journal-title":"Biol. Psychol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/1874\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:27:17Z","timestamp":1760120837000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/1874"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,7]]},"references-count":58,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23041874"],"URL":"https:\/\/doi.org\/10.3390\/s23041874","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,7]]}}}