{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,5]],"date-time":"2026-02-05T08:42:21Z","timestamp":1770280941489,"version":"3.49.0"},"reference-count":41,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2023,11,8]],"date-time":"2023-11-08T00:00:00Z","timestamp":1699401600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Predicting pilots\u2019 mental states is a critical challenge in aviation safety and performance, with electroencephalogram data offering a promising avenue for detection. However, the interpretability of machine learning and deep learning models, which are often used for such tasks, remains a significant issue. This study aims to address these challenges by developing an interpretable model to detect four mental states\u2014channelised attention, diverted attention, startle\/surprise, and normal state\u2014in pilots using EEG data. The methodology involves training a convolutional neural network on power spectral density features of EEG data from 17 pilots. The model\u2019s interpretability is enhanced via the use of SHapley Additive exPlanations values, which identify the top 10 most influential features for each mental state. The results demonstrate high performance in all metrics, with an average accuracy of 96%, a precision of 96%, a recall of 94%, and an F1 score of 95%. An examination of the effects of mental states on EEG frequency bands further elucidates the neural mechanisms underlying these states. The innovative nature of this study lies in its combination of high-performance model development, improved interpretability, and in-depth analysis of the neural correlates of mental states. This approach not only addresses the critical need for effective and interpretable mental state detection in aviation but also contributes to our understanding of the neural underpinnings of these states. This study thus represents a significant advancement in the field of EEG-based mental state detection.<\/jats:p>","DOI":"10.3390\/s23229052","type":"journal-article","created":{"date-parts":[[2023,11,9]],"date-time":"2023-11-09T03:42:40Z","timestamp":1699501360000},"page":"9052","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Illuminating the Neural Landscape of Pilot Mental States: A Convolutional Neural Network Approach with Shapley Additive Explanations Interpretability"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1234-5148","authenticated-orcid":false,"given":"Ibrahim","family":"Alreshidi","sequence":"first","affiliation":[{"name":"Centre for Computational Engineering Sciences, Cranfield University, Cranfield MK43 0AL, UK"},{"name":"Machine Learning and Data Analytics Laboratory, Digital Aviation Research and Technology Centre (DARTeC), Cranfield University, Cranfield MK43 0AL, UK"},{"name":"College of Computer Science and Engineering, University of Ha\u2019il, Ha\u2019il 81451, Saudi Arabia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5723-8429","authenticated-orcid":false,"given":"Desmond","family":"Bisandu","sequence":"additional","affiliation":[{"name":"Centre for Computational Engineering Sciences, Cranfield University, Cranfield MK43 0AL, UK"},{"name":"Machine Learning and Data Analytics Laboratory, Digital Aviation Research and Technology Centre (DARTeC), Cranfield University, Cranfield MK43 0AL, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0947-9495","authenticated-orcid":false,"given":"Irene","family":"Moulitsas","sequence":"additional","affiliation":[{"name":"Centre for Computational Engineering Sciences, Cranfield University, Cranfield MK43 0AL, UK"},{"name":"Machine Learning and Data Analytics Laboratory, Digital Aviation Research and Technology Centre (DARTeC), Cranfield University, Cranfield MK43 0AL, UK"}]}],"member":"1968","published-online":{"date-parts":[[2023,11,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Schomer, D.L., and Lopes da Silva, F.H. (2017). Niedermeyer\u2019s Electroencephalography, Oxford University Press.","DOI":"10.1093\/med\/9780190228484.001.0001"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1038\/nrn3241","article-title":"The Origin of Extracellular Fields and Currents-EEG, ECoG, LFP and Spikes","volume":"13","author":"Anastassiou","year":"2012","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1016\/j.tins.2017.02.004","article-title":"Where Does EEG Come from and What Does It Mean?","volume":"40","author":"Cohen","year":"2017","journal-title":"Trends Neurosci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/JBHI.2014.2328317","article-title":"Wearable, Wireless EEG Solutions in Daily Life Applications: What Are We Missing?","volume":"19","author":"Mihajlovic","year":"2015","journal-title":"IEEE J. Biomed. Health Inf."},{"key":"ref_5","first-page":"59","article-title":"Fundamentals of EEG Measurement. Measurement Science Review","volume":"2","author":"Teplan","year":"2002","journal-title":"Meas. Sci. Rev."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1567","DOI":"10.1109\/JPROC.2012.2185009","article-title":"Evolving Signal Processing for Brain\u2013Computer Interfaces","volume":"100","author":"Makeig","year":"2012","journal-title":"Proc. IEEE"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/j.neubiorev.2012.10.003","article-title":"Measuring Neurophysiological Signals in Aircraft Pilots and Car Drivers for the Assessment of Mental Workload, Fatigue and Drowsiness","volume":"44","author":"Borghini","year":"2014","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/S0165-0173(98)00056-3","article-title":"EEG Alpha and Theta Oscillations Reflect Cognitive and Memory Performance: A Review and Analysis","volume":"29","author":"Klimesch","year":"1999","journal-title":"Brain Res. Rev."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/S0167-8760(00)00145-8","article-title":"Gamma, Alpha, Delta, and Theta Oscillations Govern Cognitive Processes","volume":"39","year":"2001","journal-title":"Int. J. Psychophysiol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"83","DOI":"10.3389\/fnint.2013.00083","article-title":"The Functional Significance of Delta Oscillations in Cognitive Processing","volume":"7","author":"Harmony","year":"2013","journal-title":"Front. Integr. Neurosci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"5391","DOI":"10.1002\/hbm.23730","article-title":"Deep Learning with Convolutional Neural Networks for EEG Decoding and Visualization","volume":"38","author":"Schirrmeister","year":"2017","journal-title":"Hum. Brain Mapp."},{"key":"ref_12","unstructured":"Bashivan, P., Rish, I., Yeasin, M., and Codella, N. (2016, January 2\u20134). Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks. Proceedings of the 4th International Conference on Learning Representations, ICLR 2016\u2014Conference Track Proceedings, San Juan, Puerto Rico."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.ssci.2018.12.018","article-title":"Using Machine Learning Methods in Airline Flight Data Monitoring to Generate New Operational Safety Knowledge from Existing Data","volume":"114","author":"Oehling","year":"2019","journal-title":"Saf. Sci."},{"key":"ref_14","unstructured":"Chen, J., Song, L., Wainwright, M.J., and Jordan, M.I. (2018, January 10\u201315). Learning to Explain: An Information-Theoretic Perspective on Model Interpretation. Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholm, Sweden."},{"key":"ref_15","first-page":"4766","article-title":"A Unified Approach to Interpreting Model Predictions","volume":"30","author":"Lundberg","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_16","unstructured":"Terwilliger, P., Sarle, J., and Walker, S. (2020, January 20). A ResNet Autoencoder Approach for Time Series Classification of Cognitive State. Proceedings of the MODSIM World, Norfolk, VA, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Harrivel, A.R., Liles, C.A., Stephens, C.L., Ellis, K.K., Prinzel, L.J., and Pope, A.T. (2016, January 4\u20138). Psychophysiological Sensing and State Classification for Attention Management in Commercial Aviation. Proceedings of the AIAA Infotech @ Aerospace Conference, San Diego, CA, USA.","DOI":"10.2514\/6.2016-1490"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Harrivel, A.R., Stephens, C.L., Milletich, R.J., Heinich, C.M., Last, M.C., Napoli, N.J., Abraham, N.A., Prinzel, L.J., Motter, M.A., and Pope, A.T. (2017, January 9\u201313). Prediction of Cognitive States during Flight Simulation Using Multimodal Psychophysiological Sensing. Proceedings of the AIAA Information Systems-AIAA Infotech at Aerospace, Grapevine, TX, USA.","DOI":"10.2514\/6.2017-1135"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Alreshidi, I., Moulitsas, I., and Jenkins, K.W. (2023). Multimodal Approach for Pilot Mental State Detection Based on EEG. Sensors, 23.","DOI":"10.3390\/s23177350"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Alreshidi, I.M., Moulitsas, I., and Jenkins, K.W. (2022, January 20\u201323). Miscellaneous EEG Preprocessing and Machine Learning for Pilots\u2019 Mental States Classification: Implications. Proceedings of the 6th International Conference on Advances in Artificial Intelligence, Birmingham, UK.","DOI":"10.1145\/3571560.3571565"},{"key":"ref_21","unstructured":"Alreshidi, I., Yadav, S., Moulitsas, I., Jenkins, K., Alreshidi, I., Yadav, S., Moulitsas, I., and Jenkins, K. (2023). AIAA AVIATION 2023 Forum, American Institute of Aeronautics and Astronautics. AIAA AVIATION Forum."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1207\/S15327108IJAP1004_6","article-title":"A Closed-Loop System for Examining Psychophysiological Measures for Adaptive Task Allocation","volume":"10","author":"Prinzel","year":"2000","journal-title":"Int. J. Aviat. Psychol."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lo Giudice, M., Varone, G., Ieracitano, C., Mammone, N., Bruna, A.R., Tomaselli, V., and Morabito, F.C. (2020, January 19\u201324). 1D Convolutional Neural Network Approach to Classify Voluntary Eye Blinks in EEG Signals for BCI Applications. Proceedings of the International Joint Conference on Neural Networks, Glasgow, UK.","DOI":"10.1109\/IJCNN48605.2020.9207195"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"066053","DOI":"10.1088\/1741-2552\/ac4430","article-title":"A 1D CNN for High Accuracy Classification and Transfer Learning in Motor Imagery EEG-Based Brain-Computer Interface","volume":"18","author":"Mattioli","year":"2021","journal-title":"J. Neural Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"016003","DOI":"10.1088\/1741-2560\/14\/1\/016003","article-title":"A Novel Deep Learning Approach for Classification of EEG Motor Imagery Signals","volume":"14","author":"Tabar","year":"2017","journal-title":"J. Neural Eng."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zorzos, I., Kakkos, I., Miloulis, S.T., Anastasiou, A., Ventouras, E.M., and Matsopoulos, G.K. (2023). Applying Neural Networks with Time-Frequency Features for the Detection of Mental Fatigue. Appl. Sci., 13.","DOI":"10.3390\/app13031512"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3907","DOI":"10.1109\/TIM.2018.2885608","article-title":"Pilots\u2019 Fatigue Status Recognition Using Deep Contractive Autoencoder Network","volume":"68","author":"Wu","year":"2019","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1109\/TCDS.2019.2963476","article-title":"Detecting Fatigue Status of Pilots Based on Deep Learning Network Using EEG Signals","volume":"13","author":"Wu","year":"2021","journal-title":"IEEE Trans. Cogn. Dev. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"7921","DOI":"10.1109\/TNNLS.2022.3147208","article-title":"EEG-Based Cross-Subject Driver Drowsiness Recognition With an Interpretable Convolutional Neural Network","volume":"34","author":"Cui","year":"2022","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1016\/j.bbe.2019.12.002","article-title":"Classification of Pilots\u2019 Mental States Using a Multimodal Deep Learning Network","volume":"40","author":"Han","year":"2020","journal-title":"Biocybern. Biomed. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Johnson, M.K., Blanco, J.A., Gentili, R.J., Jaquess, K.J., Oh, H., and Hatfield, B.D. (2015, January 22\u201324). Probe-Independent EEG Assessment of Mental Workload in Pilots. Proceedings of the 2015 7th International IEEE\/EMBS Conference on Neural Engineering (NER), Montpellier, France.","DOI":"10.1109\/NER.2015.7146689"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Roza, V.C., Postolache, O., Groza, V., and Pereira, J.M.D. (2019, January 26\u201328). Emotions Assessment on Simulated Flights. Proceedings of the 2019 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Istanbul, Turkey.","DOI":"10.1109\/MeMeA.2019.8802194"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Roza, V.C.C., and Postolache, O.A. (2019). Multimodal Approach for Emotion Recognition Based on Simulated Flight Experiments. Sensors, 19.","DOI":"10.3390\/s19245516"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2703513","DOI":"10.1155\/2018\/2703513","article-title":"A Machine Learning Approach to the Detection of Pilot\u2019s Reaction to Unexpected Events Based on EEG Signals","volume":"2018","author":"Binias","year":"2018","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.jneumeth.2014.08.002","article-title":"Digital Filter Design for Electrophysiological Data\u2014A Practical Approach","volume":"250","author":"Widmann","year":"2015","journal-title":"J. Neurosci. Methods"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1109\/72.761722","article-title":"Fast and Robust Fixed-Point Algorithms for Independent Component Analysis","volume":"10","year":"1999","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1371","DOI":"10.1002\/j.1538-7305.1978.tb02104.x","article-title":"Prolate Spheroidal Wave Functions, Fourier Analysis, and Uncertainty-V: The Discrete Case","volume":"57","author":"Slepian","year":"1978","journal-title":"Bell Syst. Tech. J."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"863","DOI":"10.1613\/jair.1.11192","article-title":"SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-Year Anniversary","volume":"61","author":"Herrera","year":"2018","journal-title":"J. Artif. Intell. Res."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1016\/j.eswa.2019.06.040","article-title":"End-to-End Environmental Sound Classification Using a 1D Convolutional Neural Network","volume":"136","author":"Abdoli","year":"2019","journal-title":"Expert. Syst. Appl."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"107398","DOI":"10.1016\/j.ymssp.2020.107398","article-title":"1D Convolutional Neural Networks and Applications: A Survey","volume":"151","author":"Kiranyaz","year":"2021","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_41","unstructured":"Shapley, L.S. (1953). Contributions to the Theory of Games (AM-28), Volume II, Princeton University Press."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/22\/9052\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:19:33Z","timestamp":1760131173000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/22\/9052"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,8]]},"references-count":41,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2023,11]]}},"alternative-id":["s23229052"],"URL":"https:\/\/doi.org\/10.3390\/s23229052","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,8]]}}}