{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T16:23:26Z","timestamp":1775838206965,"version":"3.50.1"},"reference-count":50,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2021,7,31]],"date-time":"2021-07-31T00:00:00Z","timestamp":1627689600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Excellence Initiative of the German federal and state governments","award":["G:(DE-82)ZUK2-SF-OPSF424"],"award-info":[{"award-number":["G:(DE-82)ZUK2-SF-OPSF424"]}]},{"name":"Deutsche Forschungsgemeinschaft - DFG","award":["269953372\/GRK2150"],"award-info":[{"award-number":["269953372\/GRK2150"]}]},{"DOI":"10.13039\/501100002347","name":"BMBF","doi-asserted-by":"publisher","award":["APIC: 01EE1405A-C, 01DN18026"],"award-info":[{"award-number":["APIC: 01EE1405A-C, 01DN18026"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The aim of the present investigation was to assess if a mobile electroencephalography (EEG) setup can be used to track mental workload, which is an important aspect of learning performance and motivation and may thus represent a valuable source of information in the evaluation of cognitive training approaches. Twenty five healthy subjects performed a three-level N-back test using a fully mobile setup including tablet-based presentation of the task and EEG data collection with a self-mounted mobile EEG device at two assessment time points. A two-fold analysis approach was chosen including a standard analysis of variance and an artificial neural network to distinguish the levels of cognitive load. Our findings indicate that the setup is feasible for detecting changes in cognitive load, as reflected by alterations across lobes in different frequency bands. In particular, we observed a decrease of occipital alpha and an increase in frontal, parietal and occipital theta with increasing cognitive load. The most distinct levels of cognitive load could be discriminated by the integrated machine learning models with an accuracy of 86%.<\/jats:p>","DOI":"10.3390\/s21155205","type":"journal-article","created":{"date-parts":[[2021,8,1]],"date-time":"2021-08-01T21:44:32Z","timestamp":1627854272000},"page":"5205","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":30,"title":["Tracking of Mental Workload with a Mobile EEG Sensor"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3430-5123","authenticated-orcid":false,"given":"Ekaterina","family":"Kutafina","sequence":"first","affiliation":[{"name":"Institute of Medical Informatics, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany"},{"name":"Faculty of Applied Mathematics, AGH University of Science and Technology, 30-059 Krakow, Poland"}]},{"given":"Anne","family":"Heiligers","sequence":"additional","affiliation":[{"name":"Department of Psychiatry, Psychotherapy and Psychosomatics, School of Medicine, RWTH Aachen University, 52074 Aachen, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6669-252X","authenticated-orcid":false,"given":"Radomir","family":"Popovic","sequence":"additional","affiliation":[{"name":"Institute of Medical Informatics, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany"}]},{"given":"Alexander","family":"Brenner","sequence":"additional","affiliation":[{"name":"Institute of Medical Informatics, University of M\u00fcnster, 48149 M\u00fcnster, Germany"}]},{"given":"Bernd","family":"Hankammer","sequence":"additional","affiliation":[{"name":"Institute of Medical Informatics, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany"}]},{"given":"Stephan M.","family":"Jonas","sequence":"additional","affiliation":[{"name":"Department of Informatics, Technical University of Munich, 85748 Garching, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2276-7726","authenticated-orcid":false,"given":"Klaus","family":"Mathiak","sequence":"additional","affiliation":[{"name":"Department of Psychiatry, Psychotherapy and Psychosomatics, School of Medicine, RWTH Aachen University, 52074 Aachen, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5724-1054","authenticated-orcid":false,"given":"Jana","family":"Zweerings","sequence":"additional","affiliation":[{"name":"Department of Psychiatry, Psychotherapy and Psychosomatics, School of Medicine, RWTH Aachen University, 52074 Aachen, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"101707","DOI":"10.1016\/j.artmed.2019.101707","article-title":"The role of medical smartphone apps in clinical decision-support: A literature review","volume":"100","author":"Watson","year":"2019","journal-title":"Artif. Intell. Med."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Lee, Y.-Y., and Hsieh, S. (2014). Classifying Different Emotional States by Means of EEG-Based Functional Connectivity Patterns. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0095415"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Saeed, S.M.U., Anwar, S.M., Khalid, H., Majid, M., and Bagci, U. (2020). EEG Based Classification of Long-Term Stress Using Psychological Labeling. Sensors, 20.","DOI":"10.3390\/s20071886"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"5174815","DOI":"10.1155\/2018\/5174815","article-title":"Systematic Review on Resting-State EEG for Alzheimer\u2019s Disease Diagnosis and Progression Assessment","volume":"2018","author":"Cassani","year":"2018","journal-title":"Dis. Markers"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"322","DOI":"10.3389\/fnins.2014.00322","article-title":"Combining and comparing EEG, peripheral physiology and eye-related measures for the assessment of mental workload","volume":"8","author":"Hogervorst","year":"2014","journal-title":"Front. Neurosci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"903","DOI":"10.1016\/j.neuroimage.2009.01.001","article-title":"BOLD correlates of EEG alpha phase-locking and the fMRI default mode network","volume":"45","author":"Jann","year":"2009","journal-title":"NeuroImage"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"045008","DOI":"10.1088\/1741-2560\/9\/4\/045008","article-title":"Estimating workload using EEG spectral power and ERPs in the n-back task","volume":"9","author":"Brouwer","year":"2012","journal-title":"J. Neural Eng."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ismail, L.E., and Karwowski, W. (2020). Applications of EEG indices for the quantification of human cognitive performance: A systematic review and bibliometric analysis. PLoS ONE, 15.","DOI":"10.1371\/journal.pone.0242857"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"991","DOI":"10.1016\/j.ergon.2005.04.005","article-title":"Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic","volume":"35","author":"Ryu","year":"2005","journal-title":"Int. J. Ind. Ergon."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1518\/001872001775898287","article-title":"Monitoring Task Loading with Multivariate EEG Measures during Complex Forms of Human-Computer Interaction","volume":"43","author":"Smith","year":"2001","journal-title":"Hum. Factors"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.trf.2014.08.001","article-title":"Deep in thought while driving: An EEG study on drivers\u2019 cognitive distraction","volume":"26","author":"Almahasneh","year":"2014","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Dehais, F., Dupres, A., Flumeri, G.D., Verdiere, K., Borghini, G., Babiloni, F., and Roy, R. (2018, January 7\u201310). Monitoring Pilot\u2019s Cognitive Fatigue with Engagement Features in Simulated and Actual Flight Conditions Using an Hybrid fNIRS-EEG Passive BCI. Proceedings of the 2018 IEEE Intenational Conference on Systems, Man, and Cybernetics (SMC), Miyazaki, Japan.","DOI":"10.1109\/SMC.2018.00102"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Mills, C., Fridman, I., Soussou, W., Waghray, D., Olney, A.M., and D\u2019Mello, S.K. (2017, January 13\u201317). Put your thinking cap on: Detecting cognitive load using EEG during learning. Proceedings of the Seventh International Learning Analytics & Knowledge Conference, Vancouver, BC, Canada. Available online: https:\/\/doi.org\/10.1145\/3027385.3027431.","DOI":"10.1145\/3027385.3027431"},{"key":"ref_14","first-page":"150","article-title":"Computer-Based Cognitive Training for Executive Functions after Stroke: A Systematic Review","volume":"10","author":"Murre","year":"2016","journal-title":"Front. Hum. Neurosci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1097\/HTR.0000000000000076","article-title":"CogSMART Compensatory Cognitive Training for Traumatic Brain Injury: Effects Over 1 Year","volume":"30","author":"Twamley","year":"2015","journal-title":"J. Head Trauma Rehabil."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"842","DOI":"10.1016\/j.neuron.2011.12.024","article-title":"Computerized Cognitive Training Restores Neural Activity within the Reality Monitoring Network in Schizophrenia","volume":"73","author":"Subramaniam","year":"2012","journal-title":"Neuron"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"213574","DOI":"10.1109\/ACCESS.2020.3040437","article-title":"HealthSOS: Real-Time Health Monitoring System for Stroke Prognostics","volume":"8","author":"Hussain","year":"2020","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"16","DOI":"10.3928\/00989134-20180305-01","article-title":"Telehealth Factors for Predicting Hospital Length of Stay","volume":"44","author":"Murphy","year":"2018","journal-title":"J. Gerontol. Nurs."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kreutzer, J.S., DeLuca, J., and Caplan, B. (2011). Structured Clinical Interview for DSM-IV (SCID-I\/SCID-II). Encyclopedia of Clinical Neuropsychology, Springer. Available online: https:\/\/doi.org\/10.1007\/978-0-387-79948-3_2011.","DOI":"10.1007\/978-0-387-79948-3_2011"},{"key":"ref_20","unstructured":"Schmidt, K.-H., and Metzler, P. (1992). Wortschatztest: WST, Beltz."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1063","DOI":"10.1037\/0022-3514.54.6.1063","article-title":"Development and validation of brief measures of positive and negative affect: The PANAS scales","volume":"54","author":"Watson","year":"1988","journal-title":"J. Pers. Soc. Psychol."},{"key":"ref_22","unstructured":"Kothgasser, O.D., Felnhofer, A., Hauk, N., Kastenhofer, E., Gomm, J., and Kryspin-Exner, I. (2012). Technology Usage Inventory\u2014Manual, FFG."},{"key":"ref_23","unstructured":"Brooke, J. (2021, July 29). SUS\u2014A Quick and Dirty Usability Scale. Available online: http:\/\/hell.meiert.org\/core\/pdf\/sus.pdf."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e38","DOI":"10.7717\/peerj.38","article-title":"Validation of the Emotiv EPOC\u00ae EEG gaming system for measuring research quality auditory ERPs","volume":"1","author":"Badcock","year":"2013","journal-title":"PeerJ"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"150","DOI":"10.3389\/fnhum.2017.00150","article-title":"Systems, Subjects, Sessions: To What Extent Do These Factors Influence EEG Data?","volume":"11","author":"Melnik","year":"2017","journal-title":"Front. Hum. Neurosci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"106507","DOI":"10.1016\/j.yebeh.2019.106507","article-title":"Can commercially available wearable EEG devices be used for diagnostic purposes? An explorative pilot study","volume":"103","author":"Titgemeyer","year":"2020","journal-title":"Epilepsy Behav."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"e8969","DOI":"10.7717\/peerj.8969","article-title":"Comparison of mobile and clinical EEG sensors through resting state simultaneous data collection","volume":"8","author":"Kutafina","year":"2020","journal-title":"PeerJ"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"627","DOI":"10.1016\/j.neuroimage.2005.06.030","article-title":"Selective influences of cross-modal spatial-cues on preattentive auditory processing: A whole-head magnetoencephalography study","volume":"28","author":"Mathiak","year":"2005","journal-title":"NeuroImage"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.jneumeth.2003.10.009","article-title":"EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis","volume":"134","author":"Delorme","year":"2004","journal-title":"J. Neurosci. Methods"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"6","DOI":"10.3389\/fnhum.2017.00006","article-title":"Comparison of the Working Memory Load in N-Back and Working Memory Span Tasks by Means of EEG Frequency Band Power and P300 Amplitude","volume":"11","author":"Scharinger","year":"2017","journal-title":"Front. Hum. Neurosci."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zschocke, S., and Hansen, H.-C. (2011). Klinische Elektroenzephalographie, Springer.","DOI":"10.1007\/978-3-642-19943-1"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2585","DOI":"10.1111\/ejn.13854","article-title":"Single-trial log transformation is optimal in frequency analysis of resting EEG alpha","volume":"48","author":"Smulders","year":"2018","journal-title":"Eur. J. Neurosci."},{"key":"ref_33","first-page":"171","article-title":"Automatic Recognition of Epileptiform EEG Abnormalities","volume":"247","author":"Brenner","year":"2018","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1177\/00131640021970961","article-title":"Bootstrap Resampling Approaches for Repeated Measure Designs: Relative Robustness to Sphericity and Normality Violations","volume":"60","author":"Berkovits","year":"2000","journal-title":"Educ. Psychol. Meas."},{"key":"ref_35","first-page":"552","article-title":"Non-normal data: Is ANOVA still a valid option?","volume":"29","author":"Blanca","year":"2017","journal-title":"Psicothema"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1938","DOI":"10.1177\/00220345920710121601","article-title":"Robustness of the t test applied to data distorted from normality by floor effects","volume":"71","author":"Sullivan","year":"1992","journal-title":"J. Dent. Res."},{"key":"ref_37","first-page":"114","article-title":"Determining what individual SUS scores mean: Adding an adjective rating scale","volume":"4","author":"Bangor","year":"2009","journal-title":"J. Usability Stud."},{"key":"ref_38","first-page":"21","article-title":"Cognitive Workload Assessment of Air Traffic Controllers Using Optical Brain Imaging Sensors","volume":"21","author":"Ayaz","year":"2010","journal-title":"Adv. Underst. Hum. Perform. Neuroergonom. Hum. Factors Des. Spec. Popul."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1007\/BF01129966","article-title":"Topographical changes in the ongoing EEG related to the difficulty of mental tasks","volume":"5","author":"Gundel","year":"1992","journal-title":"Brain Topogr."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1016\/S0167-8760(97)00773-3","article-title":"EEG-alpha rhythms and memory processes","volume":"26","author":"Klimesch","year":"1997","journal-title":"Int. J. Psychophysiol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1120","DOI":"10.1016\/j.mri.2009.01.007","article-title":"Distributed analysis of simultaneous EEG-fMRI time-series: Modeling and interpretation issues","volume":"27","author":"Esposito","year":"2009","journal-title":"Magn. Reson. Imaging"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.ijpsycho.2011.11.006","article-title":"Beta band oscillations engagement in human alertness process","volume":"85","author":"Brzezicka","year":"2012","journal-title":"Int. J. Psychophysiol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"83","DOI":"10.3389\/fnint.2013.00083","article-title":"The functional significance of delta oscillations in cognitive processing","volume":"7","author":"Harmony","year":"2013","journal-title":"Front. Integr. Neurosci."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.neuroimage.2011.07.047","article-title":"Adaptive training using an artificial neural network and EEG metrics for within- and cross-task workload classification","volume":"59","author":"Baldwin","year":"2012","journal-title":"NeuroImage"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"16009","DOI":"10.1109\/ACCESS.2020.2966834","article-title":"Multilevel Feature Fusion With 3D Convolutional Neural Network for EEG-Based Workload Estimation","volume":"8","author":"Kwak","year":"2020","journal-title":"IEEE Access"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ayaz, H. (2020). Convolutional Neural Network for Hybrid fNIRS-EEG Mental Workload Classification. Advances in Neuroergonomics and Cognitive Engineering, Springer International Publishing. Advances in Intelligent Systems and Computing.","DOI":"10.1007\/978-3-030-20473-0"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1109\/TNSRE.2018.2884641","article-title":"Learning Spatial-Spectral-Temporal EEG Features With Recurrent 3D Convolutional Neural Networks for Cross-Task Mental Workload Assessment","volume":"27","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"180003","DOI":"10.1038\/sdata.2018.3","article-title":"Simultaneous acquisition of EEG and NIRS during cognitive tasks for an open access dataset","volume":"5","author":"Shin","year":"2018","journal-title":"Sci. Data"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"2106","DOI":"10.1109\/TNSRE.2018.2872924","article-title":"STEW: Simultaneous Task EEG Workload Data Set","volume":"26","author":"Lim","year":"2018","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"592","DOI":"10.1080\/00140139.2012.662527","article-title":"Evaluating the ergonomics of BCI devices for research and experimentation","volume":"55","author":"Ekandem","year":"2012","journal-title":"Ergonomics"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/15\/5205\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:38:24Z","timestamp":1760164704000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/15\/5205"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,31]]},"references-count":50,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["s21155205"],"URL":"https:\/\/doi.org\/10.3390\/s21155205","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,31]]}}}