{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T01:12:32Z","timestamp":1774573952408,"version":"3.50.1"},"reference-count":66,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,1,26]],"date-time":"2023-01-26T00:00:00Z","timestamp":1674691200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Istituto Nazionale per l\u2019Assicurazione Contro gli Infortuni sul Lavoro","award":["PR19-SV-P1"],"award-info":[{"award-number":["PR19-SV-P1"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Background and Objective: Mental workload (MWL) is a relevant construct involved in all cognitively demanding activities, and its assessment is an important goal in many research fields. This paper aims at evaluating the reproducibility and sensitivity of MWL assessment from EEG signals considering the effects of different electrode configurations and pre-processing pipelines (PPPs). Methods: Thirteen young healthy adults were enrolled and were asked to perform 45 min of Simon\u2019s task to elicit a cognitive demand. EEG data were collected using a 32-channel system with different electrode configurations (fronto-parietal; Fz and Pz; Cz) and analyzed using different PPPs, from the simplest bandpass filtering to the combination of filtering, Artifact Subspace Reconstruction (ASR) and Independent Component Analysis (ICA). The reproducibility of MWL indexes estimation and the sensitivity of their changes were assessed using Intraclass Correlation Coefficient and statistical analysis. Results: MWL assessed with different PPPs showed reliability ranging from good to very good in most of the electrode configurations (average consistency &gt; 0.87 and average absolute agreement &gt; 0.92). Larger fronto-parietal electrode configurations, albeit being more affected by the choice of PPPs, provide better sensitivity in the detection of MWL changes if compared to a single-electrode configuration (18 vs. 10 statistically significant differences detected, respectively). Conclusions: The most complex PPPs have been proven to ensure good reliability (&gt;0.90) and sensitivity in all experimental conditions. In conclusion, we propose to use at least a two-electrode configuration (Fz and Pz) and complex PPPs including at least the ICA algorithm (even better including ASR) to mitigate artifacts and obtain reliable and sensitive MWL assessment during cognitive tasks.<\/jats:p>","DOI":"10.3390\/s23031367","type":"journal-article","created":{"date-parts":[[2023,1,27]],"date-time":"2023-01-27T01:27:58Z","timestamp":1674782878000},"page":"1367","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Reliability of Mental Workload Index Assessed by EEG with Different Electrode Configurations and Signal Pre-Processing Pipelines"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3358-7111","authenticated-orcid":false,"given":"Alfonso","family":"Mastropietro","sequence":"first","affiliation":[{"name":"Institute of Biomedical Technologies, National Research Council, Via Fratelli Cervi 93, 20054 Segrate, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4905-3990","authenticated-orcid":false,"given":"Ileana","family":"Pirovano","sequence":"additional","affiliation":[{"name":"Institute of Biomedical Technologies, National Research Council, Via Fratelli Cervi 93, 20054 Segrate, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alessio","family":"Marciano","sequence":"additional","affiliation":[{"name":"Department of Molecular Medicine, University of Pavia, Via Forlanini 6, 27100 Pavia, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Simone","family":"Porcelli","sequence":"additional","affiliation":[{"name":"Department of Molecular Medicine, University of Pavia, Via Forlanini 6, 27100 Pavia, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6341-1304","authenticated-orcid":false,"given":"Giovanna","family":"Rizzo","sequence":"additional","affiliation":[{"name":"Institute of Biomedical Technologies, National Research Council, Via Fratelli Cervi 93, 20054 Segrate, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,26]]},"reference":[{"key":"ref_1","first-page":"2962","article-title":"Human Mental Workload: A Survey and a Novel Inclusive Definition","volume":"13","author":"Longo","year":"2022","journal-title":"Front. Psychol."},{"key":"ref_2","unstructured":"Cain, B. (2023, January 20). A Review of the Mental Workload Literature. Available online: https:\/\/apps.dtic.mil\/sti\/citations\/ADA474193."},{"key":"ref_3","first-page":"3","article-title":"Mental Workload Monitoring: New Perspectives from Neuroscience","volume":"1107","author":"Babiloni","year":"2019","journal-title":"Commun. Comput. Inf. Sci."},{"key":"ref_4","unstructured":"Mitchell, D.K. (2023, January 20). Mental Workload and ARL Workload Modeling Tools. Available online: https:\/\/apps.dtic.mil\/sti\/citations\/ADA377300."},{"key":"ref_5","first-page":"90","article-title":"The Impact of Workload and Fatigue on Performance","volume":"726","author":"Fan","year":"2017","journal-title":"Commun. Comput. Inf. Sci."},{"key":"ref_6","unstructured":"Lysaght, R.J., Hill, S.G., Dick, A.O., Plamondon, B.D., and Linton, P.M. (2023, January 20). Operator Workload: Comprehensive Review and Evaluation of Operator Workload Methodologies. Available online: https:\/\/apps.dtic.mil\/sti\/citations\/ADA212879."},{"key":"ref_7","first-page":"456","article-title":"Attention and Mental Workload","volume":"44","author":"Kantowitz","year":"2016","journal-title":"Proc. Hum. Factors Ergon. Soc. Annu. Meet."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/00140139.2014.956151","article-title":"State of Science: Mental Workload in Ergonomics","volume":"58","author":"Young","year":"2015","journal-title":"Ergonomics"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1207\/S15327108IJAP1201_2","article-title":"An Analysis of Mental Workload in Pilots During Flight Using Multiple Psychophysiological Measures","volume":"12","author":"Wilson","year":"2009","journal-title":"Int. J. Aviat. Psychol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"103201","DOI":"10.1016\/j.apergo.2020.103201","article-title":"Evaluation of Mental Workload during Automobile Driving Using One-Class Support Vector Machine with Eye Movement Data","volume":"89","author":"Chihara","year":"2020","journal-title":"Appl. Ergon."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"385","DOI":"10.3389\/fnins.2014.00385","article-title":"Cognitive State Monitoring and the Design of Adaptive Instruction in Digital Environments: Lessons Learned from Cognitive Workload Assessment Using a Passive Brain-Computer Interface Approach","volume":"8","author":"Gerjets","year":"2014","journal-title":"Front. Neurosci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12984-021-00953-w","article-title":"Measuring Mental Workload in Assistive Wearable Devices: A Review","volume":"18","author":"Marchand","year":"2021","journal-title":"J Neuroeng. Rehabil."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Longo, L. (2016, January 20\u201324). Mental Workload in Medicine: Foundations, Applications, Open Problems, Challenges and Future Perspectives. Proceedings of the IEEE 29th International Symposium on Computer-Based Medical Systems (CBMS), Belfast and Dublin, Ireland.","DOI":"10.1109\/CBMS.2016.36"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.apergo.2018.08.028","article-title":"Measuring Mental Workload Using Physiological Measures: A Systematic Review","volume":"74","author":"Charles","year":"2019","journal-title":"Appl. Ergon."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1093\/cercor\/7.4.374","article-title":"High-Resolution EEG Mapping of Cortical Activation Related to Working Memory: Effects of Task Difficulty, Type of Processing, and Practice","volume":"7","author":"Gevins","year":"1997","journal-title":"Cereb. Cortex"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1477","DOI":"10.1007\/s00702-005-0443-9","article-title":"Frontal Theta Event-Related Synchronization: Comparison of Directed Attention and Working Memory Load Effects","volume":"113","author":"Missonnier","year":"2006","journal-title":"J. Neural Transm."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/j.neulet.2003.09.044","article-title":"Sensitivity of Human EEG Alpha Band Desynchronization to Different Working Memory Components and Increasing Levels of Memory Load","volume":"353","author":"Stipacek","year":"2003","journal-title":"Neurosci. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1100\/tsw.2009.83","article-title":"Estimating Brain Load from the EEG","volume":"9","author":"Holm","year":"2009","journal-title":"ScientificWorldJournal"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1080\/14639220210159717","article-title":"Neurophysiological Measures of Cognitive Workload during Human-Computer Interaction","volume":"4","author":"Gevins","year":"2003","journal-title":"Theor. Issues Ergon. Sci."},{"key":"ref_20","first-page":"20","article-title":"Real-Time Mental Workload Estimation Using EEG","volume":"1107","author":"Kartali","year":"2019","journal-title":"Commun. Comput. Inf. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/j.neubiorev.2012.10.003","article-title":"Measuring Neurophysiological Signals in Aircraft Pilots and Car Drivers for the Assessment of Mental Workload, Fatigue and Drowsiness","volume":"44","author":"Borghini","year":"2014","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_22","first-page":"16","article-title":"The PREP pipeline: Standardized preprocessing for large-scale EEG analysis","volume":"9","author":"Mullen","year":"2015","journal-title":"Front. Neuroinform."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"509","DOI":"10.3389\/fnhum.2018.00509","article-title":"EEG-Based Mental Workload Neurometric to Evaluate the Impact of Different Traffic and Road Conditions in Real Driving Settings","volume":"12","author":"Borghini","year":"2018","journal-title":"Front. Hum. Neurosci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"101989","DOI":"10.1016\/j.bspc.2020.101989","article-title":"EEG-Based Mental Workload Estimation Using Deep BLSTM-LSTM Network and Evolutionary Algorithm","volume":"60","author":"Dey","year":"2020","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"297","DOI":"10.3389\/fnins.2017.00297","article-title":"ICA-Derived EEG Correlates to Mental Fatigue, Effort, and Workload in a Realistically Simulated Air Traffic Control Task","volume":"11","author":"Dasari","year":"2017","journal-title":"Front. Neurosci."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Qu, H., Shan, Y., Liu, Y., Pang, L., Fan, Z., Zhang, J., and Wanyan, X. (2020). Mental Workload Classification Method Based on EEG Independent Component Features. Appl. Sci., 10.","DOI":"10.3390\/app10093036"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2106","DOI":"10.1109\/TNSRE.2018.2872924","article-title":"STEW: Simultaneous Task EEG Workload Data Set","volume":"26","author":"Lim","year":"2018","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Rosanne, O., Albuquerque, I., Gagnon, J.F., Tremblay, S., and Falk, T.H. (2019, January 20\u201323). Performance Comparison of Automated EEG Enhancement Algorithms for Mental Workload Assessment of Ambulant Users. Proceedings of the 2019 9th International IEEE\/EMBS Conference on Neural Engineering (NER), San Francisco, CA, USA.","DOI":"10.1109\/NER.2019.8716977"},{"key":"ref_29","first-page":"105","article-title":"EEG-Based Workload Index as a Taxonomic Tool to Evaluate the Similarity of Different Robot-Assisted Surgery Systems","volume":"1107","author":"Borghini","year":"2019","journal-title":"Commun. Comput. Inf. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Bilalpur, M., Kankanhalli, M., Winkler, S., and Subramanian, R. (2018, January 16\u201320). EEG-Based Evaluation of Cognitive Workload Induced by Acoustic Parameters for Data Sonification. Proceedings of the ICMI \u201918: 20th ACM International Conference on Multimodal Interaction, Boulder, CO, USA.","DOI":"10.1145\/3242969.3243016"},{"key":"ref_31","unstructured":"Makoto, M. (2022, October 26). Makoto\u2019s Preprocessing Pipeline. Available online: https:\/\/sccn.ucsd.edu\/wiki\/Makoto%27s_preprocessing_pipeline."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"441","DOI":"10.3389\/fnhum.2017.00441","article-title":"Reliability of EEG measures of interaction: A paradigm shift is needed to fight the reproducibility crisis","volume":"11","author":"Uhl","year":"2017","journal-title":"Front. Hum. Neurosci."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Botvinik-Nezer, R., and Wager, T.D. (2023). Reproducibility in neuroimaging analysis: Challenges and solutions. Biol. Psychiatry Cogn. Neurosci. Neuroimaging, in press.","DOI":"10.1016\/j.bpsc.2022.12.006"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1473","DOI":"10.1038\/s41593-020-00709-0","article-title":"Issues and recommendations from the OHBM COBIDAS MEEG committee for reproducible EEG and MEG research","volume":"23","author":"Pernet","year":"2020","journal-title":"Nat. Neurosci."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Pernet, C., Garrido, M., Gramfort, A., Maurits, N., Michel, C.M., Pang, E., Salmelin, R., Schoffelen, J.M., Valdes-Sosa, P.A., and Puce, A. (2023, January 20). Best Practices in Data Analysis and Sharing in Neuroimaging Using MEEG. Available online: https:\/\/osf.io\/a8dhx2018.","DOI":"10.31219\/osf.io\/a8dhx"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1109\/TCDS.2021.3090217","article-title":"Cognitive workload recognition using EEG signals and machine learning: A review","volume":"14","author":"Zhou","year":"2022","journal-title":"IEEE Trans. Cogn. Dev. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.ijpsycho.2022.01.003","article-title":"Test-retest reproducibility comparison in resting and the mental task states: A sensor and source-level EEG spectral analysis","volume":"173","author":"Ding","year":"2022","journal-title":"Int. J. Psychophysiol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.clinph.2006.08.013","article-title":"Within-subject reliability and inter-session stability of EEG power and coherent activity in women evaluated monthly over nine months","volume":"118","author":"Arce","year":"2007","journal-title":"Clin. Neurophysiol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"322","DOI":"10.3389\/fnins.2017.00322","article-title":"Inter-rater reliability of preprocessing EEG data: Impact of subjective artifact removal on associative memory task ERP results","volume":"11","author":"Shirk","year":"2017","journal-title":"Front. Neurosci."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Suarez-Revelo, J., Ochoa-Gomez, J., and Duque-Grajales, J. (2016, January 16\u201320). Improving test-retest reliability of quantitative electroencephalography using different preprocessing approaches. Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA.","DOI":"10.1109\/EMBC.2016.7590861"},{"key":"ref_41","unstructured":"Su\u00e1rez-Revelo, J.X., Ochoa-G\u00f3mez, J.F., and Tob\u00f3n-Quintero, C.A. (2018). Workshop on Engineering Applications, Springer."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"729197","DOI":"10.3389\/fnrgo.2021.729197","article-title":"Measuring correlates of mental workload during simulated driving using ceegrid electrodes: A test\u2013retest reliability analysis","volume":"2","author":"Getzmann","year":"2021","journal-title":"Front. Neuroergonomics"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Arico, P., Borghini, G., Di Flumeri, G., Colosimo, A., Graziani, I., Imbert, J.P., Granger, G., Benhacene, R., Terenzi, M., and Pozzi, S. (2015, January 25\u201329). Reliability over time of EEG-based mental workload evaluation during Air Traffic Management (ATM) tasks. Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy.","DOI":"10.1109\/EMBC.2015.7320063"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Dehais, F., Dupr\u00e8s, A., Blum, S., Drougard, N., Scannella, S., Roy, R.N., and Lotte, F. (2019). Monitoring pilot\u2019s mental workload using ERPs and spectral power with a six-dry-electrode EEG system in real flight conditions. Sensors, 19.","DOI":"10.3390\/s19061324"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Longo, L. (2022). Modeling cognitive load as a self-supervised brain rate with electroencephalography and deep learning. Brain Sci., 12.","DOI":"10.3390\/brainsci12101416"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Kutafina, E., Heiligers, A., Popovic, R., Brenner, A., Hankammer, B., Jonas, S.M., Mathiak, K., and Zweerings, J. (2021). Tracking of Mental Workload with a Mobile EEG Sensor. Sensors, 21.","DOI":"10.3390\/s21155205"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Xiong, R., Kong, F., Yang, X., Liu, G., and Wen, W. (2020). Pattern recognition of cognitive load using eeg and ecg signals. Sensors, 20.","DOI":"10.3390\/s20185122"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"100336","DOI":"10.1016\/j.smhl.2022.100336","article-title":"A comprehensive decoding of cognitive load","volume":"26","author":"Zhu","year":"2022","journal-title":"Smart Health"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1275","DOI":"10.3389\/fnins.2022.744737","article-title":"Assessment of Instantaneous Cognitive Load Imposed by Educational Multimedia using EEG Signals","volume":"16","author":"Sarailoo","year":"2022","journal-title":"Front. Neurosci."},{"key":"ref_50","first-page":"81","article-title":"On EEG Preprocessing Role in Deep Learning Effectiveness for Mental Workload Classification","volume":"1493","author":"Kingphai","year":"2021","journal-title":"Commun. Comput. Inf. Sci."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1007\/s10111-017-0430-6","article-title":"A Deep Learning Scheme for Mental Workload Classification Based on Restricted Boltzmann Machines","volume":"19","author":"Zhang","year":"2017","journal-title":"Cogn. Technol. Work."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1080\/00140136308930679","article-title":"Choice reaction time as a function of angular stimulus-response correspondence and age","volume":"6","author":"Simon","year":"1963","journal-title":"Ergonomics"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1007\/BF00419687","article-title":"Inverting the Simon Effect by Intention","volume":"55","author":"Hommel","year":"1993","journal-title":"Psychol. Res."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1177\/0098628316677643","article-title":"PsyToolkit: A Novel Web-Based Method for Running Online Questionnaires and Reaction-Time Experiments","volume":"44","author":"Stoet","year":"2017","journal-title":"Teach. Psychol."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1096","DOI":"10.3758\/BRM.42.4.1096","article-title":"PsyToolkit: A Software Package for Programming Psychological Experiments Using Linux","volume":"42","author":"Stoet","year":"2010","journal-title":"Behav. Res. Methods"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"97","DOI":"10.3389\/fnins.2018.00097","article-title":"The Harvard Automated Processing Pipeline for Electroencephalography (HAPPE): Standardized Processing Software for Developmental and High-Artifact Data","volume":"12","author":"Leal","year":"2018","journal-title":"Front. Neurosci."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Mullen, T., Kothe, C., Chi, Y.M., Ojeda, A., Kerth, T., Makeig, S., Cauwenberghs, G., and Jung, T.P. (2013, January 3\u20137). Real-Time Modeling and 3D Visualization of Source Dynamics and Connectivity Using Wearable EEG. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan.","DOI":"10.1109\/EMBC.2013.6609968"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Chang, C.Y., Hsu, S.H., Pion-Tonachini, L., and Jung, T.P. (2018, January 18\u201321). Evaluation of Artifact Subspace Reconstruction for Automatic EEG Artifact Removal. Proceedings of the 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, HI, USA.","DOI":"10.1109\/EMBC.2018.8512547"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1129","DOI":"10.1162\/neco.1995.7.6.1129","article-title":"An Information-Maximization Approach to Blind Separation and Blind Deconvolution","volume":"7","author":"Bell","year":"1995","journal-title":"Neural Comput."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/j.neuroimage.2019.05.026","article-title":"ICLabel: An Automated Electroencephalographic Independent Component Classifier, Dataset, and Website","volume":"198","author":"Makeig","year":"2019","journal-title":"Neuroimage"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.jneumeth.2003.10.009","article-title":"EEGLAB: An Open Source Toolbox for Analysis of Single-Trial EEG Dynamics Including Independent Component Analysis","volume":"134","author":"Delorme","year":"2004","journal-title":"J. Neurosci. Methods"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research","volume":"15","author":"Koo","year":"2016","journal-title":"J. Chiropr. Med."},{"key":"ref_63","unstructured":"R Core Team R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing. Available online: https:\/\/www.R-project.org\/."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"313","DOI":"10.3758\/BF03194070","article-title":"Simon Says: Reliability and the Role of Working Memory and Attentional Control in the Simon Task","volume":"14","author":"Borgmann","year":"2007","journal-title":"Psychon. Bull. Rev."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1016\/S1388-2457(99)00258-8","article-title":"Test\u2013Retest Reliability of Cognitive EEG","volume":"111","author":"McEvoy","year":"2000","journal-title":"Clin. Neurophysiol."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"300","DOI":"10.3389\/fphys.2020.00300","article-title":"Indexing Mental Workload During Simulated Air Traffic Control Tasks by Means of Dual Frequency Head Maps","volume":"11","author":"Meffert","year":"2020","journal-title":"Front. Physiol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/3\/1367\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:15:55Z","timestamp":1760120155000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/3\/1367"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,26]]},"references-count":66,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23031367"],"URL":"https:\/\/doi.org\/10.3390\/s23031367","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,26]]}}}