{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T16:48:22Z","timestamp":1773938902219,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2020,9,8]],"date-time":"2020-09-08T00:00:00Z","timestamp":1599523200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012659","name":"Foundation for Innovative Research Groups of the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61103132"],"award-info":[{"award-number":["61103132"]}],"id":[{"id":"10.13039\/501100012659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012659","name":"Foundation for Innovative Research Groups of the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61872301"],"award-info":[{"award-number":["61872301"]}],"id":[{"id":"10.13039\/501100012659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The matching of cognitive load and working memory is the key for effective learning, and cognitive effort in the learning process has nervous responses which can be quantified in various physiological parameters. Therefore, it is meaningful to explore automatic cognitive load pattern recognition by using physiological measures. Firstly, this work extracted 33 commonly used physiological features to quantify autonomic and central nervous activities. Secondly, we selected a critical feature subset for cognitive load recognition by sequential backward selection and particle swarm optimization algorithms. Finally, pattern recognition models of cognitive load conditions were constructed by a performance comparison of several classifiers. We grouped the samples in an open dataset to form two binary classification problems: (1) cognitive load state vs. baseline state; (2) cognitive load mismatching state vs. cognitive load matching state. The decision tree classifier obtained 96.3% accuracy for the cognitive load vs. baseline classification, and the support vector machine obtained 97.2% accuracy for the cognitive load mismatching vs. cognitive load matching classification. The cognitive load and baseline states are distinguishable in the level of active state of mind and three activity features of the autonomic nervous system. The cognitive load mismatching and matching states are distinguishable in the level of active state of mind and two activity features of the autonomic nervous system.<\/jats:p>","DOI":"10.3390\/s20185122","type":"journal-article","created":{"date-parts":[[2020,9,8]],"date-time":"2020-09-08T09:03:48Z","timestamp":1599555828000},"page":"5122","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":53,"title":["Pattern Recognition of Cognitive Load Using EEG and ECG Signals"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1578-0073","authenticated-orcid":false,"given":"Ronglong","family":"Xiong","sequence":"first","affiliation":[{"name":"School of Electronic and Information Engineering, Southwest University, Chongqing 400715, China"},{"name":"Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, Chongqing 400715, China"}]},{"given":"Fanmeng","family":"Kong","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering, Southwest University, Chongqing 400715, China"},{"name":"Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, Chongqing 400715, China"}]},{"given":"Xuehong","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering, Southwest University, Chongqing 400715, China"},{"name":"Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, Chongqing 400715, China"}]},{"given":"Guangyuan","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering, Southwest University, Chongqing 400715, China"},{"name":"Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, Chongqing 400715, China"}]},{"given":"Wanhui","family":"Wen","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering, Southwest University, Chongqing 400715, China"},{"name":"Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, Chongqing 400715, China"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"101214","DOI":"10.1016\/j.learninstruc.2019.05.011","article-title":"Effects of prior knowledge on collaborative and individual learning","volume":"63","author":"Zambrano","year":"2019","journal-title":"Learn. Instr."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.chb.2018.07.037","article-title":"Heart rate variability reflects the effects of emotional design principle on mental effort in multimedia learning","volume":"89","author":"Le","year":"2018","journal-title":"Comput. Hum. Behav."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1016\/j.learninstruc.2012.05.004","article-title":"Cognitive load theory, the transient information effect and e-learning","volume":"22","author":"Wong","year":"2012","journal-title":"Learn. Instr."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/B978-0-12-387691-1.00002-8","article-title":"Cognitive Load Theory","volume":"55","author":"Sweller","year":"2011","journal-title":"Psychol. Learn. Motiv. Cogn. Educ."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"106393","DOI":"10.1016\/j.chb.2020.106393","article-title":"Psychophysiologic measures of cognitive load in physician team leaders during trauma resuscitation","volume":"111","author":"Johannessen","year":"2020","journal-title":"Comput. Hum. Behav."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"504.e1","DOI":"10.1016\/j.jvoice.2016.10.021","article-title":"Acoustic Measures of Voice and Physiologic Measures of Autonomic Arousal during Speech as a Function of Cognitive Load","volume":"31","author":"MacPherson","year":"2017","journal-title":"J. Voice"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1177\/0018720819830553","article-title":"Cardiac Measures of Cognitive Workload: A Meta-Analysis","volume":"61","author":"Hughes","year":"2019","journal-title":"Hum. Factors"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"116622","DOI":"10.1016\/j.neuroimage.2020.116622","article-title":"Distinguishing cognitive effort and working memory load using scale-invariance and alpha suppression in EEG","volume":"211","author":"Kardan","year":"2020","journal-title":"NeuroImage"},{"key":"ref_9","first-page":"181","article-title":"Validating theta power as an objective measure of cognitive load in educational video","volume":"68","author":"Kruger","year":"2019","journal-title":"Educ. Technol. Res. Dev."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"750","DOI":"10.1109\/LSP.2020.2989663","article-title":"Custom Domain Adaptation: A New Method for Cross-Subject, EEG-Based Cognitive Load Recognition","volume":"27","year":"2020","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Hasanbasic, A., Spahic, M., Bosnjic, D., Adzic, H.H., Mesic, V., and Jahic, O. (2019, January 20\u201322). Recognition of stress levels among students with wearable sensors. Proceedings of the 2019 18th International Symposium INFOTEH-JAHORINA (INFOTEH), East Sarajevo, Bosnia and Herzegovina.","DOI":"10.1109\/INFOTEH.2019.8717754"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1186\/1475-925X-10-96","article-title":"Nonlinear Heart Rate Variability features for real-life stress detection. Case study: Students under stress due to university examination","volume":"10","author":"Melillo","year":"2011","journal-title":"Biomed. Eng. Online"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.asoc.2019.01.006","article-title":"An application of phonocardiography signals for psychological stress detection using non-linear entropy based features in empirical mode decomposition domain","volume":"77","author":"Cheema","year":"2019","journal-title":"Appl. Soft Comput."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1109\/TNSRE.2012.2236576","article-title":"Real-Time Mental Arithmetic Task Recognition from EEG Signals","volume":"21","author":"Wang","year":"2013","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3882","DOI":"10.1364\/BOE.7.003882","article-title":"Mental stress assessment using simultaneous measurement of EEG and fNIRS","volume":"7","author":"Kiguchi","year":"2016","journal-title":"Biomed. Opt. Express"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"McDuff, D.J., Hernandez, J., Gontarek, S., and Picard, R.W. (2016, January 7\u201312). Cogcam: Contact-free measurement of cognitive stress during computer tasks with a digital camera. Presented at the in CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA.","DOI":"10.1145\/2858036.2858247"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ahn, J.W., Ku, Y., and Kim, H.C. (2019). A Novel Wearable EEG and ECG Recording System for Stress Assessment. Sensors, 19.","DOI":"10.3390\/s19091991"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.bspc.2018.06.004","article-title":"A physiological signal-based method for early mental-stress detection","volume":"46","author":"Xia","year":"2018","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1940","DOI":"10.1109\/TNSRE.2017.2701002","article-title":"Task-Independent Mental Workload Classification Based Upon Common Multiband EEG Cortical Connectivity","volume":"25","author":"Dimitrakopoulos","year":"2017","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1049\/htl.2018.5068","article-title":"Evaluating cognitive task result through heart rate pattern analysis","volume":"7","author":"Yu","year":"2020","journal-title":"Healthc. Technol. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1016\/j.procs.2019.01.234","article-title":"A data-driven framework for learners\u2019 cognitive load detection using ECG-PPG physiological feature fusion and XGBoost classification","volume":"147","author":"Wang","year":"2019","journal-title":"Procedia Comput. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"101989","DOI":"10.1016\/j.bspc.2020.101989","article-title":"EEG-based mental workload estimation using deep BLSTM-LSTM network and evolutionary algorithm","volume":"60","author":"Dey","year":"2020","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Barua, S., Ahmed, M.U., and Begum, S. (2020). Towards Intelligent Data Analytics: A Case Study in Driver Cognitive Load Classification. Brain Sci., 10.","DOI":"10.3390\/brainsci10080526"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Plechawska-W\u00f3jcik, M., Tokovarov, M., Kaczorowska, M., and Zapa\u0142a, D. (2019). A Three-Class Classification of Cognitive Workload Based on EEG Spectral Data. Appl. Sci., 9.","DOI":"10.3390\/app9245340"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"S67","DOI":"10.3233\/THC-209008","article-title":"Assessment of mental workload based on multi-physiological signals","volume":"28","author":"Fan","year":"2020","journal-title":"Technol. Health Care"},{"key":"ref_26","first-page":"149","article-title":"Psychophysiological strain correlates during cognitive workload A laboratory study using EEG and ECG","volume":"70","author":"Hillmert","year":"2020","journal-title":"Zent. Fur Arb. Arb. Und Ergon."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"e215","DOI":"10.1161\/01.CIR.101.23.e215","article-title":"PhysioBank, PhysioToolkit, and PhysioNet: Components of a new research resource for complex physiologic signals","volume":"101","author":"Goldberger","year":"2000","journal-title":"Circulation"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zyma, I., Tukaiev, S., Seleznov, I., Kiyono, K., Popov, A., Chernykh, M., and Shpenkov, O. (2019). Electroencephalograms during Mental Arithmetic Task Performance. Data, 4.","DOI":"10.3390\/data4010014"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1109\/TAFFC.2018.2792000","article-title":"Toward Constructing a Real-time Social Anxiety Evaluation System: Exploring Effective Heart Rate Features","volume":"11","author":"Wen","year":"2020","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1136\/eb-2017-102760","article-title":"Heart rate variability in bipolar disorder and borderline personality disorder: A clinical review","volume":"21","author":"Carr","year":"2018","journal-title":"\u00c9vid. Based Ment. Health"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"064004","DOI":"10.1088\/1361-6579\/ab1887","article-title":"Heart rate variability monitoring for emotion and disorders of emotion","volume":"40","author":"Zhu","year":"2019","journal-title":"Physiol. Meas."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Hua, Z., Chen, C., Zhang, R., Liu, G., and Wen, W. (2019). Diagnosing Various Severity Levels of Congestive Heart Failure Based on Long-Term HRV Signal. Appl. Sci., 9.","DOI":"10.3390\/app9122544"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"453","DOI":"10.2991\/ijcis.d.190304.001","article-title":"Intelligent Biological Alarm Clock for Monitoring Autonomic Nervous Recovery During Nap","volume":"12","author":"Xie","year":"2019","journal-title":"Int. J. Comput. Intell. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1109\/TAFFC.2017.2714671","article-title":"Emotions Recognition Using EEG Signals: A Survey","volume":"10","author":"Alarcao","year":"2019","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Han, H., Wang, W.-Y., and Mao, B.-H. (2005). Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning. International Conference on Intelligent Computing, Springer.","DOI":"10.1007\/11538059_91"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.inffus.2020.01.011","article-title":"Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review","volume":"59","author":"Zhang","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kennedy, J., and Eberhart, R.C. (1995). Particle swarm optimization. International Conference on Networks, IEEE.","DOI":"10.1109\/ICNN.1995.488968"},{"key":"ref_38","first-page":"1157","article-title":"An introduction to variable and feature selection","volume":"3","author":"Guyon","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.chemolab.2015.08.020","article-title":"Particle swarm optimization (PSO). A tutorial","volume":"149","author":"Marini","year":"2015","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1016\/j.chaos.2012.03.013","article-title":"Multiscale recurrence analysis of long-term nonlinear and nonstationary time series","volume":"45","author":"Chen","year":"2012","journal-title":"Chaos Solitons Fractals"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5122\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:08:02Z","timestamp":1760177282000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5122"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,8]]},"references-count":40,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["s20185122"],"URL":"https:\/\/doi.org\/10.3390\/s20185122","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,8]]}}}