{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T17:55:52Z","timestamp":1772819752036,"version":"3.50.1"},"reference-count":47,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2024,3,21]],"date-time":"2024-03-21T00:00:00Z","timestamp":1710979200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Loughborough University"},{"name":"UKRI Gold Open Access Funding"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The adoption of Industry 4.0 technologies in manufacturing systems has accelerated in recent years, with a shift towards understanding operators\u2019 well-being and resilience within the context of creating a human-centric manufacturing environment. In addition to measuring physical workload, monitoring operators\u2019 cognitive workload is becoming a key element in maintaining a healthy and high-performing working environment in future digitalized manufacturing systems. The current approaches to the measurement of cognitive workload may be inadequate when human operators are faced with a series of new digitalized technologies, where their impact on operators\u2019 mental workload and performance needs to be better understood. Therefore, a new method for measuring and determining the cognitive workload is required. Here, we propose a new method for determining cognitive-workload indices in a human-centric environment. The approach provides a method to define and verify the relationships between the factors of task complexity, cognitive workload, operators\u2019 level of expertise, and indirectly, the operator performance level in a highly digitalized manufacturing environment. Our strategy is tested in a series of experiments where operators perform assembly tasks on a Wankel Engine block. The physiological signals from heart-rate variability and pupillometry bio-markers of 17 operators were captured and analysed using eye-tracking and electrocardiogram sensors. The experimental results demonstrate statistically significant differences in both cardiac and pupillometry-based cognitive load indices across the four task complexity levels (rest, low, medium, and high). Notably, these developed indices also provide better indications of cognitive load responding to changes in complexity compared to other measures. Additionally, while experts appear to exhibit lower cognitive loads across all complexity levels, further analysis is required to confirm statistically significant differences. In conclusion, the results from both measurement sensors are found to be compatible and in support of the proposed new approach. Our strategy should be useful for designing and optimizing workplace environments based on the cognitive load experienced by operators.<\/jats:p>","DOI":"10.3390\/s24062010","type":"journal-article","created":{"date-parts":[[2024,3,21]],"date-time":"2024-03-21T09:13:08Z","timestamp":1711012388000},"page":"2010","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Determining Cognitive Workload Using Physiological Measurements: Pupillometry and Heart-Rate Variability"],"prefix":"10.3390","volume":"24","author":[{"given":"Xinyue","family":"Ma","sequence":"first","affiliation":[{"name":"School of Mechanical, Electrical and Manufacturing Engineering, Loughborough University, Leicestershire LE11 3TU, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8782-3426","authenticated-orcid":false,"given":"Radmehr","family":"Monfared","sequence":"additional","affiliation":[{"name":"School of Mechanical, Electrical and Manufacturing Engineering, Loughborough University, Leicestershire LE11 3TU, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9804-9934","authenticated-orcid":false,"given":"Rebecca","family":"Grant","sequence":"additional","affiliation":[{"name":"School of Mechanical, Electrical and Manufacturing Engineering, Loughborough University, Leicestershire LE11 3TU, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5028-9506","authenticated-orcid":false,"given":"Yee Mey","family":"Goh","sequence":"additional","affiliation":[{"name":"School of Mechanical, Electrical and Manufacturing Engineering, Loughborough University, Leicestershire LE11 3TU, UK"}]}],"member":"1968","published-online":{"date-parts":[[2024,3,21]]},"reference":[{"key":"ref_1","unstructured":"Romero, D., Stahre, J., Wuest, T., Noran, O., Bernus, P., Fast-Berglund, \u00c5., and Gorecky, D. (2016, January 29\u201331). Towards an Operator 4.0 Typology: A Human-Centric Perspective on the Fourth Industrial Revolution Technologies. Proceedings of the International Conference on Computers & Industrial Engineering (CIE46), Tianjin, China."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Yan, S., Wei, Y., Li, F., and Tran, C.C. (2022). Develop a Comprehensive Method to Evaluate the Mental Workload of Ship Operators. J. Mar. Sci. Eng., 10.","DOI":"10.3390\/jmse10081133"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"692878","DOI":"10.3389\/fnhum.2021.692878","article-title":"Mental Workload Estimation Based on Physiological Features for Pilot-UAV Teaming Applications","volume":"15","author":"Singh","year":"2021","journal-title":"Front. Hum. Neurosci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1344","DOI":"10.3389\/fpsyg.2014.01344","article-title":"Mental Workload and Driving","volume":"5","author":"Paxion","year":"2014","journal-title":"Front. Psychol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"106726","DOI":"10.1016\/j.compchemeng.2020.106726","article-title":"Dynamic Assessment of Control Room Operator\u2019s Cognitive Workload Using Electroencephalography (EEG)","volume":"141","author":"Srinivasan","year":"2020","journal-title":"Comput. Chem. Eng."},{"key":"ref_6","unstructured":"Brookhuis, K.A., and de Waard, D. (2020). Stress, Workload, and Fatigue, CRC Press."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1177\/155534340700100103","article-title":"Situation Awareness in Dynamic Decision Making: Effects of Practice and Working Memory","volume":"1","author":"Wimisberg","year":"2007","journal-title":"J. Cogn. Eng. Decis. Mak."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1037\/1076-8998.5.1.11","article-title":"Stress Prevention in Bus Drivers: Evaluation of 13 Natural Experiments","volume":"5","author":"Kompier","year":"2000","journal-title":"J. Occup. Health Psychol."},{"key":"ref_9","unstructured":"Research and Innovation European Commission (2023, August 18). Industry 5.0. Available online: https:\/\/research-and-innovation.ec.europa.eu\/research-area\/industrial-research-and-innovation\/industry-50_en."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2853","DOI":"10.1007\/s10845-018-1416-9","article-title":"Industrial Wearable System: The Human-Centric Empowering Technology in Industry 4.0","volume":"30","author":"Kong","year":"2019","journal-title":"J. Intell. Manuf."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"12","DOI":"10.22215\/timreview\/1117","article-title":"The Fourth Industrial Revolution (Industry 4.0): A Social Innovation Perspective","volume":"7","author":"Morrar","year":"2017","journal-title":"Technol. Innov. Manag. Rev."},{"key":"ref_12","unstructured":"Mindas, M., and Bednar, S. (2016). Advanced Industrial Engineering, Wydawnictwo Fundacji Centrum Nowych Technologii."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Leesakul, N., Oostveen, A.-M., Eimontaite, I., Wilson, M.L., and Hyde, R. (2022). Workplace 4.0: Exploring the Implications of Technology Adoption in Digital Manufacturing on a Sustainable Workforce. Sustainability, 14.","DOI":"10.3390\/su14063311"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1016\/j.engappai.2015.03.005","article-title":"A Genetic Algorithm for the Multi-Objective Optimization of Mixed-Model Assembly Line Based on the Mental Workload","volume":"47","author":"Zhao","year":"2016","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1016\/j.ergon.2012.05.002","article-title":"What Are the Obstacles and Needs of Proactive Ergonomics Measures at Early Product Development Stages?\u2014An Interview Study in Five Swedish Companies","volume":"42","author":"Falck","year":"2012","journal-title":"Int. J. Ind. Ergon."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1002\/hfm.20623","article-title":"Does Ergonomics Improve Product Quality and Reduce Costs? A Review Article","volume":"26","author":"Zare","year":"2016","journal-title":"Hum. Factors Ergon. Manuf."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"103763","DOI":"10.1016\/j.apergo.2022.103763","article-title":"Danger, High Voltage! Using EEG and EOG Measurements for Cognitive Overload Detection in a Simulated Industrial Context","volume":"102","author":"Morton","year":"2022","journal-title":"Appl. Ergon."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"813","DOI":"10.1177\/0018720820929928","article-title":"Overloaded and at Work: Investigating the Effect of Cognitive Workload on Assembly Task Performance","volume":"63","author":"Biondi","year":"2021","journal-title":"Hum. Factors"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Buchholz, V., and Kopp, S. (2020, January 7\u20139). Towards an Adaptive Assistance System for Monitoring Tasks: Assessing Mental Workload Using Eye-Tracking and Performance Measures. Proceedings of the IEEE International Conference on Human-Machine Systems (ICHMS), Rome, Italy.","DOI":"10.1109\/ICHMS49158.2020.9209435"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"102380","DOI":"10.1016\/j.rcim.2022.102380","article-title":"An Online Framework for Cognitive Load Assessment in Industrial Tasks","volume":"78","author":"Lagomarsino","year":"2022","journal-title":"Robot. Comput. Integr. Manuf."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1177\/0305735603031002290","article-title":"Differences in Mental Abilities between Musicians and Non-Musicians","volume":"31","author":"Brandler","year":"2003","journal-title":"Psychol. Music"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"633","DOI":"10.3389\/fpsyg.2020.00633","article-title":"Mental Imagery Skills in Competitive Young Athletes and Non-Athletes","volume":"11","author":"Murgia","year":"2020","journal-title":"Front. Psychol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"598383","DOI":"10.3389\/fnsys.2021.598383","article-title":"The Effect of Media Professionalization on Cognitive Neurodynamics during Audiovisual Cuts","volume":"15","author":"Villa","year":"2021","journal-title":"Front. Syst. Neurosci."},{"key":"ref_24","unstructured":"(2017). Ergonomic Principles Related to Mental Workload\u2014Part 1: General Issues and Concepts, Terms and Definitions (Standard No. ISO 10075-1:2017). Available online: https:\/\/www.iso.org\/standard\/66900.html."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/00140139.2014.956151","article-title":"State of Science: Mental Workload in Ergonomics","volume":"58","author":"Young","year":"2015","journal-title":"Ergonomics"},{"key":"ref_26","unstructured":"Neville, S. (2019). Handbook of Human Factors and Ergonomics Methods, Taylor & Francis."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1016\/S0191-8869(00)00162-8","article-title":"Individual Differences in Energetic Arousal and Sustained Attention: A Dual-Task Study","volume":"31","author":"Matthews","year":"2001","journal-title":"Pers. Individ. Differ."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1518\/hfes.45.4.635.27088","article-title":"Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks","volume":"45","author":"Wilson","year":"2003","journal-title":"Hum. Factors"},{"key":"ref_29","first-page":"99","article-title":"Mental Workload Assessment in Military Pilots Using Flight Simulators and Physiological Sensors","volume":"Volume 1493","author":"Cesare","year":"2021","journal-title":"Proceedings of the International Symposium on Human Mental Workload: Models and Applications"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Guzm\u00e1n-Garc\u00eda, C., S\u00e1nchez-Gonz\u00e1lez, P., S\u00e1nchez Margallo, J.A., Snoriguzzi, N., Rabazo, J.C., S\u00e1nchez Margallo, F.M., G\u00f3mez, E.J., and Oropesa, I. (2022). Correlating Personal Resourcefulness and Psychomotor Skills: An Analysis of Stress, Visual Attention and Technical Metrics. Sensors, 22.","DOI":"10.3390\/s22030837"},{"key":"ref_31","unstructured":"Tobii (2023, May 10). Tobii Pro Glasses 3: Real Insights from the Real World. Available online: https:\/\/www.tobii.com\/products\/eye-trackers\/wearables\/tobii-pro-glasses-3."},{"key":"ref_32","unstructured":"Tobii Pro, A.B. (2023, August 20). Tobii Pro Lab User Manual. Available online: https:\/\/go.tobii.com\/tobii_pro_lab_user_manual."},{"key":"ref_33","unstructured":"Zephyr Technology (2023, August 20). Zephyr BioHarness 3. Available online: https:\/\/www.zephyranywhere.com\/system\/components."},{"key":"ref_34","unstructured":"Zephyr Technology (2023, August 20). BioHarness 3 Log Data Descriptions. Available online: https:\/\/www.zephyranywhere.com\/media\/download\/bioharness-log-data-descriptions-07-apr-2016.pdf."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/0749-5978(86)90044-0","article-title":"Task Complexity: Definition of the Construct","volume":"37","author":"Wood","year":"1986","journal-title":"Organ. Behav. Hum. Decis. Process"},{"key":"ref_36","unstructured":"The MathWorks Inc (2022, February 13). MATLAB Version: 9.11.0 (R2021b). Available online: https:\/\/uk.mathworks.com\/."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1336","DOI":"10.3758\/s13428-018-1075-y","article-title":"Preprocessing Pupil Size Data: Guidelines and Code","volume":"51","author":"Kret","year":"2019","journal-title":"Behav. Res. Methods"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3055","DOI":"10.3758\/s13428-022-01957-7","article-title":"Methods in Cognitive Pupillometry: Design, Preprocessing, and Statistical Analysis","volume":"55","year":"2022","journal-title":"Behav. Res. Methods"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"13289","DOI":"10.1038\/ncomms13289","article-title":"Pupil Fluctuations Track Rapid Changes in Adrenergic and Cholinergic Activity in Cortex","volume":"7","author":"Reimer","year":"2016","journal-title":"Nat. Commun."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1109\/TBME.1985.325532","article-title":"A Real-Time QRS Detection Algorithm","volume":"32","author":"Pan","year":"1985","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_41","first-page":"1","article-title":"NparLD: An R Software Package for the Nonparametric Analysis of Longitudinal Data in Factorial Experiments","volume":"50","author":"Noguchi","year":"2012","journal-title":"JSS J. Stat. Softw."},{"key":"ref_42","unstructured":"RStudio Team (2023, May 10). RStudio: Integrated Development for R. Available online: http:\/\/www.rstudio.com\/."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1093\/eurheartj\/ehm584","article-title":"Work Stress and Coronary Heart Disease: What Are the Mechanisms?","volume":"29","author":"Chandola","year":"2008","journal-title":"Eur. Heart J."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"838","DOI":"10.3349\/ymj.2004.45.5.838","article-title":"Association between Job Stress on Heart Rate Variability and Metabolic Syndrome in Shipyard Male Workers","volume":"45","author":"Kang","year":"2004","journal-title":"Yonsei Med. J."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Fink, L., Simola, J., Tavano, A., Lange, E., Wallot, S., and Laeng, B. (2023). From Pre-Processing to Advanced Dynamic Modeling of Pupil Data. Behav. Res. Methods, 1\u201337.","DOI":"10.3758\/s13428-023-02098-1"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"258","DOI":"10.3389\/fpubh.2017.00258","article-title":"An Overview of Heart Rate Variability Metrics and Norms","volume":"5","author":"Shaffer","year":"2017","journal-title":"Front. Public Health"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Held, J., V\u00eesl\u0103, A., Wolfer, C., Messerli-B\u00fcrgy, N., and Fl\u00fcckiger, C. (2021). Heart Rate Variability Change during a Stressful Cognitive Task in Individuals with Anxiety and Control Participants. BMC Psychol., 9.","DOI":"10.1186\/s40359-021-00551-4"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/6\/2010\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:17:28Z","timestamp":1760105848000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/6\/2010"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,21]]},"references-count":47,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["s24062010"],"URL":"https:\/\/doi.org\/10.3390\/s24062010","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,21]]}}}