{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T11:17:18Z","timestamp":1788434238755,"version":"build-2803163510"},"reference-count":44,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T00:00:00Z","timestamp":1785801600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Industry 5.0 cobotics calls for collaborative robots that adapt to the operator\u2019s physical and cognitive state in real time. Most current industrial deployments remain reactive, responding only after explicit commands and ignoring the operator\u2019s psychophysiological condition. The three-module Human-Centric Digital Twin (HCDT) framework establishes the upstream perception-and-reasoning architecture for such systems using Vision-Language Models, and identifies closed-loop feedback and physical-assistance mechanisms as the natural next layer in the framework\u2019s development. Building on that foundation, this paper presents a complementary, real-time instantiation specialised for the resource-constrained, vision-plus-biosignal setting typical of ergonomics-and-safety HRC, deployed on a standard collaborative robot (Universal Robots UR3 with a Robotiq 2F-85 gripper) and extended with closed-loop operator-state adaptation. The Perception module pairs MediaPipe hand-landmark tracking and a Random Forest gesture classifier with Tobii Pro Glasses 3 pupillometry. The Reasoning module combines a ten-state finite-state machine, a weighted composite fatigue score (blink rate, blink duration, PERCLOS, hand-jerk) banded into FRESH, MILD, MODERATE and SEVERE, a saccade-gated commitment fixation, and a Task-Evoked Pupillary Response (TEPR) detector for acute-stress soft-emergency-stop. The Motion module provides a closed-form analytical inverse-kinematics solver, workspace clamping and a slew-rate-limited joint-velocity controller. Velocity-based linear extrapolation of hand position over a 0.5 s horizon enables anticipatory robot pre-positioning. The system is presented as a single-operator feasibility study rather than a generalisation claim. On a leak-free split-then-augment evaluation (520 raw test samples not seen by the training fold in any orientation), the Random Forest classifier reaches 99.62% accuracy with both errors falling in the Okay-Neutral confusion pair that the geometric override layer is designed to catch; a comparison against MLP and KNN baselines on the same split shows all three classifiers within the real-time control budget. Saccade-gated early-commit is designed to recover the modelled 150\u2013300 ms gaze-to-motion lead, and the TEPR Soft E-Stop operates on an independent 300\u2013500 ms channel. End-to-end gesture-to-motion latency has a conservative worst-case ceiling of approximately 830 ms, formed by a camera-buffer term, the 10-frame debounce and one control tick, inside the 1-s interactive response-time limit adopted as the design target. Owing to a Tobii Pro Glasses 3 hardware fault, the physiological pathways (fatigue banding, TEPR soft-stop and gaze commitment) were verified through their downstream control responses to simulated triggers rather than validated on organic pupil data; organic, multi-participant validation is identified as future work.<\/jats:p>","DOI":"10.3389\/frobt.2026.1897261","type":"journal-article","created":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T04:27:49Z","timestamp":1785817669000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Predictive fatigue-aware human-robot collaboration: a real-time, open-source ROS 2 instantiation of a three-module human-centric digital twin framework on a standard cobot"],"prefix":"10.3389","volume":"13","author":[{"given":"Ranidu P.","family":"Goonetilleke","sequence":"first","affiliation":[{"name":"Digital Innovation Research Group, Department of Engineering, School of Science and Technology, Nottingham Trent University","place":["Nottingham, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Azfar","family":"Khalid","sequence":"additional","affiliation":[{"name":"Digital Innovation Research Group, Department of Engineering, School of Science and Technology, Nottingham Trent University","place":["Nottingham, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,8,4]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1177\/18761364251388806","article-title":"Human digital twins: principles and challenges","volume":"18","author":"Abell\u00e1n","year":"2026","journal-title":"J. Ambient Intell. Smart Environ."},{"key":"B2","first-page":"1","article-title":"Recent trends in HCI: a survey on data glove, leap motion and Microsoft Kinect","author":"Aditya","year":"2018"},{"key":"B3","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1016\/S0169-8141(96)00044-3","article-title":"Perceived quality of fatigue during different occupational tasks: development of a questionnaire","volume":"20","author":"Ahsberg","year":"1997","journal-title":"Int. J. Indust. Ergonomics"},{"key":"B4","doi-asserted-by":"publisher","first-page":"957","DOI":"10.1007\/s10514-017-9677-2","article-title":"Progress and prospects of the human\u2013robot collaboration","volume":"42","author":"Ajoudani","year":"2018","journal-title":"Aut. Robots"},{"key":"B5","doi-asserted-by":"publisher","first-page":"3938","DOI":"10.3390\/s23083938","article-title":"Human-Centric Digital Twins in Industry: a comprehensive review of enabling technologies and implementation strategies","volume":"23","author":"Asad","year":"2023","journal-title":"Sensors"},{"key":"B6","doi-asserted-by":"publisher","first-page":"656","DOI":"10.3390\/biomimetics10100656","article-title":"A human intention and motion prediction framework for applications in human-centric digital twins","volume":"10","author":"Asad","year":"2025","journal-title":"Biomimetics"},{"key":"B7","doi-asserted-by":"publisher","first-page":"276","DOI":"10.1037\/0033-2909.91.2.276","article-title":"Task-evoked pupillary responses, processing load, and the structure of processing resources","volume":"91","author":"Beatty","year":"1982","journal-title":"Psychol. Bull."},{"key":"B8","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1016\/j.trf.2010.12.001","article-title":"Driver workload and eye blink duration","volume":"14","author":"Benedetto","year":"2011","journal-title":"Transp. Res. Part F"},{"key":"B9","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1016\/j.bspc.2019.02.011","article-title":"A review on EMG-based motor intention prediction of continuous human upper-limb motion for human-robot collaboration","volume":"51","author":"Bi","year":"2019","journal-title":"Biomed. Signal Process. Control"},{"key":"B10","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"B11","doi-asserted-by":"publisher","first-page":"6458","DOI":"10.1080\/10447318.2023.2254639","article-title":"Mental workload and human-robot interaction in collaborative tasks: a scoping review","volume":"40","author":"Carissoli","year":"2024","journal-title":"Int. J. Human-Computer Interact."},{"key":"B12","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1016\/0950-7051(93)90017-N","article-title":"Wizard of Oz studies: why and how","volume":"6","author":"Dahlb\u00e4ck","year":"1993","journal-title":"Knowledge-Based Syst."},{"key":"B13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1504\/IJHFE.2025.10074824","article-title":"Applications of digital twin in human factors, ergonomics and organisational dynamics","volume":"12","author":"De Angelis","year":"2025","journal-title":"Int. J. Hum. Factors Ergonomics"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1825254","DOI":"10.3389\/frobt.2026.1825254","article-title":"A methodological framework and experimental protocol for proactive human-robot collaboration with multimodal intention prediction and adaptive control","volume":"13","author":"Escobar-Naranjo","year":"2026","journal-title":"Front. Robotics AI"},{"key":"B15","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511811685","volume-title":"Multiple View Geometry in Computer Vision","author":"Hartley","year":"2004"},{"key":"B16","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1016\/j.tics.2005.02.009","article-title":"Eye movements in natural behavior","volume":"9","author":"Hayhoe","year":"2005","journal-title":"Trends Cognitive Sci."},{"key":"B17","volume-title":"Fatigue and work-related Accidents","year":"2021"},{"key":"B18","doi-asserted-by":"publisher","first-page":"764","DOI":"10.1080\/01691864.2019.1636714","article-title":"Human-robot interaction in industrial collaborative robotics: a literature review of the decade 2008\u20132017","volume":"33","author":"Hentout","year":"2019","journal-title":"Adv. Robot."},{"key":"B19","volume-title":"IFRA_LinkAttacher: A ROS 2 Gazebo Plugin for fixed-joint Link Attachment","year":"2023"},{"key":"B20","volume-title":"ISO 15066:2016 Robots and Robotic Devices: Collaborative Robots","year":"2016"},{"key":"B21","volume-title":"ISO 10218-1:2025 Robotics, Safety Requirements for Robot Systems in Industrial Environments, Part 1: Robots","year":"2025"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1052","DOI":"10.1109\/TVT.2004.830974","article-title":"Real-time nonintrusive monitoring and prediction of driver fatigue","volume":"53","author":"Ji","year":"2004","journal-title":"IEEE Trans. Veh. Technol."},{"key":"B23","doi-asserted-by":"crossref","DOI":"10.1109\/SWC57546.2023.10448745","article-title":"Human motion analysis for developing a human-centric digital twin","author":"Khan","year":"2023"},{"key":"B24","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1109\/TPAMI.2015.2430335","article-title":"Anticipating human activities using object affordances for reactive robotic response","volume":"38","author":"Koppula","year":"2016","journal-title":"IEEE Trans. Pattern Analysis Mach. Intell."},{"key":"B25","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1177\/1745691611427305","article-title":"Pupillometry: a window to the preconscious?","volume":"7","author":"Laeng","year":"2012","journal-title":"Perspect. Psychol. Sci."},{"key":"B26","doi-asserted-by":"publisher","first-page":"86947","DOI":"10.1109\/ACCESS.2024.3416517","article-title":"ETHICA: designing human digital twins, a systematic review and proposed methodology","volume":"12","author":"Lauer-Schmaltz","year":"2024","journal-title":"IEEE Access"},{"key":"B27","doi-asserted-by":"publisher","first-page":"eabm6074","DOI":"10.1126\/scirobotics.abm6074","article-title":"Robot Operating System 2: design, architecture, and uses in the wild","volume":"7","author":"Macenski","year":"2022","journal-title":"Sci. Robotics"},{"key":"B28","first-page":"299","article-title":"Human-robot collaborative manipulation planning using early prediction of human motion","author":"Mainprice","year":"2013"},{"key":"B29","doi-asserted-by":"publisher","first-page":"2854","DOI":"10.1016\/j.promfg.2015.07.783","article-title":"Review of eye-related measures of drivers\u2019 mental workload","volume":"3","author":"Marquart","year":"2015","journal-title":"Procedia Manuf."},{"key":"B30","doi-asserted-by":"publisher","first-page":"38565","DOI":"10.1038\/srep38565","article-title":"Noninvasive electroencephalogram based control of a robotic arm for reach and grasp tasks","volume":"6","author":"Meng","year":"2016","journal-title":"Sci. Rep."},{"key":"B31","doi-asserted-by":"publisher","first-page":"2551000","DOI":"10.1080\/19397038.2025.2551000","article-title":"Human-centric Industry 5.0 manufacturing: a multi-level framework from design to consumption within Society 5.0","volume":"18","author":"Nasir","year":"2025","journal-title":"Int. J. Sustain. Eng."},{"key":"B32","doi-asserted-by":"crossref","DOI":"10.1016\/B978-0-08-052029-2.50007-3","volume-title":"Usability Engineering","author":"Nielsen","year":"1993"},{"key":"B33","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1109\/MIM.2019.8674634","article-title":"Deep learning-based hand gesture recognition for collaborative robots","volume":"22","author":"Nuzzi","year":"2019","journal-title":"IEEE Instrum. Meas. Mag."},{"key":"B34","doi-asserted-by":"crossref","DOI":"10.1109\/ETFA61755.2024.10711109","article-title":"Human trust and digital twins in a human factors and ergonomic framework","author":"Pietrantoni","year":"2024"},{"key":"B35","doi-asserted-by":"publisher","first-page":"26754","DOI":"10.1109\/ACCESS.2017.2773127","article-title":"Working together: a review on safe human-robot collaboration in industrial environments","volume":"5","author":"Robla-G\u00f3mez","year":"2017","journal-title":"IEEE Access"},{"key":"B36","article-title":"Real-time eye blink detection using facial landmarks","author":"Soukupov\u00e1","year":"2016"},{"key":"B37","volume-title":"Tobii Pro Glasses 3 Datasheet","year":"2022"},{"key":"B38","doi-asserted-by":"publisher","first-page":"2394","DOI":"10.1109\/LRA.2018.2812906","article-title":"Human-aware robotic assistant for collaborative assembly: integrating human motion prediction with planning in time","volume":"3","author":"Unhelkar","year":"2018","journal-title":"IEEE Robotics Automation Lett."},{"key":"B39","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1016\/j.mechatronics.2018.02.009","article-title":"Survey on human-robot collaboration in industrial settings: safety, intuitive interfaces and applications","volume":"55","author":"Villani","year":"2018","journal-title":"Mechatronics"},{"key":"B40","doi-asserted-by":"publisher","first-page":"11291","DOI":"10.1109\/TASE.2024.3410703","article-title":"A digital twin driven human-centric ecosystem for Industry 5.0","volume":"22","author":"Villani","year":"2025","journal-title":"IEEE Trans. Automation Sci. Eng."},{"key":"B41","doi-asserted-by":"publisher","first-page":"701","DOI":"10.1016\/j.cirp.2019.05.002","article-title":"Symbiotic human-robot collaborative assembly","volume":"68","author":"Wang","year":"2019","journal-title":"CIRP Ann."},{"key":"B42","volume-title":"Experimental Psychology","author":"Woodworth","year":"1938"},{"key":"B43","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4899-5379-7","volume-title":"Eye Movements and Vision","author":"Yarbus","year":"1967"},{"key":"B44","unstructured":"MediaPipe hands: on-device real-time hand tracking\n          \n          \n            \n              Zhang\n              F.\n            \n            \n              Bazarevsky\n              V.\n            \n            \n              Vakunov\n              A.\n            \n            \n              Tkachenka\n              A.\n            \n            \n              Sung\n              G.\n            \n            \n              Chang\n              C. L.\n            \n          \n          10.48550\/arXiv.2006.10214\n          arXiv Preprint\n          \n          2020"}],"updated-by":[{"DOI":"10.3389\/frobt.2026.1964098","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T00:00:00Z","timestamp":1788393600000}}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2026.1897261\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T10:39:47Z","timestamp":1788431987000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2026.1897261\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,4]]},"references-count":44,"alternative-id":["10.3389\/frobt.2026.1897261"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2026.1897261","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,4]]},"article-number":"1897261"}}