{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T15:46:49Z","timestamp":1785512809096,"version":"3.56.0"},"reference-count":137,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2020,11,25]],"date-time":"2020-11-25T00:00:00Z","timestamp":1606262400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Dassault Aviation","award":["Dassault Aviation Chair CASAC 2016-2021"],"award-info":[{"award-number":["Dassault Aviation Chair CASAC 2016-2021"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>As systems grow more automatized, the human operator is all too often overlooked. Although human-robot interaction (HRI) can be quite demanding in terms of cognitive resources, the mental states (MS) of the operators are not yet taken into account by existing systems. As humans are no providential agents, this lack can lead to hazardous situations. The growing number of neurophysiology and machine learning tools now allows for efficient operators\u2019 MS monitoring. Sending feedback on MS in a closed-loop solution is therefore at hand. Involving a consistent automated planning technique to handle such a process could be a significant asset. This perspective article was meant to provide the reader with a synthesis of the significant literature with a view to implementing systems that adapt to the operator\u2019s MS to improve human-robot operations\u2019 safety and performance. First of all, the need for this approach is detailed regarding remote operation, an example of HRI. Then, several MS identified as crucial for this type of HRI are defined, along with relevant electrophysiological markers. A focus is made on prime degraded MS linked to time-on-task and task demands, as well as collateral MS linked to system outputs (i.e., feedback and alarms). Lastly, the principle of symbiotic HRI is detailed and one solution is proposed to include the operator state vector into the system using a mixed-initiative decisional framework to drive such an interaction.<\/jats:p>","DOI":"10.3390\/robotics9040100","type":"journal-article","created":{"date-parts":[[2020,11,25]],"date-time":"2020-11-25T20:48:12Z","timestamp":1606337292000},"page":"100","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":48,"title":["How Can Physiological Computing Benefit Human-Robot Interaction?"],"prefix":"10.3390","volume":"9","author":[{"given":"Rapha\u00eblle N.","family":"Roy","sequence":"first","affiliation":[{"name":"ISAE-SUPAERO, Universit\u00e9 de Toulouse, France"},{"name":"ANITI\u2014Artificial and Natural Intelligence Toulouse Institute, Universit\u00e9 de Toulouse, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicolas","family":"Drougard","sequence":"additional","affiliation":[{"name":"ISAE-SUPAERO, Universit\u00e9 de Toulouse, France"},{"name":"ANITI\u2014Artificial and Natural Intelligence Toulouse Institute, Universit\u00e9 de Toulouse, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thibault","family":"Gateau","sequence":"additional","affiliation":[{"name":"ISAE-SUPAERO, Universit\u00e9 de Toulouse, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fr\u00e9d\u00e9ric","family":"Dehais","sequence":"additional","affiliation":[{"name":"ISAE-SUPAERO, Universit\u00e9 de Toulouse, France"},{"name":"ANITI\u2014Artificial and Natural Intelligence Toulouse Institute, Universit\u00e9 de Toulouse, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3578-4186","authenticated-orcid":false,"given":"Caroline P. C.","family":"Chanel","sequence":"additional","affiliation":[{"name":"ISAE-SUPAERO, Universit\u00e9 de Toulouse, France"},{"name":"ANITI\u2014Artificial and Natural Intelligence Toulouse Institute, Universit\u00e9 de Toulouse, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/MC.2012.107","article-title":"Brain-computer interfaces: Beyond medical applications","volume":"45","author":"Lotte","year":"2012","journal-title":"Computer"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"13","DOI":"10.3389\/fnhum.2019.00013","article-title":"Neurotechnologies for human cognitive augmentation: Current state of the art and future prospects","volume":"13","author":"Cinel","year":"2019","journal-title":"Front. Hum. Neurosci."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Vasic, M., and Billard, A. (2013, January 6\u201310). Safety issues in human-robot interactions. Proceedings of the 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6630576"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"104667","DOI":"10.1016\/j.ssci.2020.104667","article-title":"Safety bounds in human robot interaction: A survey","volume":"127","author":"Zacharaki","year":"2020","journal-title":"Saf. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1561\/1100000005","article-title":"Human-robot Interaction: A Survey","volume":"1","author":"Goodrich","year":"2007","journal-title":"Found. Trends Hum.-Comput. Interact."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1177\/0018720816644364","article-title":"Human\u2013Robot Interaction: Status and Challenges","volume":"58","author":"Sheridan","year":"2016","journal-title":"Hum. Factors"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1002\/rob.21439","article-title":"Emergency response to the nuclear accident at the Fukushima Daiichi Nuclear Power Plants using mobile rescue robots","volume":"30","author":"Nagatani","year":"2013","journal-title":"J. Field Robot."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Reich, F., Heilemann, F., Mund, D., and Schulte, A. (2017). Self-scaling Human-Agent Cooperation Concept for Joint Fighter-UCAV Operations. Advances in Human Factors in Robots and Unmanned Systems, Springer.","DOI":"10.1007\/978-3-319-41959-6_19"},{"key":"ref_9","unstructured":"De Souza, P.E.U. (2017). Towards Mixed-Initiative Human-Robot Interaction: A Cooperative Human-Drone Team Framework. [Ph.D. Thesis, Universit\u00e9 de Toulouse, d\u00e9livr\u00e9 par l\u2019Institut Sup\u00e9rieur de l\u2019A\u00e9ronautique et de l\u2019Espace (ISAE-SUPAERO)]."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1518\/001872008X312198","article-title":"Humans: Still Vital After All These Years of Automation","volume":"50","author":"Parasuraman","year":"2008","journal-title":"Hum. Factors"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1016\/j.physbeh.2009.06.007","article-title":"Individual differences in task-related activation and performance","volume":"98","author":"VaezMousavi","year":"2009","journal-title":"Physiol. Behav."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"6","DOI":"10.3141\/2138-02","article-title":"Impact of incremental increases in cognitive workload on physiological arousal and performance in young adult drivers","volume":"2138","author":"Mehler","year":"2009","journal-title":"Transp. Res. Rec."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1093\/cercor\/9.1.20","article-title":"Physiological characteristics of capacity constraints in working memory as revealed by functional MRI","volume":"9","author":"Callicott","year":"1999","journal-title":"Cereb. Cortex"},{"key":"ref_14","unstructured":"Parasuraman, R., and Rizzo, M. (2008). Neuroergonomics: The Brain at Work, Oxford University Press."},{"key":"ref_15","unstructured":"Ayaz, H., and Dehais, F. (2018). Neuroergonomics: The Brain at Work and in Everyday Life, Academic Press."},{"key":"ref_16","unstructured":"Goodrich, M.A., Olsen, D.R., Crandall, J.W., and Palmer, T.J. (2001). Experiments in adjustable autonomy. Proceedings of IJCAI Workshop on Autonomy, Delegation and Control: Interacting with Intelligent Agents, American Association for Artificial Intelligence Press."},{"key":"ref_17","unstructured":"Huang, H.M., Messina, E., and Albus, J. (2003). Toward a Generic Model for Autonomy Levels for Unmanned Systems (ALFUS), Technical Report."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Tang, F., Mohammed, M., and Longazo, J. (2016, January 12\u201315). Experiments of human-robot teaming under sliding autonomy. Proceedings of the 2016 IEEE International Conference on Advanced Intelligent Mechatronics (AIM), Banff, AB, Canada.","DOI":"10.1109\/AIM.2016.7576752"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Truszkowski, W., Hallock, H., Rouff, C., Karlin, J., Rash, J., Hinchey, M., and Sterritt, R. (2009). Autonomous and Autonomic Systems: With Applications to NASA Intelligent Spacecraft Operations and Exploration Systems, Springer.","DOI":"10.1007\/b105417"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Huang, H.M., Pavek, K., Novak, B., Albus, J., and Messin, E. (2005). A framework for autonomy levels for unmanned systems (ALFUS). Proc. AUVSIs Unmanned Syst. N. Am., 849\u2013863.","DOI":"10.1117\/12.603725"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sheridan, T.B., and Verplank, W.L. (1978). Human and Computer Control of Undersea Teleoperators, Massachusetts Institute of Tech Cambridge Man-Machine Systems Lab. Technical Report.","DOI":"10.21236\/ADA057655"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1017\/S1816383112000768","article-title":"On banning autonomous weapon systems: Human rights, automation, and the dehumanization of lethal decision-making","volume":"94","author":"Asaro","year":"2012","journal-title":"Int. Rev. Red Cross"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1007\/s10676-018-9444-x","article-title":"Embedded ethics: Some technical and ethical challenges","volume":"20","author":"Bonnemains","year":"2018","journal-title":"Ethics Inf. Technol."},{"key":"ref_24","unstructured":"Nikitenko, A., and Durst, J. (2016). Autonomous systems and autonomy quantification. Digit. Infantary Battlef. Solut., 81."},{"key":"ref_25","unstructured":"Tessier, C., and Dehais, F. (2012). Authority Management and Conflict Solving in Human-Machine Systems. AerospaceLab, Available online: http:\/\/www.aerospacelab-journal.org\/al4\/authority-management-and-conflict-solving."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1080\/00140139.2013.877597","article-title":"Petri net-based modelling of human\u2013automation conflicts in aviation","volume":"57","author":"Pizziol","year":"2014","journal-title":"Ergonomics"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Gangl, S., Lettl, B., and Schulte, A. (2013, January 21\u201326). Single-seat cockpit-based management of multiple UCAVs using on-board cognitive agents for coordination in manned-unmanned fighter missions. Proceedings of the International Conference on Engineering Psychology and Cognitive Ergonomics, Las Vegas, NV, USA.","DOI":"10.1007\/978-3-642-39354-9_13"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Jiang, S., and Arkin, R.C. (2015, January 9\u201312). Mixed-Initiative Human-Robot Interaction: Definition, Taxonomy, and Survey. Proceedings of the 2015 IEEE International Conference on Systems, Man, and Cybernetics, Kowloon, China.","DOI":"10.1109\/SMC.2015.174"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hardin, B., and Goodrich, M.A. (2009, January 8\u201311). On using mixed-initiative control: A perspective for managing large-scale robotic teams. Proceedings of the 4th ACM\/IEEE International Conference on Human Robot Interaction, Boulder, CO, USA.","DOI":"10.1145\/1514095.1514126"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1177\/0278364916688255","article-title":"Computational design of mixed-initiative human\u2013robot teaming that considers human factors: Situational awareness, workload, and workflow preferences","volume":"36","author":"Gombolay","year":"2017","journal-title":"Int. J. Robot. Res."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Charles, J.A., Chanel, C.P.C., Chauffaut, C., Chauvin, P., and Drougard, N. (2018, January 15\u201318). Human-Agent Interaction Model Learning based on Crowdsourcing. Proceedings of the 6th International Conference on Human-Agent Interaction, Southampton, UK.","DOI":"10.1145\/3284432.3284471"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Schulte, A., Donath, D., and Honecker, F. (2015, January 9\u201312). Human-system interaction analysis for military pilot activity and mental workload determination. Proceedings of the 2015 IEEE International Conference on Systems, Man, and Cybernetics, Kowloon, China.","DOI":"10.1109\/SMC.2015.244"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Fairclough, S.H., and Gilleade, K. (2014). Advances in Physiological Computing, Springer.","DOI":"10.1007\/978-1-4471-6392-3"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.intcom.2008.10.011","article-title":"Fundamentals of physiological computing","volume":"21","author":"Fairclough","year":"2009","journal-title":"Interact. Comput."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"293","DOI":"10.3389\/fpsyg.2018.00293","article-title":"How our cognition shapes and is shaped by technology: A common framework for understanding human tool-use interactions in the past, present, and future","volume":"9","author":"Osiurak","year":"2018","journal-title":"Front. Psychol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"025005","DOI":"10.1088\/1741-2560\/8\/2\/025005","article-title":"Towards passive brain\u2013computer interfaces: Applying brain\u2013computer interface technology to human\u2014Machine systems in general","volume":"8","author":"Zander","year":"2011","journal-title":"J. Neur. Eng."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Chen, D., and Vertegaal, R. (2004, January 24\u201329). Using mental load for managing interruptions in physiologically attentive user interfaces. Proceedings of the CHI\u201904 Extended Abstracts on Human Factors in Computing Systems, Vienna, Austria.","DOI":"10.1145\/985921.986103"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Singh, G., Berm\u00f9dez i Badia, S., Ventura, R., and Silva, J.L. (2018, January 19\u201321). Physiologically Attentive User Interface for Robot Teleoperation - Real Time Emotional State Estimation and Interface Modification Using Physiology, Facial Expressions and Eye Movements. Proceedings of the Eleventh International Joint Conference on Biomedical Engineering Systems and Technologies, BIOSTEC 2018, Funchal, Madeira, Portugal.","DOI":"10.5220\/0006733002940302"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Clerc, M., Bougrain, L., and Lotte, F. (2016). Neurophysiological Markers for Passive Brain\u2013Computer Interfaces. Brain\u2013Computer Interfaces 1: Foundations and Methods, Wiley-ISTE.","DOI":"10.1002\/9781119144977"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/5254.796083","article-title":"Mixed-initiative interaction","volume":"14","author":"Allen","year":"1999","journal-title":"IEEE Intell. Syst. Appl."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MIS.2004.1265878","article-title":"Mapgen: Mixed-initiative planning and scheduling for the mars exploration rover mission","volume":"19","author":"Bresina","year":"2004","journal-title":"IEEE Intell. Syst."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Chanel, C.P., Roy, R.N., Drougard, N., and Dehais, F. (2020, January 19\u201324). Mixed-Initiative Human-Automated Agents Teaming: Towards a Flexible Cooperation Framework. Proceedings of the International Conference on Human-Computer Interaction, Copenhagen, Denmark.","DOI":"10.1007\/978-3-030-49183-3_10"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1177\/154193128803200221","article-title":"Design and Evaluation for Situation Awareness Enhancement","volume":"32","author":"Endsley","year":"1988","journal-title":"Proc. Hum. Factors Soc. Ann. Meet."},{"key":"ref_44","first-page":"507","article-title":"Sources of situation awareness errors in aviation","volume":"67","author":"Jones","year":"1996","journal-title":"Aviat. Space Environ. Med."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Endsley, M.R., and Garland, D.J. (2000). Theoretical Underpinnings of Situation Awareness: A Critical Review. Situation Awareness Analysis and Measurement, Lawrence Erlbaum Associates. Chapter 1.","DOI":"10.1201\/b12461"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1207\/s15327108ijap0101_4","article-title":"Situation Awareness: A Critical But Ill-Defined Phenomenon","volume":"1","author":"Sarter","year":"1991","journal-title":"Int. J. Aviat. Psychol."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1080","DOI":"10.1126\/science.6879207","article-title":"Performance of concurrent tasks: A psychophysiological analysis of the reciprocity of information-processing resources","volume":"221","author":"Wickens","year":"1983","journal-title":"Science"},{"key":"ref_48","unstructured":"Wickens, C.D. (2005, January 14\u201317). Attentional tunneling and task management. Proceedings of the 2005 International Symposium on Aviation Psychology, Dayton, OH, USA."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.cognition.2008.12.009","article-title":"Anatomy of an error: A bidirectional state model of task engagement\/disengagement and attention-related errors","volume":"111","author":"Cheyne","year":"2009","journal-title":"Cognition"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"383","DOI":"10.3389\/fnhum.2018.00383","article-title":"Out of the Loop, in Your Bubble: Mind Wandering Is Independent From Automation Reliability, but Influences Task Engagement","volume":"12","author":"Gouraud","year":"2018","journal-title":"Front. Hum. Neurosci."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1037\/h0025896","article-title":"Vigilance, arousal, and habituation","volume":"75","author":"Mackworth","year":"1968","journal-title":"Psychol. Rev."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1017\/S0048577201393095","article-title":"Driver fatigue: Electroencephalography and psychological assessment","volume":"39","author":"Lal","year":"2002","journal-title":"Psychophysiology"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"458","DOI":"10.1162\/jocn.2008.20037","article-title":"Going AWOL in the brain: Mind wandering reduces cortical analysis of external events","volume":"20","author":"Smallwood","year":"2008","journal-title":"J. Cogn. Neurosci."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"3040","DOI":"10.1016\/j.neuroimage.2010.10.008","article-title":"Lost in thoughts: Neural markers of low alertness during mind wandering","volume":"54","author":"Braboszcz","year":"2011","journal-title":"Neuroimage"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1093\/iwc\/iws011","article-title":"Boredom and distraction in multiple unmanned vehicle supervisory control","volume":"25","author":"Cummings","year":"2013","journal-title":"Interact. Comput."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/S0168-1591(99)00088-X","article-title":"Performing under pressure: Stress and cognitive function","volume":"65","author":"Mendl","year":"1999","journal-title":"Appl. Anim. Behav. Sci."},{"key":"ref_57","unstructured":"Cain, B. (2007). A Review of the Mental Workload Literature, Defence Research And Development Toronto (Canada). Technical Report."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Dehais, F., Tessier, C., Christophe, L., and Reuzeau, F. (2010). The perseveration syndrome in the pilot\u2019s activity: Guidelines and cognitive countermeasures. Human Error, Safety and Systems Development, Springer.","DOI":"10.1007\/978-3-642-11750-3_6"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1780","DOI":"10.3758\/s13414-011-0144-4","article-title":"Visual perceptual load induces inattentional deafness","volume":"73","author":"Macdonald","year":"2011","journal-title":"Atten. Percept. Psychophys."},{"key":"ref_60","first-page":"1926","article-title":"Automation surprises","volume":"2","author":"Sarter","year":"1997","journal-title":"Handb. Hum. Factors Ergon."},{"key":"ref_61","unstructured":"Dehais, F., Causse, M., and Pastor, J. (2008). Embedded eye tracker in a real aircraft: New perspectives on pilot\/aircraft interaction monitoring, Proceedings from The 3rd International Conference on Research in Air Transportation."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"5199","DOI":"10.1016\/j.promfg.2015.07.583","article-title":"Pupil diameter as a measure of cognitive load during auditory-visual interference in a simple piloting task","volume":"3","author":"Peysakhovich","year":"2015","journal-title":"Procedia Manuf."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"583","DOI":"10.3389\/fnhum.2013.00583","article-title":"NIRS-measured prefrontal cortex activity in neuroergonomics: Strengths and weaknesses","volume":"7","author":"Derosiere","year":"2013","journal-title":"Front. Hum. Neurosci."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"45","DOI":"10.3389\/fnsys.2015.00045","article-title":"Characterization of mind wandering using fNIRS","volume":"9","author":"Durantin","year":"2015","journal-title":"Front. Syst. Neurosci."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Gateau, T., Durantin, G., Lancelot, F., Scannella, S., and Dehais, F. (2015). Real-time state estimation in a flight simulator using fNIRS. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0121279"},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1093\/oxfordjournals.eurheartj.a014868","article-title":"Heart rate variability: Standards of measurement, physiological interpretation, and clinical use","volume":"17","author":"Malik","year":"1996","journal-title":"Eur. Heart J."},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"S\u00f6rnmo, L., and Laguna, P. (2005). Bioelectrical Signal Processing in Cardiac and Neurological Applications, Academic Press.","DOI":"10.1016\/B978-012437552-9\/50003-9"},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Roy, R.N., Charbonnier, S., and Campagne, A. (2013, January 3\u20137). Probing ECG-based mental state monitoring on short time segments. Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan.","DOI":"10.1109\/EMBC.2013.6611071"},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1109\/THMS.2017.2782483","article-title":"A Survey of Workload Assessment Algorithms","volume":"48","author":"Heard","year":"2018","journal-title":"IEEE Trans. Hum. Mach. Syst."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/j.neubiorev.2012.10.003","article-title":"Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness","volume":"44","author":"Borghini","year":"2014","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1016\/j.apergo.2011.09.004","article-title":"Cognitive conflict in human\u2013automation interactions: A psychophysiological study","volume":"43","author":"Dehais","year":"2012","journal-title":"Appl. Ergon."},{"key":"ref_72","unstructured":"Luck, S.J. (2014). An Introduction to the Event-Related Potential Technique, The MIT Press. [2nd ed.]."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1016\/j.ergon.2004.12.003","article-title":"Evaluation of mental fatigue using feature parameter extracted from event-related potential","volume":"35","author":"Murata","year":"2005","journal-title":"Int. J. Ind. Ergon."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Parasuraman, R., and Rizzo, M. (2007). Event-related potentials (ERPs) in Neuroergonomics. Neuroergonomics: The Brain at Work, Oxford University Press, Inc.","DOI":"10.1093\/acprof:oso\/9780195177619.001.0001"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1100\/tsw.2009.83","article-title":"Estimating Brain Load from the EEG","volume":"9","author":"Holm","year":"2009","journal-title":"Sci. World J."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.ifacol.2016.12.209","article-title":"Operator Engagement During Prolonged Simulated UAV Operation","volume":"49","author":"Roy","year":"2016","journal-title":"IFAC-PapersOnLine"},{"key":"ref_77","doi-asserted-by":"crossref","unstructured":"Giraudet, L., St-Louis, M.E., Scannella, S., and Causse, M. (2015). P300 event-related potential as an indicator of inattentional deafness?. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0118556"},{"key":"ref_78","unstructured":"Scannella, S., Roy, R., Laouar, A., and Dehais, F. (2016). Auditory neglect in the cockpit: Using ERPs to disentangle early from late processes in the inattentional deafness phenomenon. Proc. Int. Neuroergon. Conf."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"923","DOI":"10.1109\/TBME.2007.908083","article-title":"Error-related EEG potentials generated during simulated brain\u2013computer interaction","volume":"55","author":"Ferrez","year":"2008","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"208","DOI":"10.3389\/fnins.2014.00208","article-title":"Errare machinale est: The use of error-related potentials in brain-machine interfaces","volume":"8","author":"Chavarriaga","year":"2014","journal-title":"Front. Neurosci."},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/0301-0511(95)05116-3","article-title":"Biocybernetic system evaluates indices of operator engagement in automated task","volume":"40","author":"Pope","year":"1995","journal-title":"Biol. Psychol."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1016\/S0301-0082(98)00011-2","article-title":"Neural correlates of attention and arousal: Insights from electrophysiology, functional neuroimaging and psychopharmacology","volume":"55","author":"Coull","year":"1998","journal-title":"Prog. Neurobiol."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/S0165-0173(98)00056-3","article-title":"EEG alpha and theta oscillations reflect cognitive and memory performance: A review and analysis","volume":"29","author":"Klimesch","year":"1999","journal-title":"Brain Res. Rev."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1093\/cercor\/10.9.829","article-title":"Neurophysiological measures of working memory and individual differences in cognitive ability and cognitive style","volume":"10","author":"Gevins","year":"2000","journal-title":"Cereb. Cortex"},{"key":"ref_85","doi-asserted-by":"crossref","unstructured":"Clerc, M., Bougrain, L., and Lotte, F. (2016). EEG feature extraction. Brain\u2013Computer Interfaces 2: Signal Processing and Machine Learning, Wiley-ISTE.","DOI":"10.1002\/9781119332428"},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Roy, R.N., Bonnet, S., Charbonnier, S., and Campagne, A. (2013, January 3\u20137). Mental fatigue and working memory load estimation: Interaction and implications for EEG-based passive BCI. Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan.","DOI":"10.1109\/EMBC.2013.6611070"},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.eswa.2016.01.013","article-title":"EEG index for control operators\u2019 mental fatigue monitoring using interactions between brain regions","volume":"52","author":"Charbonnier","year":"2016","journal-title":"Expert Syst. Appl."},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1016\/j.bspc.2014.08.007","article-title":"Eye blink characterization from frontal EEG electrodes using source separation and pattern recognition algorithms","volume":"14","author":"Roy","year":"2014","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_89","unstructured":"Alpaydin, E. (2009). Introduction to Machine Learning, MIT Press."},{"key":"ref_90","first-page":"3","article-title":"Supervised machine learning: A review of classification techniques","volume":"160","author":"Kotsiantis","year":"2007","journal-title":"Emerg. Artif. Intell. Appl. Comput. Eng."},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"031005","DOI":"10.1088\/1741-2552\/aab2f2","article-title":"A review of classification algorithms for EEG-based brain\u2013computer interfaces: A 10 year update","volume":"15","author":"Lotte","year":"2018","journal-title":"J. Neural Eng."},{"key":"ref_92","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_93","unstructured":"Drougard, N., Chanel, C.P.C., Roy, R.N., and Dehais, F. (2017, January 24). Mixed-initiative mission planning considering human operator state estimation based on physiological sensors. Proceedings of the IROS-2017 workshop on Human-Robot Interaction in Collaborative Manufacturing Environments (HRI-CME), Vancouver, BC, Canada."},{"key":"ref_94","doi-asserted-by":"crossref","unstructured":"Dehais, F., Dupres, A., Di Flumeri, G., Verdiere, K., Borghini, G., Babiloni, F., and Roy, R. (2018, January 7\u201310). Monitoring pilot\u2019s cognitive fatigue with engagement features in simulated and actual flight conditions using an hybrid fNIRS-EEG passive BCI. Proceedings of the 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Miyazaki, Japan.","DOI":"10.1109\/SMC.2018.00102"},{"key":"ref_95","first-page":"114","article-title":"EEG-based workload estimation across affective contexts","volume":"8","author":"Jeunet","year":"2014","journal-title":"Front. Neurosci."},{"key":"ref_96","doi-asserted-by":"crossref","first-page":"519","DOI":"10.3389\/fnhum.2016.00519","article-title":"Efficient workload classification based on ignored auditory probes: A proof of concept","volume":"10","author":"Roy","year":"2016","journal-title":"Front. Hum. Neurosci."},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.bbr.2018.11.045","article-title":"Inattentional deafness to auditory alarms: Inter-individual differences, electrophysiological signature and single trial classification","volume":"360","author":"Dehais","year":"2019","journal-title":"Behav. Brain Res."},{"key":"ref_98","doi-asserted-by":"crossref","unstructured":"Dehais, F., Dupr\u00e8s, A., Blum, S., Drougard, N., Scannella, S., Roy, R.N., and Lotte, F. (2019). Monitoring Pilot\u2019s Mental Workload Using ERPs and Spectral Power with a Six-Dry-Electrode EEG System in Real Flight Conditions. Sensors, 19.","DOI":"10.3390\/s19061324"},{"key":"ref_99","doi-asserted-by":"crossref","first-page":"69","DOI":"10.2307\/2529937","article-title":"Discriminant analysis","volume":"35","author":"Lachenbruch","year":"1979","journal-title":"Biometrics"},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_101","first-page":"35","article-title":"A primer on kernel methods","volume":"47","author":"Vert","year":"2004","journal-title":"Kernel Methods Comput. Biol."},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1080\/00031305.1992.10475879","article-title":"An introduction to kernel and nearest-neighbor nonparametric regression","volume":"46","author":"Altman","year":"1992","journal-title":"Am. Stat."},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_104","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.1109\/5.58323","article-title":"30 years of adaptive neural networks: Perceptron, madaline, and backpropagation","volume":"78","author":"Widrow","year":"1990","journal-title":"Proc. IEEE"},{"key":"ref_105","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_106","doi-asserted-by":"crossref","first-page":"031001","DOI":"10.1088\/1741-2552\/ab0ab5","article-title":"Deep learning for electroencephalogram (EEG) classification tasks: A review","volume":"16","author":"Craik","year":"2019","journal-title":"J. Neural Eng."},{"key":"ref_107","doi-asserted-by":"crossref","unstructured":"LeCun, Y.A., Bottou, L., Orr, G.B., and M\u00fcller, K.R. (2012). Efficient backprop. Neural networks: Tricks of the Trade, Springer.","DOI":"10.1007\/978-3-642-35289-8_3"},{"key":"ref_108","doi-asserted-by":"crossref","first-page":"5391","DOI":"10.1002\/hbm.23730","article-title":"Deep learning with convolutional neural networks for EEG decoding and visualization","volume":"38","author":"Schirrmeister","year":"2017","journal-title":"Hum. Brain Map."},{"key":"ref_109","doi-asserted-by":"crossref","first-page":"R1","DOI":"10.1088\/1741-2560\/4\/2\/R01","article-title":"A review of classification algorithms for EEG-based brain\u2013computer interfaces","volume":"4","author":"Lotte","year":"2007","journal-title":"J. Neural Eng."},{"key":"ref_110","first-page":"1","article-title":"Blind source separation and independent component analysis: A review","volume":"6","author":"Choi","year":"2005","journal-title":"Neural Inform. Process.-Lett. Rev."},{"key":"ref_111","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1016\/j.neucom.2012.12.039","article-title":"Classification of covariance matrices using a Riemannian-based kernel for BCI applications","volume":"112","author":"Barachant","year":"2013","journal-title":"Neurocomputing"},{"key":"ref_112","doi-asserted-by":"crossref","first-page":"767","DOI":"10.1016\/S1388-2457(02)00057-3","article-title":"Brain\u2013computer interfaces for communication and control","volume":"113","author":"Wolpaw","year":"2002","journal-title":"Clin. Neurophysiol."},{"key":"ref_113","first-page":"1","article-title":"BCI for passive input in HCI","volume":"8","author":"Cutrell","year":"2008","journal-title":"Proc. CHI"},{"key":"ref_114","doi-asserted-by":"crossref","unstructured":"Zander, T.O., Kothe, C., Welke, S., and R\u00f6tting, M. (2009). Utilizing secondary input from passive brain-computer interfaces for enhancing human-machine interaction. International Conference on Foundations of Augmented Cognition, Springer.","DOI":"10.1007\/978-3-642-02812-0_86"},{"key":"ref_115","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1518\/hfes.45.4.601.27092","article-title":"Effects of a psychophysiological system for adaptive automation on performance, workload, and the event-related potential P300 component","volume":"45","author":"Prinzel","year":"2003","journal-title":"Hum. Factors"},{"key":"ref_116","doi-asserted-by":"crossref","unstructured":"De Souza, P.E.U., Chanel, C.P.C., and Dehais, F. (2015, January 9\u201311). MOMDP-based target search mission taking into account the human operator\u2019s cognitive state. Proceedings of the 2015 IEEE 27th International Conference on Tools with Artificial Intelligence (ICTAI), Vietri sul Mare, Italy.","DOI":"10.1109\/ICTAI.2015.109"},{"key":"ref_117","doi-asserted-by":"crossref","unstructured":"Gateau, T., Chanel, C.P.C., Le, M.H., and Dehais, F. (2016, January 9\u201314). Considering human\u2019s non-deterministic behavior and his availability state when designing a collaborative human-robots system. Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea.","DOI":"10.1109\/IROS.2016.7759646"},{"key":"ref_118","doi-asserted-by":"crossref","first-page":"1425","DOI":"10.1109\/JPROC.2006.876966","article-title":"Coordinated multiagent teams and sliding autonomy for large-scale assembly","volume":"94","author":"Sellner","year":"2006","journal-title":"Proc. IEEE"},{"key":"ref_119","unstructured":"Atrash, A., and Pineau, J. (2010, January 12). A Bayesian method for learning POMDP observation parameters for robot interaction management systems. Proceedings of the POMDP Practitioners Workshop, Toronto, BC, Canada."},{"key":"ref_120","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1016\/j.cviu.2009.06.008","article-title":"Automated handwashing assistance for persons with dementia using video and a partially observable Markov decision process","volume":"114","author":"Hoey","year":"2010","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_121","unstructured":"Dehais, F., Goudou, A., Lesire, C., and Tessier, C. (2005, January 4\u20136). Towards an anticipatory agent to help pilots. Proceedings of the AAAI 2005 Fall Symposium \u201cFrom Reactive to Anticipatory Cognitive Embodied Systems\u201d, Arlington, VA, USA."},{"key":"ref_122","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1109\/TSMCA.2007.914757","article-title":"Predicting controller capacity in supervisory control of multiple UAVs","volume":"38","author":"Cummings","year":"2008","journal-title":"IEEE Trans. Syst. Man Cybern.-Part A Syst. Hum."},{"key":"ref_123","doi-asserted-by":"crossref","unstructured":"Dehais, F., Peysakhovich, V., Scannella, S., Fongue, J., and Gateau, T. (2015, January 18\u201323). Automation surprise in aviation: Real-time solutions. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Korea.","DOI":"10.1145\/2702123.2702521"},{"key":"ref_124","doi-asserted-by":"crossref","unstructured":"Nikolaidis, S., Ramakrishnan, R., Gu, K., and Shah, J. (2015). Efficient Model Learning from Joint-Action Demonstrations for Human-Robot Collaborative Tasks. Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction, ACM.","DOI":"10.1145\/2696454.2696455"},{"key":"ref_125","doi-asserted-by":"crossref","unstructured":"Atrash, A., and Pineau, J. (2009, January 8\u201311). A bayesian reinforcement learning approach for customizing human-robot interfaces. Proceedings of the 14th International Conference on Intelligent User Interfaces, Sanibel Island, FL, USA.","DOI":"10.1145\/1502650.1502700"},{"key":"ref_126","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1109\/THMS.2014.2307258","article-title":"Formal Detection of Attentional Tunneling in Human Operator-Automation Interactions","volume":"44","author":"Regis","year":"2014","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_127","doi-asserted-by":"crossref","first-page":"1211","DOI":"10.3390\/s120201211","article-title":"Brain Computer Interfaces, a Review","volume":"12","year":"2012","journal-title":"Sensors"},{"key":"ref_128","unstructured":"Ghosh, D. (2012). An Adaptive Human Brain to ComputerInterface System for Robotic or Wheel-Chair based Navigational Tasks. [Master\u2019s Thesis, TUM Technische Iniversit\u00e4t M\u00fcnchen, KTH Industrial Engineering and Management Master of Science ]."},{"key":"ref_129","first-page":"539","article-title":"Adaptive automation triggered by EEG-based mental workload index: A passive brain-computer interface application in realistic air traffic control environment","volume":"10","author":"Borghini","year":"2016","journal-title":"Front. Hum. Neurosci."},{"key":"ref_130","doi-asserted-by":"crossref","unstructured":"Chanel, C.P., Roy, R.N., Dehais, F., and Drougard, N. (2020). Towards Mixed-Initiative Human\u2013Robot Interaction: Assessment of Discriminative Physiological and Behavioral Features for Performance Prediction. Sensors, 20.","DOI":"10.3390\/s20010296"},{"key":"ref_131","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1109\/MSMC.2020.2968638","article-title":"Modern Machine-Learning Algorithms: For Classifying Cognitive and Affective States From Electroencephalography Signals","volume":"6","author":"Appriou","year":"2020","journal-title":"IEEE Syst. Man Cybern. Mag."},{"key":"ref_132","doi-asserted-by":"crossref","unstructured":"Pongsakornsathien, N., Lim, Y., Gardi, A., Hilton, S., Planke, L., Sabatini, R., Kistan, T., and Ezer, N. (2019). Sensor networks for aerospace human-machine systems. Sensors, 19.","DOI":"10.3390\/s19163465"},{"key":"ref_133","doi-asserted-by":"crossref","first-page":"1167","DOI":"10.1007\/s12008-018-0467-7","article-title":"Design impact of acceptability and dependability in assisted living robotic applications","volume":"12","author":"Cavallo","year":"2018","journal-title":"Int. J. Interact. Des. Manuf."},{"key":"ref_134","first-page":"103","article-title":"Six human factors to acceptability of wearable computers","volume":"8","author":"Gimhae","year":"2013","journal-title":"Int. J. Multimed. Ubiquitous Eng."},{"key":"ref_135","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1002\/bjs.10795","article-title":"Systematic review of measurement tools to assess surgeons\u2019 intraoperative cognitive workload","volume":"105","author":"Dias","year":"2018","journal-title":"Br. J. Surg."},{"key":"ref_136","doi-asserted-by":"crossref","unstructured":"Omurtag, A., Roy, R.N., Dehais, F., Chatty, L., and Garbey, M. (2019). Tracking mental workload by multimodal measurements in the operating room. Neuroergonomics, Elsevier.","DOI":"10.1016\/B978-0-12-811926-6.00016-6"},{"key":"ref_137","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3368854","article-title":"Objective Assessment of Human Workload in Physical Human-robot Cooperation Using Brain Monitoring","volume":"9","author":"Memar","year":"2019","journal-title":"ACM Trans. Hum. Robot Interact."}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/9\/4\/100\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:37:24Z","timestamp":1760179044000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/9\/4\/100"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,25]]},"references-count":137,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["robotics9040100"],"URL":"https:\/\/doi.org\/10.3390\/robotics9040100","relation":{},"ISSN":["2218-6581"],"issn-type":[{"value":"2218-6581","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,25]]}}}