{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T07:24:23Z","timestamp":1760081063956,"version":"3.44.0"},"reference-count":61,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,8,20]],"date-time":"2025-08-20T00:00:00Z","timestamp":1755648000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:p>Trust, mental workload, and situation awareness (TWSA) are cognitive states important to human performance and human-autonomy teaming. Individual and team performance may be improved if operators can maintain ideal levels of TWSA. Predictions of operator TWSA can inform adaptive autonomy and resource allocation in teams, helping achieve this goal. Current approaches of estimating TWSA, such as questionnaires or behavioral measures, are obtrusive, task-specific, or cannot be used in real-time. Psychophysiological modeling has the potential to overcome these limitations, but prior work is limited in operational feasibility. To help address this gap, we develop psychophysiological models that can be used in real time and that do not rely on operator-specific background information. We assess the impacts of these constraints on the models' performance. Participants (<jats:italic>n<\/jats:italic> = 10) performed a human-autonomy teaming task in which they monitored a simulated spacecraft habitat. Regression models using LASSO-based feature selection were fit with an emphasis on model stability and generalizability. We demonstrate functional model fit (Adjusted <jats:italic>R<\/jats:italic><jats:sup>2<\/jats:sup>: <jats:italic>T<\/jats:italic> = 0.67, <jats:italic>W<\/jats:italic> = 0.60, SA = 0.85). Furthermore, model performance extends to predictive ability, assessed via leave-one-participant-out cross validation (<jats:italic>Q<\/jats:italic><jats:sup>2<\/jats:sup>: <jats:italic>T<\/jats:italic> = 0.58, <jats:italic>W<\/jats:italic> = 0.46, SA = 0.74). This study evaluates model performance to help establish the viability of real-time, operator-agnostic models of TWSA.<\/jats:p>","DOI":"10.3389\/fcomp.2025.1549399","type":"journal-article","created":{"date-parts":[[2025,8,20]],"date-time":"2025-08-20T05:35:01Z","timestamp":1755668101000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Operator-agnostic and real-time usable psychophysiological models of trust, workload, and situation awareness"],"prefix":"10.3389","volume":"7","author":[{"given":"Erin E.","family":"Richardson","sequence":"first","affiliation":[]},{"given":"Jacob R.","family":"Kintz","sequence":"additional","affiliation":[]},{"given":"Savannah L.","family":"Buchner","sequence":"additional","affiliation":[]},{"given":"Torin K.","family":"Clark","sequence":"additional","affiliation":[]},{"given":"Allison P.","family":"Hayman","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2025,8,20]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1109\/MCS.2020.3019151","article-title":"Human trust-based feedback control: dynamically varying automation transparency to optimize human-machine interactions","volume":"40","author":"Akash","year":"2020","journal-title":"IEEE Control Syst. Mag"},{"key":"B2","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1145\/3340555.3353735","author":"Appel","year":"2019"},{"key":"B3","doi-asserted-by":"publisher","first-page":"942","DOI":"10.3357\/AMHP.4343.2015","article-title":"Development and validation of the cognition test battery for spaceflight","volume":"86","author":"Basner","year":"2015","journal-title":"Aerosp. Med. Hum. Perform"},{"key":"B4","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1016\/j.jneumeth.2010.04.028","article-title":"A continuous measure of phasic electrodermal activity","volume":"190","author":"Benedek","year":"2010","journal-title":"J. Neurosci. Methods"},{"key":"B5","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1023\/B:GRUP.0000021840.85686.57","article-title":"The influence of task load and automation trust on deception detection","volume":"13","author":"Biros","year":"2004","journal-title":"Group Decis. Negot"},{"volume-title":"Guide for Analysing Electrodermal Activity and Skin Conductance Responses for Psychological Experiments","year":"2013","author":"Braithwaite","key":"B6"},{"key":"B7","doi-asserted-by":"publisher","first-page":"291","DOI":"10.2307\/1403680","article-title":"Submodel selection and evaluation in regression. The X-random case","volume":"60","author":"Breiman","year":"1992","journal-title":"Int. Stat. Rev"},{"key":"B8","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1177\/15553434241310084","article-title":"Assessing physiological signal utility and sensor burden in estimating trust, situation awareness, and mental workload","volume":"19","author":"Buchner","year":"2025","journal-title":"J. Cogn. Eng. Decis. Mak"},{"key":"B9","first-page":"103","volume":"8","author":"Buenaflor","year":"2013","journal-title":"Six Human Factors to Acceptability of Wearable Computers"},{"volume-title":"Measuring and Evaluating Workload: A Primer","year":"2010","author":"Casner","key":"B10"},{"key":"B11","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1016\/j.autcon.2017.08.005","article-title":"What drives construction workers' acceptance of wearable technologies in the workplace?: indoor localization and wearable health devices for occupational safety and health","volume":"84","author":"Choi","year":"2017","journal-title":"Autom. Constr"},{"key":"B12","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1177\/154193128803200221","article-title":"Design and evaluation for situation awareness enhancement","volume":"32","author":"Endsley","year":"1988","journal-title":"Proc. Hum. Factors Soc. Annu. Meet"},{"key":"B13","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1177\/154193129804200119","article-title":"A comparative analysis of sagat and sart for evaluations of situation awareness","volume":"42","author":"Endsley","year":"1998","journal-title":"Proc. Hum. Factors Ergon. Soc. Annu. Meet"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1008","DOI":"10.1177\/0018720812443983","article-title":"Toward a characterization of adaptive systems: a framework for researchers and system designers","volume":"54","author":"Feigh","year":"2012","journal-title":"Hum. Factors"},{"key":"B15","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1109\/CCMB.2014.7020692","author":"Ferreira","year":"2014"},{"key":"B16","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1111\/j.1469-8986.1981.tb03024.x","article-title":"Publication recommendations for electrodermal measurements","volume":"18","author":"Fowles","year":"1981","journal-title":"Psychophysiology"},{"key":"B17","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1145\/1864349.1864395","author":"Haapalainen","year":"2010"},{"journal-title":"Statistical Thinking","year":"2017","author":"Harrell","key":"B18"},{"year":"2020","author":"Heard","key":"B19","doi-asserted-by":"publisher","DOI":"10.1109\/CogSIMA49017.2020.9215996"},{"key":"B20","doi-asserted-by":"publisher","first-page":"220","DOI":"10.1080\/1463922021000020918","article-title":"Neuroadaptive technologies: applying neuroergonomics to the design of advanced interfaces","volume":"4","author":"Hettinger","year":"2003","journal-title":"Theor. Issues Ergon. Sci"},{"key":"B21","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1109\/RSTSCC.2010.5712835","author":"Jeyarani","year":"2010"},{"key":"B22","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1207\/S15327566IJCE0401_04","article-title":"Foundations for an empirically determined scale of trust in automated systems","volume":"4","author":"Jian","year":"2000","journal-title":"Int. J. Cogn. Ergon"},{"key":"B23","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1080\/1463922021000054335","article-title":"The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task","volume":"5","author":"Kaber","year":"2004","journal-title":"Theor. Issues Ergon. Sci"},{"key":"B24","doi-asserted-by":"publisher","first-page":"1151","DOI":"10.1145\/2638728.2641695","author":"Kassner","year":"2014"},{"journal-title":"Signal Processing Techniques for Removing Noise from ECG Signals","year":"2019","author":"Kher","key":"B25"},{"key":"B26","doi-asserted-by":"publisher","first-page":"94001","DOI":"10.1088\/1361-6579\/aad7e6","article-title":"Optimized breath detection algorithm in electrical impedance tomography","volume":"39","author":"Khodadad","year":"2018","journal-title":"Physiol. Meas"},{"year":"","author":"Kintz","key":"B27"},{"key":"B28","doi-asserted-by":"publisher","first-page":"1142","DOI":"10.1177\/00187208221129371","article-title":"Estimation of subjectively reported trust, mental workload, and situation awareness using unobtrusive measures","volume":"65","author":"Kintz","year":"","journal-title":"Hum. Factors"},{"year":"","author":"Kintz","key":"B29","doi-asserted-by":"publisher","DOI":"10.1109\/SMC53992.2023.10394254"},{"key":"B30","doi-asserted-by":"publisher","first-page":"604977","DOI":"10.3389\/fpsyg.2021.604977","article-title":"Measurement of trust in automation: a narrative review and reference guide","volume":"12","author":"Kohn","year":"2021","journal-title":"Front. Psychol"},{"key":"B31","doi-asserted-by":"publisher","first-page":"770000","DOI":"10.3389\/fpsyg.2021.770000","article-title":"Supervised classification of operator functional state based on physiological data: application to drones swarm piloting","volume":"12","author":"Kostenko","year":"2021","journal-title":"Front. Psychol"},{"key":"B32","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1518\/hfes.46.1.50.30392","article-title":"Trust in automation: designing for appropriate reliance","volume":"46","author":"Lee","year":"2004","journal-title":"Hum. Factors"},{"key":"B33","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1109\/TITS.2007.895298","article-title":"Real-time detection of driver cognitive distraction using support vector machines","volume":"8","author":"Liang","year":"2007","journal-title":"IEEE Trans. Intell. Transp. Syst"},{"key":"B34","doi-asserted-by":"publisher","first-page":"846","DOI":"10.1177\/00187208211033445","article-title":"The impact of transparency and decision risk on human\u2013automation teaming outcomes","volume":"65","author":"Loft","year":"2023","journal-title":"Hum. Factors"},{"key":"B35","doi-asserted-by":"publisher","first-page":"883321","DOI":"10.3389\/fpsyg.2022.883321","article-title":"Human mental workload: a survey and a novel inclusive definition","volume":"13","author":"Longo","year":"2022","journal-title":"Front. Psychol"},{"first-page":"4768","year":"2017","author":"Lundberg","key":"B36"},{"key":"B37","doi-asserted-by":"publisher","first-page":"1689","DOI":"10.3758\/s13428-020-01516-y","article-title":"NeuroKit2: a python toolbox for neurophysiological signal processing","volume":"53","author":"Makowski","year":"2021","journal-title":"Behav. Res. Methods"},{"key":"B38","doi-asserted-by":"publisher","first-page":"374","DOI":"10.1016\/j.csda.2006.12.019","article-title":"Relaxed lasso","volume":"52","author":"Meinshausen","year":"2007","journal-title":"Comput. Stat. Data Anal"},{"key":"B39","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1111\/j.1467-9868.2010.00740.x","article-title":"Stability selection","volume":"72","author":"Meinshausen","year":"2010","journal-title":"J. R. Stat. Soc. Ser. B"},{"key":"B40","doi-asserted-by":"publisher","first-page":"225","DOI":"10.3389\/fpsyg.2019.00225","article-title":"Automation-induced complacency potential: development and validation of a new scale","volume":"10","author":"Merritt","year":"2019","journal-title":"Front. Psychol"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.226","article-title":"R-DECO: an open-source Matlab based graphical user interface for the detection and correction of R-peaks. PeerJ","author":"Moeyersons","year":"2019","journal-title":"Comput. Sci"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.5812\/traumamon.58161","article-title":"Evaluation of nursing workload and efficiency of staff allocation in a trauma intensive care unit","author":"Momennasab","year":"2018","journal-title":"Trauma Monthly"},{"key":"B43","doi-asserted-by":"publisher","first-page":"173","DOI":"10.21236\/AD0474470","article-title":"Effects of knowledge of results and differential monetary reward on six uninterrupted hours of monitoring","volume":"7","author":"Montague","year":"1965","journal-title":"Hum. Factors"},{"key":"B44","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1177\/0018720810376055","article-title":"Complacency and bias in human use of automation: an attentional integration","volume":"52","author":"Parasuraman","year":"2010","journal-title":"Hum. Factors"},{"key":"B45","doi-asserted-by":"publisher","first-page":"286","DOI":"10.1109\/3468.844354","article-title":"A model for types and levels of human interaction with automation","volume":"30","author":"Parasuraman","year":"2000","journal-title":"IEEE Trans. Syst. Man Cybern. Part A Syst. Hum"},{"key":"B46","doi-asserted-by":"publisher","first-page":"140","DOI":"10.1518\/155534308X284417","article-title":"Situation awareness, mental workload, and trust in automation: viable, empirically supported cognitive engineering constructs","volume":"2","author":"Parasuraman","year":"2008","journal-title":"J. Cogn. Eng. Decis. Mak"},{"first-page":"2438","year":"2024","author":"Richardson","key":"B47"},{"volume-title":"Assessing Pilot Workload in Flight","year":"1984","author":"Roscoe","key":"B48"},{"volume-title":"A Subjective Rating Scale for Assessing Pilot Workload in Flight: A decade of Practical Use","year":"1990","author":"Roscoe","key":"B49"},{"volume-title":"Crew Factors in Flight Operations 9: Effects of Planned Cockpit Rest on Crew Performance and Alertness in Long-haul Operations","year":"1994","author":"Rosekind","key":"B50"},{"key":"B51","doi-asserted-by":"publisher","first-page":"512","DOI":"10.1080\/00140130802379129","article-title":"Impact of automated decision aids on performance, operator behaviour and workload in a simulated supervisory control task","volume":"52","author":"R\u00f6ttger","year":"2009","journal-title":"Ergonomics"},{"key":"B52","doi-asserted-by":"publisher","first-page":"1627","DOI":"10.1021\/ac60214a047","article-title":"Smoothing and differentiation of data by simplified least squares procedures","volume":"36","author":"Savitzky","year":"1964","journal-title":"Anal. Chem"},{"key":"B53","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1518\/107118191786755706","volume":"35","author":"Selcon","year":"1991","journal-title":"Proceedings of the Human Factors Society Annual Meeting"},{"year":"1990","author":"Taylor","key":"B54"},{"key":"B55","doi-asserted-by":"publisher","first-page":"5380","DOI":"10.3390\/s20185380","article-title":"A Usability study of physiological measurement in school using wearable sensors","volume":"20","author":"Thammasan","year":"2020","journal-title":"Sensors"},{"key":"B56","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J. R. Stat. Soc. Ser. B Methodol"},{"key":"B57","doi-asserted-by":"publisher","first-page":"11032","DOI":"10.1038\/s41598-022-14456-8","article-title":"Dynamic ensemble prediction of cognitive performance in spaceflight","volume":"12","author":"Tu","year":"2022","journal-title":"Sci. Rep"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.1155\/2020\/5640784","article-title":"Cognitive load identification of pilots based on physiological-psychological characteristics in complex environments","author":"Wang","year":"2020","journal-title":"J. Adv. Transp"},{"key":"B59","doi-asserted-by":"publisher","first-page":"618","DOI":"10.1109\/TSMC.1981.4308760","article-title":"Force management decision requirements for air force tactical command and control","volume":"11","author":"Wohl","year":"1981","journal-title":"IEEE Trans. Syst. Man Cybern"},{"key":"B60","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1109\/THMS.2018.2803025","article-title":"Real-time assessment of the cross-task mental workload using physiological measures during anomaly detection","volume":"48","author":"Zhao","year":"2018","journal-title":"IEEE Trans. Hum.-Mach. Syst"},{"key":"B61","doi-asserted-by":"publisher","first-page":"2284","DOI":"10.1109\/TITS.2021.3069776","article-title":"Using eye-tracking data to predict situation awareness in real time during takeover transitions in conditionally automated driving","volume":"23","author":"Zhou","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst"}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2025.1549399\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,20]],"date-time":"2025-08-20T05:35:03Z","timestamp":1755668103000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2025.1549399\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,20]]},"references-count":61,"alternative-id":["10.3389\/fcomp.2025.1549399"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2025.1549399","relation":{},"ISSN":["2624-9898"],"issn-type":[{"type":"electronic","value":"2624-9898"}],"subject":[],"published":{"date-parts":[[2025,8,20]]},"article-number":"1549399"}}