{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,10]],"date-time":"2026-11-10T17:09:35Z","timestamp":1794330575666,"version":"4.9.0"},"reference-count":55,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T00:00:00Z","timestamp":1788220800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["RGPIN-2024-04808"],"award-info":[{"award-number":["RGPIN-2024-04808"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neuroergonomics"],"abstract":"<jats:p>\n                    We asked how far multimodal consumer-wearable signals recorded during real general-aviation flight can be treated as construct-relevant measurement rather than as records of motion, posture, or task structure. Forty pilots flew five standardized maneuvers in a Cessna 172 while frontal electroencephalography (EEG and AF7\/AF8), cardiac activity, electrodermal activity (EDA), eye movements, skin temperature, and flight dynamics were recorded, with segments paired with pilot self-reports and the four in-air maneuvers additionally paired with instructor competency ratings. We assembled three nested tiers of evidence, namely, known-groups sensitivity, within-person convergent evidence, and criterion-related association, and then tested prediction in held-out pilots. Signal quality supported inference, with trial-level availability from 85% to 97%. Self-reported stress varied across maneuvers (\n                    <jats:italic>H<\/jats:italic>\n                    = 61.1), but because maneuver order was largely fixed this variation is confounded with elapsed time, fatigue, physical dynamics, and sensor settling, and therefore cannot establish that any signal is specific to stress. Within-person convergence was strongest for cardiac (mean heart rate\n                    <jats:italic>r<\/jats:italic>\n                    <jats:sub>rm<\/jats:sub>\n                    =.57) and oculomotor (saccade and fixation rates\n                    <jats:italic>r<\/jats:italic>\n                    <jats:sub>rm<\/jats:sub>\n                    =.39) channels, with phasic EDA and frontal theta adding weaker support. Criterion-tier associations were re-examined with leave-one-pilot-out and wild cluster bootstrap inference: Kinematic and electrodermal associations held, whereas every frontal theta\/alpha association proved to rest on individual pilots and did not survive. In cross-validation with tuning nested inside each training fold, sensor features did not exceed a maneuver-only baseline across pilots. Low-cost cardiac and oculomotor channels are the most promising basis for within-person stress monitoring, while pilot-general prediction will require individual calibration, stronger reference measures, and larger samples.\n                  <\/jats:p>","DOI":"10.3389\/fnrgo.2026.1911259","type":"journal-article","created":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T04:27:08Z","timestamp":1788236828000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["From signal to construct evidence: multimodal consumer-wearable sensing in real general-aviation flight"],"prefix":"10.3389","volume":"7","author":[{"given":"Rongbing","family":"Xu","sequence":"first","affiliation":[{"name":"Department of Systems Design Engineering, University of Waterloo","place":["Waterloo, ON, Canada"]},{"name":"Waterloo Institute for Sustainable Aeronautics, University of Waterloo","place":["Waterloo, ON, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shi","family":"Cao","sequence":"additional","affiliation":[{"name":"Department of Systems Design Engineering, University of Waterloo","place":["Waterloo, ON, Canada"]},{"name":"Waterloo Institute for Sustainable Aeronautics, University of Waterloo","place":["Waterloo, ON, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Barnett-Cowan","sequence":"additional","affiliation":[{"name":"Waterloo Institute for Sustainable Aeronautics, University of Waterloo","place":["Waterloo, ON, Canada"]},{"name":"Department of Kinesiology and Health Sciences, University of Waterloo","place":["Waterloo, ON, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gulnaz","family":"Bulbul","sequence":"additional","affiliation":[{"name":"Waterloo Institute for Sustainable Aeronautics, University of Waterloo","place":["Waterloo, ON, Canada"]},{"name":"Department of Geography and Environmental Management, University of Waterloo","place":["Waterloo, ON, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Suzanne","family":"Kearns","sequence":"additional","affiliation":[{"name":"Waterloo Institute for Sustainable Aeronautics, University of Waterloo","place":["Waterloo, ON, Canada"]},{"name":"Department of Geography and Environmental Management, University of Waterloo","place":["Waterloo, ON, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ewa","family":"Niechwiej-Szwedo","sequence":"additional","affiliation":[{"name":"Waterloo Institute for Sustainable Aeronautics, University of Waterloo","place":["Waterloo, ON, Canada"]},{"name":"Department of Kinesiology and Health Sciences, University of Waterloo","place":["Waterloo, ON, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,9,1]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"456","DOI":"10.3389\/fpsyg.2017.00456","article-title":"Repeated measures correlation","volume":"8","author":"Bakdash","year":"2017","journal-title":"Front. Psychol"},{"key":"B2","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1016\/j.jml.2012.11.001","article-title":"Random effects structure for confirmatory hypothesis testing: keep it maximal","volume":"68","author":"Barr","year":"2013","journal-title":"J. Mem. Lang"},{"key":"B3","doi-asserted-by":"publisher","first-page":"647","DOI":"10.1111\/j.1469-8986.2009.00972.x","article-title":"Decomposition of skin conductance data by means of nonnegative deconvolution","volume":"47","author":"Benedek","year":"2010","journal-title":"Psychophysiology"},{"key":"B4","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. Royal Statist. Soc.: Series B"},{"key":"B5","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1038\/s41746-020-0226-6","article-title":"Investigating sources of inaccuracy in wearable optical heart rate sensors","volume":"3","author":"Bent","year":"2020","journal-title":"NPJ Digit. Med"},{"key":"B6","doi-asserted-by":"publisher","first-page":"21412","DOI":"10.1038\/s41598-022-25949-x","article-title":"Data quality evaluation in wearable monitoring","volume":"12","author":"B\u00f6ttcher","year":"2022","journal-title":"Sci. Rep"},{"key":"B7","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4614-1126-0","volume-title":"Electrodermal Activity","author":"Boucsein","year":"2012"},{"key":"B8","doi-asserted-by":"publisher","first-page":"1017","DOI":"10.1111\/j.1469-8986.2012.01384.x","article-title":"Publication recommendations for electrodermal measurements","volume":"49","author":"Boucsein","year":"2012","journal-title":"Psychophysiology"},{"key":"B9","doi-asserted-by":"crossref","first-page":"3603","DOI":"10.1109\/BIBM52615.2021.9669778","article-title":"\u201cValidating the wearable MUSE headset for EEG spectral analysis and frontal alpha asymmetry,\u201d","volume-title":"2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM)","author":"Cannard","year":"2021"},{"key":"B10","doi-asserted-by":"publisher","first-page":"70","DOI":"10.3390\/technologies8040070","article-title":"Validity and reliability of physiological data in applied settings measured by wearable technology: a rapid systematic review","volume":"8","author":"Carrier","year":"2020","journal-title":"Technologies"},{"key":"B11","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1016\/j.ijpsycho.2020.05.010","article-title":"Best practices in eye tracking research","volume":"155","author":"Carter","year":"2020","journal-title":"Int. J. Psychophysiol"},{"key":"B12","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1016\/j.tics.2014.04.012","article-title":"Frontal theta as a mechanism for cognitive control","volume":"18","author":"Cavanagh","year":"2014","journal-title":"Trends Cogn. Sci"},{"key":"B13","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1016\/j.apergo.2018.08.028","article-title":"Measuring mental workload using physiological measures: a systematic review","volume":"74","author":"Charles","year":"2019","journal-title":"Appl. Ergon"},{"key":"B14","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1037\/h0040957","article-title":"Construct validity in psychological tests","volume":"52","author":"Cronbach","year":"1955","journal-title":"Psychol. Bull"},{"key":"B15","doi-asserted-by":"publisher","first-page":"1324","DOI":"10.3390\/s19061324","article-title":"Monitoring pilot's mental workload using ERPs and spectral power with a six-dry-electrode EEG system in real flight conditions","volume":"19","author":"Dehais","year":"2019","journal-title":"Sensors"},{"key":"B16","doi-asserted-by":"publisher","first-page":"5863","DOI":"10.3390\/s23135863","article-title":"On the reliability of wearable technology: a tutorial on measuring heart rate and heart rate variability in the wild","volume":"23","author":"Dudarev","year":"2023","journal-title":"Sensors"},{"key":"B17","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1518\/001872095779049499","article-title":"Measurement of situation awareness in dynamic systems","volume":"37","author":"Endsley","year":"","journal-title":"Hum. Factors"},{"key":"B18","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1518\/001872095779049543","article-title":"Toward a theory of situation awareness in dynamic systems","volume":"37","author":"Endsley","year":"","journal-title":"Hum. Factors"},{"key":"B19","doi-asserted-by":"publisher","first-page":"787","DOI":"10.3390\/ijerph18020787","article-title":"Impact of real and simulated flights on psychophysiological response of military pilots","volume":"18","author":"Fuentes-Garc\u00eda","year":"2021","journal-title":"Int. J. Environ. Res. Public Health"},{"key":"B20","doi-asserted-by":"publisher","first-page":"e0121279","DOI":"10.1371\/journal.pone.0121279","article-title":"Real-time state estimation in a flight simulator using fNIRS","volume":"10","author":"Gateau","year":"2015","journal-title":"PLoS ONE"},{"key":"B21","doi-asserted-by":"publisher","first-page":"1525","DOI":"10.1007\/s00421-019-04142-5","article-title":"RR interval signal quality of a heart rate monitor and an ECG Holter at rest and during exercise","volume":"119","author":"Gilgen-Ammann","year":"2019","journal-title":"Eur. J. Appl. Physiol"},{"key":"B22","first-page":"366","article-title":"\u201cReliability of instructor pilots' non-technical skills ratings,\u201d","volume-title":"Proceedings of the 18th International Symposium on Aviation Psychology","author":"Gontar","year":"2015"},{"key":"B23","doi-asserted-by":"publisher","first-page":"797","DOI":"10.1109\/TBME.2015.2474131","article-title":"cvxEDA: a convex optimization approach to electrodermal activity processing","volume":"63","author":"Greco","year":"2016","journal-title":"IEEE Trans. Biomed. Eng"},{"key":"B24","first-page":"360","article-title":"A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight","volume":"69","author":"Hankins","year":"1998","journal-title":"Aviat. Space Environm. Med"},{"key":"B25","first-page":"139","article-title":"\u201cDevelopment of NASA-TLX (Task Load Index): Results of empirical and theoretical research,\u201d","volume-title":"Human Mental Workload","author":"Hart","year":"1988"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3758\/s13428-024-02387-3","article-title":"From lab to life: Evaluating the reliability and validity of psychophysiological data from wearable devices in laboratory and ambulatory settings","volume":"56","author":"Hu","year":"2024","journal-title":"Behav. Res. Methods"},{"key":"B27","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1177\/0018720819830553","article-title":"Cardiac measures of cognitive workload: A meta-analysis","volume":"61","author":"Hughes","year":"2019","journal-title":"Hum. Factors"},{"key":"B28","doi-asserted-by":"publisher","first-page":"834","DOI":"10.3357\/AMHP.4782.2017","article-title":"Psychophysiological assessment in pilots performing challenging simulated and real flight maneuvers","volume":"88","author":"Johannes","year":"2017","journal-title":"Aerospace Med. Human Perform"},{"key":"B29","first-page":"1151","article-title":"\u201cPupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction,\u201d","volume-title":"Adjunct Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing","author":"Kassner","year":"2014"},{"key":"B30","doi-asserted-by":"publisher","first-page":"1460","DOI":"10.1109\/TBME.2017.2758643","article-title":"Simple, transparent, and flexible automated quality assessment procedures for ambulatory electrodermal activity data","volume":"65","author":"Kleckner","year":"2018","journal-title":"IEEE Trans. Biomed. Eng"},{"key":"B31","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1016\/S0165-0173(98)00056-3","article-title":"EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis","volume":"29","author":"Klimesch","year":"1999","journal-title":"Brain Res. Rev"},{"key":"B32","doi-asserted-by":"publisher","first-page":"606","DOI":"10.1016\/j.tics.2012.10.007","article-title":"Alpha-band oscillations, attention, and controlled access to stored information","volume":"16","author":"Klimesch","year":"2012","journal-title":"Trends Cogn. Sci"},{"key":"B33","doi-asserted-by":"publisher","first-page":"109","DOI":"10.3389\/fnins.2017.00109","article-title":"Choosing MUSE: validation of a low-cost, portable EEG system for ERP research","volume":"11","author":"Krigolson","year":"2017","journal-title":"Front. Neurosci"},{"key":"B34","doi-asserted-by":"publisher","first-page":"928","DOI":"10.1017\/aer.2023.101","article-title":"A review of physiological measures for mental workload assessment in aviation","volume":"128","author":"Luzzani","year":"2024","journal-title":"Aeronaut. J"},{"key":"B35","doi-asserted-by":"publisher","first-page":"1689","DOI":"10.3758\/s13428-020-01516-y","article-title":"Neurokit2: a Python toolbox for neurophysiological signal processing","volume":"53","author":"Makowski","year":"2021","journal-title":"Behav. Res. Methods"},{"key":"B36","doi-asserted-by":"publisher","first-page":"889","DOI":"10.3389\/fnhum.2013.00889","article-title":"Neuroergonomics: a review of applications to physical and cognitive work","volume":"7","author":"Mehta","year":"2013","journal-title":"Front. Hum. Neurosci"},{"key":"B37","doi-asserted-by":"publisher","first-page":"148","DOI":"10.3389\/fnbeh.2020.00148","article-title":"Validating measures of electrodermal activity and heart rate variability derived from the Empatica E4 utilized in research settings that involve interactive dyadic states","volume":"14","author":"Milstein","year":"2020","journal-title":"Front. Behav. Neurosci"},{"key":"B38","doi-asserted-by":"publisher","first-page":"832","DOI":"10.1109\/JBHI.2014.2338351","article-title":"Signal-quality indices for the electrocardiogram and photoplethysmogram: Derivation and applications to wireless monitoring","volume":"19","author":"Orphanidou","year":"2015","journal-title":"IEEE J. Biomed. Health Inform"},{"key":"B39","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1080\/14639220210199753","article-title":"Neuroergonomics: Research and practice","volume":"4","author":"Parasuraman","year":"2003","journal-title":"Theoret. Issues Ergonom. Sci"},{"key":"B40","doi-asserted-by":"publisher","first-page":"743","DOI":"10.3389\/fphys.2018.00743","article-title":"A critical review of consumer wearables, mobile applications, and equipment for providing biofeedback, monitoring stress, and sleep in physically active populations","volume":"9","author":"Peake","year":"2018","journal-title":"Front. Physiol"},{"key":"B41","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1080\/24721840.2018.1514978","article-title":"Eye-tracking measures in aviation: a selective literature review","volume":"28","author":"Pei\u00dfl","year":"2018","journal-title":"Int. J. Aerospace Psychol"},{"key":"B42","doi-asserted-by":"publisher","first-page":"861967","DOI":"10.3389\/fninf.2022.861967","article-title":"An evaluation of the EEG alpha-to-theta and theta-to-alpha band ratios as indexes of mental workload","volume":"16","author":"Raufi","year":"2022","journal-title":"Front. Neuroinform"},{"key":"B43","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1016\/0301-0511(92)90018-P","article-title":"Assessing pilot workload. Why measure heart rate, HRV and respiration?","volume":"34","author":"Roscoe","year":"1992","journal-title":"Biol.Psychol"},{"key":"B44","doi-asserted-by":"publisher","first-page":"6536","DOI":"10.3390\/s22176536","article-title":"Validity of the Polar H10 sensor for heart rate variability analysis during resting state and incremental exercise in recreational men and women","volume":"22","author":"Schaffarczyk","year":"2022","journal-title":"Sensors"},{"key":"B45","doi-asserted-by":"publisher","first-page":"258","DOI":"10.3389\/fpubh.2017.00258","article-title":"An overview of heart rate variability metrics and norms","volume":"5","author":"Shaffer","year":"2017","journal-title":"Front. Public Health"},{"key":"B46","doi-asserted-by":"crossref","first-page":"111","DOI":"10.4324\/9781315087924-8","article-title":"\u201cSituational awareness rating technique (SART): the development of a tool for aircrew systems design,\u201d","volume-title":"Situational Awareness","author":"Taylor","year":"2017"},{"key":"B47","doi-asserted-by":"publisher","first-page":"607","DOI":"10.3758\/s13428-019-01263-9","article-title":"A standardized validity assessment protocol for physiological signals from wearable technology: methodological underpinnings and an application to the E4 biosensor","volume":"52","author":"van Lier","year":"2020","journal-title":"Behav. Res. Methods"},{"key":"B48","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1207\/S15327108IJAP1201_4","article-title":"A comparative study of psychophysiological reactions during simulator and real flight","volume":"12","author":"Veltman","year":"2002","journal-title":"Int. J. Aviat. Psychol"},{"key":"B49","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1518\/001872008X288394","article-title":"Multiple resources and mental workload","volume":"50","author":"Wickens","year":"2008","journal-title":"Hum. Factors"},{"key":"B50","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1207\/S15327108IJAP1201_2","article-title":"An analysis of mental workload in pilots during flight using multiple psychophysiological measures","volume":"12","author":"Wilson","year":"2002","journal-title":"Int. J. Aviat. Psychol"},{"key":"B51","doi-asserted-by":"publisher","first-page":"103589","DOI":"10.1016\/j.mex.2025.103589","article-title":"An in-flight multimodal data collection method for assessing pilot cognitive states and performance in general aviation","volume":"15","author":"Xu","year":"2025","journal-title":"MethodsX"},{"key":"B52","doi-asserted-by":"publisher","first-page":"3627","DOI":"10.3390\/s26123627","article-title":"Consumer-grade wearable sensors for classifying pilot workload and stress during real flight training: a leave-one-subject-out validation study","volume":"26","author":"Xu","year":"","journal-title":"Sensors"},{"key":"B53","doi-asserted-by":"publisher","first-page":"24515","DOI":"10.1109\/JSEN.2026.3708589","article-title":"Feasibility of participant-independent classification of pilot stress and workload during real in-aircraft tasks using consumer-grade frontal EEG","volume":"26","author":"Xu","year":"","journal-title":"IEEE Sens. J"},{"key":"B54","doi-asserted-by":"crossref","DOI":"10.1109\/ICASSP55912.2026.11463821","article-title":"\u201cGranger causality analysis of pilots' physiological data,\u201d","volume-title":"ICASSP 2026-IEEE International Conference on Acoustics, Speech and Signal Processing","author":"Zahorska","year":"2026"},{"key":"B55","doi-asserted-by":"publisher","first-page":"025005","DOI":"10.1088\/1741-2560\/8\/2\/025005","article-title":"Towards passive brain-computer interfaces: applying brain-computer interface technology to human-machine systems in general","volume":"8","author":"Zander","year":"2011","journal-title":"J. Neural Eng"}],"container-title":["Frontiers in Neuroergonomics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnrgo.2026.1911259\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T04:27:11Z","timestamp":1788236831000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnrgo.2026.1911259\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,1]]},"references-count":55,"alternative-id":["10.3389\/fnrgo.2026.1911259"],"URL":"https:\/\/doi.org\/10.3389\/fnrgo.2026.1911259","relation":{"has-part":[{"id-type":"doi","id":"https:\/\/doi.org\/10.3389\/fnrgo.2026.1911259.s001","asserted-by":"subject"}]},"ISSN":["2673-6195"],"issn-type":[{"value":"2673-6195","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,1]]},"article-number":"1911259"}}