{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T16:06:27Z","timestamp":1774627587637,"version":"3.50.1"},"reference-count":104,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,3,19]],"date-time":"2021-03-19T00:00:00Z","timestamp":1616112000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2021,3,19]]},"abstract":"<jats:p>The capability of measuring human performance objectively is hard to overstate, especially in the context of the instructor and student relationship within the process of learning. In this work, we investigate the automated classification of cognitive load leveraging the aviation domain as a surrogate for complex task workload induction. We use a mixed virtual and physical flight environment, given a suite of biometric sensors utilizing the HTC Vive Pro Eye and the E4 Empatica. We create and evaluate multiple models. And we have taken advantage of advancements in deep learning such as generative learning, multi-modal learning, multi-task learning, and x-vector architectures to classify multiple tasks across 40 subjects inclusive of three subject types --- pilots, operators, and novices. Our cognitive load model can automate the evaluation of cognitive load agnostic to subject, subject type, and flight maneuver (task) with an accuracy of over 80%. Further, this approach is validated with real-flight data from five test pilots collected over two test and evaluation flights on a C-17 aircraft.<\/jats:p>","DOI":"10.1145\/3448111","type":"journal-article","created":{"date-parts":[[2021,3,30]],"date-time":"2021-03-30T18:56:41Z","timestamp":1617130601000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":36,"title":["Objective Measures of Cognitive Load Using Deep Multi-Modal Learning"],"prefix":"10.1145","volume":"5","author":[{"given":"Justin C.","family":"Wilson","sequence":"first","affiliation":[{"name":"Computer and Cyber Sciences, United States Air Force Academy, Colorado, USA"}]},{"given":"Suku","family":"Nair","sequence":"additional","affiliation":[{"name":"AT&amp;T Center for Virtualization, Southern Methodist University, Dallas, Texas, USA"}]},{"given":"Sandro","family":"Scielzo","sequence":"additional","affiliation":[{"name":"Link Training and Simulation, L3Harris Technologies, Arlington, Texas, USA"}]},{"given":"Eric C.","family":"Larson","sequence":"additional","affiliation":[{"name":"Computer Science, AT&amp;T Center for Virtualization, Southern Methodist University, Dallas, Texas, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,3,30]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130898"},{"key":"e_1_2_1_2_1","unstructured":"William Albert and Thomas Tullis. 2013. Measuring the user experience: collecting analyzing and presenting usability metrics. Newnes.  William Albert and Thomas Tullis. 2013. Measuring the user experience: collecting analyzing and presenting usability metrics. Newnes."},{"key":"e_1_2_1_3_1","volume-title":"Working memory: Activation limitations on retrieval. Cognitive psychology 30, 3","author":"Anderson John R","year":"1996","unstructured":"John R Anderson , Lynne M Reder , and Christian Lebiere . 1996. Working memory: Activation limitations on retrieval. Cognitive psychology 30, 3 ( 1996 ), 221--256. Publisher : Academic Press . John R Anderson, Lynne M Reder, and Christian Lebiere. 1996. Working memory: Activation limitations on retrieval. Cognitive psychology 30, 3 (1996), 221--256. Publisher: Academic Press."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3204493.3204531"},{"key":"e_1_2_1_5_1","volume-title":"Exploring Working Memory","author":"Baddeley Alan D","unstructured":"Alan D Baddeley and Graham Hitch . 2017. Working memory . In Exploring Working Memory . Routledge , 43--79. Alan D Baddeley and Graham Hitch. 2017. Working memory. In Exploring Working Memory. Routledge, 43--79."},{"key":"e_1_2_1_6_1","volume-title":"Models of working memory: Mechanisms of active maintenance and executive control","author":"Baddeley Alan D.","unstructured":"Alan D. Baddeley , Robert H. Logie , Akira Miyake , and Priti Shah . 1999. The Multiple-Component Model . In Models of working memory: Mechanisms of active maintenance and executive control . Cambridge University Press , 28. Alan D. Baddeley, Robert H. Logie, Akira Miyake, and Priti Shah. 1999. The Multiple-Component Model. In Models of working memory: Mechanisms of active maintenance and executive control. Cambridge University Press, 28."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1037\/0278-7393.33.3.570"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-8986.1985.tb01660.x"},{"key":"e_1_2_1_9_1","volume-title":"Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological bulletin 91, 2","author":"Beatty Jackson","year":"1982","unstructured":"Jackson Beatty . 1982. Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological bulletin 91, 2 ( 1982 ), 276. Publisher : American Psychological Association . Jackson Beatty. 1982. Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological bulletin 91, 2 (1982), 276. Publisher: American Psychological Association."},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the Human Factors Society Annual Meeting","volume":"33","author":"Bittner Alvah C","year":"1989","unstructured":"Alvah C Bittner Jr , James C Byers , Susan G Hill , Allen L Zaklad , and Richard E Christ . 1989 . Generic workload ratings of a mobile air defense system (LOS-FH) . In Proceedings of the Human Factors Society Annual Meeting , Vol. 33 . SAGE Publications Sage CA: Los Angeles, CA, 1476--1480. Issue : 20. Alvah C Bittner Jr, James C Byers, Susan G Hill, Allen L Zaklad, and Richard E Christ. 1989. Generic workload ratings of a mobile air defense system (LOS-FH). In Proceedings of the Human Factors Society Annual Meeting, Vol. 33. SAGE Publications Sage CA: Los Angeles, CA, 1476--1480. Issue: 20."},{"key":"e_1_2_1_11_1","first-page":"1017","article-title":"A guide for analysing electrodermal activity (EDA) & skin conductance responses (SCRs) for psychological experiments","volume":"49","author":"Braithwaite Jason J","year":"2013","unstructured":"Jason J Braithwaite , Derrick G Watson , Robert Jones , and Mickey Rowe . 2013 . A guide for analysing electrodermal activity (EDA) & skin conductance responses (SCRs) for psychological experiments . Psychophysiology 49 , 1 (2013), 1017 -- 1034 . Jason J Braithwaite, Derrick G Watson, Robert Jones, and Mickey Rowe. 2013. A guide for analysing electrodermal activity (EDA) & skin conductance responses (SCRs) for psychological experiments. Psychophysiology 49, 1 (2013), 1017--1034.","journal-title":"Psychophysiology"},{"key":"e_1_2_1_12_1","volume-title":"Random forests. Machine learning 45, 1","author":"Breiman Leo","year":"2001","unstructured":"Leo Breiman . 2001. Random forests. Machine learning 45, 1 ( 2001 ), 5--32. Publisher : Springer . Leo Breiman. 2001. Random forests. Machine learning 45, 1 (2001), 5--32. Publisher: Springer."},{"key":"e_1_2_1_13_1","first-page":"536","article-title":"On the theory of filter amplifiers","volume":"7","author":"Butterworth Stephen","year":"1930","unstructured":"Stephen Butterworth and others. 1930 . On the theory of filter amplifiers . Wireless Engineer 7 , 6 (1930), 536 -- 541 . Stephen Butterworth and others. 1930. On the theory of filter amplifiers. Wireless Engineer 7, 6 (1930), 536--541.","journal-title":"Wireless Engineer"},{"key":"e_1_2_1_14_1","volume-title":"Handbook of Psychophysiology","author":"Cacioppo John T.","unstructured":"John T. Cacioppo , Louis G. Tassinary , and Gary Berntson . 2007. Handbook of Psychophysiology . Cambridge University Press . John T. Cacioppo, Louis G. Tassinary, and Gary Berntson. 2007. Handbook of Psychophysiology. Cambridge University Press."},{"key":"e_1_2_1_15_1","volume-title":"DARPA Emerging Technologies. Strategic Studies Quarterly","author":"Calhoun Paul","year":"2016","unstructured":"Paul Calhoun . 2016. DARPA Emerging Technologies. Strategic Studies Quarterly ( 2016 ), 91--113. Paul Calhoun. 2016. DARPA Emerging Technologies. Strategic Studies Quarterly (2016), 91--113."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/0022-0965(82)90054-6"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2071536.2071547"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13421-013-0366-x"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intell.2008.01.002"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.123.4.354"},{"key":"e_1_2_1_24_1","first-page":"450","article-title":"Individual differences in working memory and reading","volume":"19","author":"Daneman Meredyth","year":"1980","unstructured":"Meredyth Daneman and Patricia A Carpenter . 1980 . Individual differences in working memory and reading . Journal of Memory and Language 19 , 4 (1980), 450 . Publisher: Academic Press. Meredyth Daneman and Patricia A Carpenter. 1980. Individual differences in working memory and reading. Journal of Memory and Language 19, 4 (1980), 450. Publisher: Academic Press.","journal-title":"Journal of Memory and Language"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2017.3025"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the 1st International Symposium on Handheld and Ubiquitous Computing (HUC '99)","author":"Anind","unstructured":"Anind K. Dey and Gregory D. Abowd. 1999. Towards a Better Understanding of Context and Context-Awareness . In Proceedings of the 1st International Symposium on Handheld and Ubiquitous Computing (HUC '99) . Springer-Verlag, London, UK, UK, 304--307. http:\/\/dl.acm.org\/citation.cfm?id=647985.743843 event-place: Karlsruhe, Germany. Anind K. Dey and Gregory D. Abowd. 1999. Towards a Better Understanding of Context and Context-Awareness. In Proceedings of the 1st International Symposium on Handheld and Ubiquitous Computing (HUC '99). Springer-Verlag, London, UK, UK, 304--307. http:\/\/dl.acm.org\/citation.cfm?id=647985.743843 event-place: Karlsruhe, Germany."},{"key":"e_1_2_1_27_1","volume-title":"Executive functions. Annual review of psychology 64","author":"Diamond Adele","year":"2013","unstructured":"Adele Diamond . 2013. Executive functions. Annual review of psychology 64 ( 2013 ), 135--168. https:\/\/doi.org\/10.1146\/annurev-psych-113011-143750 Publisher : Annual Reviews . Adele Diamond. 2013. Executive functions. Annual review of psychology 64 (2013), 135--168. https:\/\/doi.org\/10.1146\/annurev-psych-113011-143750 Publisher: Annual Reviews."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1518\/155534307X255618"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02289261"},{"key":"e_1_2_1_30_1","volume-title":"Eye tracking metrics for workload estimation in flight deck operations. Theses and Dissertations","author":"Edward Ellis Kyle Kent","year":"2009","unstructured":"Kyle Kent Edward Ellis . 2009. Eye tracking metrics for workload estimation in flight deck operations. Theses and Dissertations ( 2009 ), 288. Kyle Kent Edward Ellis. 2009. Eye tracking metrics for workload estimation in flight deck operations. Theses and Dissertations (2009), 288."},{"key":"e_1_2_1_31_1","volume-title":"Interservice\/Industry Training, Simulation, and Education Conference","author":"Engler J","unstructured":"J Engler , T Schnell , and M Walwanis . 2013. Deterministically nonlinear dynamical classification of cognitive workload . In Interservice\/Industry Training, Simulation, and Education Conference , Orlando, FL . J Engler, T Schnell, and M Walwanis. 2013. Deterministically nonlinear dynamical classification of cognitive workload. In Interservice\/Industry Training, Simulation, and Education Conference, Orlando, FL."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1080\/03610919908813578"},{"key":"e_1_2_1_33_1","volume-title":"The prefrontal cortex","author":"Fuster Joaquin","unstructured":"Joaquin Fuster . 2015. Overview of Prefrontal Functions: E Pluribus Unum - Coordinating New Sequences of Purposeful Action . In The prefrontal cortex . Academic Press , 394. Joaquin Fuster. 2015. Overview of Prefrontal Functions: E Pluribus Unum - Coordinating New Sequences of Purposeful Action. In The prefrontal cortex. Academic Press, 394."},{"key":"e_1_2_1_34_1","volume-title":"Students' investment of mental effort. In annual meeting of the american educational research association","author":"Gimino A","unstructured":"A Gimino . 2002. Students' investment of mental effort. In annual meeting of the american educational research association , New Orleans, LA . A Gimino. 2002. Students' investment of mental effort. In annual meeting of the american educational research association, New Orleans, LA."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-8986.1985.tb01658.x"},{"key":"e_1_2_1_36_1","volume-title":"Deep Learning","author":"Goodfellow Ian","unstructured":"Ian Goodfellow , Yoshua Bengio , and Aaron Courville . 2016. Convolutional Networks . In Deep Learning . The MIT Press , 321--361. Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Convolutional Networks. In Deep Learning. The MIT Press, 321--361."},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 38th Symposium of Society of Experimental Test Pilots","author":"Gray WR","year":"2007","unstructured":"WR Gray . 2007 . A boundary avoidance tracking flight test technique for performance and workload assessment . In Proceedings of the 38th Symposium of Society of Experimental Test Pilots , San Diego. WR Gray. 2007. A boundary avoidance tracking flight test technique for performance and workload assessment. In Proceedings of the 38th Symposium of Society of Experimental Test Pilots, San Diego."},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","unstructured":"William Gray. 2008. A generalized handling qualities flight test technique utilizing boundary avoidance tracking. In 2008 US Air Force T&E Days. 1648.  William Gray. 2008. A generalized handling qualities flight test technique utilizing boundary avoidance tracking. In 2008 US Air Force T&E Days. 1648.","DOI":"10.2514\/6.2008-1648"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/78.492552"},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the 12th ACM international conference on Ubiquitous computing. ACM, Copenhagen Denmark, 301--310","author":"Haapalainen Eija","year":"1864","unstructured":"Eija Haapalainen , SeungJun Kim , Jodi F. Forlizzi , and Anind K. Dey . 2010. Psycho-physiological measures for assessing cognitive load . In Proceedings of the 12th ACM international conference on Ubiquitous computing. ACM, Copenhagen Denmark, 301--310 . https:\/\/doi.org\/10.1145\/ 1864 349.1864395 Eija Haapalainen, SeungJun Kim, Jodi F. Forlizzi, and Anind K. Dey. 2010. Psycho-physiological measures for assessing cognitive load. In Proceedings of the 12th ACM international conference on Ubiquitous computing. ACM, Copenhagen Denmark, 301--310. https:\/\/doi.org\/10.1145\/1864349.1864395"},{"key":"e_1_2_1_42_1","volume-title":"Physiological reflections of mental workload. Aviation, space, and environmental medicine","author":"Hancock Peter A","year":"1985","unstructured":"Peter A Hancock , Najmedin Meshkati , and MM Robertson . 1985. Physiological reflections of mental workload. Aviation, space, and environmental medicine ( 1985 ). Publisher : Aerospace Medical Assn . Peter A Hancock, Najmedin Meshkati, and MM Robertson. 1985. Physiological reflections of mental workload. Aviation, space, and environmental medicine (1985). Publisher: Aerospace Medical Assn."},{"key":"e_1_2_1_43_1","unstructured":"Thais Hanson. 2018. L3 Introduces First-Ever High-Fidelity Mixed Reality Deployable Training Simulator. https:\/\/www.l3t.com\/link\/press\/l3-introduces-first-ever-high-fidelity-mixed-reality-deployable-training-simulator  Thais Hanson. 2018. L3 Introduces First-Ever High-Fidelity Mixed Reality Deployable Training Simulator. https:\/\/www.l3t.com\/link\/press\/l3-introduces-first-ever-high-fidelity-mixed-reality-deployable-training-simulator"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2014.2319822"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1177\/154193120605000909"},{"key":"e_1_2_1_46_1","volume-title":"Staveland","author":"Hart Sandra G.","year":"1988","unstructured":"Sandra G. Hart and Lowell E . Staveland . 1988 . Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Advances in Psychology, Peter A. Hancock and Najmedin Meshkati (Eds.). Human Mental Workload, Vol. 52 . North-Holland , 139--183. https:\/\/doi.org\/10.1016\/S0166-4115(08)62386-9 Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Advances in Psychology, Peter A. Hancock and Najmedin Meshkati (Eds.). Human Mental Workload, Vol. 52. North-Holland, 139--183. https:\/\/doi.org\/10.1016\/S0166-4115(08)62386-9"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1177\/001872089303500401"},{"key":"e_1_2_1_48_1","volume-title":"Effect of cognitive load on speech prosody in aviation: Evidence from military simulator flights. Applied ergonomics 42, 2","author":"Huttunen Kerttu","year":"2011","unstructured":"Kerttu Huttunen , Heikki Ker\u00e4nen , Eero V\u00e4yrynen , Rauno P\u00e4\u00e4kk\u00f6nen , and Tuomo Leino . 2011. Effect of cognitive load on speech prosody in aviation: Evidence from military simulator flights. Applied ergonomics 42, 2 ( 2011 ), 348--357. Publisher : Elsevier . Kerttu Huttunen, Heikki Ker\u00e4nen, Eero V\u00e4yrynen, Rauno P\u00e4\u00e4kk\u00f6nen, and Tuomo Leino. 2011. Effect of cognitive load on speech prosody in aviation: Evidence from military simulator flights. Applied ergonomics 42, 2 (2011), 348--357. Publisher: Elsevier."},{"key":"e_1_2_1_49_1","volume-title":"Xianjun Sam Zheng, and Brian P Bailey","author":"Iqbal Shamsi T","year":"2004","unstructured":"Shamsi T Iqbal , Xianjun Sam Zheng, and Brian P Bailey . 2004 . Task-evoked pupillary response to mental workload in human-computer interaction. In CHI'04 extended abstracts on Human factors in computing systems. 1477--1480. Shamsi T Iqbal, Xianjun Sam Zheng, and Brian P Bailey. 2004. Task-evoked pupillary response to mental workload in human-computer interaction. In CHI'04 extended abstracts on Human factors in computing systems. 1477--1480."},{"key":"e_1_2_1_50_1","volume-title":"USAF","author":"Wilder John P.","unstructured":"John P. Wilder , Patrick S. Martin , and Eric Santroch . 2018. Objective Measures of Workload Feasibility Study, 412TW-TP-18-47 , USAF , Air Force Test Center , Edwards AFB, California. John P. Wilder, Patrick S. Martin, and Eric Santroch. 2018. Objective Measures of Workload Feasibility Study, 412TW-TP-18-47, USAF, Air Force Test Center, Edwards AFB, California."},{"key":"e_1_2_1_51_1","unstructured":"Jonathan Baxter Rich Caruana Tom Mitchell Lorien Y. Pratt Daniel L. Silver and Sebastian Thurn. 1995. Post-NIPS*95 Workshop on Transfer in Inductive Systems. http:\/\/socrates.acadiau.ca\/courses\/comp\/dsilver\/NIPS95_LTL\/\\transfer.workshop.1995.html  Jonathan Baxter Rich Caruana Tom Mitchell Lorien Y. Pratt Daniel L. Silver and Sebastian Thurn. 1995. Post-NIPS*95 Workshop on Transfer in Inductive Systems. http:\/\/socrates.acadiau.ca\/courses\/comp\/dsilver\/NIPS95_LTL\/\\transfer.workshop.1995.html"},{"key":"e_1_2_1_52_1","volume-title":"A capacity theory of comprehension: individual differences in working memory. Psychological review 99, 1","author":"Just Marcel A","year":"1992","unstructured":"Marcel A Just and Patricia A Carpenter . 1992. A capacity theory of comprehension: individual differences in working memory. Psychological review 99, 1 ( 1992 ), 122. Publisher : American Psychological Association . Marcel A Just and Patricia A Carpenter. 1992. A capacity theory of comprehension: individual differences in working memory. Psychological review 99, 1 (1992), 122. Publisher: American Psychological Association."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0026952"},{"key":"e_1_2_1_54_1","volume-title":"Kingma and Jimmy Ba","author":"Diederik","year":"2017","unstructured":"Diederik P. Kingma and Jimmy Ba . 2017 . Adam : A Method for Stochastic Optimization . arXiv:1412.6980 [cs] (Jan. 2017). http:\/\/arxiv.org\/abs\/1412.6980 arXiv: 1412.6980 version: 8. Diederik P. Kingma and Jimmy Ba. 2017. Adam: A Method for Stochastic Optimization. arXiv:1412.6980 [cs] (Jan. 2017). http:\/\/arxiv.org\/abs\/1412.6980 arXiv: 1412.6980 version: 8."},{"key":"e_1_2_1_55_1","volume-title":"Kingma and Max Welling","author":"Diederik","year":"2013","unstructured":"Diederik P. Kingma and Max Welling . 2013 . Auto-Encoding Variational Bayes . (Dec. 2013). https:\/\/arxiv.org\/abs\/1312.6114v10 Diederik P. Kingma and Max Welling. 2013. Auto-Encoding Variational Bayes. (Dec. 2013). https:\/\/arxiv.org\/abs\/1312.6114v10"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170427.3188643"},{"key":"e_1_2_1_58_1","volume-title":"Reasoning ability is (little more than) working-memory capacity?! Intelligence 14, 4","author":"Kyllonen Patrick C","year":"1990","unstructured":"Patrick C Kyllonen and Raymond E Christal . 1990. Reasoning ability is (little more than) working-memory capacity?! Intelligence 14, 4 ( 1990 ), 389--433. Publisher : Elsevier . Patrick C Kyllonen and Raymond E Christal. 1990. Reasoning ability is (little more than) working-memory capacity?! Intelligence 14, 4 (1990), 389--433. Publisher: Elsevier."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2015.2460697"},{"key":"e_1_2_1_60_1","unstructured":"Feng Li Jiang Li Frederic McKenzie Guangfan Zhang Wei Wang Aaron Pepe Roger Xu Thomas Schnell Nick Anderson and Dean Heitkamp. 2012. Engagement Assessment Using EEG Signals. (2012).  Feng Li Jiang Li Frederic McKenzie Guangfan Zhang Wei Wang Aaron Pepe Roger Xu Thomas Schnell Nick Anderson and Dean Heitkamp. 2012. Engagement Assessment Using EEG Signals. (2012)."},{"key":"e_1_2_1_61_1","volume-title":"Autonomic activity and workload during learning of a simulated aircraft carrier landing task. Aviation, space, and environmental medicine","author":"Lindholm Ernest","year":"1983","unstructured":"Ernest Lindholm and Cary M Cheatham . 1983. Autonomic activity and workload during learning of a simulated aircraft carrier landing task. Aviation, space, and environmental medicine ( 1983 ). Publisher : Aerospace Medical Assn . Ernest Lindholm and Cary M Cheatham. 1983. Autonomic activity and workload during learning of a simulated aircraft carrier landing task. Aviation, space, and environmental medicine (1983). Publisher: Aerospace Medical Assn."},{"key":"e_1_2_1_62_1","volume-title":"Heart rate variability, cardiac mechanics, and subjectively evaluated stress during simulator flight. Aviation, space, and environmental medicine","author":"Lindqvist A","year":"1983","unstructured":"A Lindqvist , Esko Keskinen , K Antila , L Halkola , T Peltonen , and I V\u00e4lim\u00e4ki . 1983. Heart rate variability, cardiac mechanics, and subjectively evaluated stress during simulator flight. Aviation, space, and environmental medicine ( 1983 ). Publisher : Aerospace Medical Assn . A Lindqvist, Esko Keskinen, K Antila, L Halkola, T Peltonen, and I V\u00e4lim\u00e4ki. 1983. Heart rate variability, cardiac mechanics, and subjectively evaluated stress during simulator flight. Aviation, space, and environmental medicine (1983). Publisher: Aerospace Medical Assn."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1080\/00140139408964953"},{"key":"e_1_2_1_64_1","volume-title":"Objective Measures of Pilot Workload. 63RD SETP SYMPOSIUM PROCEEDINGS (Sept","author":"Martin Patrick","year":"2019","unstructured":"Patrick Martin , Paul Calhoun , Tom Schnell , and Colton Thompson . 2019. Objective Measures of Pilot Workload. 63RD SETP SYMPOSIUM PROCEEDINGS (Sept . 2019 ). https:\/\/secure.whoglue.net\/setp_admin\/papers\/SETP%20Pilot%20Workload%20Study%20PA%20Released.pdf Patrick Martin, Paul Calhoun, Tom Schnell, and Colton Thompson. 2019. Objective Measures of Pilot Workload. 63RD SETP SYMPOSIUM PROCEEDINGS (Sept. 2019). https:\/\/secure.whoglue.net\/setp_admin\/papers\/SETP%20Pilot%20Workload%20Study%20PA%20Released.pdf"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02295996"},{"key":"e_1_2_1_66_1","volume-title":"The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological review 63, 2","author":"Miller George A","year":"1956","unstructured":"George A Miller . 1956. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological review 63, 2 ( 1956 ), 81. Publisher : American Psychological Association . George A Miller. 1956. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological review 63, 2 (1956), 81. Publisher: American Psychological Association."},{"key":"e_1_2_1_67_1","unstructured":"NASA Aviation Safety Program. 2006. NASA - Portal Information Site. https:\/\/www.hq.nasa.gov\/office\/aero\/avsafe\/iifd\/Library Catalog: www.hq.nasa.gov Publisher: Brian Dunbar.  NASA Aviation Safety Program. 2006. NASA - Portal Information Site. https:\/\/www.hq.nasa.gov\/office\/aero\/avsafe\/iifd\/Library Catalog: www.hq.nasa.gov Publisher: Brian Dunbar."},{"key":"e_1_2_1_68_1","volume-title":"Working memory capacity-facets of a cognitive ability construct. Personality and individual differences 29, 6","author":"Oberauer Klaus","year":"2000","unstructured":"Klaus Oberauer , H-M S\u00fc\u00df , Ralf Schulze , Oliver Wilhelm , and Werner W Wittmann . 2000. Working memory capacity-facets of a cognitive ability construct. Personality and individual differences 29, 6 ( 2000 ), 1017--1045. Publisher : Elsevier . Klaus Oberauer, H-M S\u00fc\u00df, Ralf Schulze, Oliver Wilhelm, and Werner W Wittmann. 2000. Working memory capacity-facets of a cognitive ability construct. Personality and individual differences 29, 6 (2000), 1017--1045. Publisher: Elsevier."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0160-2896(02)00115-0"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1080\/00140137308924486"},{"key":"e_1_2_1_71_1","volume-title":"Cognitive load measurement as a means to advance cognitive load theory. Educational psychologist 38, 1","author":"Paas Fred","year":"2003","unstructured":"Fred Paas , Juhani E Tuovinen , Huib Tabbers , and Pascal WM Van Gerven . 2003. Cognitive load measurement as a means to advance cognitive load theory. Educational psychologist 38, 1 ( 2003 ), 63--71. Publisher : Taylor & Francis . Fred Paas, Juhani E Tuovinen, Huib Tabbers, and Pascal WM Van Gerven. 2003. Cognitive load measurement as a means to advance cognitive load theory. Educational psychologist 38, 1 (2003), 63--71. Publisher: Taylor & Francis."},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-0663.84.4.429"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-0663.86.1.122"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02213420"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1109\/tkde.2009.191"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858201"},{"key":"e_1_2_1_77_1","volume-title":"Cognitive load theory","author":"Plass Jan L","unstructured":"Jan L Plass , Roxana Moreno , and Roland Br\u00fcnken . 2010. Cognitive load theory . Cambridge university press . Jan L Plass, Roxana Moreno, and Roland Br\u00fcnken. 2010. Cognitive load theory. Cambridge university press."},{"key":"e_1_2_1_78_1","doi-asserted-by":"crossref","unstructured":"Sohail Rafiqi. 2015. Pupilware: Towards cognitive and context-aware framework. PhD Thesis. Southern Methodist University.  Sohail Rafiqi. 2015. Pupilware: Towards cognitive and context-aware framework. PhD Thesis. Southern Methodist University.","DOI":"10.1145\/2769493.2769506"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2017.2738401"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1007\/11853565_24"},{"key":"e_1_2_1_81_1","volume-title":"Heart rate monitoring of pilots during steep-gradient approaches. Aviation, space, and environmental medicine 46, 11","author":"Roscoe AH","year":"1975","unstructured":"AH Roscoe . 1975. Heart rate monitoring of pilots during steep-gradient approaches. Aviation, space, and environmental medicine 46, 11 ( 1975 ), 1410--1413. AH Roscoe. 1975. Heart rate monitoring of pilots during steep-gradient approaches. Aviation, space, and environmental medicine 46, 11 (1975), 1410--1413."},{"key":"e_1_2_1_82_1","volume-title":"Use of pilot heart rate measurement in flight evaluation. Aviation, space, and environmental medicine 47, 1","author":"Roscoe AH","year":"1976","unstructured":"AH Roscoe . 1976. Use of pilot heart rate measurement in flight evaluation. Aviation, space, and environmental medicine 47, 1 ( 1976 ), 86--90. AH Roscoe. 1976. Use of pilot heart rate measurement in flight evaluation. Aviation, space, and environmental medicine 47, 1 (1976), 86--90."},{"key":"e_1_2_1_83_1","volume-title":"Flight: A decade of Practical Use. Technical Report RAE-TR-90019. ROYAL AEROSPACE ESTABLISHMENT FARNBOROUGH (UNITED KINGDOM). https:\/\/apps.dtic.mil\/docs\/citations\/ADA227864","author":"Roscoe A. H.","year":"1990","unstructured":"A. H. Roscoe and G. A. Ellis . 1990 . A Subjective Rating Scale for Assessing Pilot Workload in Flight: A decade of Practical Use. Technical Report RAE-TR-90019. ROYAL AEROSPACE ESTABLISHMENT FARNBOROUGH (UNITED KINGDOM). https:\/\/apps.dtic.mil\/docs\/citations\/ADA227864 A. H. Roscoe and G. A. Ellis. 1990. A Subjective Rating Scale for Assessing Pilot Workload in Flight: A decade of Practical Use. Technical Report RAE-TR-90019. ROYAL AEROSPACE ESTABLISHMENT FARNBOROUGH (UNITED KINGDOM). https:\/\/apps.dtic.mil\/docs\/citations\/ADA227864"},{"key":"e_1_2_1_84_1","volume-title":"Adaptive aiding for human\/computer control. Human factors 30, 4","author":"Rouse William B","year":"1988","unstructured":"William B Rouse . 1988. Adaptive aiding for human\/computer control. Human factors 30, 4 ( 1988 ), 431--443. Publisher : SAGE Publications Sage CA: Los Angeles, CA. William B Rouse. 1988. Adaptive aiding for human\/computer control. Human factors 30, 4 (1988), 431--443. Publisher: SAGE Publications Sage CA: Los Angeles, CA."},{"key":"e_1_2_1_85_1","volume-title":"An Overview of Multi-Task Learning in Deep Neural Networks. arXiv:1706.05098 [cs, stat] (June","author":"Ruder Sebastian","year":"2017","unstructured":"Sebastian Ruder . 2017. An Overview of Multi-Task Learning in Deep Neural Networks. arXiv:1706.05098 [cs, stat] (June 2017 ). http:\/\/arxiv.org\/abs\/1706.05098 arXiv: 1706.05098. Sebastian Ruder. 2017. An Overview of Multi-Task Learning in Deep Neural Networks. arXiv:1706.05098 [cs, stat] (June 2017). http:\/\/arxiv.org\/abs\/1706.05098 arXiv: 1706.05098."},{"key":"e_1_2_1_86_1","volume-title":"Mental effort and performance as determinants for the dynamic selection of learning tasks in air traffic control training. Instructional science 32, 1-2","author":"Salden Ron JCM","year":"2004","unstructured":"Ron JCM Salden , Fred Paas , Nick J Broers , and Jeroen JG Van Merrienboer . 2004. Mental effort and performance as determinants for the dynamic selection of learning tasks in air traffic control training. Instructional science 32, 1-2 ( 2004 ), 153--172. Publisher : Springer . Ron JCM Salden, Fred Paas, Nick J Broers, and Jeroen JG Van Merrienboer. 2004. Mental effort and performance as determinants for the dynamic selection of learning tasks in air traffic control training. Instructional science 32, 1-2 (2004), 153--172. Publisher: Springer."},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.1991.tb00127.x"},{"key":"e_1_2_1_88_1","volume-title":"Smoothing and differentiation of data by simplified least squares procedures. Analytical chemistry 36, 8","author":"Savitzky Abraham","year":"1964","unstructured":"Abraham Savitzky and Marcel JE Golay . 1964. Smoothing and differentiation of data by simplified least squares procedures. Analytical chemistry 36, 8 ( 1964 ), 1627--1639. Abraham Savitzky and Marcel JE Golay. 1964. Smoothing and differentiation of data by simplified least squares procedures. Analytical chemistry 36, 8 (1964), 1627--1639."},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1109\/HFPP.2002.1042859"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-02812-0_73"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1109\/DASC.2008.4702827"},{"key":"e_1_2_1_92_1","volume-title":"Workload assessment in flight using dense array eeg. In 2006 ieee\/aiaa 25TH Digital Avionics Systems Conference","author":"Schnell Tom","unstructured":"Tom Schnell , Todd Macuda , Pieter Poolman , and Mike Keller . 2006. Workload assessment in flight using dense array eeg. In 2006 ieee\/aiaa 25TH Digital Avionics Systems Conference . IEEE , 1--11. Tom Schnell, Todd Macuda, Pieter Poolman, and Mike Keller. 2006. Workload assessment in flight using dense array eeg. In 2006 ieee\/aiaa 25TH Digital Avionics Systems Conference. IEEE, 1--11."},{"key":"e_1_2_1_93_1","volume-title":"Head-and Helmet-Mounted Displays XIV: Design and Applications","volume":"7326","author":"Schnell Thomas","year":"2009","unstructured":"Thomas Schnell , James E Melzer , and Steve J Robbins . 2009 . The cognitive pilot helmet: enabling pilot-aware smart avionics . In Head-and Helmet-Mounted Displays XIV: Design and Applications , Vol. 7326 . International Society for Optics and Photonics, 73260A. Thomas Schnell, James E Melzer, and Steve J Robbins. 2009. The cognitive pilot helmet: enabling pilot-aware smart avionics. In Head-and Helmet-Mounted Displays XIV: Design and Applications, Vol. 7326. International Society for Optics and Photonics, 73260A."},{"key":"e_1_2_1_94_1","volume-title":"An overview of heart rate variability metrics and norms. Frontiers in public health 5","author":"Shaffer Fred","year":"2017","unstructured":"Fred Shaffer and JP Ginsberg . 2017. An overview of heart rate variability metrics and norms. Frontiers in public health 5 ( 2017 ), 258. Publisher : Frontiers . Fred Shaffer and JP Ginsberg. 2017. An overview of heart rate variability metrics and norms. Frontiers in public health 5 (2017), 258. Publisher: Frontiers."},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.2307\/2333709"},{"key":"e_1_2_1_96_1","first-page":"2","article-title":"Fighter pilot performance during airborne and simulator missions: physiological comparisons","volume":"23","author":"Skelly June J","year":"1988","unstructured":"June J Skelly , B Purvis , and G Wilson . 1988 . Fighter pilot performance during airborne and simulator missions: physiological comparisons . Electric and Magnetic Activity of the Central Nervous System: Research and Clinical Applications in Aerospace 23 (1988), 2 . June J Skelly, B Purvis, and G Wilson. 1988. Fighter pilot performance during airborne and simulator missions: physiological comparisons. Electric and Magnetic Activity of the Central Nervous System: Research and Clinical Applications in Aerospace 23 (1988), 2.","journal-title":"Electric and Magnetic Activity of the Central Nervous System: Research and Clinical Applications in Aerospace"},{"key":"e_1_2_1_97_1","volume-title":"Heart rate of pilots flying aircraft on scheduled airline routes. Aerospace medicine 38, 11","author":"Smith HP","year":"1967","unstructured":"HP Smith . 1967. Heart rate of pilots flying aircraft on scheduled airline routes. Aerospace medicine 38, 11 ( 1967 ), 1117. HP Smith. 1967. Heart rate of pilots flying aircraft on scheduled airline routes. Aerospace medicine 38, 11 (1967), 1117."},{"key":"e_1_2_1_98_1","doi-asserted-by":"crossref","unstructured":"David Snyder Daniel Garcia-Romero Daniel Povey and Sanjeev Khudanpur. 2017. Deep Neural Network Embeddings for Text-Independent Speaker Verification.. In Interspeech. 999--1003.  David Snyder Daniel Garcia-Romero Daniel Povey and Sanjeev Khudanpur. 2017. Deep Neural Network Embeddings for Text-Independent Speaker Verification.. In Interspeech. 999--1003.","DOI":"10.21437\/Interspeech.2017-620"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2018.8461375"},{"key":"e_1_2_1_100_1","volume-title":"Dropout: A Simple Way to Prevent Neural Networks from Overfitting. The journal of machine learning research 15, 1 (June","author":"Srivastava Nitish","year":"2014","unstructured":"Nitish Srivastava , Geofirey Hinton , Alex Krizhevsky , Ilya Sutskever , and Ruslan Salakhutdinov . 2014 . Dropout: A Simple Way to Prevent Neural Networks from Overfitting. The journal of machine learning research 15, 1 (June 2014), 1929--1958. Nitish Srivastava, Geofirey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: A Simple Way to Prevent Neural Networks from Overfitting. The journal of machine learning research 15, 1 (June 2014), 1929--1958."},{"key":"e_1_2_1_101_1","doi-asserted-by":"publisher","DOI":"10.1109\/CRV.2010.37"},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-8986.1984.tb02312.x"},{"key":"e_1_2_1_103_1","volume-title":"Jeroen JG Van Merrienboer, and Fred GWC Paas","author":"Sweller John","year":"1998","unstructured":"John Sweller , Jeroen JG Van Merrienboer, and Fred GWC Paas . 1998 . Cognitive architecture and instructional design. Educational psychology review 10, 3 (1998), 251--296. Publisher : Springer . John Sweller, Jeroen JG Van Merrienboer, and Fred GWC Paas. 1998. Cognitive architecture and instructional design. Educational psychology review 10, 3 (1998), 251--296. Publisher: Springer."},{"key":"e_1_2_1_104_1","volume-title":"On the division of short-term and working memory: an examination of simple and complex span and their relation to higher order abilities. Psychological bulletin 133, 6","author":"Unsworth Nash","year":"2007","unstructured":"Nash Unsworth and Randall W Engle . 2007. On the division of short-term and working memory: an examination of simple and complex span and their relation to higher order abilities. Psychological bulletin 133, 6 ( 2007 ), 1038. Publisher : American Psychological Association . Nash Unsworth and Randall W Engle. 2007. On the division of short-term and working memory: an examination of simple and complex span and their relation to higher order abilities. Psychological bulletin 133, 6 (2007), 1038. Publisher: American Psychological Association."},{"key":"e_1_2_1_105_1","volume-title":"Mental workload","author":"Ursin Holger","unstructured":"Holger Ursin and Reidun Ursin . 1979. Physiological indicators of mental workload . In Mental workload . Springer , 349--365. Holger Ursin and Reidun Ursin. 1979. Physiological indicators of mental workload. In Mental workload. Springer, 349--365."},{"key":"e_1_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.1145\/3161164"},{"key":"e_1_2_1_107_1","volume-title":"Breakthroughs in statistics","author":"Wilcoxon Frank","unstructured":"Frank Wilcoxon . 1992. Individual comparisons by ranking methods . In Breakthroughs in statistics . Springer , 196--202. Frank Wilcoxon. 1992. Individual comparisons by ranking methods. In Breakthroughs in statistics. Springer, 196--202."},{"key":"e_1_2_1_108_1","volume-title":"Advances in Psychology.","author":"Wilson Glenn F","unstructured":"Glenn F Wilson and Robert D O'Donnell . 1988. Measurement of operator workload with the neuropsychological workload test battery . In Advances in Psychology. Vol. 52 . Elsevier , 63--100. Glenn F Wilson and Robert D O'Donnell. 1988. Measurement of operator workload with the neuropsychological workload test battery. In Advances in Psychology. Vol. 52. Elsevier, 63--100."},{"key":"e_1_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0701020104"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3448111","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3448111","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:59Z","timestamp":1750195499000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3448111"}},"subtitle":["A Use-Case in Aviation"],"short-title":[],"issued":{"date-parts":[[2021,3,19]]},"references-count":104,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,3,19]]}},"alternative-id":["10.1145\/3448111"],"URL":"https:\/\/doi.org\/10.1145\/3448111","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,19]]},"assertion":[{"value":"2021-03-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}