{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T21:38:36Z","timestamp":1777153116407,"version":"3.51.4"},"reference-count":89,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,11,28]],"date-time":"2022-11-28T00:00:00Z","timestamp":1669593600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,11,28]],"date-time":"2022-11-28T00:00:00Z","timestamp":1669593600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002345","name":"Eberhard Karls Universit\u00e4t T\u00fcbingen","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002345","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Leibniz-Institut f\u00fcr Wissensmedien"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Multimodal User Interfaces"],"published-print":{"date-parts":[[2023,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Computerized systems are taking on increasingly complex tasks. Consequently, monitoring automated computerized systems is becoming increasingly demanding for human operators, which is particularly relevant in time-critical situations. A possible solution might be adapting human\u2013computer interfaces (HCI) to the operators\u2019 cognitive load. Here, we present a novel approach for theory-based measurement of cognitive load based on tracking eye movements of 42 participants while playing a serious game simulating time-critical situations that required resource management at different levels of difficulty. Gaze data was collected within narrow time periods, calculated based on log data interpreted in the light of the time-based resource-sharing model. Our results indicated that eye fixation frequency, saccadic rate, and pupil diameter significantly predicted task difficulty, while performance was best predicted by eye fixation frequency. Subjectively perceived cognitive load was significantly associated with the rate of microsaccades. Moreover our results indicated that more successful players tended to use breaks in gameplay to actively monitor the scene, while players who use these times to rest are more likely to fail the level. The presented approach seems promising for measuring cognitive load in realistic situations, considering adaptation of HCI.<\/jats:p>","DOI":"10.1007\/s12193-022-00398-y","type":"journal-article","created":{"date-parts":[[2022,11,28]],"date-time":"2022-11-28T18:08:04Z","timestamp":1669658884000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":32,"title":["Theory-based approach for assessing cognitive load during time-critical resource-managing human\u2013computer interactions: an eye-tracking study"],"prefix":"10.1007","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8734-3337","authenticated-orcid":false,"given":"Natalia","family":"Sevcenko","sequence":"first","affiliation":[]},{"given":"Tobias","family":"Appel","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4664-8430","authenticated-orcid":false,"given":"Manuel","family":"Ninaus","sequence":"additional","affiliation":[]},{"given":"Korbinian","family":"Moeller","sequence":"additional","affiliation":[]},{"given":"Peter","family":"Gerjets","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,11,28]]},"reference":[{"key":"398_CR1","doi-asserted-by":"crossref","unstructured":"Babiloni F (2019) Mental workload monitoring: new perspectives from neuroscience. In: Longo L, Leva M (eds) Human mental workload: models and applications. H-WORKLOAD 2019. Communications in Computer and Information Science, vol 1107. Cham: Springer, pp. 3-19","DOI":"10.1007\/978-3-030-32423-0_1"},{"key":"398_CR2","doi-asserted-by":"publisher","first-page":"385","DOI":"10.3389\/fnins.2014.00385","volume":"8","author":"P Gerjets","year":"2014","unstructured":"Gerjets P, Walter C, Rosenstiel W, Bogdan M, Zander TO (2014) Cognitive state monitoring and the design of adaptive instruction in digital environments: lessons learned from cognitive workload assessment using a passive brain-computer interface approach. Front Neurosci 8:385","journal-title":"Front Neurosci"},{"issue":"5","key":"398_CR3","doi-asserted-by":"publisher","first-page":"670","DOI":"10.1093\/bja\/aep258","volume":"103","author":"S Charabati","year":"2009","unstructured":"Charabati S, Bracco D, Mathieu P, Hemmerling T (2009) Comparison of four different display designs of a novel anaesthetic monitoring system, the \u2018integrated monitor of anaesthesia (IMA\u2122).\u2019 Br J Anaesth 103(5):670\u2013677","journal-title":"Br J Anaesth"},{"key":"398_CR4","doi-asserted-by":"crossref","unstructured":"Oviatt S, (2006) Human-centered design meets cognitive load theory: designing interfaces that help people think. In: Proceedings of the 14th ACM international conference on multimedia, pp. 871\u2013880","DOI":"10.1145\/1180639.1180831"},{"key":"398_CR5","doi-asserted-by":"publisher","first-page":"286","DOI":"10.3389\/fnhum.2017.00286","volume":"11","author":"C Walter","year":"2017","unstructured":"Walter C, Rosenstiel W, Bogdan M, Gerjets P, Sp\u00fcler M (2017) Online EEG-based workload adaptation of an arithmetic learning environment. Front Human Neurosci 11:286. https:\/\/doi.org\/10.3389\/fnhum.2017.00286","journal-title":"Front Human Neurosci"},{"key":"398_CR6","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1007\/978-3-030-15569-8_8","volume-title":"Game-Based Assessment Revisited","author":"S Nebel","year":"2019","unstructured":"Nebel S, Ninaus M (2019) New perspectives on game-based assessment with process data and physiological signals. In: Ifenthaler D, Kim YJ (eds) Game-Based Assessment Revisited. Springer International Publishing, Cham, pp 141\u2013161. https:\/\/doi.org\/10.1007\/978-3-030-15569-8_8"},{"issue":"1","key":"398_CR7","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1037\/0096-3445.133.1.83","volume":"133","author":"P Barrouillet","year":"2004","unstructured":"Barrouillet P, Bernardin S, Camos V (2004) Time constraints and resource sharing in adults\u2019 working memory spans. J Exp Psychol Gen 133(1):83","journal-title":"J Exp Psychol Gen"},{"key":"398_CR8","doi-asserted-by":"publisher","first-page":"906","DOI":"10.3389\/fpsyg.2021.572437","volume":"12","author":"N Sevcenko","year":"2021","unstructured":"Sevcenko N, Ninaus M, Wortha F, Moeller K, Gerjets P (2021) Measuring cognitive load using in-game metrics of a serious simulation game. Front Psychol 12:906. https:\/\/doi.org\/10.3389\/fpsyg.2021.572437","journal-title":"Front Psychol"},{"issue":"2","key":"398_CR9","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1037\/h0043158","volume":"63","author":"GA Miller","year":"1956","unstructured":"Miller GA (1956) The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychol Rev 63(2):81","journal-title":"Psychol Rev"},{"issue":"1","key":"398_CR10","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/j.neuroimage.2011.06.023","volume":"59","author":"H Ayaz","year":"2012","unstructured":"Ayaz H, Shewokis PA, Bunce S, Izzetoglu K, Willems B, Onaral B (2012) Optical brain monitoring for operator training and mental workload assessment. Neuroimage 59(1):36\u201347","journal-title":"Neuroimage"},{"issue":"Supplement 1","key":"398_CR11","doi-asserted-by":"publisher","first-page":"3608","DOI":"10.3233\/WOR-2012-0666-3608","volume":"41","author":"G Hancock","year":"2012","unstructured":"Hancock G, Hancock P, Janelle C (2012) The impact of emotions and predominant emotion regulation technique on driving performance. Work 41(Supplement 1):3608\u20133611","journal-title":"Work"},{"key":"398_CR12","doi-asserted-by":"crossref","unstructured":"Fan J, Smith AP (2017) The impact of workload and fatigue on performance. In: Longo L. and Leva M. (eds.) Human mental workload: models and applications. H-WORKLOAD 2017. Communications in computer and information science, vol. 726, Cham: Springer, pp. 90-105","DOI":"10.1007\/978-3-319-61061-0_6"},{"issue":"3","key":"398_CR13","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1016\/0003-6870(89)90077-X","volume":"20","author":"P Hancock","year":"1989","unstructured":"Hancock P (1989) The effect of performance failure and task demand on the perception of mental workload. Appl Ergon 20(3):197\u2013205","journal-title":"Appl Ergon"},{"key":"398_CR14","doi-asserted-by":"publisher","DOI":"10.1016\/j.treng.2020.100008","volume":"2","author":"G Prabhakar","year":"2020","unstructured":"Prabhakar G, Mukhopadhyay A, Murthy L, Modiksha M, Sachin D, Biswas P (2020) Cognitive load estimation using ocular parameters in automotive. Transportation Engineering 2:100008","journal-title":"Transportation Engineering"},{"key":"398_CR15","doi-asserted-by":"crossref","unstructured":"Tokuda S, Obinata G, Palmer E, Chaparro A, (2011) Estimation of mental workload using saccadic eye movements in a free-viewing task. In: 2011 Annual international conference of the IEEE engineering in medicine and biology society, IEEE, pp. 4523\u20134529","DOI":"10.1109\/IEMBS.2011.6091121"},{"key":"398_CR16","doi-asserted-by":"publisher","DOI":"10.16910\/jemr.12.3.3","author":"MD Babu","year":"2019","unstructured":"Babu MD, JeevithaShree D, Prabhakar G, Saluja KPS, Pashilkar A, Biswas P (2019) Estimating pilots\u2019 cognitive load from ocular parameters through simulation and in-flight studies. J Eye Movement Res. https:\/\/doi.org\/10.16910\/jemr.12.3.3","journal-title":"J Eye Movement Res"},{"issue":"2","key":"398_CR17","doi-asserted-by":"publisher","DOI":"10.1117\/1.NPh.2.2.020801","volume":"2","author":"CM Aasted","year":"2015","unstructured":"Aasted CM et al (2015) Anatomical guidance for functional near-infrared spectroscopy: atlasviewer tutorial. Neurophotonics 2(2):020801","journal-title":"Neurophotonics"},{"issue":"2","key":"398_CR18","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1016\/j.jenvp.2008.09.002","volume":"29","author":"TL Smith-Jackson","year":"2009","unstructured":"Smith-Jackson TL, Klein KW (2009) Open-plan offices: task performance and mental workload. J Environ Psychol 29(2):279\u2013289","journal-title":"J Environ Psychol"},{"issue":"5","key":"398_CR19","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1097\/SIH.0b013e3181e3f329","volume":"5","author":"YY Yurko","year":"2010","unstructured":"Yurko YY, Scerbo MW, Prabhu AS, Acker CE, Stefanidis D (2010) Higher mental workload is associated with poorer laparoscopic performance as measured by the NASA-TLX tool. Simulation Healthcare 5(5):267\u2013271. https:\/\/doi.org\/10.1097\/SIH.0b013e3181e3f329","journal-title":"Simulation Healthcare"},{"issue":"5","key":"398_CR20","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1002\/cne.920180503","volume":"18","author":"RM Yerkes","year":"1908","unstructured":"Yerkes RM, Dodson JD (1908) The relation of strength of stimulus to rapidity of habit-formation. J Comp Neurol Psychol 18(5):459\u2013482","journal-title":"J Comp Neurol Psychol"},{"key":"398_CR21","unstructured":"Csikszentmihalyi M, Csikszentmihalyi I, Graef R, Holcomb JH, Hendin J, MacAloon J (1975) Eds. Beyond boredom and anxiety, 1 ed. (Behavioral Science Series). San Francisco, London: Jossey-Bass Publishers"},{"key":"398_CR22","unstructured":"Kiili K, Lindstedt A, Ninaus M, (2018) Exploring characteristics of students' emotions, flow and motivation in a math game competition. In: GamiFIN Conference, Pori, Finland, May 21\u201323, 2018, pp. 20\u201329"},{"issue":"6","key":"398_CR23","doi-asserted-by":"publisher","first-page":"813","DOI":"10.1016\/0191-8869(94)90226-7","volume":"16","author":"KJ Anderson","year":"1994","unstructured":"Anderson KJ (1994) Impulsitivity, caffeine, and task difficulty: a within-subjects test of the Yerkes-Dodson law. Personality Individ Differ 16(6):813\u2013829","journal-title":"Personality Individ Differ"},{"issue":"1","key":"398_CR24","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1177\/0018726718819055","volume":"73","author":"F Montani","year":"2020","unstructured":"Montani F, Vandenberghe C, Khedhaouria A, Courcy F (2020) Examining the inverted U-shaped relationship between workload and innovative work behavior: The role of work engagement and mindfulness. Human Relations 73(1):59\u201393","journal-title":"Human Relations"},{"key":"398_CR25","unstructured":"Cummings ML and Nehme CE (2009) Modeling the impact of workload in network centric supervisory control settings. In: presented at the 2nd annual sustaining performance under stress symposium, 25 February"},{"key":"398_CR26","doi-asserted-by":"crossref","unstructured":"Orru G, Longo L (2019) The evolution of cognitive load theory and the measurement of its intrinsic, extraneous and Germane loads: a review. In: Longo L. and Leva M. (eds.) Human mental workload: models and applications. H-WORKLOAD, 2018 Communications in computer and information science, Cham: Springer, pp. 23\u201348","DOI":"10.1007\/978-3-030-14273-5_3"},{"key":"398_CR27","volume-title":"Generic intelligent driver support","author":"JA Michon","year":"1993","unstructured":"Michon JA (1993) Generic intelligent driver support. CRC Press, UK"},{"issue":"4","key":"398_CR28","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1016\/j.trf.2003.08.001","volume":"6","author":"W Piechulla","year":"2003","unstructured":"Piechulla W, Mayser C, Gehrke H, K\u00f6nig W (2003) Reducing drivers\u2019 mental workload by means of an adaptive man\u2013machine interface. Transport Res F: Traffic Psychol Behav 6(4):233\u2013248","journal-title":"Transport Res F: Traffic Psychol Behav"},{"key":"398_CR29","unstructured":"Riener A, Noldi J, (2015) Cognitive load estimation in the car: practical experience from lab and on-road tests. In: Adjunct proceedings of automotive UI 2015, workshop practical experiences in measuring and modeling drivers and driver-vehicle interactions, 2015, pp. 4"},{"issue":"3","key":"398_CR30","doi-asserted-by":"publisher","first-page":"463","DOI":"10.1109\/TITS.2008.928172","volume":"9","author":"C Wu","year":"2008","unstructured":"Wu C, Tsimhoni O, Liu Y (2008) Development of an adaptive workload management system using the queueing network-model human processor (QN-MHP). IEEE Trans Intell Transp Syst 9(3):463\u2013475","journal-title":"IEEE Trans Intell Transp Syst"},{"issue":"1","key":"398_CR31","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1109\/TITS.2010.2081359","volume":"12","author":"B Lin","year":"2010","unstructured":"Lin B, Wu C (2010) Mathematical modeling of the human cognitive system in two serial processing stages with its applications in adaptive workload-management systems. IEEE Trans Intell Transp Syst 12(1):221\u2013231","journal-title":"IEEE Trans Intell Transp Syst"},{"key":"398_CR32","unstructured":"Kohlmorgen J et al., (2007) Improving human performance in a real operating environment through real-time mental workload detection. In: Dornhege G, Millan JDR, Hinterverger T, McFarland DJ, and M\u00fcller K-R. (eds.) Toward Brain-computer interfacing, vol. 409422,. Cambridge, Massachusetts, London, England: MIT Press, 2007, ch. 24, pp. 409\u2013422"},{"key":"398_CR33","doi-asserted-by":"crossref","unstructured":"Wilson GF, Purvis B, Skelly J, Fullenkamp P, Davis I, (1987) Physiological data used to measure pilot workload in actual flight and simulator conditions. In: Proceedings of the human factors society annual meeting, 1987, vol. 31, no. 7: SAGE Publications Sage CA: Los Angeles, CA, pp. 779\u2013783","DOI":"10.1177\/154193128703100720"},{"issue":"3","key":"398_CR34","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1016\/0301-0511(95)05165-1","volume":"42","author":"J Veltman","year":"1996","unstructured":"Veltman J, Gaillard A (1996) Physiological indices of workload in a simulated flight task. Biol Psychol 42(3):323\u2013342","journal-title":"Biol Psychol"},{"key":"398_CR35","doi-asserted-by":"crossref","unstructured":"Strenzke R, Uhrmann J, Benzler A, Maiwald F, Rauschert A, Schulte A, (2011) Managing cockpit crew excess task load in military manned-unmanned teaming missions by dual-mode cognitive automation approaches. In: AIAA guidance, navigation, and control conference, 2011, pp. 6237","DOI":"10.2514\/6.2011-6237"},{"issue":"3","key":"398_CR36","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1109\/THMS.2019.2914667","volume":"50","author":"G Roth","year":"2019","unstructured":"Roth G, Schulte A, Schmitt F, Brand Y (2019) Transparency for a Workload-adaptive cognitive agent in a manned-unmanned teaming application. IEEE Trans Human-Machine Syst 50(3):225\u2013233","journal-title":"IEEE Trans Human-Machine Syst"},{"key":"398_CR37","doi-asserted-by":"publisher","first-page":"539","DOI":"10.3389\/fnhum.2016.00539","volume":"10","author":"P Aric\u00f2","year":"2016","unstructured":"Aric\u00f2 P et al (2016) Adaptive automation triggered by EEG-based mental workload index: a passive brain-computer interface application in realistic air traffic control environment. Front Hum Neurosci 10:539","journal-title":"Front Hum Neurosci"},{"issue":"6","key":"398_CR38","doi-asserted-by":"publisher","first-page":"1005","DOI":"10.1518\/001872007X249875","volume":"49","author":"GF Wilson","year":"2007","unstructured":"Wilson GF, Russell CA (2007) Performance enhancement in an uninhabited air vehicle task using psychophysiologically determined adaptive aiding. Hum Factors 49(6):1005\u20131018","journal-title":"Hum Factors"},{"key":"398_CR39","doi-asserted-by":"crossref","unstructured":"Sarkar P, Ross K, Ruberto AJ, Rodenbura D, Hungler P, Etemad A, (2019) Classification of cognitive load and expertise for adaptive simulation using deep multitask learning. In: 2019 8th International conference on affective computing and intelligent interaction (ACII), 2019: IEEE, pp. 1\u20137","DOI":"10.1109\/ACII.2019.8925507"},{"key":"398_CR40","unstructured":"Mirbabaie M, Fromm J (2019) Reducing the cognitive load of decision-makers in emergency management through augmented reality"},{"key":"398_CR41","doi-asserted-by":"crossref","unstructured":"Yuksel BF et al. (2016) Learn piano with BACh: an adaptive learning interface that adjusts task difficulty based on brain state. In: Proceedings of the 2016 CHI conference on human factors in computing systems, 2016, pp. 5372\u20135384","DOI":"10.1145\/2858036.2858388"},{"key":"398_CR42","doi-asserted-by":"crossref","unstructured":"Br\u00fcnken R, Seufert T, Paas F, (2010) Measuring cognitive load","DOI":"10.1017\/CBO9780511844744.011"},{"key":"398_CR43","first-page":"207","volume-title":"Multiple-task performance","author":"FT Eggemeier","year":"1991","unstructured":"Eggemeier FT, Wilson GF, Kramer AF, Damos DL (1991) Workload assessment in multi-task environments. In: Damos DL (ed) Multiple-task performance. Taylor & Francis, London, Washington, DC, pp 207\u2013216"},{"key":"398_CR44","doi-asserted-by":"crossref","unstructured":"Johannsen G (1979), Workload and workload measurement. In: Mental Workload, vol. 8, N. Moray Ed., (NATO Conference. Boston: Springer, 1979, pp. 3\u201311","DOI":"10.1007\/978-1-4757-0884-4_1"},{"key":"398_CR45","doi-asserted-by":"crossref","unstructured":"Reid GB, Nygren TE (1988) The subjective workload assessment technique: a scaling procedure for measuring mental workload. In: Advances in psychology, vol. 52: Elsevier, 1988, pp. 185\u2013218","DOI":"10.1016\/S0166-4115(08)62387-0"},{"key":"398_CR46","doi-asserted-by":"crossref","unstructured":"Hart SG, Staveland LE (1988) Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Advances in psychology, vol. 52: Elsevier, 1988, pp. 139\u2013183","DOI":"10.1016\/S0166-4115(08)62386-9"},{"issue":"2","key":"398_CR47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.4018\/jdet.2013040101","volume":"11","author":"J Azcarraga","year":"2013","unstructured":"Azcarraga J, Suarez MT (2013) Recognizing student emotions using brainwaves and mouse behavior data. Int J Distance Educ Technol (IJDET) 11(2):1\u201315","journal-title":"Int J Distance Educ Technol (IJDET)"},{"key":"398_CR48","doi-asserted-by":"publisher","unstructured":"Haapalainen E, Kim S, Forlizzi JF, Dey AK (2010) Psycho-physiological measures for assessing cognitive load. In: Presented at the proceedings of the 12th ACM international conference on Ubiquitous computing, Copenhagen, Denmark, 2010. [Online]. Available: https:\/\/doi.org\/10.1145\/1864349.1864395","DOI":"10.1145\/1864349.1864395"},{"issue":"2","key":"398_CR49","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1007\/s12193-019-00300-3","volume":"13","author":"SM FakhrHosseini","year":"2019","unstructured":"FakhrHosseini SM, Jeon M (2019) How do angry drivers respond to emotional music? A comprehensive perspective on assessing emotion. J Multimodal User Interfaces 13(2):137\u2013150. https:\/\/doi.org\/10.1007\/s12193-019-00300-3","journal-title":"J Multimodal User Interfaces"},{"key":"398_CR50","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1007\/s12193-020-00325-z","volume":"15","author":"R Liu","year":"2020","unstructured":"Liu R, Walker E, Friedman L, Arrington CM (2020) fNIRS-based classification of mind-wandering with personalized window selection for multimodal learning interfaces. J Multimodal User Interfaces 15:257\u2013272. https:\/\/doi.org\/10.1007\/s12193-020-00325-z","journal-title":"J Multimodal User Interfaces"},{"issue":"1","key":"398_CR51","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1504\/IJTEL.2014.060022","volume":"6","author":"M Ninaus","year":"2014","unstructured":"Ninaus M et al (2014) Neurophysiological methods for monitoring brain activity in serious games and virtual environments: a review. Int J Technol Enhanced Learn 6(1):78\u2013103. https:\/\/doi.org\/10.1504\/IJTEL.2014.060022","journal-title":"Int J Technol Enhanced Learn"},{"key":"398_CR52","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1007\/978-3-030-20085-5_8","volume-title":"Eye Movement research: an introduction to its scientific foundations and applications","author":"SB Hutton","year":"2019","unstructured":"Hutton SB (2019) Eye tracking methodology. In: Klein C, Ettinger U (eds) Eye Movement research: an introduction to its scientific foundations and applications. Springer International Publishing, Cham, pp 277\u2013308"},{"issue":"3","key":"398_CR53","doi-asserted-by":"publisher","first-page":"372","DOI":"10.1037\/0033-2909.124.3.372","volume":"124","author":"K Rayner","year":"1998","unstructured":"Rayner K (1998) Eye movements in reading and information processing: 20 years of research. Psychol Bull 124(3):372","journal-title":"Psychol Bull"},{"key":"398_CR54","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/978-3-030-20085-5_1","volume-title":"Eye movement research: an introduction to its scientific foundations and applications","author":"P Pouget","year":"2019","unstructured":"Pouget P (2019) Introduction to the study of eye movements. In: Klein C, Ettinger U (eds) Eye movement research: an introduction to its scientific foundations and applications. Springer International Publishing, Cham, pp 3\u201310"},{"key":"398_CR55","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.jml.2015.07.004","volume":"86","author":"C Clifton Jr","year":"2016","unstructured":"Clifton C Jr et al (2016) Eye movements in reading and information processing: Keith Rayner\u2019s 40 year legacy. J Mem Lang 86:1\u201319","journal-title":"J Mem Lang"},{"key":"398_CR56","doi-asserted-by":"crossref","unstructured":"Chen S, Epps J, Ruiz N, Chen F (2011) Eye activity as a measure of human mental effort in HCI. In: Proceedings of the 16th international conference on intelligent user interfaces, 2011, pp. 315\u2013318","DOI":"10.1145\/1943403.1943454"},{"issue":"9","key":"398_CR57","doi-asserted-by":"publisher","first-page":"1295","DOI":"10.1080\/00140130802120267","volume":"51","author":"M De Rivecourt","year":"2008","unstructured":"De Rivecourt M, Kuperus M, Post W, Mulder L (2008) Cardiovascular and eye activity measures as indices for momentary changes in mental effort during simulated flight. Ergonomics 51(9):1295\u20131319. https:\/\/doi.org\/10.1080\/00140130802120267","journal-title":"Ergonomics"},{"issue":"1","key":"398_CR58","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1518\/001872001775992570","volume":"43","author":"KF Van Orden","year":"2001","unstructured":"Van Orden KF, Limbert W, Makeig S, Jung T-P (2001) Eye activity correlates of workload during a visuospatial memory task. Hum Factors 43(1):111\u2013121. https:\/\/doi.org\/10.1518\/001872001775992570","journal-title":"Hum Factors"},{"issue":"6","key":"398_CR59","doi-asserted-by":"publisher","first-page":"631","DOI":"10.1016\/S0169-8141(98)00068-7","volume":"24","author":"JH Goldberg","year":"1999","unstructured":"Goldberg JH, Kotval XP (1999) Computer interface evaluation using eye movements: methods and constructs. Int J Ind Ergon 24(6):631\u2013645","journal-title":"Int J Ind Ergon"},{"key":"398_CR60","doi-asserted-by":"crossref","unstructured":"Nakayama M, Takahashi K, Shimizu Y (2002) The act of task difficulty and eye-movement frequency for the'Oculo-motor indices. In: Proceedings of the 2002 symposium on Eye tracking research & applications: ACM Digital Library, 2002, pp. 37\u201342","DOI":"10.1145\/507072.507080"},{"key":"398_CR61","doi-asserted-by":"publisher","DOI":"10.16910\/jemr.4.2.2","author":"S Benedetto","year":"2011","unstructured":"Benedetto S, Pedrotti M, Bridgeman B (2011) Microsaccades and exploratory saccades in a naturalistic environment. J Eye Mov Res. https:\/\/doi.org\/10.16910\/jemr.4.2.2","journal-title":"J Eye Mov Res"},{"issue":"3","key":"398_CR62","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1167\/15.3.3","volume":"15","author":"X Gao","year":"2015","unstructured":"Gao X, Yan H, Sun H-J (2015) Modulation of microsaccade rate by task difficulty revealed through between-and within-trial comparisons. J Vis 15(3):3\u20133. https:\/\/doi.org\/10.1167\/15.3.3","journal-title":"J Vis"},{"issue":"2","key":"398_CR63","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1111\/ejn.12395","volume":"39","author":"E Siegenthaler","year":"2014","unstructured":"Siegenthaler E et al (2014) Task difficulty in mental arithmetic affects microsaccadic rates and magnitudes. Eur J Neurosci 39(2):287\u2013294. https:\/\/doi.org\/10.1111\/ejn.12395","journal-title":"Eur J Neurosci"},{"key":"398_CR64","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1007\/978-3-030-20085-5_3","volume-title":"Eye Movement Research: an Introduction to its Scientific Foundations and Applications","author":"RG Alexander","year":"2019","unstructured":"Alexander RG, Martinez-Conde S (2019) Fixational Eye Movements. In: Klein C, Ettinger U (eds) Eye Movement Research: an Introduction to its Scientific Foundations and Applications. Springer International Publishing, Cham, pp 73\u2013115"},{"issue":"5","key":"398_CR65","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1111\/j.1469-8986.2008.00681.x","volume":"45","author":"GJ Siegle","year":"2008","unstructured":"Siegle GJ, Ichikawa N, Steinhauer S (2008) Blink before and after you think: Blinks occur prior to and following cognitive load indexed by pupillary responses. Psychophysiology 45(5):679\u2013687. https:\/\/doi.org\/10.1111\/j.1469-8986.2008.00681.x","journal-title":"Psychophysiology"},{"key":"398_CR66","doi-asserted-by":"publisher","DOI":"10.4324\/9781410602817","volume-title":"Psychophysiology: Human behavior & physiological response","author":"JL Andreassi","year":"2013","unstructured":"Andreassi JL (2013) Psychophysiology: Human behavior & physiological response, 4th edn. Lawrence Erlbaub Associates, USA","edition":"4"},{"issue":"7","key":"398_CR67","first-page":"C75","volume":"76","author":"K Fukuda","year":"2005","unstructured":"Fukuda K, Stern JA, Brown TB, Russo MB (2005) Cognition, blinks, eye-movements, and pupillary movements during performance of a running memory task. Aviation, Space, Environ Med 76(7):C75\u2013C85","journal-title":"Aviation, Space, Environ Med"},{"issue":"3","key":"398_CR68","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1111\/j.1469-8986.2010.01069.x","volume":"48","author":"J Klingner","year":"2011","unstructured":"Klingner J, Tversky B, Hanrahan P (2011) Effects of visual and verbal presentation on cognitive load in vigilance, memory, and arithmetic tasks. Psychophysiology 48(3):323\u2013332. https:\/\/doi.org\/10.1111\/j.1469-8986.2010.01069.x","journal-title":"Psychophysiology"},{"issue":"6","key":"398_CR69","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1016\/0024-3205(83)90123-6","volume":"33","author":"RB Murray","year":"1983","unstructured":"Murray RB, Adler MW, Korczyn AD (1983) The pupillary effects of oploids. Life Sci 33(6):495\u2013509","journal-title":"Life Sci"},{"issue":"3","key":"398_CR70","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1016\/S1529-1839(04)70037-8","volume":"75","author":"JE Richman","year":"2004","unstructured":"Richman JE, McAndrew KG, Decker D, Mullaney SC (2004) An evaluation of pupil size standards used by police officers for detecting drug impairment. Optometry-J Am Optom Assoc 75(3):175\u2013182","journal-title":"Optometry-J Am Optom Assoc"},{"issue":"4","key":"398_CR71","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1038\/scientificamerican0465-46","volume":"212","author":"EH Hess","year":"1965","unstructured":"Hess EH (1965) Attitude and pupil size. Sci Am 212(4):46\u201355","journal-title":"Sci Am"},{"issue":"3423","key":"398_CR72","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1126\/science.132.3423.349","volume":"132","author":"EH Hess","year":"1960","unstructured":"Hess EH, Polt JM (1960) Pupil size as related to interest value of visual stimuli. Science 132(3423):349\u2013350","journal-title":"Science"},{"key":"398_CR73","doi-asserted-by":"crossref","unstructured":"He X, Wang L, Gao X, Chen Y. (2012) The eye activity measurement of mental workload based on basic flight task. In: IEEE 10th international conference on industrial informatics, 2012: IEEE, pp. 502\u2013507","DOI":"10.1109\/INDIN.2012.6301203"},{"key":"398_CR74","doi-asserted-by":"crossref","unstructured":"Appel T, et al. (2019) Predicting Cognitive load in an emergency simulation based on behavioral and physiological measures. In: 2019 International conference on multimodal interaction, W. Gao et al. Eds. New York United States: Association for Computing Machinery, 2019, pp. 154\u2013163","DOI":"10.1145\/3340555.3353735"},{"key":"398_CR75","unstructured":"Promotion\u00a0Software\u00a0GmbH. \"World of Emergency.\" Promotion\u00a0Software\u00a0GmbH. https:\/\/www.world-of-emergency.com\/?lang=en (accessed August 26, 2019, 2019)"},{"key":"#cr-split#-398_CR76.1","unstructured":"Hart SG (2006) ASA-task load index (NASA-TLX)"},{"key":"#cr-split#-398_CR76.2","doi-asserted-by":"crossref","unstructured":"20 years later. In: Proceedings of the human factors and ergonomics society annual meeting, vol. 50, no. 9). Los Angeles, CA: Sage Publications CA, 2006, pp. 904-908","DOI":"10.1177\/154193120605000909"},{"issue":"12","key":"398_CR77","doi-asserted-by":"publisher","first-page":"2935","DOI":"10.1002\/lary.24004","volume":"123","author":"SK Haerle","year":"2013","unstructured":"Haerle SK, Daly MJ, Chan HH, Vescan A, Kucharczyk W, Irish JC (2013) Virtual surgical planning in endoscopic skull base surgery. Laryngoscope 123(12):2935\u20132939","journal-title":"Laryngoscope"},{"key":"398_CR78","doi-asserted-by":"crossref","unstructured":"Temple JG, Dember WN, Warm JS, Jones KS, LaGrange CM, (1997) The effects of caffeine on performance and stress in an abbreviated vigilance task. In: Proceedings of the human factors and ergonomics society annual meeting, 1997, vol. 41, no. 2: SAGE Publications Sage CA: Los Angeles, CA, pp. 1293\u20131297","DOI":"10.1177\/1071181397041002126"},{"issue":"3","key":"398_CR79","doi-asserted-by":"publisher","first-page":"1336","DOI":"10.3758\/s13428-018-1075-y","volume":"51","author":"ME Kret","year":"2019","unstructured":"Kret ME, Sjak-Shie EE (2019) Preprocessing pupil size data: guidelines and code. Behav Res Methods 51(3):1336\u20131342","journal-title":"Behav Res Methods"},{"issue":"1","key":"398_CR80","doi-asserted-by":"publisher","first-page":"94","DOI":"10.3758\/s13428-017-1007-2","volume":"50","author":"S Math\u00f4t","year":"2018","unstructured":"Math\u00f4t S, Fabius J, Van Heusden E, Van der Stigchel S (2018) Safe and sensible preprocessing and baseline correction of pupil-size data. Behav Res Methods 50(1):94\u2013106","journal-title":"Behav Res Methods"},{"issue":"9","key":"398_CR81","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0203629","volume":"13","author":"K Krejtz","year":"2018","unstructured":"Krejtz K, Duchowski AT, Niedzielska A, Biele C, Krejtz I (2018) Eye tracking cognitive load using pupil diameter and microsaccades with fixed gaze. PLoS ONE 13(9):e0203629","journal-title":"PLoS ONE"},{"key":"398_CR82","unstructured":"R\u00a0Core\u00a0Team, \"R: A Language and Environment for Statistical Computing,\" 2020. [Online]. Available: https:\/\/www.R-project.org\/"},{"key":"398_CR83","doi-asserted-by":"crossref","unstructured":"Bates D, M\u00e4chler M, Bolker B, Walker S (2014) Fitting linear mixed-effects models using lme4. arXiv preprint arXiv:1406.5823","DOI":"10.18637\/jss.v067.i01"},{"key":"398_CR84","doi-asserted-by":"crossref","first-page":"2815","DOI":"10.21105\/joss.02306","volume":"5","author":"D Makowski","year":"2020","unstructured":"Makowski D, L\u00fcdecke D, Ben-Schachar M (2020) Automated reporting as a practical tool to improve reproducibility and methodological best practices adoption. J Open Source Softw 5:2815","journal-title":"J Open Source Softw"},{"key":"398_CR85","unstructured":"Magerko B, Stensrud BS, Holt LS, (2006) Bringing the schoolhouse inside the box-a tool for engaging, individualized training. SOAR TECHNOLOGY INC ANN ARBOR MI, 01.11.2006 2006. Accessed: 12.03.2021. [Online]. Available: https:\/\/apps.dtic.mil\/sti\/pdfs\/ADA481593.pdf"},{"issue":"3","key":"398_CR86","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1007\/s10994-006-6205-6","volume":"63","author":"P Spronck","year":"2006","unstructured":"Spronck P, Ponsen M, Sprinkhuizen-Kuyper I, Postma E (2006) Adaptive game AI with dynamic scripting. Mach Learn 63(3):217\u2013248","journal-title":"Mach Learn"},{"key":"398_CR87","doi-asserted-by":"crossref","unstructured":"Zook AE, Riedl MO, (2012) A temporal data-driven player model for dynamic difficulty adjustment. In: 8th Artificial intelligence and interactive digital entertainment conference","DOI":"10.1609\/aiide.v8i1.12504"},{"issue":"3","key":"398_CR88","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1386\/jgvw.3.3.181_1","volume":"3","author":"JM Kivikangas","year":"2011","unstructured":"Kivikangas JM et al (2011) A review of the use of psychophysiological methods in game research. J Gaming Virtual Worlds 3(3):181\u2013199","journal-title":"J Gaming Virtual Worlds"}],"container-title":["Journal on Multimodal User Interfaces"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-022-00398-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12193-022-00398-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-022-00398-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,15]],"date-time":"2023-02-15T17:08:02Z","timestamp":1676480882000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12193-022-00398-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,28]]},"references-count":89,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,3]]}},"alternative-id":["398"],"URL":"https:\/\/doi.org\/10.1007\/s12193-022-00398-y","relation":{},"ISSN":["1783-7677","1783-8738"],"issn-type":[{"value":"1783-7677","type":"print"},{"value":"1783-8738","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,28]]},"assertion":[{"value":"25 May 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 October 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 November 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare a conflict of interest: \u201cAuthor Natalia Sevcenko was employed by the company Daimler Truck AG. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.\u201d","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}},{"value":"Study was approved by IWM Ethics Committee.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"All participants signed written informed consent prior to the experiment.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"All authors give their consent for publication.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}]}}