{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T18:12:12Z","timestamp":1773943932858,"version":"3.50.1"},"reference-count":107,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2012,12,1]],"date-time":"2012-12-01T00:00:00Z","timestamp":1354320000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100008242","name":"NICTA","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100008242","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100015539","name":"Australian Government","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100015539","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000181","name":"Air Force Office of Scientific Research","doi-asserted-by":"publisher","award":["FA2386-12-1-4049"],"award-info":[{"award-number":["FA2386-12-1-4049"]}],"id":[{"id":"10.13039\/100000181","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000935","name":"Department of Broadband, Communications and the Digital Economy , Australian Government","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000935","id-type":"DOI","asserted-by":"publisher"}]},{"name":"ICT Center of Excellence program"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2012,12]]},"abstract":"<jats:p>High cognitive load arises from complex time and safety-critical tasks, for example, mapping out flight paths, monitoring traffic, or even managing nuclear reactors, causing stress, errors, and lowered performance. Over the last five years, our research has focused on using the multimodal interaction paradigm to detect fluctuations in cognitive load in user behavior during system interaction. Cognitive load variations have been found to impact interactive behavior: by monitoring variations in specific modal input features executed in tasks of varying complexity, we gain an understanding of the communicative changes that occur when cognitive load is high. So far, we have identified specific changes in: speech, namely acoustic, prosodic, and linguistic changes; interactive gesture; and digital pen input, both interactive and freeform. As ground-truth measurements, galvanic skin response, subjective, and performance ratings have been used to verify task complexity.<\/jats:p>\n          <jats:p>The data suggest that it is feasible to use features extracted from behavioral changes in multiple modal inputs as indices of cognitive load. The speech-based indicators of load, based on data collected from user studies in a variety of domains, have shown considerable promise. Scenarios include single-user and team-based tasks; think-aloud and interactive speech; and single-word, reading, and conversational speech, among others. Pen-based cognitive load indices have also been tested with some success, specifically with pen-gesture, handwriting, and freeform pen input, including diagraming. After examining some of the properties of these measurements, we present a multimodal fusion model, which is illustrated with quantitative examples from a case study.<\/jats:p>\n          <jats:p>The feasibility of employing user input and behavior patterns as indices of cognitive load is supported by experimental evidence. Moreover, symptomatic cues of cognitive load derived from user behavior such as acoustic speech signals, transcribed text, digital pen trajectories of handwriting, and shapes pen, can be supported by well-established theoretical frameworks, including O'Donnell and Eggemeier's workload measurement [1986] Sweller's Cognitive Load Theory [Chandler and Sweller 1991], and Baddeley's model of modal working memory [1992] as well as McKinstry et al.'s [2008] and Rosenbaum's [2005] action dynamics work. The benefit of using this approach to determine the user's cognitive load in real time is that the data can be collected implicitly that is, during day-to-day use of intelligent interactive systems, thus overcomes problems of intrusiveness and increases applicability in real-world environments, while adapting information selection and presentation in a dynamic computer interface with reference to load.<\/jats:p>","DOI":"10.1145\/2395123.2395127","type":"journal-article","created":{"date-parts":[[2013,1,8]],"date-time":"2013-01-08T15:34:16Z","timestamp":1357659256000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":100,"title":["Multimodal behavior and interaction as indicators of cognitive load"],"prefix":"10.1145","volume":"2","author":[{"given":"Fang","family":"Chen","sequence":"first","affiliation":[{"name":"NICTA, Australia"}]},{"given":"Natalie","family":"Ruiz","sequence":"additional","affiliation":[{"name":"NICTA, Australia"}]},{"given":"Eric","family":"Choi","sequence":"additional","affiliation":[{"name":"NICTA, Australia"}]},{"given":"Julien","family":"Epps","sequence":"additional","affiliation":[{"name":"NICTA, Australia"}]},{"given":"M. Asif","family":"Khawaja","sequence":"additional","affiliation":[{"name":"NICTA, Australia"}]},{"given":"Ronnie","family":"Taib","sequence":"additional","affiliation":[{"name":"NICTA, Australia"}]},{"given":"Bo","family":"Yin","sequence":"additional","affiliation":[{"name":"NICTA, Australia"}]},{"given":"Yang","family":"Wang","sequence":"additional","affiliation":[{"name":"NICTA, Australia"}]}],"member":"320","published-online":{"date-parts":[[2013,1]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1080\/016909600750040571"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the 8th International Conference on Human-Computer Interaction (HCI'99)","volume":"1","author":"Ark W. S.","unstructured":"Ark , W. S. , Dryer , D. C. , and Lu , D. J . 1999. The emotion mouse . In Proceedings of the 8th International Conference on Human-Computer Interaction (HCI'99) : Ergonomics and User Interfaces. Vol. 1 , Lawrence Erlbaum Association, London. Ark, W. S., Dryer, D. C., and Lu, D. J. 1999. The emotion mouse. In Proceedings of the 8th International Conference on Human-Computer Interaction (HCI'99): Ergonomics and User Interfaces. Vol. 1, Lawrence Erlbaum Association, London."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/0003-6870(92)90152-L"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0021-9924(03)00019-4"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1736359"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the 7th International Conference on User Modeling (UM'99)","author":"Berthold A.","unstructured":"Berthold , A. and Jameson , A . 1999. Interpreting symptoms of cognitive load in speech input . In Proceedings of the 7th International Conference on User Modeling (UM'99) . Berthold, A. and Jameson, A. 1999. Interpreting symptoms of cognitive load in speech input. In Proceedings of the 7th International Conference on User Modeling (UM'99)."},{"key":"e_1_2_1_7_1","unstructured":"Brenner M. Shipp T. Doherty E. and Morrissey P. 1985. Voice measures of psychological stress: Laboratory and field data. In Vocal Fold Physiology Biomechanics Acoustics and Phonatory Control I. Titze and R. Scherer Eds. 239--248.  Brenner M. Shipp T. Doherty E. and Morrissey P. 1985. Voice measures of psychological stress: Laboratory and field data. In Vocal Fold Physiology Biomechanics Acoustics and Phonatory Control I. Titze and R. Scherer Eds. 239--248."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15326985EP3801_7"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1093\/bja\/80.1.58"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Chalker S. and Weiner E. 1998. The Oxford Dictionary of English Grammar. Oxford University Press New York.  Chalker S. and Weiner E. 1998. The Oxford Dictionary of English Grammar. Oxford University Press New York.","DOI":"10.1093\/acref\/9780192800879.001.0001"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1207\/s1532690xci0804_2"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X01003922"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0001728"},{"key":"e_1_2_1_14_1","unstructured":"Dechert H. W. and Raupach M. 1980. Towards a Cross-Linguistic Assessment of Speech Production. Lang Frankfurt.  Dechert H. W. and Raupach M. 1980. Towards a Cross-Linguistic Assessment of Speech Production. Lang Frankfurt."},{"key":"e_1_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Delis D. C. Kramer J. H. and Kaplan E. 2001. The Delis-Kaplan Executive Function System. The Psychological Corporation.  Delis D. C. Kramer J. H. and Kaplan E. 2001. The Delis-Kaplan Executive Function System. The Psychological Corporation.","DOI":"10.1037\/t15082-000"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979049"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the International Symposium on Brain, Vision and Artificial Intelligence (BVAI'07)","volume":"4729","author":"Esposito A.","unstructured":"Esposito , A. , Stejskal , V. , Smekal , Z. , and Bourbakis , N . 2007. The significance of empty speech pauses: Cognitive and algorithmic issues . In Proceedings of the International Symposium on Brain, Vision and Artificial Intelligence (BVAI'07) . Lecture Notes in Computer Science , vol. 4729 . Springer. Esposito, A., Stejskal, V., Smekal, Z., and Bourbakis, N. 2007. The significance of empty speech pauses: Cognitive and algorithmic issues. In Proceedings of the International Symposium on Brain, Vision and Artificial Intelligence (BVAI'07). Lecture Notes in Computer Science, vol. 4729. Springer."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6393(02)00080-8"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0057532"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/223904.223972"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1006\/inco.1995.1136"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1006\/jcss.1997.1504"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0301-0511(99)00037-X"},{"key":"e_1_2_1_24_1","volume-title":"Human Performance Measures Handbook","author":"Gawron V. J.","unstructured":"Gawron , V. J. 2000. Human Performance Measures Handbook . Lawrence Erlbaum Associates . Gawron, V. J. 2000. Human Performance Measures Handbook. Lawrence Erlbaum Associates."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9280.00395"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1177\/001872088402600504"},{"key":"e_1_2_1_27_1","volume-title":"The Technique of Clear Writing","author":"Gunning R.","unstructured":"Gunning , R. 1952. The Technique of Clear Writing . McGraw-Hill . Gunning, R. 1952. The Technique of Clear Writing. McGraw-Hill."},{"key":"e_1_2_1_28_1","unstructured":"Gutl C. Pivec M. Trummer C. Garcabarrios V. M. Mdristscher F. Pripfl J. and Umgeher M. 2005. Adele (adaptive e-learning with eye-tracking): Theoretical background system architecture and application scenarios. Euro. J. Open Dist. E-Learn. 2.  Gutl C. Pivec M. Trummer C. Garcabarrios V. M. Mdristscher F. Pripfl J. and Umgeher M. 2005. Adele (adaptive e-learning with eye-tracking): Theoretical background system architecture and application scenarios. Euro. J. Open Dist. E-Learn. 2."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1460563.1460611"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6393(96)00050-7"},{"key":"e_1_2_1_31_1","volume-title":"NATO Advances Research Workshop on Operator Functional State and Impaired Performance in Complex Work Environments II.","author":"Hockey G. R. J.","year":"2003","unstructured":"Hockey , G. R. J. 2003 . Operator functional state as a framework for the assessment of performance degradation . In NATO Advances Research Workshop on Operator Functional State and Impaired Performance in Complex Work Environments II. Hockey, G. R. J. 2003. Operator functional state as a framework for the assessment of performance degradation. In NATO Advances Research Workshop on Operator Functional State and Impaired Performance in Complex Work Environments II."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2005.103"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/985921.986094"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/0002-8703(94)90748-X"},{"key":"e_1_2_1_35_1","doi-asserted-by":"crossref","unstructured":"Jameson A. Keifer J. Muller C. Grossmann-Hutter B. Wittig F. and Rummer R. 2009. Assessment of a user's time pressure and cognitive load on the basis of features of speech. In Resource-Adaptive Cognitive Processes M. W. Crocker and J. Siekmann Eds. Springer 171.  Jameson A. Keifer J. Muller C. Grossmann-Hutter B. Wittig F. and Rummer R. 2009. Assessment of a user's time pressure and cognitive load on the basis of features of speech. In Resource-Adaptive Cognitive Processes M. W. Crocker and J. Siekmann Eds. Springer 171.","DOI":"10.1007\/978-3-540-89408-7_9"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10648-007-9051-6"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the RTO HFM Symposium on Current Aeromedical Issues in Rotary Wing Operations.","author":"Katz C.","unstructured":"Katz , C. , Fraser , E. B. , and Wagner , T. L . 1998. Rotary-Wing crew communication patterns across workload levels . In Proceedings of the RTO HFM Symposium on Current Aeromedical Issues in Rotary Wing Operations. Katz, C., Fraser, E. B., and Wagner, T. L. 1998. Rotary-Wing crew communication patterns across workload levels. In Proceedings of the RTO HFM Symposium on Current Aeromedical Issues in Rotary Wing Operations."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s002139900335"},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the Fonetiikan Paivat Conference.","author":"Keranen H.","unstructured":"Keranen , H. , Vayrynen , E. , Paakkonen , R. , Leino , T. , Kuronen , P. , Toivanen , J. , and Seppanen , T . 2004. Prosodic features of speech produced by military pilots during demanding tasks . In Proceedings of the Fonetiikan Paivat Conference. Keranen, H., Vayrynen, E., Paakkonen, R., Leino, T., Kuronen, P., Toivanen, J., and Seppanen, T. 2004. Prosodic features of speech produced by military pilots during demanding tasks. In Proceedings of the Fonetiikan Paivat Conference."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03208899"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1027933.1027953"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1719970.1720024"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-03655-2_54"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10648-008-9095-2"},{"key":"e_1_2_1_45_1","volume-title":"Physiological metrics of mental workload: A review of recent progress","author":"Kramer A. F.","unstructured":"Kramer , A. F. 1991. Physiological metrics of mental workload: A review of recent progress . In Multiple Task Performance, D. L. Damos, Ed., Taylor and Francis , London , 279--328. Kramer, A. F. 1991. Physiological metrics of mental workload: A review of recent progress. In Multiple Task Performance, D. L. Damos, Ed., Taylor and Francis, London, 279--328."},{"key":"e_1_2_1_46_1","volume-title":"Computers as Cognitive Tools: No More Walls","author":"Lajoie S. P.","unstructured":"Lajoie , S. P. 2000. Computers as Cognitive Tools: No More Walls . Lawrence Erlbaum , Hillsdale, NJ . Lajoie, S. P. 2000. Computers as Cognitive Tools: No More Walls. Lawrence Erlbaum, Hillsdale, NJ."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2011.01.005"},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the APSIPA Annual Summit and Conference (APSIPA'10)","author":"Le P.","unstructured":"Le , P. , Epps , J. , Amikairajah , E. , and Sethu , V . 2010a. Robust speech-based cognitive load classification using a multi-band approach . In Proceedings of the APSIPA Annual Summit and Conference (APSIPA'10) . Le, P., Epps, J., Amikairajah, E., and Sethu, V. 2010a. Robust speech-based cognitive load classification using a multi-band approach. In Proceedings of the APSIPA Annual Summit and Conference (APSIPA'10)."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2010.1097"},{"key":"e_1_2_1_50_1","unstructured":"Lennon C. and Burdick H. 2004. The lexile framework as an approach for reading measurement and success. http:\/\/www.Lexile.com.  Lennon C. and Burdick H. 2004. The lexile framework as an approach for reading measurement and success. http:\/\/www.Lexile.com."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-8986.00165.x"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2003.1193657"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.405815"},{"key":"e_1_2_1_54_1","volume-title":"AIS React Software v.6.6","author":"MacKintosh C.","unstructured":"MacKintosh , C. 2010. AIS React Software v.6.6 . Australian Institute of Sport . MacKintosh, C. 2010. AIS React Software v.6.6. Australian Institute of Sport."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-0663.88.1.49"},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the 36th Hawaii International Conference on System Sciences (HICSS'03)","volume":"5","author":"Marshall S. P.","unstructured":"Marshall , S. P. , Pleydell-Pearce , C. W. , and Dickson , B. T . 2003. Integrating psychological measures of cognitive workload and eye movements to detect strategy shifts . In Proceedings of the 36th Hawaii International Conference on System Sciences (HICSS'03) . Vol. 5 , IEEE Computer Society, Los Alamitos, CA. Marshall, S. P., Pleydell-Pearce, C. W., and Dickson, B. T. 2003. Integrating psychological measures of cognitive workload and eye movements to detect strategy shifts. In Proceedings of the 36th Hawaii International Conference on System Sciences (HICSS'03). Vol. 5, IEEE Computer Society, Los Alamitos, CA."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.2008.02041.x"},{"key":"e_1_2_1_58_1","first-page":"639","article-title":"SMOG grading: A new readability formula","volume":"12","author":"McLaughlin H. G.","year":"1969","unstructured":"McLaughlin , H. G. 1969 . SMOG grading: A new readability formula . J. Read. 12 , 8, 639 -- 646 . McLaughlin, H. G. 1969. SMOG grading: A new readability formula. J. Read. 12, 8, 639--646.","journal-title":"J. Read."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-0663.87.2.319"},{"key":"e_1_2_1_60_1","volume-title":"Proceedings of the 18th International Conference on User Modeling (UM'01)","author":"Muller C.","unstructured":"Muller , C. , Grossmann-Hutter , B. , Jameson , A. , Rummer , R. , and Wittig , F . 2001. Recognising time pressure and cognitive load on the basis of speech: An experimental study . In Proceedings of the 18th International Conference on User Modeling (UM'01) . Muller, C., Grossmann-Hutter, B., Jameson, A., Rummer, R., and Wittig, F. 2001. Recognising time pressure and cognitive load on the basis of speech: An experimental study. In Proceedings of the 18th International Conference on User Modeling (UM'01)."},{"key":"e_1_2_1_61_1","volume-title":"Proceedings of the 14th Triennial Congress of the International Ergonomics Association and 44th Annual Meeting of the Human Factors and Ergonomics Society (IEA'00\/HFES'00)","author":"Nickel P.","unstructured":"Nickel , P. and Nachreiner , F . 2000. Psychometric properties of the 0.1Hz component of hrv as an indicator of mental strain . In Proceedings of the 14th Triennial Congress of the International Ergonomics Association and 44th Annual Meeting of the Human Factors and Ergonomics Society (IEA'00\/HFES'00) . Nickel, P. and Nachreiner, F. 2000. Psychometric properties of the 0.1Hz component of hrv as an indicator of mental strain. In Proceedings of the 14th Triennial Congress of the International Ergonomics Association and 44th Annual Meeting of the Human Factors and Ergonomics Society (IEA'00\/HFES'00)."},{"key":"e_1_2_1_62_1","volume-title":"Handbook of Perception and Human Performance","volume":"2","author":"O'Donnell R. D.","unstructured":"O'Donnell , R. D. and Eggemeier , F. T . 1986. Workload assessment methodology . In Handbook of Perception and Human Performance , vol. 2 , K. R. Boff, L. Kaufman, and J. P. Thomas, Eds., Wiley, New York, 1--49. O'Donnell, R. D. and Eggemeier, F. T. 1986. Workload assessment methodology. In Handbook of Perception and Human Performance, vol. 2, K. R. Boff, L. Kaufman, and J. P. Thomas, Eds., Wiley, New York, 1--49."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci1201%262_4"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180639.1180831"},{"key":"e_1_2_1_65_1","volume-title":"Proceedings of the Conference on Research Foundations for Understanding Book and Reading in the Digital Age: Implementing New Knowledge Environments.","author":"Oviatt S.","year":"2009","unstructured":"Oviatt , S. 2009 . Designing interfaces that stimulate ideational superfluency . In Proceedings of the Conference on Research Foundations for Understanding Book and Reading in the Digital Age: Implementing New Knowledge Environments. Oviatt, S. 2009. Designing interfaces that stimulate ideational superfluency. In Proceedings of the Conference on Research Foundations for Understanding Book and Reading in the Digital Age: Implementing New Knowledge Environments."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/1027933.1027957"},{"key":"e_1_2_1_67_1","unstructured":"Paas F. Ayers P. and Pachman M. 2008. Assessment of cognitive load in multimedia learning: Theory methods and applications. In Recent Innovations in Educational Technology that Facilitate Student Learning D. H. Robinson and G. Schraw Eds. 11--36.  Paas F. Ayers P. and Pachman M. 2008. Assessment of cognitive load in multimedia learning: Theory methods and applications. In Recent Innovations in Educational Technology that Facilitate Student Learning D. H. Robinson and G. Schraw Eds. 11--36."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15326985EP3801_8"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.1998.675340"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1518\/155534308X284417"},{"key":"e_1_2_1_71_1","volume-title":"Affective Computing","author":"Picard R.","unstructured":"Picard , R. 1997. Affective Computing . MIT Press . Picard, R. 1997. Affective Computing. MIT Press."},{"key":"e_1_2_1_72_1","volume-title":"Proceedings of the Corpus Linguistics Conference.","author":"Reck R. P.","unstructured":"Reck , R. P. and Reck , R. A . 2007. Generating and rendering readability scores for project Gutenberg tests . In Proceedings of the Corpus Linguistics Conference. Reck, R. P. and Reck, R. A. 2007. Generating and rendering readability scores for project Gutenberg tests. In Proceedings of the Corpus Linguistics Conference."},{"key":"e_1_2_1_73_1","volume-title":"Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'92)","author":"Reynolds D. A.","unstructured":"Reynolds , D. A. and Rose , R. C . 1992. An integrated speech-background model for robust speaker identification . In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'92) . Reynolds, D. A. and Rose, R. C. 1992. An integrated speech-background model for robust speaker identification. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'92)."},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.60.4.308"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/122718.122753"},{"key":"e_1_2_1_76_1","volume-title":"A simulator study of the interaction of pilot workload with errors, vigilance, and decisions. NASA tech. memo","author":"Ruffell Smith H. P.","unstructured":"Ruffell Smith , H. P. 1979. A simulator study of the interaction of pilot workload with errors, vigilance, and decisions. NASA tech. memo , Moffett Field, CA : NASA Ames Research Center . Ruffell Smith, H. P. 1979. A simulator study of the interaction of pilot workload with errors, vigilance, and decisions. NASA tech. memo, Moffett Field, CA: NASA Ames Research Center."},{"key":"e_1_2_1_78_1","volume-title":"Proceedings of the 24th BCS Conference on Human-Computer Interaction (HCI'10)","author":"Ruiz N.","unstructured":"Ruiz , N. , Liu , G. , Yin , B. , Farrow , D. , and Chen , F . 2010. Teaching athletes cognitive skills: Detecting load in speech input . In Proceedings of the 24th BCS Conference on Human-Computer Interaction (HCI'10) . Ruiz, N., Liu, G., Yin, B., Farrow, D., and Chen, F. 2010. Teaching athletes cognitive skills: Detecting load in speech input. In Proceedings of the 24th BCS Conference on Human-Computer Interaction (HCI'10)."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/1228175.1228254"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070481.2070511"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/1322192.1322246"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022648800760"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1024691352"},{"key":"e_1_2_1_84_1","volume-title":"Contemporary Tools and Techniques for Studying Writing","author":"Schilperoord J.","unstructured":"Schilperoord , J. 2001. On the cognitive status of pauses in discourse production . In Contemporary Tools and Techniques for Studying Writing , T. Olive and C. M. Levy, Eds., Kluwer Academic Publishers , London . Schilperoord, J. 2001. On the cognitive status of pauses in discourse production. In Contemporary Tools and Techniques for Studying Writing, T. Olive and C. M. Levy, Eds., Kluwer Academic Publishers, London."},{"key":"e_1_2_1_85_1","doi-asserted-by":"crossref","unstructured":"Schwartz D. L. and Heiser J. 2006. Spatial representations and imagery in learning. In Handbook of the Learning Sciences K. Sawywe Ed. Lawrence Erlbaum.  Schwartz D. L. and Heiser J. 2006. Spatial representations and imagery in learning. In Handbook of the Learning Sciences K. Sawywe Ed. Lawrence Erlbaum.","DOI":"10.1017\/CBO9780511816833.018"},{"key":"e_1_2_1_86_1","first-page":"63","article-title":"Analyzing cockpit communication: The links between language, performance, error and workload","volume":"5","author":"Sexton J. B.","year":"2000","unstructured":"Sexton , J. B. and Helmreich , R. L. 2000 . Analyzing cockpit communication: The links between language, performance, error and workload . J. Hum. Perform. Extreme Environ. 5 , 1, 63 -- 68 . Sexton, J. B. and Helmreich, R. L. 2000. Analyzing cockpit communication: The links between language, performance, error and workload. J. Hum. Perform. Extreme Environ. 5, 1, 63--68.","journal-title":"J. Hum. Perform. Extreme Environ."},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240866.1241057"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0503903102"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0054651"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022193728205"},{"key":"e_1_2_1_91_1","first-page":"302","article-title":"Effect of experimentally induced stress on vocal parameters","volume":"12","author":"Tolkmitt E. J.","year":"1986","unstructured":"Tolkmitt , E. J. and Scherer , K. R. 1986 . Effect of experimentally induced stress on vocal parameters . J. Experiment. Psychol. 12 , 302 -- 312 . Tolkmitt, E. J. and Scherer, K. R. 1986. Effect of experimentally induced stress on vocal parameters. J. Experiment. Psychol. 12, 302--312.","journal-title":"J. Experiment. Psychol."},{"key":"e_1_2_1_92_1","volume-title":"Applications of Linguistics","author":"Ure J.","unstructured":"Ure , J. 1971. Lexical density and register differentiation . In Applications of Linguistics , G. Perren and T. Trim, Eds., Cambridge University Press , 443--452. Ure, J. 1971. Lexical density and register differentiation. In Applications of Linguistics, G. Perren and T. Trim, Eds., Cambridge University Press, 443--452."},{"key":"e_1_2_1_93_1","first-page":"7","article-title":"Which components of working memory are important in the writing process&quest; Read","volume":"20","author":"Vanderberg R.","year":"2007","unstructured":"Vanderberg , R. and Swanson , H. L. 2007 . Which components of working memory are important in the writing process&quest; Read . Writ. Interdiscpl. J. 20 , 7 . Vanderberg, R. and Swanson, H. L. 2007. Which components of working memory are important in the writing process&quest; Read. Writ. Interdiscpl. J. 20, 7.","journal-title":"Writ. Interdiscpl. J."},{"key":"e_1_2_1_94_1","unstructured":"Wickens C. D. and Hollands J. G. 2000. Engineering Psychology and Human Performance 3rd Ed. Pearson\/Prentice-Hall Upper Saddle River NJ.  Wickens C. D. and Hollands J. G. 2000. Engineering Psychology and Human Performance 3 rd Ed. Pearson\/Prentice-Hall Upper Saddle River NJ."},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.45.4.635.27088"},{"key":"e_1_2_1_96_1","volume-title":"Proceedings of the 9th Conference on Speech and Computer (SPECOM'04)","author":"Wood C.","unstructured":"Wood , C. , Torkkola , K. , and Kundalkar , S . 2004. Using driver's speech to detect cognitive workload . In Proceedings of the 9th Conference on Speech and Computer (SPECOM'04) . International Speech Communication Association Press. Wood, C., Torkkola, K., and Kundalkar, S. 2004. Using driver's speech to detect cognitive workload. In Proceedings of the 9th Conference on Speech and Computer (SPECOM'04). International Speech Communication Association Press."},{"key":"e_1_2_1_98_1","volume-title":"Proceedings of the IEEE International Conference on Information Sciences, Signal Processing and Their Applications (ISSPA'10)","author":"Yap T. F.","unstructured":"Yap , T. F. , Ambikairajah , E. , Epps , J. , and Choi , E . 2010a. Cognitive load classification using formant features . In Proceedings of the IEEE International Conference on Information Sciences, Signal Processing and Their Applications (ISSPA'10) . Yap, T. F., Ambikairajah, E., Epps, J., and Choi, E. 2010a. Cognitive load classification using formant features. In Proceedings of the IEEE International Conference on Information Sciences, Signal Processing and Their Applications (ISSPA'10)."},{"key":"e_1_2_1_99_1","volume-title":"Proceedings of the Annual Conference of the International Speech Communication Association (InterSpeech'10)","author":"Yap T. F.","unstructured":"Yap , T. F. , Epps , J. , Ambikairajah , E. , and Choi , E . 2010b. An investigation of formant frequencies for cognitive load classification . In Proceedings of the Annual Conference of the International Speech Communication Association (InterSpeech'10) . Yap, T. F., Epps, J., Ambikairajah, E., and Choi, E. 2010b. An investigation of formant frequencies for cognitive load classification. In Proceedings of the Annual Conference of the International Speech Communication Association (InterSpeech'10)."},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1155\/2011\/219253"},{"key":"e_1_2_1_101_1","volume-title":"Proceedings of the IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP'10)","author":"Yap T. F.","unstructured":"Yap , T. F. , Epps , J. , Choi , E. , and Ambikairajah , E . 2010c. Glottal features for speech-based cognitive load classification . In Proceedings of the IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP'10) . Yap, T. F., Epps, J., Choi, E., and Ambikairajah, E. 2010c. Glottal features for speech-based cognitive load classification. In Proceedings of the IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP'10)."},{"key":"e_1_2_1_102_1","doi-asserted-by":"crossref","unstructured":"Yin B. and Chen F. 2007. Towards automatic cognitive load measurement from speech analysis. In Human-Computer Interaction Interaction Design and Usability J. Jacko Ed. Springer 1011--1020.   Yin B. and Chen F. 2007. Towards automatic cognitive load measurement from speech analysis. In Human-Computer Interaction Interaction Design and Usability J. Jacko Ed. Springer 1011--1020.","DOI":"10.1007\/978-3-540-73105-4_111"},{"key":"e_1_2_1_103_1","volume-title":"Proceedings of the IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP'08)","author":"Yin B.","unstructured":"Yin , B. , Chen , F. , Ruiz , N. , and Ambikairajah , E . 2008. Speech-Based cognitive load monitoring system . In Proceedings of the IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP'08) . Yin, B., Chen, F., Ruiz, N., and Ambikairajah, E. 2008. Speech-Based cognitive load monitoring system. In Proceedings of the IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP'08)."},{"key":"e_1_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.1145\/1324892.1324946"},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1177\/001872088803000110"},{"key":"e_1_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.1145\/1943403.1943481"},{"key":"e_1_2_1_107_1","volume-title":"Proceedings of the ACM Symposium on User Interface Software and Technology (UIST'11)","author":"Yu K.","unstructured":"Yu , K. , Epps , J. , and Chen , F . 2011b. Cognitive load evaluation with pen orientation and pressure . In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST'11) . Yu, K., Epps, J., and Chen, F. 2011b. Cognitive load evaluation with pen orientation and pressure. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST'11)."},{"key":"e_1_2_1_108_1","unstructured":"Yu K. Epps J. and Chen F. 2011c. Cognitive load measurement with pen orientation and pressure. http:\/\/icmi11.forge.nicta.com.au\/papers\/MMCogEmS2011_Yu.pdf.  Yu K. Epps J. and Chen F. 2011c. Cognitive load measurement with pen orientation and pressure. http:\/\/icmi11.forge.nicta.com.au\/papers\/MMCogEmS2011_Yu.pdf."},{"key":"e_1_2_1_109_1","doi-asserted-by":"crossref","unstructured":"Zander T. O. and Kothe C. 2011. Towards passive brain-computer interfaces: Applying brain-computer interface technology to human-machine systems in general. J. Neur. Engin. 8.  Zander T. O. and Kothe C. 2011. Towards passive brain-computer interfaces: Applying brain-computer interface technology to human-machine systems in general. J. Neur. Engin. 8.","DOI":"10.1088\/1741-2560\/8\/2\/025005"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2395123.2395127","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2395123.2395127","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T09:34:56Z","timestamp":1750239296000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2395123.2395127"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,12]]},"references-count":107,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2012,12]]}},"alternative-id":["10.1145\/2395123.2395127"],"URL":"https:\/\/doi.org\/10.1145\/2395123.2395127","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,12]]},"assertion":[{"value":"2011-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-01-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}