{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,7]],"date-time":"2026-02-07T07:46:42Z","timestamp":1770450402011,"version":"3.49.0"},"reference-count":68,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2017,9,11]],"date-time":"2017-09-11T00:00:00Z","timestamp":1505088000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"German Research Foundation within the SimTech Cluster of Excellence","award":["EXC 310\/2"],"award-info":[{"award-number":["EXC 310\/2"]}]},{"name":"Amplify project which received funding from the European Research Council (ERC) under the European Union's Horizon 2020 research and innovation programme","award":["683008"],"award-info":[{"award-number":["683008"]}]},{"name":"Victorian State Government and Microsoft through their contributions to the Microsoft Research Centre for Social Natural User Interfaces"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2017,9,11]]},"abstract":"<jats:p>Current digital systems are largely blind to users\u2019 cognitive states. Systems that adapt to users\u2019 states show great potential for augmenting cognition and for creating novel user experiences. However, most approaches for sensing cognitive states, and cognitive load specifically, involve obtrusive technologies, such as physiological sensors attached to users\u2019 bodies. This paper present an unobtrusive indicator of the users\u2019 cognitive load based on thermal imaging that is applicable in real-world. We use a commercial thermal camera to monitor a person\u2019s forehead and nose temperature changes to estimate their cognitive load. To assess the effect of different levels of cognitive load on facial temperature we conducted a user study with 12 participants. The study showed that different levels of the Stroop test and the complexity of reading texts affect facial temperature patterns, thereby giving a measure of cognitive load. To validate the feasibility for real-time assessments of cognitive load, we conducted a second study with 24 participants, we analyzed the temporal latency of temperature changes. Our system detected temperature changes with an average latency of 0.7 seconds after users were exposed to a stimulus, outperforming latency in related work that used other thermal imaging techniques. We provide empirical evidence showing how to unobtrusively detect changes in cognitive load in real-time. Our exploration of exposing users to different content types gives rise to thermal-based activity tracking, which facilitates new applications in the field of cognition-aware computing.<\/jats:p>","DOI":"10.1145\/3130898","type":"journal-article","created":{"date-parts":[[2017,9,11]],"date-time":"2017-09-11T12:12:26Z","timestamp":1505131946000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":139,"title":["Cognitive Heat"],"prefix":"10.1145","volume":"1","author":[{"given":"Yomna","family":"Abdelrahman","sequence":"first","affiliation":[{"name":"University of Stuttgart, Germany"}]},{"given":"Eduardo","family":"Velloso","sequence":"additional","affiliation":[{"name":"The University of Melbourne, Australia"}]},{"given":"Tilman","family":"Dingler","sequence":"additional","affiliation":[{"name":"Osaka Prefecture University, Japan"}]},{"given":"Albrecht","family":"Schmidt","sequence":"additional","affiliation":[{"name":"University of Stuttgart, Germany"}]},{"given":"Frank","family":"Vetere","sequence":"additional","affiliation":[{"name":"The University of Melbourne, Australia"}]}],"member":"320","published-online":{"date-parts":[[2017,9,11]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Yomna Abdelrahman. 2013. Thermal imaging for interactive surfaces. Master\u2019s thesis. Yomna Abdelrahman. 2013. Thermal imaging for interactive surfaces. Master\u2019s thesis."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025461"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123024.3124450"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123024.3129269"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702290"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Jackson Beatty. 1982. Task-evoked pupillary responses processing load and the structure of processing resources. Psychological bulletin 91 2 (1982) 276. Jackson Beatty. 1982. Task-evoked pupillary responses processing load and the structure of processing resources. Psychological bulletin 91 2 (1982) 276.","DOI":"10.1037\/0033-2909.91.2.276"},{"key":"e_1_2_1_7_1","unstructured":"Kirsch C. (Producer) Moxham J. B. (Producer) Alusi G. (Producer) Berkovitz B. (Producer) and T. (Producer) Cheesman. 2013. 3D Head and Neck Anatomy with Special Senses and Basic Neuroanatomy. {DVD-ROM}. United Kingdom: Primal Pictures. Kirsch C. (Producer) Moxham J. B. (Producer) Alusi G. (Producer) Berkovitz B. (Producer) and T. (Producer) Cheesman. 2013. 3D Head and Neck Anatomy with Special Senses and Basic Neuroanatomy. {DVD-ROM}. United Kingdom: Primal Pictures."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICALT.2010.81"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3053179"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Douglas C Engelbart. 1962. Augmenting human intellect: a conceptual framework (1962). Technical Report for the Air Force Office of Scientific Research (1962). Douglas C Engelbart. 1962. Augmenting human intellect: a conceptual framework (1962). Technical Report for the Air Force Office of Scientific Research (1962).","DOI":"10.21236\/AD0289565"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0090782"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2008.10.011"},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","unstructured":"Ismael Fern\u00e1ndez-Cuevas Joao Carlos Bouzas Marins Javier Arn\u00e1iz Lastras Pedro Mar\u00eda G\u00f3mez Carmona Sergio Pi\u00f1onosa Cano Miguel \u00c1ngel Garc\u00eda-Concepci\u00f3n and Manuel Sillero-Quintana. 2015. Classification of factors influencing the use of infrared thermography in humans: A review. Infrared Physics 8 Technology 71 (2015) 28--55. Ismael Fern\u00e1ndez-Cuevas Joao Carlos Bouzas Marins Javier Arn\u00e1iz Lastras Pedro Mar\u00eda G\u00f3mez Carmona Sergio Pi\u00f1onosa Cano Miguel \u00c1ngel Garc\u00eda-Concepci\u00f3n and Manuel Sillero-Quintana. 2015. Classification of factors influencing the use of infrared thermography in humans: A review. Infrared Physics 8 Technology 71 (2015) 28--55.","DOI":"10.1016\/j.infrared.2015.02.007"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2800835.2807942"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00138-013-0570-5"},{"key":"e_1_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Marc Germain Michel Jobin and Michel Cabanac. 1987. The effect of face fanning during recovery from exercise hyperthermia. Canadian journal of physiology and pharmacology 65 1 (1987) 87--91. Marc Germain Michel Jobin and Michel Cabanac. 1987. The effect of face fanning during recovery from exercise hyperthermia. Canadian journal of physiology and pharmacology 65 1 (1987) 87--91.","DOI":"10.1139\/y87-017"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130917"},{"key":"e_1_2_1_18_1","unstructured":"M Haak S Bos S Panic and LJM Rothkrantz. 2009. Detecting stress using eye blinks and brain activity from EEG signals. Proceeding of the 1st driver car interaction and interface (DCII 2008) (2009) 35--60. M Haak S Bos S Panic and LJM Rothkrantz. 2009. Detecting stress using eye blinks and brain activity from EEG signals. Proceeding of the 1st driver car interaction and interface (DCII 2008) (2009) 35--60."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2005.848368"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557165"},{"key":"e_1_2_1_21_1","volume-title":"International Conference on. IEEE, 220--226","author":"Hosni Sarah M","year":"2007"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2005.103"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0079440"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.12243"},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-13500-7","volume-title":"Symbiotic Interaction: A Critical Definition and Comparison to other Human-Computer Paradigms","author":"Jacucci Giulio","year":"2014"},{"key":"e_1_2_1_26_1","doi-asserted-by":"crossref","unstructured":"SD Jenkins and RDH Brown. 2014. A correlational analysis of human cognitive activity using Infrared Thermography of the supraorbital region frontal EEG and self-report of core affective state. QIRT. SD Jenkins and RDH Brown. 2014. A correlational analysis of human cognitive activity using Infrared Thermography of the supraorbital region frontal EEG and self-report of core affective state. QIRT.","DOI":"10.21611\/qirt.2014.131"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1037\/e578262012-047"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of Army Science Conference","author":"Kang J","year":"2006"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.1998.745598"},{"key":"e_1_2_1_30_1","doi-asserted-by":"crossref","unstructured":"Koji Kuraoka and Katsuki Nakamura. 2011. The use of nasal skin temperature measurements in studying emotion in macaque monkeys. Physiology 8 behavior 102 3 (2011) 347--355. Koji Kuraoka and Katsuki Nakamura. 2011. The use of nasal skin temperature measurements in studying emotion in macaque monkeys. Physiology 8 behavior 102 3 (2011) 347--355.","DOI":"10.1016\/j.physbeh.2010.11.029"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CBMS.2013.6627790"},{"key":"e_1_2_1_32_1","doi-asserted-by":"crossref","unstructured":"Elise Labb\u00e9 Nicholas Schmidt Jonathan Babin and Martha Pharr. 2007. Coping with stress: the effectiveness of different types of music. Applied psychophysiology and biofeedback 32 3-4 (2007) 163--168. Elise Labb\u00e9 Nicholas Schmidt Jonathan Babin and Martha Pharr. 2007. Coping with stress: the effectiveness of different types of music. Applied psychophysiology and biofeedback 32 3-4 (2007) 163--168.","DOI":"10.1007\/s10484-007-9043-9"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979317"},{"key":"e_1_2_1_34_1","unstructured":"Robert W Levenson. 1988. Emotion and the autonomic nervous system: A prospectus for research on autonomic specificity. (1988). Robert W Levenson. 1988. Emotion and the autonomic nervous system: A prospectus for research on autonomic specificity. (1988)."},{"key":"e_1_2_1_35_1","doi-asserted-by":"crossref","unstructured":"Joseph CR Licklider. 1960. Man-computer symbiosis. IRE transactions on human factors in electronics 1 (1960) 4--11. Joseph CR Licklider. 1960. Man-computer symbiosis. IRE transactions on human factors in electronics 1 (1960) 4--11.","DOI":"10.1109\/THFE2.1960.4503259"},{"key":"e_1_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Barbara Manini Daniela Cardone Sjoerd JH Ebisch Daniela Bafunno Tiziana Aureli and Arcangelo Merla. 2013. Mom feels what her child feels: thermal signatures of vicarious autonomic response while watching children in a stressful situation. Front. Hum. Neurosci 7 (2013). Barbara Manini Daniela Cardone Sjoerd JH Ebisch Daniela Bafunno Tiziana Aureli and Arcangelo Merla. 2013. Mom feels what her child feels: thermal signatures of vicarious autonomic response while watching children in a stressful situation. Front. Hum. Neurosci 7 (2013).","DOI":"10.3389\/fnhum.2013.00299"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1152\/jappl.1975.39.1.114"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2007.4352270"},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Takakazu Oka Kae Oka and Tetsuro Hori. 2001. Mechanisms and mediators of psychological stress-induced rise in core temperature. Psychosomatic medicine 63 3 (2001) 476--486. Takakazu Oka Kae Oka and Tetsuro Hori. 2001. Mechanisms and mediators of psychological stress-induced rise in core temperature. Psychosomatic medicine 63 3 (2001) 476--486.","DOI":"10.1097\/00006842-200105000-00018"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.3233\/OER-2007-7202"},{"key":"e_1_2_1_41_1","volume-title":"Mobile Computing, Applications, and Services","author":"Parnandi Avinash"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2013.8"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/MEMB.2002.1175139"},{"key":"e_1_2_1_44_1","doi-asserted-by":"crossref","unstructured":"Ioannis Pavlidis Panagiotis Tsiamyrtzis Dvijesh Shastri Avinash Wesley Yan Zhou Peggy Lindner Pradeep Buddharaju Rohan Joseph Anitha Mandapati Brian Dunkin etal 2012. Fast by nature-how stress patterns define human experience and performance in dexterous tasks. Scientific Reports 2 (2012). Ioannis Pavlidis Panagiotis Tsiamyrtzis Dvijesh Shastri Avinash Wesley Yan Zhou Peggy Lindner Pradeep Buddharaju Rohan Joseph Anitha Mandapati Brian Dunkin et al. 2012. Fast by nature-how stress patterns define human experience and performance in dexterous tasks. Scientific Reports 2 (2012).","DOI":"10.1038\/srep00305"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.5555\/2062850.2062929"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858117"},{"key":"e_1_2_1_47_1","doi-asserted-by":"crossref","unstructured":"Rosalind W. Picard. 1997. Affective Computing. MIT Press Cambridge MA USA. Rosalind W. Picard. 1997. Affective Computing. MIT Press Cambridge MA USA.","DOI":"10.1037\/e526112012-054"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1056808.1057007"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2014.2317309"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557208"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2017.8"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2516540.2516561"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2012.07.003"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2008.2003265"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2012.13"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240866.1241057"},{"key":"e_1_2_1_57_1","doi-asserted-by":"crossref","unstructured":"Alireza Sahami Shirazi Markus Funk Florian Pfleiderer Hendrik Gl\u00fcck and Albrecht Schmidt. 2012. MediaBrain: Annotating Videos based on Brain-Computer Interaction.. In Mensch 8 Computer. 263--272. Alireza Sahami Shirazi Markus Funk Florian Pfleiderer Hendrik Gl\u00fcck and Albrecht Schmidt. 2012. MediaBrain: Annotating Videos based on Brain-Computer Interaction.. In Mensch 8 Computer. 263--272.","DOI":"10.1524\/9783486718782.263"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2582051.2582096"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1097\/00006842-199207000-00005"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/CRV.2010.37"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.121.1.15"},{"key":"e_1_2_1_62_1","doi-asserted-by":"crossref","unstructured":"John Sweller Paul Ayres and Slava Kalyuga. 2011. Measuring Cognitive Load. Springer New York New York NY 71--85. John Sweller Paul Ayres and Slava Kalyuga. 2011. Measuring Cognitive Load. Springer New York New York NY 71--85.","DOI":"10.1007\/978-1-4419-8126-4_6"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/238386.238619"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000013087.49260.fb"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2401836.2401850"},{"key":"e_1_2_1_66_1","doi-asserted-by":"crossref","unstructured":"Mark Weiser. 1991. The computer for the 21st century. Scientific american 265 3 (1991) 94--104. Mark Weiser. 1991. The computer for the 21st century. Scientific american 265 3 (1991) 94--104.","DOI":"10.1038\/scientificamerican0991-94"},{"key":"e_1_2_1_67_1","doi-asserted-by":"crossref","unstructured":"Robert B Zajonc Sheila T Murphy and Marita Inglehart. 1989. Feeling and facial efference: implications of the vascular theory of emotion. Psychological review 96 3 (1989) 395. Robert B Zajonc Sheila T Murphy and Marita Inglehart. 1989. Feeling and facial efference: implications of the vascular theory of emotion. Psychological review 96 3 (1989) 395.","DOI":"10.1037\/0033-295X.96.3.395"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2007.4352269"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130898","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3130898","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:13:19Z","timestamp":1750212799000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130898"}},"subtitle":["Exploring the Usage of Thermal Imaging to Unobtrusively Estimate Cognitive Load"],"short-title":[],"issued":{"date-parts":[[2017,9,11]]},"references-count":68,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2017,9,11]]}},"alternative-id":["10.1145\/3130898"],"URL":"https:\/\/doi.org\/10.1145\/3130898","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,9,11]]},"assertion":[{"value":"2017-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-09-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}