{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T04:27:35Z","timestamp":1781324855176,"version":"3.54.1"},"reference-count":75,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2019,9,9]],"date-time":"2019-09-09T00:00:00Z","timestamp":1567987200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["Grant No. AL 1899\/2-1"],"award-info":[{"award-number":["Grant No. AL 1899\/2-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010663","name":"H2020 European Research Council","doi-asserted-by":"publisher","award":["683008"],"award-info":[{"award-number":["683008"]}],"id":[{"id":"10.13039\/100010663","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Australian Research Council Discovery Early Career Researcher","award":["DE180100315"],"award-info":[{"award-number":["DE180100315"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2019,9,9]]},"abstract":"<jats:p>Despite the importance of attention in user performance, current methods for attention classification do not allow to discriminate between different attention types. We propose a novel method that combines thermal imaging and eye tracking to unobtrusively classify four types of attention: sustained, alternating, selective, and divided. We collected a data set in which we stimulate these four attention types in a user study (N = 22) using combinations of audio and visual stimuli while measuring users' facial temperature and eye movement. Using a Logistic Regression on features extracted from both sensing technologies, we can classify the four attention types with high AUC scores up to 75.7% for the user independent-condition independent, 87% for the user-independent-condition dependent, and 77.4% for the user-dependent prediction. Our findings not only demonstrate the potential of thermal imaging and eye tracking for unobtrusive classification of different attention types but also pave the way for novel applications for attentive user interfaces and attention-aware computing.<\/jats:p>","DOI":"10.1145\/3351227","type":"journal-article","created":{"date-parts":[[2019,9,10]],"date-time":"2019-09-10T15:58:26Z","timestamp":1568131106000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":49,"title":["Classifying Attention Types with Thermal Imaging and Eye Tracking"],"prefix":"10.1145","volume":"3","author":[{"given":"Yomna","family":"Abdelrahman","sequence":"first","affiliation":[{"name":"Bundeswehr University Munich, Munich, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anam Ahmad","family":"Khan","sequence":"additional","affiliation":[{"name":"Computing and Information Systems, The University of Melbourne, Melbourne, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joshua","family":"Newn","sequence":"additional","affiliation":[{"name":"Computing and Information Systems, The University of Melbourne, Melbourne, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eduardo","family":"Velloso","sequence":"additional","affiliation":[{"name":"Computing and Information Systems, The University of Melbourne, Melbourne, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sherine Ashraf","family":"Safwat","sequence":"additional","affiliation":[{"name":"German University in Cairo, Cairo, Egypt"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Bailey","sequence":"additional","affiliation":[{"name":"Computing and Information Systems, The University of Melbourne, Melbourne, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"Bulling","sequence":"additional","affiliation":[{"name":"Institute for Visualisation and Interactive Systems, University of Stuttgart, Stuttgart, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Frank","family":"Vetere","sequence":"additional","affiliation":[{"name":"Computing and Information Systems, The University of Melbourne, Melbourne, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Albrecht","family":"Schmidt","sequence":"additional","affiliation":[{"name":"Ludwig Maximilian University Munich, Munich, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,9,9]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786567.2793709"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130898"},{"key":"e_1_2_1_3_1","volume-title":"Lazy Learning","author":"Aha David W.","unstructured":"David W. Aha . 1997. Lazy Learning . Kluwer Academic Publishers , Norwell, MA, USA , Chapter Lazy Learning, 7--10. http:\/\/dl.acm.org\/citation.cfm?id=273530.273534 David W. Aha. 1997. Lazy Learning. Kluwer Academic Publishers, Norwell, MA, USA, Chapter Lazy Learning, 7--10. http:\/\/dl.acm.org\/citation.cfm?id=273530.273534"},{"key":"e_1_2_1_4_1","volume-title":"Psychology: An Introductory Study of the Structure and Function of Human Consciousness. H. Holt.","author":"Angell James Rowland","year":"1910","unstructured":"James Rowland Angell . 1910 . Psychology: An Introductory Study of the Structure and Function of Human Consciousness. H. Holt. James Rowland Angell. 1910. Psychology: An Introductory Study of the Structure and Function of Human Consciousness. H. Holt."},{"key":"e_1_2_1_5_1","volume-title":"What They See Is What You Get: Eye Tracking of Attention in the Anxiety Disorders. Psychological Science Agenda 23, 3","author":"Armstrong T","year":"2009","unstructured":"T Armstrong and BO Olatunji . 2009. What They See Is What You Get: Eye Tracking of Attention in the Anxiety Disorders. Psychological Science Agenda 23, 3 ( 2009 ). T Armstrong and BO Olatunji. 2009. What They See Is What You Get: Eye Tracking of Attention in the Anxiety Disorders. Psychological Science Agenda 23, 3 (2009)."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2811681.2824997"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170427.3188688"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2016.32"},{"key":"e_1_2_1_9_1","volume-title":"Hugo Pl\u00e1cido da Silva, and Ana L. N. Fred","author":"Carreiras Carlos","year":"2016","unstructured":"Carlos Carreiras , Andr\u00e9 Louren\u00e7o , Helena Aidos , Hugo Pl\u00e1cido da Silva, and Ana L. N. Fred . 2016 . Unsupervised Analysis of Morphological ECG Features for Attention Detection. Springer International Publishing , Cham, 437--453. Carlos Carreiras, Andr\u00e9 Louren\u00e7o, Helena Aidos, Hugo Pl\u00e1cido da Silva, and Ana L. N. Fred. 2016. Unsupervised Analysis of Morphological ECG Features for Attention Detection. Springer International Publishing, Cham, 437--453."},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"O. T.. Chen P. Chen and Y. Tsai. 2017. Attention Estimation System via Smart Glasses. (Aug 2017) 1--5.  O. T.. Chen P. Chen and Y. Tsai. 2017. Attention Estimation System via Smart Glasses. (Aug 2017) 1--5.","DOI":"10.1109\/CIBCB.2017.8058565"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/375348.376626"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132025"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1532-0464(03)00034-0"},{"key":"e_1_2_1_14_1","volume-title":"Using Eye Movements as an Experimental Probe of Brain Function, Christopher Kennard and R","author":"Duc Albert Hoang","unstructured":"Albert Hoang Duc , Paul Bays , and Masud Husain . 2008. Chapter 5.5 - Eye movements as a Probe of Attention . In Using Eye Movements as an Experimental Probe of Brain Function, Christopher Kennard and R .John Leigh (Eds.). Progress in Brain Research, Vol. 171 . Elsevier , 403--411. Albert Hoang Duc, Paul Bays, and Masud Husain. 2008. Chapter 5.5 - Eye movements as a Probe of Attention. In Using Eye Movements as an Experimental Probe of Brain Function, Christopher Kennard and R.John Leigh (Eds.). Progress in Brain Research, Vol. 171. Elsevier, 403--411."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2009.08.008"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3053179"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03212870"},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Josef Falkinger. {n.d.}. Limited Attention as a Scarce Resource in Information-Rich Economies. The Economic Journal 118 532 ({n. d.}) 1596--1620.  Josef Falkinger. {n.d.}. Limited Attention as a Scarce Resource in Information-Rich Economies. The Economic Journal 118 532 ({n. d.}) 1596--1620.","DOI":"10.1111\/j.1468-0297.2008.02182.x"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jet.2005.12.001"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.3390\/s150511092"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2800835.2807942"},{"key":"e_1_2_1_22_1","volume-title":"Parkin","author":"Gardiner John M.","year":"1990","unstructured":"John M. Gardiner and Alan J . Parkin . 1990 . Attention and Recollective Experience in Recognition Memory. Memory & Cognition 18, 6 (01 Nov 1990), 579--583. John M. Gardiner and Alan J. Parkin. 1990. Attention and Recollective Experience in Recognition Memory. Memory & Cognition 18, 6 (01 Nov 1990), 579--583."},{"key":"e_1_2_1_23_1","volume-title":"On The Move to Meaningful Internet Systems 2003: CoopIS, DOA, and ODBASE, Robert Meersman, Zahir Tari, and Douglas C","author":"Guo Gongde","unstructured":"Gongde Guo , Hui Wang , David Bell , Yaxin Bi , and Kieran Greer . 2003. KNN Model-Based Approach in Classification . In On The Move to Meaningful Internet Systems 2003: CoopIS, DOA, and ODBASE, Robert Meersman, Zahir Tari, and Douglas C .Schmidt (Eds.). Springer Berlin Heidelberg , Berlin, Heidelberg , 986--996. Gongde Guo, Hui Wang, David Bell, Yaxin Bi, and Kieran Greer. 2003. KNN Model-Based Approach in Classification. In On The Move to Meaningful Internet Systems 2003: CoopIS, DOA, and ODBASE, Robert Meersman, Zahir Tari, and Douglas C.Schmidt (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 986--996."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1037\/e577632012-009"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025669"},{"key":"e_1_2_1_26_1","volume-title":"Hoffman and Baskaran Subramaniam","author":"James","year":"1995","unstructured":"James E. Hoffman and Baskaran Subramaniam . 1995 . The role of visual attention in saccadic eye movements. Perception & Psychophysics 57, 6 (01 Jan 1995), 787--795. James E. Hoffman and Baskaran Subramaniam. 1995. The role of visual attention in saccadic eye movements. Perception & Psychophysics 57, 6 (01 Jan 1995), 787--795."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0079440"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.12243"},{"key":"e_1_2_1_29_1","unstructured":"Daniel Kahneman. 1973. Attention and Effort. Vol. 1063. Prentice-Hall Englewood Cliffs NJ.  Daniel Kahneman. 1973. Attention and Effort. Vol. 1063. Prentice-Hall Englewood Cliffs NJ."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15326942DN1602_9"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123024.3124395"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3311768"},{"key":"e_1_2_1_33_1","first-page":"5","article-title":"The cocktail party effect","volume":"11","author":"Kuyper P.","year":"1972","unstructured":"P. Kuyper . 1972 . The cocktail party effect . Audiology 11 , 5 - 6 (1972), 277--282. P.Kuyper. 1972. The cocktail party effect. Audiology 11, 5-6 (1972), 277--282.","journal-title":"Audiology"},{"key":"e_1_2_1_34_1","volume-title":"Rabeling-Keus","author":"Lamers Martijn J. M.","year":"2010","unstructured":"Martijn J. M. Lamers , Ardi Roelofs , and Inge M . Rabeling-Keus . 2010 . Selective attention and response set in the Stroop task. Memory & Cognition 38, 7 (01 Oct 2010), 893--904. Martijn J. M. Lamers, Ardi Roelofs, and Inge M. Rabeling-Keus. 2010. Selective attention and response set in the Stroop task. Memory & Cognition 38, 7 (01 Oct 2010), 893--904."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.12.298"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.obhdp.2009.04.002"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2030092.2030099"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170427.3188621"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.3390\/s130810273"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00702-011-0744-0"},{"key":"e_1_2_1_41_1","volume-title":"From Human Attention to Computational Attention: A Multidisciplinary Approach","author":"Mancas Matei","unstructured":"Matei Mancas , Vincent P Ferrera , Nicolas Riche , and John G Taylor . 2016. From Human Attention to Computational Attention: A Multidisciplinary Approach . Vol. 10 . Springer . Matei Mancas, Vincent P Ferrera, Nicolas Riche, and John G Taylor. 2016. From Human Attention to Computational Attention: A Multidisciplinary Approach. Vol. 10. Springer."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173666"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01109051"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2016.7757403"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2015.00086"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1080\/17470218.2013.867517"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173835"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3116595.3116624"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0037202"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1080\/00335558008248231"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.ne.13.030190.000325"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.110.2.204"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3282894.3282900"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3282894.3282930"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/355017.355028"},{"key":"e_1_2_1_56_1","volume-title":"Physiological signals based human emotion Recognition: a review. (03","author":"Selvaraj Jerritta","year":"2011","unstructured":"Jerritta Selvaraj , Murugappan M, R Nagarajan , and Khairunizam Wan . 2011. Physiological signals based human emotion Recognition: a review. (03 2011 ). Jerritta Selvaraj, Murugappan M, R Nagarajan, and Khairunizam Wan. 2011. Physiological signals based human emotion Recognition: a review. (03 2011)."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2008.2003265"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1097\/00006842-199207000-00005"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1080\/01688638708405352"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287067"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3229434.3229439"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.121.1.15"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1080\/713755526"},{"key":"e_1_2_1_64_1","volume-title":"The Psychology of Attention","author":"Styles Elizabeth A.","unstructured":"Elizabeth A. Styles . 1997. The Psychology of Attention . Psychology Press . Elizabeth A. Styles. 1997. The Psychology of Attention. Psychology Press."},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3053243"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470696"},{"key":"e_1_2_1_67_1","volume-title":"International archives of occupational and environmental health 82, 3","author":"van Daalen Geertje","year":"2009","unstructured":"Geertje van Daalen , Tineke M Willemsen , Karin Sanders , and Marc JPM van Veldhoven . 2009. Emotional exhaustion and mental health problems among employees doing \"people work\": The impact of job demands, job resources and family-to-work conflict . International archives of occupational and environmental health 82, 3 ( 2009 ), 291--303. Geertje van Daalen, Tineke M Willemsen, Karin Sanders, and Marc JPM van Veldhoven. 2009. Emotional exhaustion and mental health problems among employees doing \"people work\": The impact of job demands, job resources and family-to-work conflict. International archives of occupational and environmental health 82, 3 (2009), 291--303."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comcom.2011.11.002"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2968542"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/2957265.2965025"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3022198.3026341"},{"key":"e_1_2_1_72_1","volume-title":"Orienting of attention","author":"Wright Richard D","unstructured":"Richard D Wright and Lawrence M Ward . 2008. Orienting of attention . Oxford University Press . Richard D Wright and Lawrence M Ward. 2008. Orienting of attention. Oxford University Press."},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170427.3188628"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13640-017-0228-8"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3313010"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3351227","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3351227","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:25:50Z","timestamp":1750206350000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3351227"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,9]]},"references-count":75,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2019,9,9]]}},"alternative-id":["10.1145\/3351227"],"URL":"https:\/\/doi.org\/10.1145\/3351227","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,9,9]]},"assertion":[{"value":"2019-09-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}