{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T17:58:38Z","timestamp":1777571918634,"version":"3.51.4"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2006,9,1]],"date-time":"2006-09-01T00:00:00Z","timestamp":1157068800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Auton. Adapt. Syst."],"published-print":{"date-parts":[[2006,9]]},"abstract":"<jats:p>Machines would require the ability to perceive and adapt to affects for achieving artificial sociability. Most autonomous systems use Automated Facial Expression Classification (AFEC) and Automated Affect Interpretation (AAI) to achieve sociability. Varying lighting conditions, occlusion, and control over physiognomy can influence the real life performance of vision-based AFEC systems. Physiological signals provide complementary information for AFEC and AAI. We employed transient facial thermal features for AFEC and AAI. Infrared thermal images with participants' normal expression and intentional expressions of happiness, sadness, disgust, and fear were captured. Facial points that undergo significant thermal changes with a change in expression termed as Facial Thermal Feature Points (FTFPs) were identified. Discriminant analysis was invoked on principal components derived from the Thermal Intensity Values (TIVs) recorded at the FTFPs. The cross-validation and person-independent classification respectively resulted in 66.28% and 56.0% success rates. Classification significance tests suggest that (1) like other physiological cues, facial skin temperature also provides useful information about affective states and their facial expression; (2) patterns of facial skin temperature variation can complement other cues for AFEC and AAI; and (3) infrared thermal imaging may help achieve artificial sociability in robots and autonomous systems.<\/jats:p>","DOI":"10.1145\/1152934.1152939","type":"journal-article","created":{"date-parts":[[2007,2,21]],"date-time":"2007-02-21T16:42:23Z","timestamp":1172076143000},"page":"91-113","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":58,"title":["Automated Facial Expression Classification and affect interpretation using infrared measurement of facial skin temperature variations"],"prefix":"10.1145","volume":"1","author":[{"given":"Masood Mehmood","family":"Khan","sequence":"first","affiliation":[{"name":"American University of Sharjah, Sharjah, UAE"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Ingleby","sequence":"additional","affiliation":[{"name":"The University of Huddersfield, Queensgate, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Robert D.","family":"Ward","sequence":"additional","affiliation":[{"name":"The University of Huddersfield, Queensgate, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2006,9]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009602621318"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1011811315582"},{"key":"e_1_2_1_3_1","unstructured":"Belmont Report. 1979. Ethical principles and guidelines for the protection of human subjects of research. United States Government National Institute of Health Washington D.C. http:\/\/ohsr.od.nih.gov\/guidelines\/belmont.html.  Belmont Report. 1979. Ethical principles and guidelines for the protection of human subjects of research. United States Government National Institute of Health Washington D.C. http:\/\/ohsr.od.nih.gov\/guidelines\/belmont.html."},{"key":"e_1_2_1_4_1","doi-asserted-by":"crossref","unstructured":"Bolle R. M. Connell J. H. Pankanti S. Ratha N. K. and Senior A. W. 2004. Guide to Biometrics. Springer Verlag Berlin Germany.   Bolle R. M. Connell J. H. Pankanti S. Ratha N. K. and Senior A. W. 2004. Guide to Biometrics. Springer Verlag Berlin Germany.","DOI":"10.1007\/978-1-4757-4036-3"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.637261"},{"key":"e_1_2_1_6_1","unstructured":"Brooks R. A. 2002. Flesh and Machines: How Robots Will Change Us. Pantheon Books New York NY.   Brooks R. A. 2002. Flesh and Machines: How Robots Will Change Us. Pantheon Books New York NY."},{"key":"e_1_2_1_7_1","unstructured":"Cantronic Systems Inc. 2001. IR 860 User Manual. Cantronic Systems Inc. Coquitlam Canada.  Cantronic Systems Inc. 2001. IR 860 User Manual. Cantronic Systems Inc. Coquitlam Canada."},{"key":"e_1_2_1_8_1","unstructured":"Cantronix Systems Inc. 2003. IR 860 Product Data Sheet. Cantronic Systems Inc. Coquitlam Canada.  Cantronix Systems Inc. 2003. IR 860 Product Data Sheet. Cantronic Systems Inc. Coquitlam Canada."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1077-3142(03)00081-X"},{"key":"e_1_2_1_10_1","unstructured":"Cohen J. 1977. Statistical Power Analysis for Behavioral Sciences. Academic Press New York.  Cohen J. 1977. Statistical Power Analysis for Behavioral Sciences. Academic Press New York."},{"key":"e_1_2_1_11_1","doi-asserted-by":"crossref","first-page":"777","DOI":"10.1080\/01621459.1979.10481030","article-title":"Comparison of stopping rules in forward stepwise discriminant analysis","volume":"74","author":"Costanza M. C.","year":"1979","journal-title":"J. Amer. Statist. Assoc."},{"key":"e_1_2_1_12_1","first-page":"203","article-title":"The functional neuroanantomy of social behavior: changes in cerebral blood flow when people with autistic disorder process facial expressions","volume":"123","author":"Critchley D.","year":"2000","journal-title":"Brain"},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/0921-8890(95)00054-2","article-title":"Getting to know each other---Artificial social intelligence for autonomous robots","volume":"16","author":"Dautenhahn K.","year":"1995","journal-title":"Robotics Autonom. Syst."},{"key":"e_1_2_1_14_1","first-page":"78","article-title":"Department of Health, Education and Welfare Publication No","author":"Dhew","year":"1979","journal-title":"(OS)"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.799905"},{"key":"e_1_2_1_16_1","unstructured":"Duda R. O. Hart P. E. and Stork D. G. 2001. Pattern Classification. Wiley Interscience New York.   Duda R. O. Hart P. E. and Stork D. G. 2001. Pattern Classification. Wiley Interscience New York."},{"key":"e_1_2_1_17_1","unstructured":"Ekman P. 1982. Emotion in the Human Face. Cambridge University Press Cambridge UK.  Ekman P. 1982. Emotion in the Human Face. Cambridge University Press Cambridge UK."},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1037\/0003-066X.48.4.384","article-title":"Facial expression and emotion","volume":"48","author":"Ekman P.","year":"1993","journal-title":"Amer. Psychol."},{"key":"e_1_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Ekman P. and Friesen W. V. 1978. Facial Action Coding System: A Technique for the Measurement off Facial Movement. Consulting Psychology Press Mountain View CA.  Ekman P. and Friesen W. V. 1978. Facial Action Coding System: A Technique for the Measurement off Facial Movement. Consulting Psychology Press Mountain View CA.","DOI":"10.1037\/t27734-000"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.598232"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1016\/S0262-8856(03)00056-8","article-title":"Tracking human faces in infrared video","volume":"21","author":"Eveland C. K.","year":"2003","journal-title":"Image Vision Comput."},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/S0031-3203(02)00052-3","article-title":"Automatic facial expression analysis: a survey","volume":"36","author":"Fasel B.","year":"2003","journal-title":"Patt. Recognit."},{"key":"e_1_2_1_23_1","unstructured":"Field A. 2000. Discovering Statistics Using SPSS for Windows. Sage Publications London UK.   Field A. 2000. Discovering Statistics Using SPSS for Windows. Sage Publications London UK."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCA.2003.817057"},{"key":"e_1_2_1_25_1","volume-title":"Step: A Simple Guide and Reference","author":"George D.","year":"1995"},{"key":"e_1_2_1_26_1","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1006\/jvci.1997.0359","article-title":"Facial expression recognition using model-based feature extraction and action parameters classification","volume":"8","author":"Huang C.","year":"1997","journal-title":"J. Visual Comm. Image Represent."},{"key":"e_1_2_1_27_1","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1037\/0033-2909.95.1.156","article-title":"Issues in the use and interpretation of discriminant analysis","volume":"95","author":"Huberty C. J.","year":"1984","journal-title":"Psycholog. Bull."},{"key":"e_1_2_1_28_1","unstructured":"Huberty C. J. 1994. Applied Discriminant Analysis. Wiley New York NY.  Huberty C. J. 1994. Applied Discriminant Analysis. Wiley New York NY."},{"key":"e_1_2_1_29_1","unstructured":"Jones C. H. Ring E. F. J. and Clark R. P. 1988. Medical thermography. In Applications of Thermal Imaging Burnay S. G. Williams T. L. and Jones C. H. N. Eds. Adam Hilger Bristol UK 156--187.  Jones C. H. Ring E. F. J. and Clark R. P. 1988. Medical thermography. In Applications of Thermal Imaging Burnay S. G. Williams T. L. and Jones C. H. N. Eds. Adam Hilger Bristol UK 156--187."},{"key":"e_1_2_1_30_1","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1207\/s15516709cog1704_5","article-title":"Machine interpretation of emotion: Design of memory-based expert systems for interpreting facial expressions in terms of signaled emotions","volume":"17","author":"Kearney G. D.","year":"1993","journal-title":"Cognitive Science"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the IEEE Conference on Cybernetics and Intelligent Systems","author":"Khan M. M."},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the 19th British HCI Group Annual Conference (HCI'05)","author":"Khan M. M."},{"key":"e_1_2_1_33_1","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1007\/BF02344719","article-title":"Emotion recognition system using short-term monitoring of physiological signals","volume":"42","author":"Kim H. K.","year":"2004","journal-title":"Medical Biological Engin. Comput."},{"key":"e_1_2_1_34_1","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/S0953-5438(01)00053-4","article-title":"This computer responds to user frustration: Theory, design and results","volume":"14","author":"Klein J.","year":"2002","journal-title":"Interact. Comput."},{"key":"e_1_2_1_35_1","doi-asserted-by":"crossref","unstructured":"Kurse P. W. 2001. Uncooled Thermal Imaging: Analysis Systems and Applications. SPIE Press Bellingham WA.  Kurse P. W. 2001. Uncooled Thermal Imaging: Analysis Systems and Applications. SPIE Press Bellingham WA.","DOI":"10.1117\/3.415351"},{"key":"e_1_2_1_36_1","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1075\/pc.8.1.09lis","article-title":"Automatic facial expression interpretation: Where human-computer interaction, artificial intelligence and cognitive science intersect","volume":"8","author":"Lisetti C. S.","year":"2000","journal-title":"Pragmatics Cognition"},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Matsuzaki H. and Mizote M. 1996. Measurement of facial temperature fluctuations by thermal image analysis. Progress in Biophysics and Molecular Biology 65 Supplement 1 185-- 186.  Matsuzaki H. and Mizote M. 1996. Measurement of facial temperature fluctuations by thermal image analysis. Progress in Biophysics and Molecular Biology 65 Supplement 1 185-- 186.","DOI":"10.1016\/S0079-6107(97)80647-5"},{"key":"e_1_2_1_38_1","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1054\/bjom.2000.0524","article-title":"Role of thermography is the assessment of infraorbital nerve injury after malar fractures","volume":"38","author":"Mcgimpsey J. G.","year":"2000","journal-title":"British J. Oral Maxillofacial Surg."},{"key":"e_1_2_1_39_1","volume-title":"Biometrics: Identity Verification in a Networked World","author":"Nanavati S.","year":"2002"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1147\/sj.421.0038"},{"key":"e_1_2_1_41_1","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1067\/moe.2001.116508","article-title":"MR imaging and thermography of facial angioedema: A case report","volume":"92","author":"Ogasawara T.","year":"2001","journal-title":"Oral Surg. Oral Medicine, Oral Pathol."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.895976"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of SPIE Thermosense XXVI (April)","author":"Pavlidis I.","year":"2004"},{"key":"e_1_2_1_44_1","doi-asserted-by":"crossref","unstructured":"Picard R. W. 2000. Affective Computing. MIT Press Cambridge MA.   Picard R. W. 2000. Affective Computing. MIT Press Cambridge MA.","DOI":"10.7551\/mitpress\/1140.001.0001"},{"key":"e_1_2_1_45_1","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1016\/S0028-3932(97)00117-6","article-title":"Faces and emotion: brain electric field sources during covert emotional processing","volume":"36","author":"Pizzagalli D.","year":"1998","journal-title":"Neuropsychologia"},{"key":"e_1_2_1_46_1","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1023\/A:1025519712569","article-title":"Processing faces and facial expressions","volume":"13","author":"Posamentier M. T.","year":"2003","journal-title":"Neuropsychology Rev."},{"key":"e_1_2_1_47_1","volume-title":"Biometrics: Personal Identification in Networked Society","author":"Prokoski F. J.","year":"1999"},{"key":"e_1_2_1_48_1","first-page":"290","article-title":"Conference Report: Social goals and emotions","volume":"13","author":"Redford P.","year":"2000","journal-title":"Psychologist"},{"key":"e_1_2_1_49_1","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/S0169-2607(00)00150-4","article-title":"VIEWER: A program for visualizing, recording, and analyzing animal behavior","volume":"67","author":"Schwarz S.","year":"2002","journal-title":"Comput. Methods Programs Biomedicine"},{"key":"e_1_2_1_50_1","unstructured":"Sharma S. 1996. Applied Multivariate Techniques. Wiley New York NY.   Sharma S. 1996. Applied Multivariate Techniques. Wiley New York NY."},{"key":"e_1_2_1_51_1","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/S0921-8890(99)00104-9","article-title":"A method of detecting transitions of emotional states using a thermal facial image based on a synthesis of facial expressions","volume":"31","author":"Sugimoto Y.","year":"2000","journal-title":"Robotics Autonom. Syst."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.531802"},{"key":"e_1_2_1_53_1","unstructured":"Turner J. R. and Thayer J. F. 2001. Introduction to Variance Analysis. Sage Publications London UK.  Turner J. R. and Thayer J. F. 2001. Introduction to Variance Analysis. Sage Publications London UK."},{"key":"e_1_2_1_54_1","doi-asserted-by":"crossref","first-page":"707","DOI":"10.1016\/j.intcom.2004.06.002","article-title":"Affective computing: problems, reactions and intentions","volume":"16","author":"Ward R. D.","year":"2004","journal-title":"Interacting with Computers"},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the IEEE International Workshop on Robotics and Human Interactive Communication","author":"Yoshitomi Y."}],"container-title":["ACM Transactions on Autonomous and Adaptive Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1152934.1152939","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1152934.1152939","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T16:18:43Z","timestamp":1750263523000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1152934.1152939"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,9]]},"references-count":55,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2006,9]]}},"alternative-id":["10.1145\/1152934.1152939"],"URL":"https:\/\/doi.org\/10.1145\/1152934.1152939","relation":{},"ISSN":["1556-4665","1556-4703"],"issn-type":[{"value":"1556-4665","type":"print"},{"value":"1556-4703","type":"electronic"}],"subject":[],"published":{"date-parts":[[2006,9]]},"assertion":[{"value":"2006-09-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}