{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T10:17:31Z","timestamp":1774865851873,"version":"3.50.1"},"reference-count":108,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2009,2,1]],"date-time":"2009-02-01T00:00:00Z","timestamp":1233446400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Appl. Percept."],"published-print":{"date-parts":[[2009,2]]},"abstract":"<jats:p>Earlier researchers were able to extract the transient facial thermal features from thermal infrared images (TIRIs) to make binary distinctions between the expressions of affective states. However, effective human-computer interaction would require machines to distinguish between the subtle facial expressions of affective states. This work, for the first time, attempts to use the transient facial thermal features for recognizing a much wider range of facial expressions. A database of 324 time-sequential, visible-spectrum, and thermal facial images was developed representing different facial expressions from 23 participants in different situations. A novel facial thermal feature extraction, selection, and classification approach was developed and invoked on various Gaussian mixture models constructed using: neutral and pretended happy and sad faces, faces with multiple positive and negative facial expressions, faces with neutral and six (pretended) basic facial expressions, and faces with evoked happiness, sadness, disgust, and anger. This work demonstrates that (1) infrared imaging can be used to observe the affective-state-specific facial thermal variations, (2) pixel-grey level analysis of TIRIs can help localise significant facial thermal feature points along the major facial muscles, and (3) cluster-analytic classification of transient thermal features can help distinguish between the facial expressions of affective states in an optimized eigenspace of input thermal feature vectors. The observed classification results exhibited influence of a Gaussian mixture model's structure on classifier-performance. The work also unveiled some pertinent aspects of future research on the use of facial thermal features in automated facial expression classification and affect recognition.<\/jats:p>","DOI":"10.1145\/1462055.1462061","type":"journal-article","created":{"date-parts":[[2009,2,25]],"date-time":"2009-02-25T14:44:30Z","timestamp":1235573070000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":74,"title":["Classifying pretended and evoked facial expressions of positive and negative affective states using infrared measurement of skin temperature"],"prefix":"10.1145","volume":"6","author":[{"given":"Masood Mehmood","family":"Khan","sequence":"first","affiliation":[{"name":"Curtin University of Technology, Perth, Western Australia"}]},{"given":"Robert D.","family":"Ward","sequence":"additional","affiliation":[{"name":"University of Huddersfield, Queensgate, England"}]},{"given":"Michael","family":"Ingleby","sequence":"additional","affiliation":[{"name":"University of Huddersfield, Queensgate, England"}]}],"member":"320","published-online":{"date-parts":[[2009,2,25]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the 2004 IEEE International Carnahan Conference on Security Technology. IEEE","author":"Abidi B."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1002\/0471745790"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2004.08.001"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2044-8295.1997.tb02654.x"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0048577299971664"},{"key":"e_1_2_1_6_1","volume-title":"Ethical principles and guidelines for the protection of human subjects of research. United States Government","author":"Belmont"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007977618277"},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Bolle R. M. Connell J. H. Pankanti S. Ratha N. K. and Senior A. W. 2004. Guide to Biometrics. Springer New York.   Bolle R. M. Connell J. H. Pankanti S. Ratha N. K. and Senior A. W. 2004. Guide to Biometrics. Springer New York.","DOI":"10.1007\/978-1-4757-4036-3"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.637261"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1037\/0735-7044.117.2.369"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0940-9602(02)80030-9"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1027933.1027968"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0042-6989(01)00002-5"},{"key":"e_1_2_1_14_1","volume-title":"IR 860 User Manual"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8655(02)00371-9"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2003.08.002"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1077-3142(03)00081-X"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-1838(96)00108-7"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/0738-081X(93)90055-H"},{"key":"e_1_2_1_20_1","first-page":"203","article-title":"The functional neuroanantomy of social behavior: Changes in cerebral blood flow when people with autistic disorder process facial expressions","volume":"123","author":"Critchley D.","year":"2000","journal-title":"Brain"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the IEEE Information, Communication and Signal Processing Conference. IEEE","author":"DeSilva L. C."},{"key":"e_1_2_1_22_1","volume-title":"Department of Health, Education and Welfare. Publication No. (OS) 78-0014. US Government Printing Office"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-8986.1990.tb01962.x"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9450.1990.tb00835.x"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1002\/acp.1130"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0923-5965(02)00076-0"},{"key":"e_1_2_1_27_1","unstructured":"Duda R. O. Hart P. E. and Stork D. G. 2001. Pattern Classification. Wiley Interscience New York.   Duda R. O. Hart P. E. and Stork D. G. 2001. Pattern Classification. Wiley Interscience New York."},{"key":"e_1_2_1_28_1","first-page":"581","article-title":"Face recognition using active appearance models","volume":"2","author":"Edwards G. J.","year":"1998","journal-title":"Proceedings of the European Conference on Computer Vision"},{"key":"e_1_2_1_29_1","volume-title":"Emotion in the Human Face","author":"Ekman P."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.58.2.342"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.6612338"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.598232"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0262-8856(03)00056-8"},{"key":"e_1_2_1_34_1","unstructured":"Everitt B. S. and Dunn G. 1991. Applied Multivariate Data Analysis. John Wiley and Sons London.  Everitt B. S. and Dunn G. 1991. Applied Multivariate Data Analysis. John Wiley and Sons London."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/51.687961"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/51.844383"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of CVRP 2004-IEEE 2004 Conference on Computer Vision and Pattern Recognition 1, Washington DC, 1356--1363","author":"Garbey M."},{"key":"e_1_2_1_38_1","unstructured":"Gonzalez R. C. and Woods R. E. 2002. Digital Image Processing. Addison-Wesley New York.   Gonzalez R. C. and Woods R. E. 2002. Digital Image Processing. Addison-Wesley New York."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2005.848368"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the IEEE International Conference on Engineering in Medicine and Biology (EMBS'02)","author":"Herry C. L."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-8760(92)90064-I"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1006\/jvci.1997.0359"},{"key":"e_1_2_1_43_1","unstructured":"IAPS. 1997. International affective picture system technical manual and affective ratings. http:\/\/www.unifesp.br\/adap\/instructions.pdf.  IAPS. 1997. International affective picture system technical manual and affective ratings. http:\/\/www.unifesp.br\/adap\/instructions.pdf."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1006\/nimg.2002.1225"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the IEEE\/ICME International Conference on Complex Medical Engineering (CME'07)","author":"Jiang G."},{"key":"e_1_2_1_46_1","volume-title":"Principal Component Analysis","author":"Jolliffe I. T."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/MEMB.2002.1175137"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/42.746635"},{"key":"e_1_2_1_49_1","unstructured":"Jones C. H. Ring E. F. J. and Clark R. P. 1988. Medical Thermography. In Applications of Thermal Imaging Burnay S. G. Williams T. L. and Jones C. H. N. Eds. Adam Hilger Bristol 156--187.  Jones C. H. Ring E. F. J. and Clark R. P. 1988. Medical Thermography. In Applications of Thermal Imaging Burnay S. G. Williams T. L. and Jones C. H. N. Eds. Adam Hilger Bristol 156--187."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.13"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.241"},{"key":"e_1_2_1_52_1","volume-title":"Clinical EMG for Surface Recording","volume":"2","author":"Kall R.","year":"1990"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1152934.1152939"},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the IEEE Conference on Cybernetics and Intelligent Systems. IEEE","author":"Khan M. M."},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the 19th British HCI Group Annual Conference (HCI'05)","author":"Khan M. M."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02344719"},{"key":"e_1_2_1_58_1","unstructured":"Kinnear P. R. and Gray C. D. 2000. SPSS for Windows Made Simple. Psychology Press Ltd. East Sussex UK.  Kinnear P. R. and Gray C. D. 2000. SPSS for Windows Made Simple. Psychology Press Ltd. East Sussex UK."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.0412-5463.2004.00208.x"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2004.04.001"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1037\/0882-7974.20.1.47"},{"key":"e_1_2_1_62_1","volume-title":"Uncooled Thermal Imaging: Analysis, Systems and Applications","author":"Kurse P. W."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1155\/S1110865704406192"},{"key":"e_1_2_1_64_1","volume-title":"Proceedings of 2nd International Conference on Cognitive Science, 113--118","author":"Lyons M."},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0079-6107(97)80647-5"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-8760(91)90024-R"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1054\/bjom.2000.0524"},{"key":"e_1_2_1_68_1","doi-asserted-by":"crossref","volume-title":"Discriminant Analysis and Statistical Pattern Recognition","author":"Mclachlan G. J.","DOI":"10.1002\/0471725293"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.64.5.723"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.4992\/jjpsy.64.51"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.physbeh.2005.03.009"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-0992(200003\/04)30:2<211::AID-EJSP988>3.0.CO;2-3"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1067\/moe.2001.116508"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0014-2999(03)01326-8"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1109\/MEMB.2002.1175138"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8760(99)00099-9"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2005.05.002"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1109\/MEMB.2002.1175139"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.547806"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1098-2353(1998)11:5<310::AID-CA3>3.0.CO;2-T"},{"key":"e_1_2_1_81_1","first-page":"45","article-title":"Subjective and autonomic responses to emotion induction in psychopaths","volume":"26","author":"Pham T. H.","year":"2000","journal-title":"Encaphale"},{"key":"e_1_2_1_82_1","first-page":"32","article-title":"High performance thermal imaging technology","volume":"15","author":"Phillips T. J.","year":"2002","journal-title":"Advanced Semiconductor Magazine"},{"key":"e_1_2_1_83_1","volume-title":"Affective Computing","author":"Picard R. W."},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0028-3932(97)00117-6"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10439-006-9143-3"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1025519712569"},{"key":"e_1_2_1_87_1","volume-title":"Biometrics: Personal Identification in Networked Society","author":"Prokoski F. J.","year":"1999"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/1056808.1057007"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02251007"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1113\/jphysiol.2002.035691"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neulet.2005.03.037"},{"key":"e_1_2_1_92_1","first-page":"489","article-title":"Facial muscle patterning to affective imagery in depressed and non-depressed subjects","volume":"192","author":"Schwartz G. E.","year":"1976","journal-title":"Science, New Series"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-2607(00)00150-4"},{"key":"e_1_2_1_94_1","volume-title":"Applied Multivariate Techniques","author":"Sharma S."},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1080\/026999396380321"},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1077-3142(03)00075-4"},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0921-8890(99)00104-9"},{"key":"e_1_2_1_98_1","volume-title":"Proceedings of the 5th IEEE International Conference on Automatic Face and Expression Recognition (FG'02)","author":"Tian Y. L."},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1177\/00238309040470040301"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1460-9568.2005.04073.x"},{"key":"e_1_2_1_101_1","doi-asserted-by":"crossref","unstructured":"Vrana S. R. 1993. The psychophysiology of disgust: differentiating negative emotional contexts with facial EMG. Psychophysiol. 30 3 279--286.  Vrana S. R. 1993. The psychophysiology of disgust: differentiating negative emotional contexts with facial EMG. Psychophysiol. 30 3 279--286.","DOI":"10.1111\/j.1469-8986.1993.tb03354.x"},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.biopsycho.2003.07.004"},{"key":"e_1_2_1_103_1","volume-title":"Statistical Pattern Recognition","author":"Webb A. R."},{"key":"e_1_2_1_104_1","volume-title":"In Proceedings of the International Conference on Spoken Language Processing (ICSLP'98)","author":"Whiteside S.","year":"1998"},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-1781(01)00225-6"},{"key":"e_1_2_1_106_1","first-page":"9","article-title":"The face of pain- a pilot study to validate the measurement of facial pain expression with improved electromyogram method","volume":"10","author":"Wolf K.","year":"2005","journal-title":"Pain Resear. Manag."},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1097\/00001756-200410250-00009"},{"key":"e_1_2_1_108_1","volume-title":"Proceedings of the IEEE International Workshop on Robotics and Human Interactive Communication. IEEE","author":"Yoshitomi Y."},{"key":"e_1_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.3883492"}],"container-title":["ACM Transactions on Applied Perception"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1462055.1462061","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1462055.1462061","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T13:29:41Z","timestamp":1750253381000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1462055.1462061"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,2]]},"references-count":108,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2009,2]]}},"alternative-id":["10.1145\/1462055.1462061"],"URL":"https:\/\/doi.org\/10.1145\/1462055.1462061","relation":{},"ISSN":["1544-3558","1544-3965"],"issn-type":[{"value":"1544-3558","type":"print"},{"value":"1544-3965","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,2]]},"assertion":[{"value":"2006-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2009-02-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}