{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T21:34:21Z","timestamp":1775079261689,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1008335","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2020,11,9]],"date-time":"2020-11-09T00:00:00Z","timestamp":1604880000000}}],"reference-count":51,"publisher":"Public Library of Science (PLoS)","issue":"10","license":[{"start":{"date-parts":[[2020,10,28]],"date-time":"2020-10-28T00:00:00Z","timestamp":1603843200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NIHR Nottingham Biomedical Research Centre"}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Facial expressions carry key information about an individual\u2019s emotional state. Research into the perception of facial emotions typically employs static images of a small number of artificially posed expressions taken under tightly controlled experimental conditions. However, such approaches risk missing potentially important facial signals and within-person variability in expressions. The extent to which patterns of emotional variance in such images resemble more natural <jats:italic>ambient<\/jats:italic> facial expressions remains unclear. Here we advance a novel protocol for eliciting natural expressions from dynamic faces, using a dimension of emotional valence as a test case. Subjects were video recorded while delivering either positive or negative news to camera, but were not instructed to deliberately or artificially pose any specific expressions or actions. A PCA-based active appearance model was used to capture the key dimensions of facial variance across frames. Linear discriminant analysis distinguished facial change determined by the emotional valence of the message, and this also generalised across subjects. By sampling along the discriminant dimension, and back-projecting into the image space, we extracted a behaviourally interpretable dimension of emotional valence. This dimension highlighted changes commonly represented in traditional face stimuli such as variation in the internal features of the face, but also key postural changes that would typically be controlled away such as a dipping versus raising of the head posture from negative to positive valences. These results highlight the importance of natural patterns of facial behaviour in emotional expressions, and demonstrate the efficacy of using data-driven approaches to study the representation of these cues by the perceptual system. The protocol and model described here could be readily extended to other emotional and non-emotional dimensions of facial variance.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1008335","type":"journal-article","created":{"date-parts":[[2020,10,28]],"date-time":"2020-10-28T17:54:35Z","timestamp":1603907675000},"page":"e1008335","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":7,"title":["A data-driven characterisation of natural facial expressions when giving good and bad news"],"prefix":"10.1371","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5479-3822","authenticated-orcid":true,"given":"David M.","family":"Watson","sequence":"first","affiliation":[]},{"given":"Ben B.","family":"Brown","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9026-1199","authenticated-orcid":true,"given":"Alan","family":"Johnston","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2020,10,28]]},"reference":[{"issue":"4","key":"pcbi.1008335.ref001","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1111\/j.2044-8295.1975.tb01477.x","article-title":"Recognizing Faces","volume":"66","author":"HD Ellis","year":"1975","journal-title":"Br J Psychol"},{"issue":"32","key":"pcbi.1008335.ref002","doi-asserted-by":"crossref","first-page":"11087","DOI":"10.1073\/pnas.0805664105","article-title":"The functional basis of face evaluation","volume":"105","author":"NN Oosterhof","year":"2008","journal-title":"Proc Natl Acad Sci"},{"issue":"3","key":"pcbi.1008335.ref003","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1111\/j.2044-8295.1986.tb02199.x","article-title":"Understanding face recognition","volume":"77","author":"V Bruce","year":"1986","journal-title":"Br J Psychol"},{"issue":"8","key":"pcbi.1008335.ref004","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1038\/nrn1724","article-title":"Understanding the recognition of facial identity and facial expression","volume":"6","author":"AJ Calder","year":"2005","journal-title":"Nat Rev Neurosci"},{"issue":"3","key":"pcbi.1008335.ref005","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1016\/j.cognition.2011.08.001","article-title":"Variability in photos of the same face","volume":"121","author":"R Jenkins","year":"2011","journal-title":"Cognition"},{"issue":"3\u20134","key":"pcbi.1008335.ref006","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1080\/02699939208411068","article-title":"An argument for basic emotions","volume":"6","author":"P Ekman","year":"1992","journal-title":"Cogn Emot"},{"issue":"4","key":"pcbi.1008335.ref007","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1037\/0022-3514.53.4.712","article-title":"Universals and cultural differences in the judgments of facial expressions of emotion","volume":"53","author":"P Ekman","year":"1987","journal-title":"J Pers Soc Psychol"},{"issue":"2","key":"pcbi.1008335.ref008","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1007\/BF00992253","article-title":"A new pan-cultural facial expression of emotion","volume":"10","author":"P Ekman","year":"1986","journal-title":"Motiv Emot"},{"issue":"6","key":"pcbi.1008335.ref009","doi-asserted-by":"crossref","first-page":"708","DOI":"10.1037\/xge0000162","article-title":"Four not six: Revealing culturally common facial expressions of emotion","volume":"145","author":"RE Jack","year":"2016","journal-title":"J Exp Psychol Gen"},{"issue":"6","key":"pcbi.1008335.ref010","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1037\/h0077714","article-title":"A circumplex model of affect","volume":"39","author":"JA Russell","year":"1980","journal-title":"J Pers Soc Psychol"},{"issue":"03","key":"pcbi.1008335.ref011","doi-asserted-by":"crossref","first-page":"715","DOI":"10.1017\/S0954579405050340","article-title":"The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology","volume":"17","author":"J Posner","year":"2005","journal-title":"Dev Psychopathol."},{"issue":"2","key":"pcbi.1008335.ref012","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1080\/713756735","article-title":"Categorical Perception of Morphed Facial Expressions","volume":"3","author":"AJ Calder","year":"1996","journal-title":"Vis cogn"},{"issue":"3","key":"pcbi.1008335.ref013","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1177\/0963721416688114","article-title":"Recognizing Faces","volume":"26","author":"AW Young","year":"2017","journal-title":"Curr Dir Psychol Sci"},{"issue":"1","key":"pcbi.1008335.ref014","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.cognition.2012.12.001","article-title":"Social inferences from faces: Ambient images generate a three-dimensional model","volume":"127","author":"CAM Sutherland","year":"2013","journal-title":"Cognition"},{"issue":"2","key":"pcbi.1008335.ref015","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.cub.2013.11.064","article-title":"Dynamic Facial Expressions of Emotion Transmit an Evolving Hierarchy of Signals over Time","volume":"24","author":"RE Jack","year":"2014","journal-title":"Curr Biol"},{"issue":"5","key":"pcbi.1008335.ref016","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1177\/1948550617697176","article-title":"Facial Image Manipulation","volume":"8","author":"CAM Sutherland","year":"2017","journal-title":"Soc Psychol Personal Sci"},{"issue":"9","key":"pcbi.1008335.ref017","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1016\/S0042-6989(01)00002-5","article-title":"A principal component analysis of facial expressions","volume":"41","author":"AJ Calder","year":"2001","journal-title":"Vision Res"},{"issue":"1329","key":"pcbi.1008335.ref018","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1098\/rspb.1992.0162","article-title":"A computational model of the analysis of some first-order and second-order motion patterns by simple and complex cells","volume":"250","author":"A Johnston","year":"1992","journal-title":"Proc R Soc B Biol Sci"},{"issue":"1418","key":"pcbi.1008335.ref019","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1098\/rspb.1999.0666","article-title":"Robust velocity computation from a biologically motivated model of motion perception","volume":"266","author":"A Johnston","year":"1999","journal-title":"Proc R Soc London Ser B Biol Sci"},{"key":"pcbi.1008335.ref020","volume-title":"Example-based computer-generated facial mimicry","author":"G Cowe","year":"2003"},{"issue":"12","key":"pcbi.1008335.ref021","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1167\/11.12.8","article-title":"Relative faces: Encoding of family resemblance relative to gender means in face space","volume":"11","author":"HJ Griffin","year":"2011","journal-title":"J Vis."},{"issue":"11","key":"pcbi.1008335.ref022","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1167\/10.11.27","article-title":"Identifying regions that carry the best information about global facial configurations","volume":"10","author":"F Berisha","year":"2010","journal-title":"J Vis"},{"issue":"1","key":"pcbi.1008335.ref023","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1162\/jocn.1991.3.1.71","article-title":"Eigenfaces for Recognition","volume":"3","author":"M Turk","year":"1991","journal-title":"J Cogn Neurosci"},{"key":"pcbi.1008335.ref024","volume-title":"Facial Action Coding System: A Technique for the Measurement of Facial Movement","author":"P Ekman","year":"1978"},{"key":"pcbi.1008335.ref025","volume-title":"Facial Action Coding System: The Manual on CD ROM","author":"P Ekman","year":"2002"},{"key":"pcbi.1008335.ref026","first-page":"1","article-title":"OpenFace: An open source facial behavior analysis toolkit","author":"T Baltrusaitis","year":"2016","journal-title":"2016 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE"},{"key":"pcbi.1008335.ref027","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1109\/FG.2018.00019","article-title":"OpenFace 2.0: Facial Behavior Analysis Toolkit","author":"T Baltrusaitis","year":"2018","journal-title":"2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018). IEEE"},{"issue":"2","key":"pcbi.1008335.ref028","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1016\/j.neuron.2011.08.026","article-title":"A Common, High-Dimensional Model of the Representational Space in Human Ventral Temporal Cortex","volume":"72","author":"V Haxby J","year":"2011","journal-title":"Neuron"},{"issue":"3","key":"pcbi.1008335.ref029","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1080\/026999399379267","article-title":"Culture and Facial Expression: Open-ended Methods Find More Expressions and a Gradient of Recognition","volume":"13","author":"J Haidt","year":"1999","journal-title":"Cogn Emot."},{"issue":"3","key":"pcbi.1008335.ref030","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1111\/j.0956-7976.2004.01503008.x","article-title":"Show Your Pride","volume":"15","author":"JL Tracy","year":"2004","journal-title":"Psychol Sci."},{"issue":"4","key":"pcbi.1008335.ref031","doi-asserted-by":"crossref","first-page":"554","DOI":"10.1037\/a0015766","article-title":"Development of a FACS-verified set of basic and self-conscious emotion expressions","volume":"9","author":"JL Tracy","year":"2009","journal-title":"Emotion"},{"issue":"1","key":"pcbi.1008335.ref032","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.tics.2019.10.010","article-title":"Developing an Understanding of Emotion Categories: Lessons from Objects","volume":"24","author":"K Hoemann","year":"2020","journal-title":"Trends Cogn Sci."},{"issue":"1","key":"pcbi.1008335.ref033","doi-asserted-by":"crossref","first-page":"20247","DOI":"10.1038\/srep20247","article-title":"Integration or separation in the processing of facial properties\u2014a computational view","volume":"6","author":"CD Dahl","year":"2016","journal-title":"Sci Rep."},{"issue":"2","key":"pcbi.1008335.ref034","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1037\/rev0000048","article-title":"Robust social categorization emerges from learning the identities of very few faces","volume":"124","author":"RSS Kramer","year":"2017","journal-title":"Psychol Rev"},{"key":"pcbi.1008335.ref035","doi-asserted-by":"crossref","first-page":"41.1","DOI":"10.5244\/C.29.41","article-title":"Deep Face Recognition","author":"OM Parkhi","year":"2015","journal-title":"Procedings of the British Machine Vision Conference 2015. British Machine Vision Association"},{"key":"pcbi.1008335.ref036","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/FG.2018.00020","article-title":"VGGFace2: A Dataset for Recognising Faces across Pose and Age","author":"Q Cao","year":"2018","journal-title":"2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018). IEEE"},{"issue":"c","key":"pcbi.1008335.ref037","first-page":"1","article-title":"Deep Facial Expression Recognition: A Survey","volume":"3045","author":"S Li","year":"2020","journal-title":"IEEE Trans Affect Comput"},{"key":"pcbi.1008335.ref038","doi-asserted-by":"crossref","first-page":"1215","DOI":"10.1109\/WACV.2017.140","article-title":"Deep Spatio-Temporal Features for Multimodal Emotion Recognition","author":"D Nguyen","year":"2017","journal-title":"2017 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE"},{"key":"pcbi.1008335.ref039","first-page":"427","article-title":"Refactoring facial expressions: An automatic analysis of natural occurring facial expressions in iterative social dilemma","author":"G Stratou","year":"2017","journal-title":"2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE"},{"issue":"1","key":"pcbi.1008335.ref040","doi-asserted-by":"crossref","first-page":"26","DOI":"10.3758\/BF03197270","article-title":"Face processing: Human perception and principal components analysis","volume":"24","author":"PJB Hancock","year":"1996","journal-title":"Mem Cognit."},{"issue":"15\u201316","key":"pcbi.1008335.ref041","doi-asserted-by":"crossref","first-page":"2277","DOI":"10.1016\/S0042-6989(97)00439-2","article-title":"A comparison of two computer-based face identification systems with human perceptions of faces","volume":"38","author":"PJB Hancock","year":"1998","journal-title":"Vision Res"},{"issue":"3","key":"pcbi.1008335.ref042","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1364\/JOSAA.10.000405","article-title":"Low-dimensional representation of faces in higher dimensions of the face space","volume":"10","author":"AJ O\u2019Toole","year":"1993","journal-title":"J Opt Soc Am A"},{"issue":"2","key":"pcbi.1008335.ref043","doi-asserted-by":"crossref","first-page":"208","DOI":"10.3758\/BF03208892","article-title":"Structural aspects of face recognition and the other-race effect","volume":"22","author":"AJ O\u2019Toole","year":"1994","journal-title":"Mem Cognit"},{"issue":"8","key":"pcbi.1008335.ref044","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1068\/p6985","article-title":"Judging Political Affiliation from Faces of UK MPs","volume":"40","author":"T Roberts","year":"2011","journal-title":"Perception"},{"issue":"1","key":"pcbi.1008335.ref045","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1111\/cogs.12231","article-title":"Identity From Variation: Representations of Faces Derived From Multiple Instances","volume":"40","author":"AM Burton","year":"2016","journal-title":"Cogn Sci"},{"issue":"2","key":"pcbi.1008335.ref046","first-page":"65","article-title":"A Simple Sequentially Rejective Multiple Test Procedure","volume":"6","author":"S Holm","year":"1979","journal-title":"Scand J Stat."},{"issue":"3","key":"pcbi.1008335.ref047","doi-asserted-by":"crossref","first-page":"379","DOI":"10.3758\/BF03192707","article-title":"Recommended effect size statistics for repeated measures designs","volume":"37","author":"R Bakeman","year":"2005","journal-title":"Behav Res Methods"},{"issue":"4","key":"pcbi.1008335.ref048","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1037\/1082-989X.8.4.434","article-title":"Generalized Eta and Omega Squared Statistics: Measures of Effect Size for Some Common Research Designs","volume":"8","author":"S Olejnik","year":"2003","journal-title":"Psychol Methods"},{"issue":"272","key":"pcbi.1008335.ref049","doi-asserted-by":"crossref","first-page":"1096","DOI":"10.1080\/01621459.1955.10501294","article-title":"A Multiple Comparison Procedure for Comparing Several Treatments with a Control","volume":"50","author":"CW Dunnett","year":"1955","journal-title":"J Am Stat Assoc"},{"issue":"2","key":"pcbi.1008335.ref050","doi-asserted-by":"crossref","first-page":"99","DOI":"10.2307\/3001913","article-title":"Comparing Individual Means in the Analysis of Variance","volume":"5","author":"JW Tukey","year":"1949","journal-title":"Biometrics"},{"key":"pcbi.1008335.ref051","first-page":"3","article-title":"PsychoPy2: Experiments in behavior made easy","author":"J Peirce","year":"2019","journal-title":"Behav Res Methods"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1008335","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2020,11,9]],"date-time":"2020-11-09T00:00:00Z","timestamp":1604880000000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1008335","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,9]],"date-time":"2020-11-09T18:51:58Z","timestamp":1604947918000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1008335"}},"subtitle":[],"editor":[{"given":"Rachael","family":"Jack","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2020,10,28]]},"references-count":51,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2020,10,28]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1008335","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1008335","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,28]]}}}