{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,29]],"date-time":"2026-10-29T01:52:42Z","timestamp":1793238762600,"version":"4.5.0"},"reference-count":97,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,8,19]],"date-time":"2021-08-19T00:00:00Z","timestamp":1629331200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,8,19]],"date-time":"2021-08-19T00:00:00Z","timestamp":1629331200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000050","name":"U.S. Department of Health & Human Services | NIH | National Heart, Lung, and Blood Institute","doi-asserted-by":"publisher","award":["F31 HL140943-01"],"award-info":[{"award-number":["F31 HL140943-01"]}],"id":[{"id":"10.13039\/100000050","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000057","name":"U.S. Department of Health & Human Services | NIH | National Institute of General Medical Sciences","doi-asserted-by":"publisher","award":["GM118629"],"award-info":[{"award-number":["GM118629"]}],"id":[{"id":"10.13039\/100000057","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007457","name":"JPB Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100007457","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000025","name":"U.S. Department of Health & Human Services | NIH | National Institute of Mental Health","doi-asserted-by":"publisher","award":["5 F32 MH105052"],"award-info":[{"award-number":["5 F32 MH105052"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000025","name":"U.S. Department of Health & Human Services | NIH | National Institute of Mental Health","doi-asserted-by":"publisher","award":["R01-MH113234"],"award-info":[{"award-number":["R01-MH113234"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000025","name":"U.S. Department of Health & Human Services | NIH | National Institute of Mental Health","doi-asserted-by":"publisher","award":["R01-MH109464"],"award-info":[{"award-number":["R01-MH109464"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100009919","name":"United States Department of Defense | United States Army | Army Research Institute for the Behavioral and Social Sciences","doi-asserted-by":"publisher","award":["W911NF-16-1-019"],"award-info":[{"award-number":["W911NF-16-1-019"]}],"id":[{"id":"10.13039\/100009919","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"U.S. Department of Health & Human Services | NIH | National Cancer Institute","doi-asserted-by":"publisher","award":["U01-CA193632"],"award-info":[{"award-number":["U01-CA193632"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"name":"U.S. Department of Health & Human Services | NIH | National Institute of Mental Health"},{"name":"U.S. Department of Health & Human Services | NIH | National Institute of Mental Health"},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["Civil, Mechanical, and Manufacturing Innovation Grant 1638234"],"award-info":[{"award-number":["Civil, Mechanical, and Manufacturing Innovation Grant 1638234"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000053","name":"U.S. Department of Health & Human Services | NIH | National Eye Institute","doi-asserted-by":"publisher","award":["R01-EY020834"],"award-info":[{"award-number":["R01-EY020834"]}],"id":[{"id":"10.13039\/100000053","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Commun"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>It is long\u00a0hypothesized that there is a reliable, specific mapping between certain emotional states and the facial movements that express those states. This hypothesis is often tested by asking untrained participants to pose the facial movements they believe they use to express emotions during generic scenarios. Here, we test this hypothesis using, as stimuli, photographs of facial configurations posed by professional actors in response to contextually-rich scenarios. The scenarios portrayed in the photographs were rated by a convenience sample of participants for the extent to which they evoked an instance of 13 emotion categories, and actors\u2019 facial poses were coded for their specific movements. Both unsupervised and supervised machine learning find that in these photographs, the actors portrayed emotional states with variable facial configurations; instances of only three emotion categories (fear, happiness, and surprise) were portrayed with moderate reliability and specificity. The photographs were separately rated by another sample of participants for the extent to which they portrayed an instance of the 13 emotion categories; they were rated when presented alone and when presented with their associated scenarios, revealing that emotion inferences by participants also vary in a context-sensitive manner. Together, these findings suggest that facial movements and perceptions of emotion vary by situation and transcend stereotypes of emotional expressions. Future research may build on these findings by incorporating dynamic stimuli rather than photographs and studying a broader range of cultural contexts.<\/jats:p>","DOI":"10.1038\/s41467-021-25352-6","type":"journal-article","created":{"date-parts":[[2021,8,19]],"date-time":"2021-08-19T06:30:05Z","timestamp":1629354605000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":64,"title":["Professional actors demonstrate variability, not stereotypical expressions, when portraying emotional states in photographs"],"prefix":"10.1038","volume":"12","author":[{"given":"Tuan","family":"Le Mau","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9938-7676","authenticated-orcid":false,"given":"Katie","family":"Hoemann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sam H.","family":"Lyons","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0831-4234","authenticated-orcid":false,"given":"Jennifer M. B.","family":"Fugate","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2668-7819","authenticated-orcid":false,"given":"Emery N.","family":"Brown","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria","family":"Gendron","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4478-2051","authenticated-orcid":false,"given":"Lisa Feldman","family":"Barrett","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,8,19]]},"reference":[{"key":"25352_CR1","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1207\/s15327957pspr1001_2","volume":"10","author":"LF Barrett","year":"2006","unstructured":"Barrett, L. F. Solving the emotion paradox: categorization and the experience of emotion. Personal. Soc. Psychol. Rev. 10, 20\u201346 (2006).","journal-title":"Personal. Soc. Psychol. Rev."},{"key":"25352_CR2","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1177\/0963721411429125","volume":"20","author":"LF Barrett","year":"2011","unstructured":"Barrett, L. F. Was Darwin wrong about emotional expressions? Curr. Directions Psychol. Sci. 20, 400\u2013406 (2011).","journal-title":"Curr. Directions Psychol. Sci."},{"key":"25352_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/scan\/nsx060","volume":"12","author":"LF Barrett","year":"2017","unstructured":"Barrett, L. F. The theory of constructed emotion: an active inference account of interoception and categorization. Soc. Cogn. Affect. Neurosci. 12, 1\u201323 (2017).","journal-title":"Soc. Cogn. Affect. Neurosci."},{"key":"25352_CR4","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1146\/annurev.psych.54.101601.145102","volume":"54","author":"JA Russell","year":"2003","unstructured":"Russell, J. A., Bachorowski, J. A. & Fernandez-Dols, J. M. Facial and vocal expressions of emotion. Annu. Rev. Psychol. 54, 329\u2013349 (2003).","journal-title":"Annu. Rev. Psychol."},{"key":"25352_CR5","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1016\/j.cell.2014.03.003","volume":"157","author":"DJ Anderson","year":"2014","unstructured":"Anderson, D. J. & Adolphs, R. A framework for studying emotions across species. Cell 157, 187\u2013200 (2014).","journal-title":"Cell"},{"key":"25352_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.4092\/jsre.2.1","volume":"2","author":"JJ Campos","year":"1994","unstructured":"Campos, J. J., Mumme, D., Kermoian, R. & Campos, R. G. A functionalist perspective on the nature of emotion. Jpn. J. Res. Emot. 2, 1\u201320 (1994).","journal-title":"Jpn. J. Res. Emot."},{"key":"25352_CR7","unstructured":"Fridlund, A. J. In The Science of Facial Expression (eds Fern\u00e1ndez-Dols, J.-M. & Russell, J. A.) 77\u201392 (Oxford University Press, 2017)."},{"key":"25352_CR8","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1016\/j.cobeha.2018.10.001","volume":"24","author":"LF Barrett","year":"2018","unstructured":"Barrett, L. F. & Finlay, B. L. Concepts, goals, and the control of survival-related behaviors. Curr. Opin. Behav. Sci. 24, 172\u2013179 (2018).","journal-title":"Curr. Opin. Behav. Sci."},{"key":"25352_CR9","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1037\/emo0000302","volume":"18","author":"DT Cordaro","year":"2018","unstructured":"Cordaro, D. T. et al. Universals and cultural variations in 22 emotional expressions across five cultures. Emotion 18, 75\u201393 (2018).","journal-title":"Emotion"},{"key":"25352_CR10","doi-asserted-by":"publisher","first-page":"364","DOI":"10.1177\/1754073911410740","volume":"3","author":"P Ekman","year":"2011","unstructured":"Ekman, P. & Cordaro, D. T. What is meant by calling emotions basic. Emot. Rev. 3, 364\u2013370 (2011).","journal-title":"Emot. Rev."},{"key":"25352_CR11","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1177\/0963721411424739","volume":"20","author":"AF Shariff","year":"2011","unstructured":"Shariff, A. F. & Tracy, J. L. What are emotion expressions for? Curr. Directions Psychol. Sci. 20, 395\u2013399 (2011).","journal-title":"Curr. Directions Psychol. Sci."},{"key":"25352_CR12","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1007\/s10919-019-00293-3","volume":"43","author":"D Keltner","year":"2019","unstructured":"Keltner, D., Sauter, D., Tracy, J. L. & Cowen, A. S. Emotional expression: advances in basic emotion theory. J. Nonverbal Behav. 43, 133\u2013160 (2019).","journal-title":"J. Nonverbal Behav."},{"key":"25352_CR13","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1016\/0162-3095(90)90017-Z","volume":"11","author":"J Tooby","year":"1990","unstructured":"Tooby, J. & Cosmides, L. The past explains the present: emotional adaptations and the structure of ancestral environments. Ethol. Sociobiol. 11, 375\u2013424 (1990).","journal-title":"Ethol. Sociobiol."},{"key":"25352_CR14","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1037\/1528-3542.7.1.131","volume":"7","author":"HA Elfenbein","year":"2007","unstructured":"Elfenbein, H. A., Beaupr\u00e9, M., L\u00e9vesque, M. & Hess, U. Toward a dialect theory: cultural differences in the expression and recognition of posed facial expressions. Emotion 7, 131\u2013146 (2007).","journal-title":"Emotion"},{"key":"25352_CR15","doi-asserted-by":"publisher","first-page":"1363","DOI":"10.1037\/0022-3514.73.6.1363","volume":"73","author":"D Galati","year":"1997","unstructured":"Galati, D., Scherer, K. R. & Ricci-Bitti, P. E. Voluntary facial expression of emotion: Comparing congenitally blind with normally sighted encoders. J. Personal. Soc. Psychol. 73, 1363\u20131379 (1997).","journal-title":"J. Personal. Soc. Psychol."},{"key":"25352_CR16","unstructured":"Ekman, P. & Friesen, W. V. Pictures of Facial Affect (Consulting Psychologists Press, Palo Alto, CA, 1976)."},{"key":"25352_CR17","doi-asserted-by":"crossref","unstructured":"Lundqvist, D., Flykt, A. & \u00d6hman, A. The Karolinska Directed Emotional Faces - KDEF (Department of Clinical Neurosciences, Karolinska Hospital, Stockholm, 1998).","DOI":"10.1037\/t27732-000"},{"key":"25352_CR18","doi-asserted-by":"publisher","first-page":"1122","DOI":"10.3758\/s13428-014-0532-5","volume":"47","author":"DS Ma","year":"2015","unstructured":"Ma, D. S., Correll, J. & Wittenbrink, B. The Chicago face database: a free stimulus set of faces and norming data. Behav. Res. Methods 47, 1122\u20131135 (2015).","journal-title":"Behav. Res. Methods"},{"key":"25352_CR19","unstructured":"Mollahosseini, A., Hasani, B. & Mahoor, M. H. Affectnet: a database for facial expression, valence, and arousal computing in the wild. In IEEE Transactions on Affective Computing (2017)."},{"key":"25352_CR20","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1016\/j.psychres.2008.05.006","volume":"168","author":"N Tottenham","year":"2009","unstructured":"Tottenham, N. et al. The NimStim set of facial expressions: Judgments from untrained research participants. Psychiatry Res. 168, 242\u2013249 (2009).","journal-title":"Psychiatry Res."},{"key":"25352_CR21","unstructured":"Schatz, H. & Ornstein, B. J. In Character: Actors Acting (Bulfinch Press, 2006)."},{"key":"25352_CR22","unstructured":"Schatz, H., Edwards, E. & Ornstein, B. J. Caught in the Act: Actors Acting (Glitterati Incorporated, 2013)."},{"key":"25352_CR23","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1037\/0022-3514.72.1.164","volume":"72","author":"JM Carroll","year":"1997","unstructured":"Carroll, J. M. & Russell, J. A. Facial expressions in Hollywood\u2019s protrayal of emotion. J. Personal. Soc. Psychol. 72, 164\u2013176 (1997).","journal-title":"J. Personal. Soc. Psychol."},{"key":"25352_CR24","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1037\/0022-3514.68.1.83","volume":"68","author":"P Gosselin","year":"1995","unstructured":"Gosselin, P., Kirouac, G. & Dor\u00e9, F. Y. Components and recognition of facial expression in the communication of emotion by actors. J. Personal. Soc. Psychol. 68, 83\u201396 (1995).","journal-title":"J. Personal. Soc. Psychol."},{"key":"25352_CR25","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1037\/0033-2909.125.1.3","volume":"125","author":"J Russell","year":"1999","unstructured":"Russell, J. & Carroll, J. On the bipolarity of positive and negative affect. Psychological Bull. 125, 3\u201330 (1999).","journal-title":"Psychological Bull."},{"key":"25352_CR26","unstructured":"Ekman, P. E., Friesen, W. V. & Hager, J. C. A Human Face 77\u2013254 (Salt Lake City, 2002)."},{"key":"25352_CR27","unstructured":"Affectiva. Affectiva SDK, https:\/\/www.affectiva.com\/science-resource\/affdex-sdk-a-cross-platform-realtime-multi-face-expression-recognition-toolkit\/ (2018)."},{"key":"25352_CR28","doi-asserted-by":"publisher","unstructured":"Benitez-Quiroz, C. F., Srinivasan, R. & Martinez, A. M. EmotioNet: an accurate, real-time algorithm for the automatic annotation of a million facial expressions in the wild. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 5562\u20135570, https:\/\/doi.org\/10.1109\/CVPR.2016.600 (2016).","DOI":"10.1109\/CVPR.2016.600"},{"key":"25352_CR29","doi-asserted-by":"publisher","unstructured":"Jaiswal, S. & Valstar, M. Deep learning the dynamic appearance and shape of facial action units. In 2016 IEEE Winter Conference on Applications of Computer Vision, WACV 2016, https:\/\/doi.org\/10.1109\/WACV.2016.7477625 (2016).","DOI":"10.1109\/WACV.2016.7477625"},{"key":"25352_CR30","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1038\/s41592-019-0686-2","volume":"17","author":"P Virtanen","year":"2020","unstructured":"Virtanen, P. et al. SciPy 1.0: fundamental algorithms for scientific computing in Python. Nat. Methods 17, 261\u2013272 (2020).","journal-title":"Nat. Methods"},{"key":"25352_CR31","doi-asserted-by":"publisher","first-page":"286","DOI":"10.1177\/0963721411422522","volume":"20","author":"LF Barrett","year":"2011","unstructured":"Barrett, L. F., Mesquita, B. & Gendron, M. Context in emotion perception. Curr. Directions Psychol. Sci. 20, 286\u2013290 (2011).","journal-title":"Curr. Directions Psychol. Sci."},{"key":"25352_CR32","unstructured":"Gendron, M., Mesquita, B. & Barrett, L. F. In Oxford Handbook of Cognitive Psychology (ed. Reisberg, D.) 379\u2013389 (Oxford University Press, 2013)."},{"key":"25352_CR33","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1037\/met0000201","volume":"24","author":"H Hoijtink","year":"2019","unstructured":"Hoijtink, H., Mulder, J., van Lissa, C. & Gu, X. A tutorial on testing hypotheses using the Bayes factor. Psychol. Methods 24, 539\u2013556 (2019).","journal-title":"Psychol. Methods"},{"key":"25352_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/1529100619832930","volume":"20","author":"LF Barrett","year":"2019","unstructured":"Barrett, L. F., Adolphs, R., Marsella, S., Martinez, A. & Pollak, S. Emotional expressions reconsidered: challenges to inferring emotion in human facial movements. Psychol. Sci. Public Interest 20, 1\u201368 (2019).","journal-title":"Psychol. Sci. Public Interest"},{"key":"25352_CR35","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1080\/026999399379267","volume":"13","author":"J Haidt","year":"1999","unstructured":"Haidt, J. & Keltner, D. Culture and facial expression: open-ended methods find more expressions and a gradient of recognition. Cogn. Emot. 13, 225\u2013266 (1999).","journal-title":"Cogn. Emot."},{"key":"25352_CR36","unstructured":"Ekman, P., Friesen, W. V. & Ellsworth, P. Emotion in the Human Face: Guidelines for Research and a Review of Findings (Permagon, 1972)."},{"key":"25352_CR37","doi-asserted-by":"publisher","first-page":"708","DOI":"10.1037\/xge0000162","volume":"145","author":"RE Jack","year":"2016","unstructured":"Jack, R. E., Sun, W., Delis, I., Garrod, O. G. & Schyns, P. G. Four not six: revealing culturally common facial expressions of emotion. J. Exp. Psychol. Gen. 145, 708\u2013730 (2016).","journal-title":"J. Exp. Psychol. Gen."},{"key":"25352_CR38","doi-asserted-by":"publisher","first-page":"1225","DOI":"10.1126\/science.1224313","volume":"338","author":"H Aviezer","year":"2012","unstructured":"Aviezer, H., Trope, Y. & Todorov, A. Body cues, not facial expressions, discriminate between intense positive and negative emotions. Science 338, 1225\u20131229 (2012).","journal-title":"Science"},{"key":"25352_CR39","unstructured":"Ekman, P. & Friesen, W. V. Facial Action Coding (FACS) Manual (Consulting Psychologists Press, San Francisco, 1984)."},{"key":"25352_CR40","doi-asserted-by":"publisher","first-page":"E1454","DOI":"10.1073\/pnas.1322355111","volume":"111","author":"S Du","year":"2014","unstructured":"Du, S., Tao, Y. & Martinez, A. M. Compound facial expressions of emotion. Proc. Natl Acad. Sci. USA 111, E1454\u2013E1462 (2014).","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"25352_CR41","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12888-018-1761-4","volume":"18","author":"DS Quintana","year":"2018","unstructured":"Quintana, D. S. & Williams, D. R. Bayesian alternatives for common null-hypothesis significance tests in psychiatry: a non-technical guide using JASP. BMC Psychiatry 18, 1\u20138 (2018).","journal-title":"BMC Psychiatry"},{"key":"25352_CR42","doi-asserted-by":"publisher","first-page":"225","DOI":"10.3758\/PBR.16.2.225","volume":"16","author":"JN Rouder","year":"2009","unstructured":"Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D. & Iverson, G. Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bull. Rev. 16, 225\u2013237 (2009).","journal-title":"Psychonomic Bull. Rev."},{"key":"25352_CR43","doi-asserted-by":"publisher","first-page":"702","DOI":"10.1177\/1745691616658637","volume":"11","author":"S Steegen","year":"2016","unstructured":"Steegen, S., Tuerlinckx, F., Gelman, A. & Vanpaemel, W. Increasing transparency through a multiverse analysis. Perspect. Psychol. Sci. 11, 702\u2013712 (2016).","journal-title":"Perspect. Psychol. Sci."},{"key":"25352_CR44","doi-asserted-by":"crossref","unstructured":"Murphy, G. L. The Big Book of Concepts (MIT Press, 2002).","DOI":"10.7551\/mitpress\/1602.001.0001"},{"key":"25352_CR45","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1037\/0033-2909.128.2.203","volume":"128","author":"HA Elfenbein","year":"2002","unstructured":"Elfenbein, H. A. & Ambady, N. On the universality and cultural specificity of emotion recognition: a meta-analysis. Psychol. Bull. 128, 203\u2013235 (2002).","journal-title":"Psychol. Bull."},{"key":"25352_CR46","doi-asserted-by":"crossref","unstructured":"Duran, J. I. & Fern\u00e1ndez-Dols, J. M. Do emotions result in their predicted facial expressions? A meta-analysis of studies on the link between expression and emotion. Preprint at https:\/\/psyarxiv.com\/65qp7 (2018).","DOI":"10.31234\/osf.io\/65qp7"},{"key":"25352_CR47","first-page":"93","volume":"15","author":"K-I Benta","year":"2015","unstructured":"Benta, K.-I. & Vaida, M.-F. Towards real-life facial expression recognition systems. Comput. Eng. 15, 93\u2013102 (2015).","journal-title":"Comput. Eng."},{"key":"25352_CR48","doi-asserted-by":"crossref","unstructured":"Duran, J. I., Reisenzein, R. & Fern\u00e1ndez-Dols, J. M. In The Science of Facial Expression (eds Fern\u00e1ndez-Dols, J. M. & Russell, J. A.) 107\u2013129 (Oxford University Press, 2017).","DOI":"10.1093\/acprof:oso\/9780190613501.003.0024"},{"key":"25352_CR49","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1007\/BF00995569","volume":"14","author":"D Matsumoto","year":"1990","unstructured":"Matsumoto, D. Cultural similarities and differences in display rules. Motiv. Emot. 14, 195\u2013214 (1990).","journal-title":"Motiv. Emot."},{"key":"25352_CR50","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/1754073911410744","volume":"3","author":"IJ Roseman","year":"2011","unstructured":"Roseman, I. J. Emotional behaviors, emotivational goals, emotion strategies: Multiple levels of organization integrate variable and consistent responses. Emot. Rev. 3, 1\u201310 (2011).","journal-title":"Emot. Rev."},{"key":"25352_CR51","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1177\/1090820X09360703","volume":"30","author":"MR Farahvash","year":"2010","unstructured":"Farahvash, M. R. et al. Anatomic variations of midfacial muscles and nasolabial crease: a survey on 52 hemifacial dissections in fresh Persian cadavers. Aesthetic Surg. J. 30, 17\u201321 (2010).","journal-title":"Aesthetic Surg. J."},{"key":"25352_CR52","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1002\/ca.980020302","volume":"2","author":"K Shimada","year":"1989","unstructured":"Shimada, K. & Gasser, R. F. Variations in the facial muscles at the angle of the mouth. Clin. Anat. 2, 129\u2013134 (1989).","journal-title":"Clin. Anat."},{"key":"25352_CR53","doi-asserted-by":"crossref","unstructured":"Darwin, C. The Expression of Emotion in Man and Animals (1872).","DOI":"10.1037\/10001-000"},{"key":"25352_CR54","unstructured":"Bell, C. Essays on the Anatomy of Expression in Painting (Longman, Hurst, Rees, and Orme, 1806)."},{"key":"25352_CR55","unstructured":"Duchenne, G.-B. The Mechanism of Human Facial Expression (Cambridge University Press, 1990\/1862)."},{"key":"25352_CR56","first-page":"45","volume":"6","author":"M Gendron","year":"2017","unstructured":"Gendron, M. & Barrett, L. F. Facing the past: a history of the face in psychological research on emotion perception. Sci. Facial Expr. 6, 45\u201366 (2017).","journal-title":"Sci. Facial Expr."},{"key":"25352_CR57","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1037\/a0031640","volume":"139","author":"SC Widen","year":"2013","unstructured":"Widen, S. C. & Russell, J. A. Children\u2019s recognition of disgust in others. Psychol. Bull. 139, 271\u2013299 (2013).","journal-title":"Psychol. Bull."},{"key":"25352_CR58","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1177\/0963721417746794","volume":"27","author":"M Gendron","year":"2018","unstructured":"Gendron, M., Crivelli, C. & Barrett, L. F. Universality reconsidered: diversity in making meaning of facial expressions. Curr. Directions Psychol. Sci. 27, 211\u2013219 (2018).","journal-title":"Curr. Directions Psychol. Sci."},{"key":"25352_CR59","doi-asserted-by":"publisher","first-page":"1292","DOI":"10.1037\/emo0000501","volume":"19","author":"K Hoemann","year":"2019","unstructured":"Hoemann, K. et al. Context facilitates performance on a classic cross-cultural emotion perception task. Emotion 19, 1292\u20131313 (2019).","journal-title":"Emotion"},{"key":"25352_CR60","doi-asserted-by":"publisher","first-page":"426","DOI":"10.1037\/0033-2909.110.3.426","volume":"110","author":"JA Russell","year":"1991","unstructured":"Russell, J. A. Culture and the categorization of emotions. Psychol. Bull. 110, 426\u2013450 (1991).","journal-title":"Psychol. Bull."},{"key":"25352_CR61","unstructured":"de Gelder, B. In Handbook of Emotions (eds Barrett, L. F., Lewis, M., & Haviland-Jones, J. M.) Ch. 28, 483\u2013494 (Guildford Publications, 2016)."},{"key":"25352_CR62","unstructured":"Hess, U. & Hareli, S. In The Science of Facial Expression (eds Fernandez-Dols, J. M. & Russell, J. A.) 375\u2013396 (Oxford University Press, 2017)."},{"key":"25352_CR63","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fpsyg.2012.00471","volume":"3","author":"MJ Wieser","year":"2012","unstructured":"Wieser, M. J. & Brosch, T. Faces in context: a review and systematization of contextual influences on affective face processing. Front. Psychol. 3, 1\u201313 (2012).","journal-title":"Front. Psychol."},{"key":"25352_CR64","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/s10919-015-0223-7","volume":"40","author":"U Hess","year":"2016","unstructured":"Hess, U., Blaison, C. & Kafetsios, K. Judging facial emotion expressions in context: The influence of culture and self-construal orientation. J. Nonverb. Behav. 40, 55\u201364 (2016).","journal-title":"J. Nonverb. Behav."},{"key":"25352_CR65","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1037\/emo0000032","volume":"15","author":"M Kayyal","year":"2015","unstructured":"Kayyal, M., Widen, S. & Russell, J. A. Context is more powerful than we think: Contextual cues override facial cues even for valence. Emotion 15, 287 (2015).","journal-title":"Emotion"},{"key":"25352_CR66","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1007\/BF02172290","volume":"18","author":"P Carrera-Levillain","year":"1994","unstructured":"Carrera-Levillain, P. & Fernandez-Dols, J.-M. Neutral faces in context: their emotional meaning and their function. J. Nonverb. Behav. 18, 281\u2013299 (1994).","journal-title":"J. Nonverb. Behav."},{"key":"25352_CR67","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1037\/0022-3514.70.2.205","volume":"70","author":"JM Carroll","year":"1996","unstructured":"Carroll, J. M. & Russell, J. A. Do facial expressions signal specific emotions? Judging emotion from the face in context. J. Personal. Soc. Psychol. 70, 205\u2013218 (1996).","journal-title":"J. Personal. Soc. Psychol."},{"key":"25352_CR68","unstructured":"Scarantino, A. In The Psychological Construction of Emotion (eds Russell, J. A. & Barrett, L. F.) 334\u2013376 (Guilford Press, 2015)."},{"key":"25352_CR69","unstructured":"Plutchik, R. The Psychology and Biology of Emotion (Harper and Row, 1994)."},{"key":"25352_CR70","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/1467-8721.00156","volume":"11","author":"DS Messinger","year":"2002","unstructured":"Messinger, D. S. Positive and negative: infant facial expressions and emotions. Curr. Directions Psychol. Sci. 11, 1\u20136 (2002).","journal-title":"Curr. Directions Psychol. Sci."},{"key":"25352_CR71","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1177\/0956797614561044","volume":"26","author":"OR Arag\u00f3n","year":"2015","unstructured":"Arag\u00f3n, O. R., Clark, M. S., Dyer, R. L. & Bargh, J. A. Dimorphous expressions of positive emotion: displays of both care and aggression in response to cute stimuli. Psychol. Sci. 26, 259\u2013273 (2015).","journal-title":"Psychol. Sci."},{"key":"25352_CR72","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1080\/026999398379718","volume":"12","author":"B Fredrickson","year":"1998","unstructured":"Fredrickson, B. & Levenson, R. W. Positive emotions speed recovery from the cardiovascular sequelae of negative emotions. Cogn. Emot. 12, 191\u2013220 (1998).","journal-title":"Cogn. Emot."},{"key":"25352_CR73","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1146\/annurev.psych.58.110405.085709","volume":"58","author":"LF Barrett","year":"2007","unstructured":"Barrett, L. F., Mesquita, B., Ochsner, K. N. & Gross, J. J. The experience of emotion. Annu. Rev. Psychol. 58, 373\u2013403 (2007).","journal-title":"Annu. Rev. Psychol."},{"key":"25352_CR74","doi-asserted-by":"publisher","unstructured":"Scherer, K. R. & Fontaine, J. R. J. The semantic structure of emotion words across languages is consistent with componential appraisal models of emotion. Cogn. Emot. 1\u201310, https:\/\/doi.org\/10.1080\/02699931.2018.1481369 (2018).","DOI":"10.1080\/02699931.2018.1481369"},{"key":"25352_CR75","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1080\/02699931.2011.561298","volume":"26","author":"JL Tracy","year":"2012","unstructured":"Tracy, J. L. & Prehn, C. Arrogant or self-confident? The use of contextual knowledge to differentiate hubristic and authentic pride from a single nonverbal expression. Cogn. Emot. 26, 14\u201324 (2012).","journal-title":"Cogn. Emot."},{"key":"25352_CR76","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1037\/pspi0000181","volume":"118","author":"Z Witkower","year":"2020","unstructured":"Witkower, Z., Tracy, J. L., Cheng, J. T. & Henrich, J. Two signals of social rank: Prestige and dominance are associated with distinct nonverbal displays. J. Personal. Soc. Psychol. 118, 89\u2013120 (2020).","journal-title":"J. Personal. Soc. Psychol."},{"key":"25352_CR77","doi-asserted-by":"crossref","unstructured":"de Gelder, B. Emotions and the Body (Oxford University Press, 2016).","DOI":"10.1093\/acprof:oso\/9780195374346.001.0001"},{"key":"25352_CR78","doi-asserted-by":"publisher","first-page":"477","DOI":"10.1080\/13506285.2017.1310164","volume":"25","author":"M Lecker","year":"2017","unstructured":"Lecker, M., Shoval, R., Aviezer, H. & Eitam, B. Temporal integration of bodies and faces: united we stand, divided we fall? Vis. Cogn. 25, 477\u2013491 (2017).","journal-title":"Vis. Cogn."},{"key":"25352_CR79","doi-asserted-by":"publisher","first-page":"1325","DOI":"10.1098\/rstb.2008.0312","volume":"364","author":"LF Barrett","year":"2009","unstructured":"Barrett, L. F. & Bar, M. See it with feeling: affective predictions during object perception. Philos. Trans. R. Soc. B Biol. Sci. 364, 1325\u20131334 (2009).","journal-title":"Philos. Trans. R. Soc. B Biol. Sci."},{"key":"25352_CR80","doi-asserted-by":"crossref","unstructured":"Mobbs, D. et al. Promises and challenges of human computational ethology. Neuron 109, 2224\u20132238 (2021).","DOI":"10.1016\/j.neuron.2021.05.021"},{"key":"25352_CR81","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1007\/s10919-008-0059-5","volume":"33","author":"Z Ambadar","year":"2009","unstructured":"Ambadar, Z., Cohn, J. F. & Reed, L. I. All smiles are not created equal: Morphology and timing of smiles perceived as amused, polite, and embarrassed\/nervous. J. Nonverb. Behav. 33, 17\u201334 (2009).","journal-title":"J. Nonverb. Behav."},{"key":"25352_CR82","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1146\/annurev-psych-010416-044242","volume":"68","author":"RE Jack","year":"2017","unstructured":"Jack, R. E. & Schyns, P. G. Toward a social psychophysics of face communication. Annu. Rev. Psychol. 68, 269\u2013297 (2017).","journal-title":"Annu. Rev. Psychol."},{"key":"25352_CR83","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1177\/1754073912451349","volume":"5","author":"EG Krumhuber","year":"2013","unstructured":"Krumhuber, E. G., Kappas, A. & Manstead, A. S. Effects of dynamic aspects of facial expressions: a review. Emot. Rev. 5, 41\u201346 (2013).","journal-title":"Emot. Rev."},{"key":"25352_CR84","doi-asserted-by":"publisher","unstructured":"Jeni, L. A., Cohn, J. F. & De La Torre, F. Facing imbalanced data - Recommendations for the use of performance metrics. In Proc. 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, ACII 2013 245\u2013251, https:\/\/doi.org\/10.1109\/ACII.2013.47 (2013).","DOI":"10.1109\/ACII.2013.47"},{"key":"25352_CR85","doi-asserted-by":"publisher","unstructured":"De La Torre, F., Simon, T., Ambadar, Z. & Cohn, J. F. Fast-FACS: A computer-assisted system to increase speed and reliability of manual FACS coding. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 6974 LNCS, 57\u201366, https:\/\/doi.org\/10.1007\/978-3-642-24600-5_9 (2011).","DOI":"10.1007\/978-3-642-24600-5_9"},{"key":"25352_CR86","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1006\/nimg.1998.0409","volume":"9","author":"S Dubois","year":"1999","unstructured":"Dubois, S. et al. Effect of familiarity on the processing of human faces. NeuroImage 9, 278\u2013289 (1999).","journal-title":"NeuroImage"},{"key":"25352_CR87","doi-asserted-by":"publisher","first-page":"12441","DOI":"10.1073\/pnas.1808083115","volume":"115","author":"A Coppock","year":"2018","unstructured":"Coppock, A., Leeper, T. J. & Mullinix, K. J. Generalizability of heterogeneous treatment effect estimates across samples. Proc. Natl Acad. Sci. USA 115, 12441\u201312446 (2018).","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"25352_CR88","doi-asserted-by":"publisher","first-page":"1463","DOI":"10.1037\/emo0000510","volume":"19","author":"N Betz","year":"2019","unstructured":"Betz, N., Hoemann, K. & Barrett, L. F. Words are a context for mental inference. Emotion 19, 1463\u20131477 (2019).","journal-title":"Emotion"},{"key":"25352_CR89","doi-asserted-by":"crossref","unstructured":"Russell, J. A. Forced-choice response format in the study of facial expression. Motiv. Emot. 17, 41\u201351 (1993).","DOI":"10.1007\/BF00995206"},{"key":"25352_CR90","doi-asserted-by":"publisher","first-page":"400","DOI":"10.3758\/s13428-015-0578-z","volume":"48","author":"DJ Hauser","year":"2016","unstructured":"Hauser, D. J. & Schwarz, N. Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants. Behav. Res. Methods 48, 400\u2013407 (2016).","journal-title":"Behav. Res. Methods"},{"key":"25352_CR91","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/23311908.2015.1005493","volume":"2","author":"K Kafetsios","year":"2015","unstructured":"Kafetsios, K. & Hess, U. Are you looking at me? The influence of facial orientation and cultural focus salience on the perception of emotion expressions. Cogent Psychol. 2, 1\u201312 (2015).","journal-title":"Cogent Psychol."},{"key":"25352_CR92","doi-asserted-by":"publisher","first-page":"438","DOI":"10.1080\/13546805.2015.1080157","volume":"20","author":"H Silver","year":"2015","unstructured":"Silver, H. & Bilker, W. B. Colour influences perception of facial emotions but this effect is impaired in healthy ageing and schizophrenia. Cogn. Neuropsychiatry 20, 438\u2013455 (2015).","journal-title":"Cogn. Neuropsychiatry"},{"key":"25352_CR93","doi-asserted-by":"crossref","unstructured":"McDuff, D. et al. AFFDEX SDK: a cross-platform real-time multi-face expression recognition toolkit. In Proc. 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems CHI EA \u201816, 3723\u20133726 (2016).","DOI":"10.1145\/2851581.2890247"},{"key":"25352_CR94","doi-asserted-by":"publisher","unstructured":"Lucey, P. et al. The extended Cohn-Kanade dataset (CK+): a complete facial expression dataset for action unit and emotion-specified expression. Cvprw 94\u2013101, https:\/\/doi.org\/10.1109\/ISIEA.2010.5679500 (2010).","DOI":"10.1109\/ISIEA.2010.5679500"},{"key":"25352_CR95","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1029-242X-2013-1","volume":"2013","author":"S Sara\u00e7li","year":"2013","unstructured":"Sara\u00e7li, S., Do\u01e7an, N. & Do\u01e7an, I. Comparison of hierarchical cluster analysis methods by cophenetic correlation. J. Inequalities Appl. 2013, 1\u20138 (2013).","journal-title":"J. Inequalities Appl."},{"key":"25352_CR96","unstructured":"Matsumoto, D., Keltner, D., Shiota, M. N., O\u2019Sullivan, M. & Frank, M. In Handbook of Emotions (eds Michael Lewis, M., Haviland-Jones, J. M., & Barrett, L. F.) 211\u2013234 (Guildford Press, 2008)."},{"key":"25352_CR97","unstructured":"Keltner, D. & Cordaro, D. T. In The Science of Facial Expression (eds Fern\u00e1ndez-Dols, J. M. & Russell, J. A.) 57\u201375 (Oxford University Press, 2015)."}],"container-title":["Nature Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41467-021-25352-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41467-021-25352-6","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41467-021-25352-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,5]],"date-time":"2023-02-05T12:07:33Z","timestamp":1675598853000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41467-021-25352-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,19]]},"references-count":97,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["25352"],"URL":"https:\/\/doi.org\/10.1038\/s41467-021-25352-6","relation":{},"ISSN":["2041-1723"],"issn-type":[{"value":"2041-1723","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,19]]},"assertion":[{"value":"18 December 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 August 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 August 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"5037"}}