{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,5]],"date-time":"2026-10-05T14:03:59Z","timestamp":1791209039263,"version":"4.1.0"},"reference-count":66,"publisher":"Public Library of Science (PLoS)","issue":"1","license":[{"start":{"date-parts":[[2024,1,2]],"date-time":"2024-01-02T00:00:00Z","timestamp":1704153600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>Facial mimicry is the automatic imitation of the facial affect expressions of others. It serves as an important component of interpersonal communication and affective co-experience. Facial mimicry has so far been measured by Electromyography (EMG), which requires a complex measuring apparatus. Recently, software for measuring facial expressions have become available, but it is still unclear how well it is suited for measuring facial mimicry. This study investigates the comparability of the automated facial coding software Affdex with EMG for measuring facial mimicry. For this purpose, facial mimicry was induced in 33 subjects by presenting naturalistic affect-expressive video sequences (anger, joy). The response of the subjects is measured simultaneously by facial EMG (corrugator supercilii muscle, zygomaticus major muscle) and by Affdex (action units lip corner puller and brow lowerer and affects joy and anger). Subsequently, the correlations between the measurement results of EMG and Affdex were calculated. After the presentation of the joy stimulus, there was an increase in zygomaticus muscle activity (EMG) about 400 ms after stimulus onset and an increase in joy and lip corner puller activity (Affdex) about 1200 ms after stimulus onset. The joy and the lip corner puller activity detected by Affdex correlate significantly with the EMG activity. After presentation of the anger stimulus, corrugator muscle activity (EMG) also increased approximately 400 ms after stimulus onset, whereas anger and brow lowerer activity (Affdex) showed no response. During the entire measurement interval, anger activity and brow lowerer activity (Affdex) did not correlate with corrugator muscle activity (EMG). Using Affdex, the facial mimicry response to a joy stimulus can be measured, but it is detected approximately 800 ms later compared to the EMG. Thus, electromyography remains the tool of choice for studying subtle mimic processes like facial mimicry.<\/jats:p>","DOI":"10.1371\/journal.pone.0290569","type":"journal-article","created":{"date-parts":[[2024,1,2]],"date-time":"2024-01-02T19:09:20Z","timestamp":1704222560000},"page":"e0290569","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":13,"title":["Measuring facial mimicry: Affdex vs. EMG"],"prefix":"10.1371","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9025-9934","authenticated-orcid":true,"given":"Jan-Frederik","family":"Westermann","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ralf","family":"Sch\u00e4fer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marc","family":"Nordmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Richter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tobias","family":"M\u00fcller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthias","family":"Franz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2024,1,2]]},"reference":[{"key":"pone.0290569.ref001","first-page":"213","article-title":"Mimicry- Facts and fiction.","author":"U Hess","year":"1999","journal-title":"The social context of nonverbal behavior."},{"key":"pone.0290569.ref002","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.3389\/fpsyg.2015.01122","article-title":"Facial mimicry in its social setting.","volume":"6","author":"B Seibt","year":"2015","journal-title":"Frontiers in psychology."},{"key":"pone.0290569.ref003","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1111\/1467-9450.00054","article-title":"Rapid facial reactions to emotional facial expressions.","volume":"39","author":"U Dimberg","year":"1998","journal-title":"Scand J Psychol"},{"key":"pone.0290569.ref004","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1111\/1467-9280.00221","article-title":"Unconscious facial reactions to emotional facial expressions","volume":"11","author":"U Dimberg","year":"2000","journal-title":"Psychological Science"},{"issue":"7","key":"pone.0290569.ref005","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1037\/0003-066X.54.7.462","article-title":"The Unbearable Automaticity of Being.","volume":"54","author":"JA Bargh","year":"1999","journal-title":"American Psychologist."},{"key":"pone.0290569.ref006","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.biopsycho.2013.12.009","article-title":"Automatic facial responses to near-threshold presented facial displays of emotion: imitation or evaluation.","volume":"96","author":"R Neumann","year":"2014","journal-title":"Biol Psychol"},{"key":"pone.0290569.ref007","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1111\/j.1467-9450.1995.tb00974.x","article-title":"Facial EMG reactions to facial expressions: a case of facial emotional contagion.","volume":"36","author":"LO Lundqvist","year":"1995","journal-title":"Scand J Psychol"},{"key":"pone.0290569.ref008","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1207\/s15327957pspr0903_1","article-title":"Embodiment in attitudes, social perception, and emotion.","volume":"9","author":"PM Niedenthal","year":"2005","journal-title":"Pers Soc Psychol Rev"},{"key":"pone.0290569.ref009","first-page":"397","volume-title":"The Science of facial expression","author":"PM Niedenthal","year":"2017"},{"key":"pone.0290569.ref010","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1080\/17470910701391943","article-title":"Face to face: blocking facial mimicry can selectively impair recognition of emotional expressions.","volume":"2","author":"LM Oberman","year":"2007","journal-title":"Soc Neurosci."},{"key":"pone.0290569.ref011","article-title":"Blocking facial mimicry affects recognition of facial and body expressions.","author":"Alessio Avenanti","year":"2020","journal-title":"PLOS ONE."},{"key":"pone.0290569.ref012","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1021370825283","article-title":"Mimicry and the Judgement of Emotional Facial Expressions","volume":"23","author":"S Blairy","year":"1999","journal-title":"Journal of Nonverbal Behavior"},{"key":"pone.0290569.ref013","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1037\/0022-3514.72.2.305","article-title":"Stress, Affiliation, and Emotional Contagion","volume":"72","author":"BB Gump","year":"1997","journal-title":"Journal of Personality and Social Psychology"},{"key":"pone.0290569.ref014","first-page":"213","volume-title":"The social context of nonverbal behavior","author":"U Hess","year":"1999"},{"key":"pone.0290569.ref015","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1037\/0033-2909.89.1.101","article-title":"Mutual influence in expressive behavior: Adult\u2013adult and infant\u2013adult dyadic interaction.","volume":"89","author":"JN Cappella","year":"1981","journal-title":"Psychological Bulletin."},{"key":"pone.0290569.ref016","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1037\/0022-3514.56.4.543","article-title":"Expectations of cooperation and competition and their effects on observers\u2019 vicarious emotional responses","volume":"56","author":"JT Lanzetta","year":"1989","journal-title":"Journal of Personality and Social Psychology"},{"key":"pone.0290569.ref017","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1521\/soco.2013.31.5.613","article-title":"Subliminal Interdependence Priming Modulates Congruent and Incongruent Facial Reactions to Emotional Displays.","volume":"31","author":"B Seibt","year":"2013","journal-title":"Social Cognition."},{"key":"pone.0290569.ref018","volume-title":"Emotional contagion. 1st ed.","author":"E Hatfield","year":"1994"},{"key":"pone.0290569.ref019","doi-asserted-by":"crossref","first-page":"1672","DOI":"10.1080\/02699931.2019.1596068","article-title":"From face to face: the contribution of facial mimicry to cognitive and emotional empathy.","volume":"33","author":"H Drimalla","year":"2019","journal-title":"Cognition & Emotion."},{"key":"pone.0290569.ref020","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1111\/spc3.12083","article-title":"Emotional Mimicry: Why and When We Mimic Emotions.","volume":"8","author":"U Hess","year":"2014","journal-title":"Social and Personality Psychology Compass."},{"key":"pone.0290569.ref021","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1037\/0022-3514.76.6.893","article-title":"The Chameleon Effect: The Perception-Behavior Link and Social Interaction","author":"TL Chartrand","year":"1999","journal-title":"Journal of Personality and Social Psychology"},{"key":"pone.0290569.ref022","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1037\/0033-2909.117.3.497","article-title":"The Need to Belong: Desire for Interpersonal Attachments as a Fundamental Human Motivation.","author":"RF Baumeister","year":"1995","journal-title":"Psychological Bulletin."},{"key":"pone.0290569.ref023","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1177\/0146167291175014","article-title":"Smile and (Half) the World Smiles with You, Frown and You Frown Alone.","author":"VB Hinsz","year":"1991","journal-title":"Personality and Social Psychology Bulletin."},{"key":"pone.0290569.ref024","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1111\/j.1469-8986.1982.tb02516.x","article-title":"Facial reactions to facial expressions","volume":"19","author":"U. Dimberg","year":"1982","journal-title":"Psychophysiology"},{"key":"pone.0290569.ref025","doi-asserted-by":"crossref","first-page":"776","DOI":"10.1111\/1469-8986.00078","article-title":"Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii.","volume":"40","author":"JT Larsen","year":"2003","journal-title":"Psychophysiology"},{"key":"pone.0290569.ref026","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1111\/j.1469-8986.1993.tb03354.x","article-title":"The psychophysiology of disgust: differentiating negative emotional contexts with facial EMG.","volume":"30","author":"SR Vrana","year":"1993","journal-title":"Psychophysiology."},{"key":"pone.0290569.ref027","doi-asserted-by":"crossref","first-page":"4692","DOI":"10.1038\/s41598-020-61563-5","article-title":"Perception of Discrete Emotions in Others: Evidence for Distinct Facial Mimicry Patterns.","volume":"10","author":"TSH Wingenbach","year":"2020","journal-title":"Sci Rep."},{"key":"pone.0290569.ref028","doi-asserted-by":"crossref","first-page":"1318","DOI":"10.1007\/s10803-014-2291-7","article-title":"Impaired overt facial mimicry in response to dynamic facial expressions in high-functioning autism spectrum disorders.","volume":"45","author":"S Yoshimura","year":"2015","journal-title":"J Autism Dev Disord"},{"key":"pone.0290569.ref029","author":"P Ekman","year":"1978","journal-title":"Facial Action Coding System (FACS)."},{"key":"pone.0290569.ref030","article-title":"EMFACS-7: Emotional facial action coding system, Version 7.","author":"WV Friesen","year":"1984","journal-title":"Unpublished manuscript. Unpublished manuscript"},{"key":"pone.0290569.ref031","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1111\/j.1467-7687.2008.00796.x","article-title":"Slow echo: facial EMG evidence for the delay of spontaneous, but not voluntary, emotional mimicry in children with autism spectrum disorders.","volume":"12","author":"LM Oberman","year":"2009","journal-title":"Dev Sci."},{"key":"pone.0290569.ref032","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1111\/j.1467-7687.2006.00492.x","article-title":"When the social mirror breaks: deficits in automatic, but not voluntary, mimicry of emotional facial expressions in autism.","volume":"9","author":"DN McIntosh","year":"2006","journal-title":"Dev Sci."},{"key":"pone.0290569.ref033","doi-asserted-by":"crossref","first-page":"1537","DOI":"10.1037\/emo0001002","article-title":"It is in your face-Alexithymia impairs facial mimicry.","volume":"21","author":"M Franz","year":"2021","journal-title":"Emotion"},{"key":"pone.0290569.ref034","doi-asserted-by":"crossref","first-page":"e0160329","DOI":"10.1371\/journal.pone.0160329","article-title":"Does Facial Amimia Impact the Recognition of Facial Emotions? An EMG Study in Parkinson\u2019s Disease","volume":"11","author":"S Argaud","year":"2016","journal-title":"PLOS ONE."},{"key":"pone.0290569.ref035","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1017\/S1355617710000329","article-title":"Empathic deficits in schizophrenia: the potential role of rapid facial mimicry.","volume":"16","author":"KJ Varcin","year":"2010","journal-title":"J Int Neuropsychol Soc"},{"key":"pone.0290569.ref036","doi-asserted-by":"crossref","first-page":"368","DOI":"10.3389\/fnhum.2013.00368","article-title":"Facial reactions in response to dynamic emotional stimuli in different modalities in patients suffering from schizophrenia: a behavioral and EMG study.","volume":"7","author":"M Sestito","year":"2013","journal-title":"Front Hum Neurosci."},{"key":"pone.0290569.ref037","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1159\/000351122","article-title":"Facial reactions during emotion recognition in borderline personality disorder: a facial electromyography study.","volume":"47","author":"B Matzke","year":"2014","journal-title":"Psychopathology"},{"key":"pone.0290569.ref038","first-page":"127","article-title":"Decreased Perceptual Sensitivity to Emotion-Evoking Stimuli in Depression.","author":"BE Wexler","year":"1993","journal-title":"Psychiatry Research."},{"key":"pone.0290569.ref039","first-page":"3723","article-title":"F","volume-title":"Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems","author":"D McDuff","year":"2016"},{"key":"pone.0290569.ref040","doi-asserted-by":"crossref","first-page":"1446","DOI":"10.3758\/s13428-017-0996-1","article-title":"Facial expression analysis with AFFDEX and FACET: A validation study.","volume":"50","author":"S St\u00f6ckli","year":"2018","journal-title":"Behav Res Methods"},{"key":"pone.0290569.ref041","doi-asserted-by":"crossref","first-page":"329","DOI":"10.3389\/fpsyg.2020.00329","article-title":"A Comparison of the Affectiva iMotions Facial Expression Analysis Software With EMG for Identifying Facial Expressions of Emotion.","volume":"11","author":"L Kulke","year":"2020","journal-title":"Frontiers in psychology."},{"key":"pone.0290569.ref042","doi-asserted-by":"crossref","first-page":"874","DOI":"10.1080\/02699931.2021.1902786","article-title":"Automatic facial coding versus electromyography of mimicked, passive, and inhibited facial response to emotional faces.","volume":"35","author":"TTA H\u00f6fling","year":"2021","journal-title":"Cognition & Emotion."},{"key":"pone.0290569.ref043","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1109\/ICCVW.2015.11","article-title":"Facial Action Unit Detection Using Active Learning and an Efficient Non-linear Kernel Approximation.","author":"T Senechal","year":"2015","journal-title":"2015 IEEE International Conference on Computer Vision Workshop (ICCVW). IEEE;"},{"key":"pone.0290569.ref044","unstructured":"Wittchen HU, Wunderlich U, Gruschwitz S, Zaudig M. SCID: Structured Clinical Interview for DSM-IV Axis I Disorders."},{"key":"pone.0290569.ref045","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1016\/j.comppsych.2008.11.008","article-title":"The German version of the Toronto Structured Interview for Alexithymia: factor structure, reliability, and concurrent validity in a psychiatric patient sample.","volume":"50","author":"HJ Grabe","year":"2009","journal-title":"Compr Psychiatry."},{"key":"pone.0290569.ref046","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.psychres.2018.09.036","article-title":"Correlations between TSIA and TAS-20 and their relation to self-reported negative affect: A study using a multi-method approach in the assessment of alexithymia in a nonclinical sample from Italy.","volume":"270","author":"O Montebarocci","year":"2018","journal-title":"Psychiatry Research"},{"key":"pone.0290569.ref047","article-title":"Evaluation der deutschen version des Autismus-Spektrum-Quotienten (AQ)-die Kurzversion AQ-k.","volume":"36","author":"CM Freitag","year":"2007","journal-title":"Klinische Psychologie und Psychotherapie."},{"key":"pone.0290569.ref048","author":"M Hautzinger","year":"2006","journal-title":"Beck depressions-inventar (BDI-II)."},{"key":"pone.0290569.ref049","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1046\/j.1525-1497.2001.016009606.x","article-title":"The PHQ-9: validity of a brief depression severity measure","volume":"16","author":"K Kroenke","year":"2001","journal-title":"Journal of General Internal Medicin"},{"key":"pone.0290569.ref050","doi-asserted-by":"crossref","first-page":"140343","DOI":"10.1098\/rsos.140343","article-title":"The 20-item prosopagnosia index (PI20): a self-report instrument for identifying developmental prosopagnosia.","volume":"2","author":"P Shah","year":"2015","journal-title":"R Soc Open Sci"},{"key":"pone.0290569.ref051","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/0022-3999(94)90005-1","article-title":"The twenty-item Toronto Alexithymia scale\u2014I. Item selection and cross-validation of the factor structure","volume":"38","author":"R Bagby","year":"1994","journal-title":"Journal of Psychosomatic Research"},{"key":"pone.0290569.ref052","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511526831","volume-title":"Disorders of affect regulation: Alexithymia in medical and psychiatric illness. 1999th ed.","author":"GJ Taylor","year":"1997"},{"key":"pone.0290569.ref053","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1007\/s00127-007-0265-1","article-title":"Alexithymia in the German general population.","volume":"43","author":"M Franz","year":"2008","journal-title":"Soc Psychiatry Psychiatr Epidemiol."},{"key":"pone.0290569.ref054","unstructured":"Leiner DJ. SoSci survey. Available Online at: https:\/\/www.soscisurvey. de.(accessed Decembre 13, 2021). 2014."},{"key":"pone.0290569.ref055","article-title":"The averaged Karolinska directed emotional-KDEF (CD ROM).","author":"D Lundqvist","year":"1998","journal-title":"Stockholm: Karolinska Institute, Department of"},{"key":"pone.0290569.ref056","doi-asserted-by":"crossref","first-page":"1094","DOI":"10.1080\/02699930701626582","article-title":"The Karolinska Directed Emotional Faces: A validation study","volume":"22","author":"E Goeleven","year":"2008","journal-title":"Cognition and Emotion"},{"key":"pone.0290569.ref057","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.ijpsycho.2019.01.001","article-title":"Adults\u2019 facial reaction to affective facial expressions of children and adults.","volume":"139","author":"T M\u00fcller","year":"2019","journal-title":"Int J Psychophysiol"},{"key":"pone.0290569.ref058","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.jneumeth.2006.11.017","article-title":"PsychoPy\u2014Psychophysics software in Python","volume":"162","author":"JW Peirce","year":"2007","journal-title":"J Neurosci Methods"},{"key":"pone.0290569.ref059","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1111\/j.1469-8986.1986.tb00676.x","article-title":"Guidelines for Human Electromyographic Research","volume":"23","author":"A. J. Fridlund","year":"1986","journal-title":"Psychophysiology"},{"key":"pone.0290569.ref060","first-page":"I-511-I","article-title":"Rapid object detection using a boosted cascade of simple features.","author":"P Viola","year":"2001","journal-title":"Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001. IEEE Comput. Soc"},{"key":"pone.0290569.ref061","doi-asserted-by":"crossref","first-page":"3723","DOI":"10.1145\/2851581.2890247","volume-title":"Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems","author":"D McDuff","year":"2016"},{"key":"pone.0290569.ref062","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1080\/02699930143000356","article-title":"Facial reactions to emotional stimuli: Automatically controlled emotional responses.","volume":"16","author":"U Dimberg","year":"2002","journal-title":"Cognition and Emotion"},{"key":"pone.0290569.ref063","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cognition.2006.05.001","article-title":"Spontaneous facial mimicry in response to dynamic facial expressions.","volume":"104","author":"W Sato","year":"2007","journal-title":"Cognition."},{"key":"pone.0290569.ref064","doi-asserted-by":"crossref","first-page":"259","DOI":"10.3389\/fpsyg.2019.00259","article-title":"Facial Expressions of Basic Emotions in Japanese Laypeople.","volume":"10","author":"W Sato","year":"2019","journal-title":"Frontiers in psychology."},{"key":"pone.0290569.ref065","doi-asserted-by":"crossref","first-page":"1388","DOI":"10.3389\/fpsyg.2020.01388","article-title":"Read My Face: Automatic Facial Coding Versus Psychophysiological Indicators of Emotional Valence and Arousal.","volume":"11","author":"TTA H\u00f6fling","year":"2020","journal-title":"Frontiers in psychology."},{"key":"pone.0290569.ref066","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1037\/npe0000028","article-title":"Automated facial coding: Validation of basic emotions and FACS AUs in FaceReader","volume":"7","author":"P Lewinski","year":"2014","journal-title":"Journal of Neuroscience, Psychology, and Economics."}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0290569","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,2]],"date-time":"2024-01-02T19:09:55Z","timestamp":1704222595000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0290569"}},"subtitle":[],"editor":[{"given":"Peter A.","family":"Bos","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2024,1,2]]},"references-count":66,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,1,2]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0290569","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,2]]}}}