{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T17:30:18Z","timestamp":1780421418669,"version":"3.54.1"},"reference-count":42,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2024,4,11]],"date-time":"2024-04-11T00:00:00Z","timestamp":1712793600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["11972248"],"award-info":[{"award-number":["11972248"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["12021002"],"award-info":[{"award-number":["12021002"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["12302242"],"award-info":[{"award-number":["12302242"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Facial expression is an important way to reflect human emotions and it represents a dynamic deformation process. Analyzing facial movements is an effective means of understanding expressions. However, there is currently a lack of methods capable of analyzing the dynamic details of full-field deformation in expressions. In this paper, in order to enable effective dynamic analysis of expressions, a classic optical measuring method called stereo digital image correlation (stereo-DIC or 3D-DIC) is employed to analyze the deformation fields of facial expressions. The forming processes of six basic facial expressions of certain experimental subjects are analyzed through the displacement and strain fields calculated by 3D-DIC. The displacement fields of each expression exhibit strong consistency with the action units (AUs) defined by the classical Facial Action Coding System (FACS). Moreover, it is shown that the gradient of the displacement, i.e., the strain fields, offers special advantages in characterizing facial expressions due to their localized nature, effectively sensing the nuanced dynamics of facial movements. By processing extensive data, this study demonstrates two featured regions in six basic expressions, one where deformation begins and the other where deformation is most severe. Based on these two regions, the temporal evolutions of the six basic expressions are discussed. The presented investigations demonstrate the superior performance of 3D-DIC in the quantitative analysis of facial expressions. The proposed analytical strategy might have potential value in objectively characterizing human expressions based on quantitative measurement.<\/jats:p>","DOI":"10.3390\/s24082450","type":"journal-article","created":{"date-parts":[[2024,4,11]],"date-time":"2024-04-11T07:09:28Z","timestamp":1712819368000},"page":"2450","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Application of Stereo Digital Image Correlation on Facial Expressions Sensing"],"prefix":"10.3390","volume":"24","author":[{"given":"Xuanshi","family":"Cheng","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, Tianjin University, Tianjin 300350, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shibin","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Tianjin University, Tianjin 300350, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huixin","family":"Wei","sequence":"additional","affiliation":[{"name":"School of Civil Engineering and Architecture, Nanchang University, Nanchang 330000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Tianjin University, Tianjin 300350, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lipan","family":"Xin","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Tianjin University, Tianjin 300350, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Linan","family":"Li","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Tianjin University, Tianjin 300350, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chuanwei","family":"Li","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Tianjin University, Tianjin 300350, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1920-9926","authenticated-orcid":false,"given":"Zhiyong","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Tianjin University, Tianjin 300350, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,4,11]]},"reference":[{"key":"ref_1","unstructured":"Darwin, C., Ekman, P., and Prodger, P. (1999). The Expression of the Emotions in Man and Animals, HarperCollins. [3rd ed.]."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1007\/s12369-012-0168-5","article-title":"Visualization of Facial Expression Deformation Applied to the Mechanism Improvement of Face Robot","volume":"5","author":"Cheng","year":"2013","journal-title":"Int. J. Soc. Robot."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TAFFC.2014.2386334","article-title":"Automatic Facial Expression Recognition Using Features of Salient Facial Patches","volume":"6","author":"Happy","year":"2015","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1037\/h0030377","article-title":"Constants across cultures in the face and emotion","volume":"17","author":"Ekman","year":"1971","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1126\/science.164.3875.86","article-title":"Pan-cultural elements in facial displays of emotion","volume":"164","author":"Ekman","year":"1969","journal-title":"Science"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1080\/13682199.2023.2172526","article-title":"Review on learning framework for facial expression recognition","volume":"70","author":"Borgalli","year":"2022","journal-title":"Imaging Sci. J."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1111\/1468-5914.00210","article-title":"Guilt and shame in Chinese culture: A cross-cultural framework from the perspective of morality and identity","volume":"33","author":"Bedford","year":"2003","journal-title":"J. Theor. Soc. Behav."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"767","DOI":"10.1080\/02699930341000202","article-title":"The organisation of Chinese shame concepts?","volume":"18","author":"Li","year":"2004","journal-title":"Cogn. Emot."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1111\/j.0956-7976.2004.01503008.x","article-title":"Show your pride\u2014Evidence for a discrete emotion expression","volume":"15","author":"Tracy","year":"2004","journal-title":"Psychol. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"E1454","DOI":"10.1073\/pnas.1322355111","article-title":"Compound facial expressions of emotion","volume":"111","author":"Du","year":"2014","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1023\/A:1006641104653","article-title":"Multiple Messages: Facial Recognition Advantage for Compound Expressions","volume":"24","author":"LaPlante","year":"2000","journal-title":"J. Nonverbal Behav."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"634","DOI":"10.3758\/BF03206544","article-title":"Photographs of facial expression: Accuracy, response times, and ratings of intensity","volume":"36","author":"Palermo","year":"2004","journal-title":"Behav. Res. Methods Ins. C"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/1529100619832930","article-title":"Emotional Expressions Reconsidered: Challenges to Inferring Emotion From Human Facial Movements","volume":"20","author":"Barrett","year":"2019","journal-title":"Psychol. Sci. Public Interest"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"115","DOI":"10.3758\/BF03195356","article-title":"Making faces: Creating three-dimensional parameterized models of facial expression","volume":"33","author":"Wild","year":"2001","journal-title":"Behav. Res. Methods Instrum. Comput."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1079","DOI":"10.3758\/BRM.42.4.1079","article-title":"Spontaneous facial expression in a small group can be automatically measured: An initial demonstration","volume":"42","author":"Cohn","year":"2010","journal-title":"Behav. Res. Methods"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1023\/A:1010671109788","article-title":"A Psychometric Evaluation of the Facial Action Coding System for Assessing Spontaneous Expression","volume":"25","author":"Sayette","year":"2001","journal-title":"J. Nonverbal Behav."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hao, L.F., Wang, S.F., Peng, G.Z., and Ji, Q. (2018, January 15\u201319). Facial Action Unit Recognition Augmented by Their Dependencies. Proceedings of the 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), Xi\u2019an, China.","DOI":"10.1109\/FG.2018.00036"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1037\/emo0000302","article-title":"Universals and Cultural Variations in 22 Emotional Expressions Across Five Cultures","volume":"18","author":"Cordaro","year":"2018","journal-title":"Emotion"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1177\/0963721417746794","article-title":"Universality Reconsidered: Diversity in Making Meaning of Facial Expressions","volume":"27","author":"Gendron","year":"2018","journal-title":"Curr. Dir. Psychol. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/j.jneumeth.2011.06.023","article-title":"Automated Facial Action Coding System for dynamic analysis of facial expressions in neuropsychiatric disorders","volume":"200","author":"Hamm","year":"2011","journal-title":"J. Neurosci. Methods"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1007\/s10919-016-0246-8","article-title":"Quantifying Facial Expression Synchrony in Face-To-Face Dyadic Interactions: Temporal Dynamics of Simultaneously Recorded Facial EMG Signals","volume":"41","author":"Riehle","year":"2017","journal-title":"J. Nonverbal Behav."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1404","DOI":"10.1038\/nn.4635","article-title":"Seeing faces is necessary for face-domain formation","volume":"20","author":"Arcaro","year":"2017","journal-title":"Nat. Neurosci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"864","DOI":"10.1016\/j.tics.2017.08.007","article-title":"Smiles as Multipurpose Social Signals","volume":"21","author":"Martin","year":"2017","journal-title":"Trends Cogn. Sci."},{"key":"ref_24","first-page":"5826","article-title":"Video-Based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms","volume":"44","author":"Ben","year":"2022","journal-title":"IEEE Trans. Pattern Anal."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1016\/j.neucom.2022.05.077","article-title":"A comparative study on optical flow for facial expression analysis","volume":"500","author":"Allaert","year":"2022","journal-title":"Neurocomputing"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"107861","DOI":"10.1016\/j.patcog.2021.107861","article-title":"Optical flow and scene flow estimation: A survey","volume":"114","author":"Zhai","year":"2021","journal-title":"Pattern Recogn."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"4409","DOI":"10.1364\/AO.51.004409","article-title":"Optimization of a three-dimensional digital image correlation system for deformation measurements in extreme environments","volume":"51","author":"Pan","year":"2012","journal-title":"Appl. Optics"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"082001","DOI":"10.1088\/1361-6501\/aac55b","article-title":"Digital image correlation for surface deformation measurement: Historical developments, recent advances and future goals","volume":"29","author":"Pan","year":"2018","journal-title":"Meas. Sci. Technol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"841","DOI":"10.1016\/j.optlaseng.2010.04.007","article-title":"High-temperature deformation field measurement by combining transient aerodynamic heating simulation system and reliability-guided digital image correlation","volume":"48","author":"Pan","year":"2010","journal-title":"Opt. Laser Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1007\/s11431-017-9125-7","article-title":"Precise 3D shape measurement of three-dimensional digital image correlation for complex surfaces","volume":"61","author":"Yan","year":"2018","journal-title":"Sci. China Technol. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.optlaseng.2017.11.016","article-title":"Accuracy-enhanced constitutive parameter identification using virtual fields method and special stereo-digital image correlation","volume":"103","author":"Zhang","year":"2018","journal-title":"Opt. Laser Eng."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1111\/j.1600-0846.2007.00266.x","article-title":"An in vivo study of the mechanical properties of facial skin and influence of aging using digital image speckle correlation","volume":"14","author":"Staloff","year":"2008","journal-title":"Skin Res. Technol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1111\/j.1600-0846.2008.00294.x","article-title":"Measurement of skin stretch using digital image speckle correlation","volume":"14","author":"Staloff","year":"2008","journal-title":"Skin Res. Technol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1299\/jmmp.6.545","article-title":"Digital Image Correlation Strain Analysis for the Study of Wrinkle Formation on Facial Skin","volume":"6","author":"Miura","year":"2012","journal-title":"J. Solid Mech. Mater. Eng."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1016\/j.taml.2016.05.005","article-title":"Visualizing surface strain distribution of facial skin using stereovision","volume":"6","author":"Miura","year":"2016","journal-title":"Theor. Appl. Mech. Lett."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"107547","DOI":"10.1016\/j.optlaseng.2023.107547","article-title":"Digital image correlation by natural textures on biological skin","volume":"165","author":"Cheng","year":"2023","journal-title":"Opt. Laser Eng."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"7037","DOI":"10.1364\/OE.16.007037","article-title":"Study on subset size selection in digital image correlation for speckle patterns","volume":"16","author":"Pan","year":"2008","journal-title":"Opt. Express"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.optlaseng.2018.10.012","article-title":"Elimination of systematic error in digital image correlation caused by intensity interpolation by introducing position randomness to subset points","volume":"114","author":"Su","year":"2019","journal-title":"Opt. Laser Eng."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.optlastec.2010.04.010","article-title":"Evaluation of the quality of a speckle pattern in the digital image correlation method by mean subset fluctuation","volume":"43","author":"Hua","year":"2011","journal-title":"Opt. Laser Technol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1016\/j.optlaseng.2009.08.010","article-title":"Mean intensity gradient: An effective global parameter for quality assessment of the speckle patterns used in digital image correlation","volume":"48","author":"Pan","year":"2010","journal-title":"Opt. Laser Eng."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1007\/s11340-006-9005-9","article-title":"Statistical analysis of the effect of intensity pattern noise on the displacement measurement precision of digital image correlation using self-correlated images","volume":"47","author":"Wang","year":"2007","journal-title":"Exp. Mech."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/8\/2450\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:26:23Z","timestamp":1760106383000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/8\/2450"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,11]]},"references-count":42,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,4]]}},"alternative-id":["s24082450"],"URL":"https:\/\/doi.org\/10.3390\/s24082450","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,11]]}}}