{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T09:54:18Z","timestamp":1785405258442,"version":"3.56.0"},"reference-count":50,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T00:00:00Z","timestamp":1777420800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100014013","name":"United Kingdom Research and Innovation","doi-asserted-by":"crossref","award":["SIPF00006\/1"],"award-info":[{"award-number":["SIPF00006\/1"]}],"id":[{"id":"10.13039\/100014013","id-type":"DOI","asserted-by":"crossref"}]},{"award":["SIPF00006\/1"],"award-info":[{"award-number":["SIPF00006\/1"]}],"id":[{"id":"https:\/\/ror.org\/001aqnf71","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Facial expressions transmit information about internal states, both during social interaction and in response to shared stimuli such as films. When individuals view the same content, synchrony in their expressions reflects shared information processing, and the degree to which their expressions correlate indicates how similarly their perceptual and affective systems are responding to the common input. This makes interindividual expression synchrony a potential marker of engagement and subjective experience. However, the acquisition and analysis of facial data pose both ethical and technical challenges to researchers. \u2018Trace\u2019 is a research media player implemented in PsychoPy\u2019s online platform Pavlovia, which captures anonymised facial landmark coordinates through a webcam, without the ethical and technical constraints of capturing and storing video images of participants. Nonetheless, its usefulness is currently limited due to the lack of available preprocessing and analysis tools. This paper describes the functionality of TraceLAB, a MATLAB-based toolbox designed for the preprocessing of Trace data: specifically, the formatting, aligning, and filtering of data. In addition, TraceLAB implements some novel analysis techniques to allow researchers to quantify interindividual synchrony of expressions (through correlated component analysis) and head movements (through Surrogate Synchrony), which may be interpreted as measures of shared information processing. These techniques are demonstrated here on both simulated and real datasets.<\/jats:p>","DOI":"10.3390\/e28050503","type":"journal-article","created":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T12:31:56Z","timestamp":1777465916000},"page":"503","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["TraceLAB: A MATLAB Toolbox for Interindividual Synchrony Analysis of Facial Expression and Head Movement Data Acquired via Trace"],"prefix":"10.3390","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1020-2939","authenticated-orcid":false,"given":"Felix","family":"Carter","sequence":"first","affiliation":[{"name":"School of Psychological Science, University of Bristol, 12a Priory Road, Bristol BS8 1TU, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5433-6250","authenticated-orcid":false,"given":"Mike","family":"Richardson","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Bath, 10 West, Claverton Down, Bath BA2 7AY, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dana\u00eb","family":"Stanton Fraser","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Bath, 10 West, Claverton Down, Bath BA2 7AY, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Iain D.","family":"Gilchrist","sequence":"additional","affiliation":[{"name":"School of Psychological Science, University of Bristol, 12a Priory Road, Bristol BS8 1TU, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,4,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1080\/02699939208411068","article-title":"An argument for basic emotions","volume":"6","author":"Ekman","year":"1992","journal-title":"Cogn. Emot."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1177\/1088868311411164","article-title":"Temporal interpersonal emotion systems: The \u201cTIES\u201d that form relationships","volume":"15","author":"Butler","year":"2011","journal-title":"Pers. Soc. Psychol. Rev."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1037\/h0030377","article-title":"Constants across cultures in the face and emotion","volume":"17","author":"Ekman","year":"1971","journal-title":"J. Pers. Soc. Psychol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1125","DOI":"10.1037\/h0077722","article-title":"Facial signs of emotional experience","volume":"39","author":"Ekman","year":"1980","journal-title":"J. Pers. Soc. Psychol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/scan\/nsx060","article-title":"The theory of constructed emotion: An active inference account of interoception and categorization","volume":"12","author":"Barrett","year":"2017","journal-title":"Soc. Cogn. Affect. Neurosci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/1529100619832930","article-title":"Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements","volume":"20","author":"Barrett","year":"2019","journal-title":"Psychol. Sci. Public Interest"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1007\/s10919-016-0246-8","article-title":"Quantifying facial expression synchrony in face-to-face dyadic interactions: Temporal dynamics of simultaneously recorded facial EMG signals","volume":"41","author":"Riehle","year":"2017","journal-title":"J. Nonverbal Behav."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.physbeh.2016.01.004","article-title":"Physiological evidence of interpersonal dynamics in a cooperative production task","volume":"156","author":"Eskildsen","year":"2016","journal-title":"Physiol. Behav."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"514","DOI":"10.1016\/j.biopsycho.2009.11.001","article-title":"You smile\u2013I smile: Emotion expression in social interaction","volume":"84","author":"Hess","year":"2010","journal-title":"Biol. Psychol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1037\/a0023419","article-title":"Nonverbal synchrony in psychotherapy: Coordinated body movement reflects relationship quality and outcome","volume":"79","author":"Ramseyer","year":"2011","journal-title":"J. Consult. Clin. Psychol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1111\/1467-9280.14481","article-title":"Using nonconscious behavioral mimicry to create affiliation and rapport","volume":"14","author":"Lakin","year":"2003","journal-title":"Psychol. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Robinson, M.D., and Thomas, L.E. (2021). Forms and Functions of Affective Synchrony. Handbook of Embodied Psychology, Springer.","DOI":"10.1007\/978-3-030-78471-3"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1493","DOI":"10.3758\/s13428-021-01678-3","article-title":"Audience facial expressions detected by automated face analysis software reflect emotions in music","volume":"54","author":"Kayser","year":"2022","journal-title":"Behav. Res. Methods"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Golland, Y., Arzouan, Y., and Levit-Binnun, N. (2015). The mere co-presence: Synchronization of autonomic signals and emotional responses across co-present individuals not engaged in direct interaction. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0125804"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1099","DOI":"10.1038\/s42003-023-05461-2","article-title":"Synchronized affect in shared experiences strengthens social connection","volume":"6","author":"Cheong","year":"2023","journal-title":"Commun. Biol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3120","DOI":"10.1038\/s41598-019-40060-4","article-title":"Affiliative zygomatic synchrony in co-present strangers","volume":"9","author":"Golland","year":"2019","journal-title":"Sci. Rep."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1080\/02699931.2011.645280","article-title":"Emotional signals in nonverbal interaction: Dyadic facilitation and convergence in expressions, appraisals, and feelings","volume":"26","author":"Bruder","year":"2012","journal-title":"Cogn. Emot."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1787","DOI":"10.1162\/jocn_a_02338","article-title":"Electroencephalographic Functional Connectivity, Heartrate Synchrony, and Eye Movements Reveal Distinct Components within Narrative Engagement and Immersion","volume":"37","author":"Carter","year":"2025","journal-title":"J. Cogn. Neurosci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1186\/s41235-023-00475-0","article-title":"Audience immersion: Validating attentional and physiological measures against self-report","volume":"8","author":"Hammond","year":"2023","journal-title":"Cogn. Res. Princ. Implic."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"109692","DOI":"10.1016\/j.celrep.2021.109692","article-title":"Conscious processing of narrative stimuli synchronizes heart rate between individuals","volume":"36","author":"Madsen","year":"2021","journal-title":"Cell Rep."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"ENEURO.0203-16.2016","DOI":"10.1523\/ENEURO.0203-16.2016","article-title":"Memorable audiovisual narratives synchronize sensory and supramodal neural responses","volume":"3","author":"Cohen","year":"2016","journal-title":"eNeuro"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Dmochowski, J.P., Sajda, P., Dias, J., and Parra, L.C. (2012). Correlated components of ongoing EEG point to emotionally laden attention\u2013a possible marker of engagement?. Front. Hum. Neurosci., 6.","DOI":"10.3389\/fnhum.2012.00112"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"203","DOI":"10.53765\/mm2024.203","article-title":"Music synchronizes the bodies of its audience","volume":"22","author":"Tschacher","year":"2024","journal-title":"Mind Matter"},{"key":"ref_25","unstructured":"(2016). FaceReaderTM 7: Tool for Automatic Analysis of Facial Expressions, Noldus Information Technology."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"110013","DOI":"10.1016\/j.isci.2024.109843","article-title":"Inter-subject correlation of audience facial expressions predicts audience engagement during theatrical performances","volume":"27","author":"Oakes","year":"2024","journal-title":"iScience"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"77","DOI":"10.3167\/proj.2025.190305","article-title":"Adapting a Live Streamed Digital Theatre Experience Using Physiological Synchrony","volume":"19","author":"Richardson","year":"2025","journal-title":"Projections"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"44","DOI":"10.3758\/s13428-024-02522-0","article-title":"Trace: A research media player measuring real-time audience engagement","volume":"57","author":"Levordashka","year":"2025","journal-title":"Behav. Res. Methods"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Peirce, J.W., Hirst, R.J., and MacAskill, M.R. (2022). Building Experiments in PsychoPy, Sage. [2nd ed.].","DOI":"10.4135\/9781036231378"},{"key":"ref_30","unstructured":"(2025, March 18). Pavlovia. Available online: https:\/\/pavlovia.org."},{"key":"ref_31","unstructured":"The MathWorks Inc (MATLAB, 2024). MATLAB, [Computer software]."},{"key":"ref_32","unstructured":"(2025, March 18). face-api.js. Available online: https:\/\/justadudewhohacks.github.io\/face-api.js\/."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"10516","DOI":"10.1038\/s41598-023-37209-7","article-title":"Measuring real-time cognitive engagement in remote audiences","volume":"13","author":"Levordashka","year":"2023","journal-title":"Sci. Rep."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Tschacher, W., and Haken, H. (2019). The Process of Psychotherapy, Springer International Publishing.","DOI":"10.1007\/978-3-030-12748-0"},{"key":"ref_35","unstructured":"(2026, February 25). TraceLAB GitHub Repository. Available online: https:\/\/github.com\/FelixCarter\/tracelab."},{"key":"ref_36","first-page":"36","article-title":"Variation and extrema of human interpupillary distance","volume":"Volume 5291","author":"Dodgson","year":"2004","journal-title":"Stereoscopic Displays and Virtual Reality Systems XI. International Society for Optics and Photonics"},{"key":"ref_37","unstructured":"Richardson, M., Gilchrist, I.D., and Stanton Fraser, D. (2026, February 25). Validating face-api.js for the detection of emotional facial expressions via Trace. Open Sci. Framew. Available online: https:\/\/osf.io\/e8zj2\/overview."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Parra, L.C., Haufe, S., and Dmochowski, J.P. (2018). Correlated components analysis-extracting reliable dimensions in multivariate data. arXiv.","DOI":"10.51628\/001c.7125"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"pgac020","DOI":"10.1093\/pnasnexus\/pgac020","article-title":"Cognitive processing of a common stimulus synchronizes brains, hearts, and eyes","volume":"1","author":"Madsen","year":"2022","journal-title":"PNAS Nexus"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Livingstone, S.R., and Russo, F.A. (2018). The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0196391"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Wingenbach, T.S., Ashwin, C., and Brosnan, M. (2016). Validation of the Amsterdam Dynamic Facial Expression Set\u2013Bath Intensity Variations (ADFES-BIV): A set of videos expressing low, intermediate, and high intensity emotions. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0168891"},{"key":"ref_42","unstructured":"Berndt, D.J., and Clifford, J. (August, January 31). Using dynamic time warping to find patterns in time series. Proceedings of the 3rd International Conference on Knowledge Discovery and Data Mining, Seattle, WA, USA."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Sun, Y., Day, S., Gilbert, T., Maria, B., Hamilton, A.F.D.C., and Ward, J.A. (2024). Quantification and Visualisation of Interpersonal Synchrony using Wearable Sensors and Time Series Similarity Analysis. Authorea Prepr.","DOI":"10.36227\/techrxiv.173202562.29692868\/v1"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"102894","DOI":"10.1016\/j.humov.2021.102894","article-title":"Analyzing multidimensional movement interaction with generalized cross-wavelet transform","volume":"81","author":"Toiviainen","year":"2022","journal-title":"Hum. Mov. Sci."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Tripathi, S.C., and Garg, R. (2024). Consistent movement of viewers\u2019 facial keypoints while watching emotionally evocative videos. PLoS ONE, 19.","DOI":"10.1101\/2024.05.02.592052"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Pandey, R.K., Karmakar, S., Ramakrishnan, A.G., and Saha, N. (2019). Improving facial emotion recognition systems using gradient and laplacian images. arXiv.","DOI":"10.1007\/978-3-030-30642-7_24"},{"key":"ref_47","unstructured":"Robinson, J.P., Li, Y., Zhang, N., Fu, Y., and Tulyakov, S. (November, January 27). Laplace landmark localization. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Ekman, P., and Friesen, W.V. (1978). Facial Action Coding System: A Technique for the Measurement of Facial Movement, Consulting Psychologists Press.","DOI":"10.1037\/t27734-000"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/j.jneumeth.2011.06.023","article-title":"Automated facial action coding system for dynamic analysis of facial expressions in neuropsychiatric disorders","volume":"200","author":"Hamm","year":"2011","journal-title":"J. Neurosci. Methods"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Jiang, B., Valstar, M.F., and Pantic, M. (2011, January 21\u201325). Action unit detection using sparse appearance descriptors in space-time video volumes. Proceedings of the 2011 IEEE International Conference on Automatic Face & Gesture Recognition (FG), Santa Barbara, CA, USA.","DOI":"10.1109\/FG.2011.5771416"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/28\/5\/503\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T04:14:41Z","timestamp":1777608881000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/28\/5\/503"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,29]]},"references-count":50,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2026,5]]}},"alternative-id":["e28050503"],"URL":"https:\/\/doi.org\/10.3390\/e28050503","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,29]]}}}