{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T05:02:22Z","timestamp":1789534942091,"version":"build-2803163510"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T00:00:00Z","timestamp":1785542400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T00:00:00Z","timestamp":1789516800000},"content-version":"vor","delay-in-days":46,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100017700","name":"Henan Provincial Science and Technology Research Project","doi-asserted-by":"publisher","award":["252102211022"],"award-info":[{"award-number":["252102211022"]}],"id":[{"id":"10.13039\/501100017700","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Data"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Multimodal resources for emotion expression analysis in pediatric clinical populations remain limited, particularly for children with Tourette syndrome (TS). MindTS-MMD was developed as a Chinese multimodal dataset to support computational research on emotional expression and tic-related behavior in this population. The dataset contains 10,034 instance-level samples from 60 children with TS aged 6\u201312 years, collected through semi-structured emotion-elicitation tasks. Each sample includes available symbolic representations from three modalities\u2014visual, acoustic, and semantic\u2014and is linked to a corresponding annotation record. The annotations cover seven categories: anxious, calm, focused, irritable, relaxed, shy, and tense, together with child-reported and experimenter-observed valence\u2013arousal ratings and tic occurrence, anatomical location, and frequency when observable. Annotation reliability, signal quality, audiovisual synchronization, facial tracking, modality completeness, and tic\u2013emotion co-occurrence were evaluated. Unimodal and multimodal baselines are provided to illustrate the computational usability of the released representations.<\/jats:p>","DOI":"10.1038\/s41597-026-08006-4","type":"journal-article","created":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T10:45:19Z","timestamp":1785581119000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["MindTS-MMD: A Chinese Multimodal Dataset for Emotion Expression Analysis in Children with Tourette Syndrome"],"prefix":"10.1038","volume":"13","author":[{"given":"Jianping","family":"Wang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haoyu","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liping","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoxia","family":"Fang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qian","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,8,1]]},"reference":[{"key":"8006_CR1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-025-02025-8","volume":"15","author":"NR Sommer","year":"2025","unstructured":"Sommer, N. R., Carrard, V., Bourquin, C., Berney, A. & Schlegel, K. Social support and avoidance mediate positive and negative effects of emotion recognition ability on mental health in medical students. Scientific Reports 15, 16910 (2025).","journal-title":"Scientific Reports"},{"key":"8006_CR2","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.804","volume":"7","author":"MF Carbonell","year":"2021","unstructured":"Carbonell, M. F., Boman, M. & Laukka, P. Comparing supervised and unsupervised approaches to multimodal emotion recognition. PeerJ Computer Science 7, e804 (2021).","journal-title":"PeerJ Computer Science"},{"key":"8006_CR3","doi-asserted-by":"crossref","unstructured":"Nojavanasghari, B. et al. EmoReact: A multimodal approach and dataset for recognizing emotional responses in children. In Proceedings of the 18th ACM International Conference on Multimodal Interaction, 137\u2013144 (2016).","DOI":"10.1145\/2993148.2993168"},{"key":"8006_CR4","doi-asserted-by":"crossref","unstructured":"Sousa, A., Young, K., D\u2019Aquin, M., Zarrouk, M. & Holloway, J. Introducing CALMED: Multimodal annotated dataset for emotion detection in children with autism. In International Conference on Human\u2013Computer Interaction, 657\u2013677 (Springer Nature Switzerland, 2023).","DOI":"10.1007\/978-3-031-35681-0_43"},{"key":"8006_CR5","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-023-02272-2","volume":"10","author":"B Co\u015fkun","year":"2023","unstructured":"Co\u015fkun, B. et al. A physiological signal database of children with different special needs for stress recognition. Scientific Data 10, 382 (2023).","journal-title":"Scientific Data"},{"key":"8006_CR6","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/T-AFFC.2011.15","volume":"3","author":"S Koelstra","year":"2012","unstructured":"Koelstra, S. et al. DEAP: A database for emotion analysis using physiological signals. IEEE Transactions on Affective Computing 3, 18\u201331 (2012).","journal-title":"IEEE Transactions on Affective Computing"},{"key":"8006_CR7","doi-asserted-by":"publisher","first-page":"1022","DOI":"10.1109\/TPAMI.2019.2944808","volume":"43","author":"J Kossaifi","year":"2021","unstructured":"Kossaifi, J. et al. SEWA DB: A rich database for audio-visual emotion and sentiment research in the wild. IEEE Transactions on Pattern Analysis and Machine Intelligence 43, 1022\u20131040 (2021).","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"8006_CR8","doi-asserted-by":"publisher","first-page":"2627","DOI":"10.1109\/TPAMI.2022.3169734","volume":"45","author":"Z Zhu","year":"2023","unstructured":"Zhu, Z. et al. WebFace260M: A benchmark for million-scale deep face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 45, 2627\u20132644 (2023).","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"8006_CR9","doi-asserted-by":"publisher","first-page":"8089","DOI":"10.3390\/s22218089","volume":"22","author":"S Li","year":"2022","unstructured":"Li, S., Guo, L. & Liu, J. Towards East Asian facial expression recognition in the real world: A new database and deep recognition baseline. Sensors 22, 8089 (2022).","journal-title":"Sensors"},{"key":"8006_CR10","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-024-03838-4","volume":"11","author":"MH Lee","year":"2024","unstructured":"Lee, M. H. et al. EAV: EEG-audio-video dataset for emotion recognition in conversational contexts. Scientific Data 11, 1026 (2024).","journal-title":"Scientific Data"},{"key":"8006_CR11","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1109\/T-AFFC.2011.25","volume":"3","author":"M Soleymani","year":"2012","unstructured":"Soleymani, M. et al. A multimodal database for affect recognition and implicit tagging. IEEE Transactions on Affective Computing 3, 42\u201355 (2012).","journal-title":"IEEE Transactions on Affective Computing"},{"key":"8006_CR12","doi-asserted-by":"publisher","first-page":"1110","DOI":"10.1109\/TCYB.2018.2797176","volume":"49","author":"WL Zheng","year":"2019","unstructured":"Zheng, W. L. et al. EmotionMeter: A multimodal framework for recognizing human emotions. IEEE Transactions on Cybernetics 49, 1110\u20131122 (2019).","journal-title":"IEEE Transactions on Cybernetics"},{"key":"8006_CR13","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1109\/JBHI.2017.2688239","volume":"22","author":"S Katsigiannis","year":"2018","unstructured":"Katsigiannis, S. & Ramzan, N. DREAMER: A database for emotion recognition through EEG and ECG signals from wireless low-cost off-the-shelf devices. IEEE Journal of Biomedical and Health Informatics 22, 98\u2013107 (2018).","journal-title":"IEEE Journal of Biomedical and Health Informatics"},{"key":"8006_CR14","doi-asserted-by":"publisher","first-page":"12177","DOI":"10.1109\/ACCESS.2019.2891579","volume":"7","author":"T Song","year":"2019","unstructured":"Song, T. et al. MPED: A multi-modal physiological emotion database for discrete emotion recognition. IEEE Access 7, 12177\u201312191 (2019).","journal-title":"IEEE Access"},{"key":"8006_CR15","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1109\/TAFFC.2016.2625250","volume":"9","author":"R Subramanian","year":"2018","unstructured":"Subramanian, R. et al. ASCERTAIN: Emotion and personality recognition using commercial sensors. IEEE Transactions on Affective Computing 9, 147\u2013160 (2018).","journal-title":"IEEE Transactions on Affective Computing"},{"key":"8006_CR16","doi-asserted-by":"publisher","first-page":"479","DOI":"10.1109\/TAFFC.2018.2884461","volume":"12","author":"JA Miranda-Correa","year":"2021","unstructured":"Miranda-Correa, J. A. et al. AMIGOS: A dataset for affect, personality and mood research on individuals and groups. IEEE Transactions on Affective Computing 12, 479\u2013493 (2021).","journal-title":"IEEE Transactions on Affective Computing"},{"key":"8006_CR17","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1007\/s10579-008-9076-6","volume":"42","author":"C Busso","year":"2008","unstructured":"Busso, C. et al. IEMOCAP: Interactive emotional dyadic motion capture database. Language Resources and Evaluation 42, 335\u2013359 (2008).","journal-title":"Language Resources and Evaluation"},{"key":"8006_CR18","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1109\/T-AFFC.2011.20","volume":"3","author":"G McKeown","year":"2012","unstructured":"McKeown, G., Valstar, M., Cowie, R., Pantic, M. & Schr\u00f6der, M. The SEMAINE database: Annotated multimodal records of emotionally colored conversations between a person and a limited agent. IEEE Transactions on Affective Computing 3, 5\u201317 (2012).","journal-title":"IEEE Transactions on Affective Computing"},{"key":"8006_CR19","doi-asserted-by":"crossref","unstructured":"Chou, H. C. et al. NNIME: The NTHU-NTUA Chinese interactive multimodal emotion corpus. In 2017 Seventh International Conference on Affective Computing and Intelligent Interaction, 292\u2013298 (2017).","DOI":"10.1109\/ACII.2017.8273615"},{"key":"8006_CR20","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0196391","volume":"13","author":"SR Livingstone","year":"2018","unstructured":"Livingstone, S. R. & Russo, F. A. The Ryerson Audio-Visual Database of Emotional Speech and Song: A dynamic, multimodal set of facial and vocal expressions in North American English. PLoS ONE 13, e0196391 (2018).","journal-title":"PLoS ONE"},{"key":"8006_CR21","doi-asserted-by":"publisher","first-page":"300","DOI":"10.1109\/TAFFC.2016.2553038","volume":"8","author":"S Zhalehpour","year":"2017","unstructured":"Zhalehpour, S., Onder, O., Akhtar, Z. & Erdem, C. E. BAUM-1: A spontaneous audio-visual face database of affective and mental states. IEEE Transactions on Affective Computing 8, 300\u2013313 (2017).","journal-title":"IEEE Transactions on Affective Computing"},{"key":"8006_CR22","unstructured":"Jackson, P. & Haq, S. Surrey Audio-Visual Expressed Emotion Database. University of Surrey, Guildford, UK (2014)."},{"key":"8006_CR23","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-020-00630-y","volume":"7","author":"CY Park","year":"2020","unstructured":"Park, C. Y. et al. K-EmoCon, a multimodal sensor dataset for continuous emotion recognition in naturalistic conversations. Scientific Data 7, 293 (2020).","journal-title":"Scientific Data"},{"key":"8006_CR24","doi-asserted-by":"crossref","unstructured":"Saffaryazdi, N. et al. Emotion recognition in conversations using brain and physiological signals. In Proceedings of the 27th International Conference on Intelligent User Interfaces, 229\u2013242 (2022).","DOI":"10.1145\/3490099.3511148"},{"key":"8006_CR25","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.18281896","author":"J Wang","year":"2026","unstructured":"Wang, J., Wu, H., Li, L., Fang, X. & Li, Q. MindTS-MMD: A Chinese Multimodal Dataset for Emotion Expression Analysis in Children with Tourette Syndrome. Zenodo https:\/\/doi.org\/10.5281\/zenodo.18281896 (2026)."},{"key":"8006_CR26","doi-asserted-by":"crossref","unstructured":"Wang, X. et al. Enhancing multimodal emotion recognition through multi-granularity cross-modal alignment. In ICASSP 2025\u2014IEEE International Conference on Acoustics, Speech and Signal Processing, 1\u20135 (2025).","DOI":"10.1109\/ICASSP49660.2025.10889156"},{"key":"8006_CR27","doi-asserted-by":"crossref","unstructured":"Ye, J. et al. Temporal modeling matters: A novel temporal emotional modeling approach for speech emotion recognition. In ICASSP 2023\u2014IEEE International Conference on Acoustics, Speech and Signal Processing, 1\u20135 (2023).","DOI":"10.1109\/ICASSP49357.2023.10096370"},{"key":"8006_CR28","doi-asserted-by":"publisher","first-page":"1919","DOI":"10.1109\/TAFFC.2024.3389453","volume":"15","author":"J Li","year":"2024","unstructured":"Li, J., Wang, X., Liu, Y. & Zeng, Z. CFN-ESA: A cross-modal fusion network with emotion-shift awareness for dialogue emotion recognition. IEEE Transactions on Affective Computing 15, 1919\u20131933 (2024).","journal-title":"IEEE Transactions on Affective Computing"},{"key":"8006_CR29","doi-asserted-by":"publisher","first-page":"10535","DOI":"10.1007\/s00521-023-08248-y","volume":"35","author":"D Nguyen","year":"2023","unstructured":"Nguyen, D. et al. Meta-transfer learning for emotion recognition. Neural Computing and Applications 35, 10535\u201310549 (2023).","journal-title":"Neural Computing and Applications"},{"key":"8006_CR30","doi-asserted-by":"publisher","first-page":"1627","DOI":"10.1109\/TAFFC.2021.3109485","volume":"14","author":"K Feng","year":"2023","unstructured":"Feng, K. & Chaspari, T. Few-shot learning in emotion recognition of spontaneous speech using a Siamese neural network with adaptive sample pair formation. IEEE Transactions on Affective Computing 14, 1627\u20131633 (2023).","journal-title":"IEEE Transactions on Affective Computing"},{"key":"8006_CR31","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1016\/j.ymeth.2022.03.005","volume":"204","author":"A Nandi","year":"2022","unstructured":"Nandi, A. & Xhafa, F. A federated learning method for real-time emotion state classification from multimodal streaming. Methods 204, 340\u2013347 (2022).","journal-title":"Methods"},{"key":"8006_CR32","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1016\/S1474-4422(22)00303-9","volume":"22","author":"KA Johnson","year":"2023","unstructured":"Johnson, K. A. et al. Tourette syndrome: clinical features, pathophysiology, and treatment. Lancet Neurol. 22, 147\u2013158 (2023).","journal-title":"Lancet Neurol."},{"key":"8006_CR33","unstructured":"Denham, S. A., Bassett, H. H., & Wyatt, T. The socialization of emotional competence. Handbook of socialization: Theory and research, 614\u2013637 (2007)."},{"key":"8006_CR34","doi-asserted-by":"publisher","first-page":"1259","DOI":"10.1016\/j.jpsychires.2013.05.019","volume":"47","author":"CM Eddy","year":"2013","unstructured":"Eddy, C. M. & Cavanna, A. E. On being your own worst enemy: an investigation of socially inappropriate symptoms in Tourette syndrome. Journal of Psychiatric Research 47, 1259\u20131263 (2013).","journal-title":"Journal of Psychiatric Research"},{"key":"8006_CR35","doi-asserted-by":"publisher","first-page":"1161","DOI":"10.1037\/h0077714","volume":"39","author":"JA Russell","year":"1980","unstructured":"Russell, J. A. A circumplex model of affect. Journal of personality and social psychology 39, 1161 (1980).","journal-title":"Journal of personality and social psychology"},{"key":"8006_CR36","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1080\/02699931.2017.1320978","volume":"32","author":"DA Sauter","year":"2018","unstructured":"Sauter, D. A. & Fischer, A. H. Can perceivers recognise emotions from spontaneous expressions? Cognition and Emotion 32, 504\u2013515 (2018).","journal-title":"Cognition and Emotion"},{"key":"8006_CR37","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1016\/j.imavis.2019.02.004","volume":"83","author":"RA Khan","year":"2019","unstructured":"Khan, R. A., Crenn, A., Meyer, A. & Bouakaz, S. A novel database of children\u2019s spontaneous facial expressions (LIRIS-CSE). Image and Vision Computing 83, 61\u201369 (2019).","journal-title":"Image and Vision Computing"},{"key":"8006_CR38","doi-asserted-by":"publisher","first-page":"1108","DOI":"10.3390\/children8121108","volume":"8","author":"K Barisnikov","year":"2021","unstructured":"Barisnikov, K., Thomasson, M., Stutzmann, J. & Lejeune, F. Sensitivity to emotion intensity and recognition of emotion expression in neurotypical children. Children 8, 1108 (2021).","journal-title":"Children"},{"key":"8006_CR39","unstructured":"Poyiadzi, R., Shen, J., Petridis, S., Wang, Y. & Pantic, M. Domain generalisation for apparent emotional facial expression recognition across age-groups. arXiv preprint arXiv:2110.09168 (2021)."},{"key":"8006_CR40","doi-asserted-by":"publisher","first-page":"418","DOI":"10.3390\/biomimetics10070418","volume":"10","author":"Y Wu","year":"2025","unstructured":"Wu, Y., Mi, Q. & Gao, T. A comprehensive review of multimodal emotion recognition: Techniques, challenges, and future directions. Biomimetics 10, 418 (2025).","journal-title":"Biomimetics"},{"key":"8006_CR41","doi-asserted-by":"publisher","first-page":"8071","DOI":"10.3390\/app14178071","volume":"14","author":"G Udahemuka","year":"2024","unstructured":"Udahemuka, G., Djouani, K. & Kurien, A. M. Multimodal Emotion Recognition using visual, vocal and Physiological Signals: a review. Applied Sciences 14, 8071 (2024).","journal-title":"Applied Sciences"},{"key":"8006_CR42","doi-asserted-by":"publisher","first-page":"519","DOI":"10.1037\/a0019008","volume":"10","author":"CE Durbin","year":"2010","unstructured":"Durbin, C. E. Validity of young children\u2019s self-reports of their emotion in response to structured laboratory tasks. Emotion 10, 519 (2010).","journal-title":"Emotion"},{"key":"8006_CR43","doi-asserted-by":"publisher","first-page":"790","DOI":"10.1111\/jcpp.13375","volume":"62","author":"J Hagstr\u00f8m","year":"2021","unstructured":"Hagstr\u00f8m, J. et al. An observational study of emotion regulation in children with Tourette syndrome. Journal of Child Psychology and Psychiatry 62, 790\u2013797 (2021).","journal-title":"Journal of Child Psychology and Psychiatry"},{"key":"8006_CR44","doi-asserted-by":"publisher","first-page":"1136","DOI":"10.1002\/mdc3.14158","volume":"11","author":"R Schappert","year":"2024","unstructured":"Schappert, R. et al. Automated Video\u2010Based Approach for the Diagnosis of Tourette Syndrome. Movement Disorders Clinical Practice 11, 1136\u20131140 (2024).","journal-title":"Movement Disorders Clinical Practice"},{"key":"8006_CR45","doi-asserted-by":"publisher","first-page":"100549","DOI":"10.1016\/j.chbr.2024.100549","volume":"17","author":"E Chitti","year":"2025","unstructured":"Chitti, E. et al. MiEmo: A multi-modal platform on emotion recognition for children with autism spectrum condition. Computers in Human Behavior Reports 17, 100549 (2025).","journal-title":"Computers in Human Behavior Reports"},{"key":"8006_CR46","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1007\/s00426-024-02068-y","volume":"89","author":"T Angkasirisan","year":"2025","unstructured":"Angkasirisan, T. Naturalistic multimodal emotion data with deep learning can advance the theoretical understanding of emotion. Psychological Research 89, 36 (2025).","journal-title":"Psychological Research"},{"key":"8006_CR47","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-024-03676-4","volume":"11","author":"P Yang","year":"2024","unstructured":"Yang, P. et al. A multimodal dataset for mixed emotion recognition. Scientific Data 11, 847 (2024).","journal-title":"Scientific Data"}],"container-title":["Scientific Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41597-026-08006-4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41597-026-08006-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41597-026-08006-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T04:09:07Z","timestamp":1789531747000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41597-026-08006-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,1]]},"references-count":47,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["8006"],"URL":"https:\/\/doi.org\/10.1038\/s41597-026-08006-4","relation":{"references":[{"id-type":"doi","id":"10.5281\/zenodo.18281896","asserted-by":"subject"}]},"ISSN":["2052-4463"],"issn-type":[{"value":"2052-4463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,1]]},"assertion":[{"value":"27 January 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 July 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 August 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Ethics"}}],"article-number":"1318"}}