{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T02:45:08Z","timestamp":1785725108731,"version":"3.56.0"},"reference-count":55,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T00:00:00Z","timestamp":1785542400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004826","name":"Beijing Natural Science Foundation","doi-asserted-by":"publisher","award":["L247011"],"award-info":[{"award-number":["L247011"]}],"id":[{"id":"10.13039\/501100004826","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Intell."],"abstract":"<jats:p>Emotion recognition is essential for social adaptation and mental health. However, existing measures still rely on limited stimulus materials or simplified task formats, which restricts ecological validity. The present study aimed to construct a localized multimodal emotion expression database in the Chinese context and to develop a multimodal emotion recognition ability test integrating emotion category and intensity recognition. In Study 1, a multimodal emotion expression database was established through actor performances, expert evaluation, and participant validation. The final database contained 2160 videos representing six basic emotions, five levels of emotional intensity, and two expression modes (vocal and non-vocal). In Study 2, 90 videos were selected under three recognition conditions (vocal-expression, muted vocal-expression, and muted non-vocal-expression). An integrated scoring approach combining emotion category and intensity was used to develop the test. A total of 236 valid participants completed the test. The results indicated that, after 61 video clips were retained, the test demonstrated good reliability and item discrimination. Evidence for criterion-related validity and construct validity was also obtained. Overall, the findings suggest that the present measure is a reliable and valid tool for assessing multimodal emotion recognition ability in the Chinese cultural context and offers the first empirical evidence that integrating category and intensity recognition can better capture the multidimensional nature of this ability.<\/jats:p>","DOI":"10.3390\/jintelligence14080169","type":"journal-article","created":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T01:43:27Z","timestamp":1785721407000},"page":"169","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Development and Validation of a Multimodal Emotion Recognition Ability Test Based on the Chinese Cultural Context"],"prefix":"10.3390","volume":"14","author":[{"given":"Xiaoming","family":"Song","sequence":"first","affiliation":[{"name":"Faculty of Psychology, Beijing Normal University, 19 Xinjiekouwai Street, Haidian District, Beijing 100875, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinmei","family":"Leng","sequence":"additional","affiliation":[{"name":"Faculty of Psychology, Beijing Normal University, 19 Xinjiekouwai Street, Haidian District, Beijing 100875, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xia","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-7259-380X","authenticated-orcid":false,"given":"Sheng","family":"Yang","sequence":"additional","affiliation":[{"name":"Li Auto Inc., 11 Wenliang Street, Shunyi District, Beijing 101399, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fang","family":"Luo","sequence":"additional","affiliation":[{"name":"Faculty of Psychology, Beijing Normal University, 19 Xinjiekouwai Street, Haidian District, Beijing 100875, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,8,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.paid.2014.01.051","article-title":"Development of the situational test of emotional understanding-brief (STEU-B) using item response theory","volume":"65","author":"Allen","year":"2014","journal-title":"Personality and Individual Differences"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"691","DOI":"10.1037\/a0017088","article-title":"Emotion recognition from expressions in face, voice, and body: The Multimodal Emotion Recognition Test (MERT)","volume":"9","author":"Grandjean","year":"2009","journal-title":"Emotion"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1037\/a0025827","article-title":"Introducing the Geneva multimodal expression corpus for experimental research on emotion perception","volume":"12","author":"Mortillaro","year":"2012","journal-title":"Emotion"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Berrios-Martos, M.-P., and Palomera, R. (2025). Development of a Video-Test of Emotional Intelligence for Teachers (ViTIED). Journal of Intelligence, 13, (1).","DOI":"10.3390\/jintelligence13010003"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"8253","DOI":"10.1038\/s41598-022-12184-7","article-title":"Correlated expression of the body, face, and voice during character portrayal in actors","volume":"12","author":"Berry","year":"2022","journal-title":"Scientific Reports"},{"key":"ref_6","unstructured":"Bowers, D., Blonder, L., and Heilman, K. (1998). Florida affect battery, Center for Neuropsychological Studies, Department of Neurology Florida."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/j.cub.2023.12.001","article-title":"Cultural facial expressions dynamically convey emotion category and intensity information","volume":"34","author":"Chen","year":"2024","journal-title":"Current Biology"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"104166","DOI":"10.1016\/j.cognition.2019.104166","article-title":"Emotion recognition ability: Evidence for a supramodal factor and its links to social cognition","volume":"197","author":"Connolly","year":"2020","journal-title":"Cognition"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Conson, M., Ponari, M., Monteforte, E., Ricciato, G., Sar\u00e0, M., Grossi, D., and Trojano, L. (2013). Explicit recognition of emotional facial expressions is shaped by expertise: Evidence from professional actors. Frontiers in Psychology, 4.","DOI":"10.3389\/fpsyg.2013.00382"},{"key":"ref_10","first-page":"E7900","article-title":"Self-report captures 27 distinct categories of emotion bridged by continuous gradients","volume":"114","author":"Cowen","year":"2017","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1097\/NMD.0b013e3181923f82","article-title":"Facial expression recognition in depressed subjects: The impact of intensity level and arousal dimension","volume":"197","author":"Csukly","year":"2009","journal-title":"Journal of Nervous and Mental Disease"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1080\/026999300378824","article-title":"The perception of emotions by ear and by eye","volume":"14","author":"Vroomen","year":"2000","journal-title":"Cognition & Emotion"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"320","DOI":"10.1108\/JOSM-11-2014-0307","article-title":"I know how you feel, but it does not always help: Integrating emotion recognition, agreeableness, and cognitive ability in a compensatory model of service performance","volume":"27","author":"Doucet","year":"2016","journal-title":"Journal of Service Management"},{"key":"ref_14","unstructured":"Ekman, P. (2003). Emotions revealed: Recognizing faces and feelings to improve communication and emotional life, Henry Holt and Company."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1037\/0033-2909.128.2.203","article-title":"On the universality and cultural specificity of emotion recognition: A meta-analysis","volume":"128","author":"Elfenbein","year":"2002","journal-title":"Psychological Bulletin"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"8804","DOI":"10.1038\/s41598-018-27102-z","article-title":"Pervasive influence of idiosyncratic associative biases during facial emotion recognition","volume":"8","author":"Wyart","year":"2018","journal-title":"Scientific Reports"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Favelle, S., Karakale, \u00d6., and Menzies, L. (2026). Motion and intensity shape accuracy and confusion patterns in emotion recognition. Cognition and Emotion, 1\u201311.","DOI":"10.1080\/02699931.2026.2693720"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1186\/s40479-015-0031-z","article-title":"Emotion recognition in borderline personality disorder: Effects of emotional information on negative bias","volume":"2","author":"Fenske","year":"2015","journal-title":"Borderline Personality Disorder and Emotion Dysregulation"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1002\/aur.1432","article-title":"Prosody recognition in adults with high-functioning autism spectrum disorders: From psychoacoustics to cognition","volume":"8","author":"Globerson","year":"2015","journal-title":"Autism Research"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"115","DOI":"10.2190\/IC.29.2.c","article-title":"Actors are skilled in theory of mind but not empathy","volume":"29","author":"Goldstein","year":"2009","journal-title":"Imagination, Cognition and Personality"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Gu, S., Wang, F., Cao, C., Wu, E., Tang, Y.-Y., and Huang, J. H. (2019). An integrative way for studying neural basis of basic emotions with fMRI. Frontiers in Neuroscience, 13.","DOI":"10.3389\/fnins.2019.00628"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1007\/s10803-010-1073-0","article-title":"The construction and validation of an abridged version of the autism-spectrum quotient (AQ-Short)","volume":"41","author":"Hoekstra","year":"2011","journal-title":"Journal of Autism and Developmental Disorders"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Israelashvili, J., and Fischer, A. (2023). Recognition of emotion from verbal and nonverbal expressions and its relation to effective communication: A preliminary evidence of a positive link. Journal of Intelligence, 11, (1).","DOI":"10.3390\/jintelligence11010006"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1038\/s41598-017-00502-3","article-title":"Neural basis of negativity bias in the perception of ambiguous facial expression","volume":"7","author":"Ito","year":"2017","journal-title":"Scientific Reports"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1037\/0021-843X.115.4.705","article-title":"Is this happiness I see? Biases in the identification of emotional facial expressions in depression and social phobia","volume":"115","author":"Joormann","year":"2006","journal-title":"Journal of Abnormal Psychology"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1007\/s10919-021-00375-1","article-title":"Superior communication of positive emotions through nonverbal vocalisations compared to speech prosody","volume":"45","author":"Boateng","year":"2021","journal-title":"Journal of Nonverbal Behavior"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1037\/0033-2909.122.3.250","article-title":"Embarrassment: Its distinct form and appeasement functions","volume":"122","author":"Keltner","year":"1997","journal-title":"Psychological Bulletin"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"108767","DOI":"10.1016\/j.biopsycho.2024.108767","article-title":"The impact of culture on emotion suppression: Insights from an electrophysiological study of emotion regulation in Japan","volume":"187","author":"Kraus","year":"2024","journal-title":"Biological Psychology"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"LaPalme, M. L., Barsade, S. G., Brackett, M. A., and Floman, J. L. (2023). The Meso-Expression Test (MET): A novel assessment of emotion perception. Journal of Intelligence, 11, (7).","DOI":"10.3390\/jintelligence11070145"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"103422","DOI":"10.1016\/j.actpsy.2021.103422","article-title":"Investigating individual differences in emotion recognition ability using the ERAM test","volume":"220","author":"Laukka","year":"2021","journal-title":"Acta Psychologica"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1207\/s15327752jpa6101_10","article-title":"The interaction anxiousness scale: Construct and criterion-related validity","volume":"61","author":"Leary","year":"1993","journal-title":"Journal of Personality Assessment"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1037\/xge0000160","article-title":"Functional architecture of visual emotion recognition ability: A latent variable approach","volume":"145","author":"Lewis","year":"2016","journal-title":"Journal of Experimental Psychology: General"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"117","DOI":"10.2147\/NDT.S393264","article-title":"The neural correlates of the recognition of emotional intensity deficits in major depression: An ERP study","volume":"19","author":"Li","year":"2023","journal-title":"Neuropsychiatric Disease and Treatment"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"026012","DOI":"10.1088\/1741-2552\/ac5c8d","article-title":"Identifying similarities and differences in emotion recognition with EEG and eye movements among Chinese, German, and French people","volume":"19","author":"Liu","year":"2022","journal-title":"Journal of Neural Engineering"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1002\/eat.23854","article-title":"Association of emotion recognition ability and interpersonal emotional competence in anorexia nervosa: A study with a multimodal dynamic task","volume":"56","author":"Martini","year":"2023","journal-title":"International Journal of Eating Disorders"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Masoomi, M., Saeidi, M., Cedeno, R., Shahrivar, Z., Tehrani-Doost, M., Ramirez, Z., Gandi, D. A., and Gunturu, S. (2024). Emotion recognition deficits in children and adolescents with autism spectrum disorder: A comprehensive meta-analysis of accuracy and response time. Frontiers in Child and Adolescent Psychiatry, 3.","DOI":"10.3389\/frcha.2024.1520854"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1177\/1754073916639667","article-title":"The ability model of emotional intelligence: Principles and updates","volume":"8","author":"Mayer","year":"2016","journal-title":"Emotion Review"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1704","DOI":"10.1037\/emo0001525","article-title":"The role of emotion recognition in empathy","volume":"25","author":"Monroy","year":"2025","journal-title":"Emotion"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Mortillaro, M., and Schlegel, K. (2023). Embracing the emotion in emotional intelligence measurement: Insights from emotion theory and research. Journal of Intelligence, 11, (11).","DOI":"10.3390\/jintelligence11110210"},{"key":"ref_40","first-page":"100253","article-title":"Mobile facial affect recognition and real-time social experiences in serious mental illness","volume":"29","author":"Parrish","year":"2022","journal-title":"Schizophrenia Research: Cognition"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1111\/j.2044-8309.1990.tb00885.x","article-title":"Age and social competence in preschoolers\u2019 decoding of facial expression","volume":"29","author":"Philippot","year":"1990","journal-title":"British Journal of Social Psychology"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1037\/h0077714","article-title":"A circumplex model of affect","volume":"39","author":"Russell","year":"1980","journal-title":"Journal of Personality and Social Psychology"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1111\/jpr.12529","article-title":"The influence of emotional facial expression intensity on decoding accuracy: High intensity does not yield high accuracy","volume":"66","author":"Shimizu","year":"2024","journal-title":"Japanese Psychological Research"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"16910","DOI":"10.1038\/s41598-025-02025-8","article-title":"Social support and avoidance mediate positive and negative effects of emotion recognition ability on mental health in medical students","volume":"15","author":"Sommer","year":"2025","journal-title":"Scientific Reports"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1080\/00224545.2025.2545942","article-title":"Navigating social waters: Exploring the impacts of trait cognitive emotion regulation and emotion recognition ability in naturalistic social situations","volume":"166","author":"Sommer","year":"2025","journal-title":"Journal of Social Psychology"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1037\/0894-4105.18.2.212","article-title":"Recognition accuracy and response bias to happy and sad facial expressions in patients with major depression","volume":"18","author":"Surguladze","year":"2004","journal-title":"Neuropsychology"},{"key":"ref_47","first-page":"34","article-title":"The revised Toronto alexithymia scale: Some reliability, validity, and normative data","volume":"57","author":"Taylor","year":"1992","journal-title":"Psychotherapy and Psychosomatics"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1007\/s12369-019-00524-z","article-title":"Multimodal integration of emotional signals from voice, body, and context: Effects of (In)Congruence on emotion recognition and attitudes towards robots","volume":"11","author":"Tsiourti","year":"2019","journal-title":"International Journal of Social Robotics"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Gellman, M. D., and Turner, J. R. (2013). Beck Depression Inventory (BDI). Encyclopedia of behavioral medicine, Springer.","DOI":"10.1007\/978-1-4419-1005-9"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1017\/S1355617714000253","article-title":"Multimodal emotion integration in bipolar disorder: An investigation of involuntary cross-modal influences between facial and prosodic channels","volume":"20","author":"Rossell","year":"2014","journal-title":"Journal of the International Neuropsychological Society"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1369","DOI":"10.1007\/s12187-018-9590-z","article-title":"Characteristics of emotion recognition ability among primary school children: Relationships with peer status and friendship quality","volume":"12","author":"Wang","year":"2019","journal-title":"Child Indicators Research"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1037\/0033-2909.98.2.219","article-title":"Toward a consensual structure of mood","volume":"98","author":"Watson","year":"1985","journal-title":"Psychological Bulletin"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Wu, Y., Mi, Q., and Gao, T. (2025). A comprehensive review of multimodal emotion recognition: Techniques, challenges, and future directions. Biomimetics, 10, (7).","DOI":"10.3390\/biomimetics10070418"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"5471","DOI":"10.1093\/cercor\/bhaa129","article-title":"Neural correlates of evidence and urgency during human perceptual decision-making in dynamically changing conditions","volume":"30","author":"Yau","year":"2020","journal-title":"Cerebral Cortex"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Yu, R. L., Poon, S. F., Yi, H. J., Chien, C. Y., and Hsu, P. H. (2022). The development of a multi-modality emotion recognition test presented via a mobile application. Brain Sciences, 12, (2).","DOI":"10.3390\/brainsci12020251"}],"container-title":["Journal of Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3200\/14\/8\/169\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T02:06:43Z","timestamp":1785722803000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3200\/14\/8\/169"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,1]]},"references-count":55,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2026,8]]}},"alternative-id":["jintelligence14080169"],"URL":"https:\/\/doi.org\/10.3390\/jintelligence14080169","relation":{},"ISSN":["2079-3200"],"issn-type":[{"value":"2079-3200","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,1]]}}}