{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,13]],"date-time":"2026-11-13T03:13:28Z","timestamp":1794539608210,"version":"4.9.1"},"reference-count":70,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T00:00:00Z","timestamp":1788393600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T00:00:00Z","timestamp":1788393600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100008375","name":"University of Basel","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100008375","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Advances in generative artificial intelligence (GenAI) have prompted interest in its application in sensitive fields, including mental health. Yet the validity of its nonverbal social-cognitive abilities remains unclear. This study addresses two issues that probe GenAI\u2019s social intelligence: its capacity to interpret nonverbal channels (bodily gestures and vocal tone) with accuracy comparable to humans, and whether accuracy of emotion recognition is different by emotional valence. Emotion recognition accuracy of three Gemini GenAI models (Pro 1.5, Pro 2 (Experimental) and Flash 2) were evaluated using the EU-Emotion Stimulus Set of bodily gestures and vocal tone depicting basic emotions. Model accuracy was compared to validated human benchmarks. Advanced GenAI models achieved near-human accuracy in recognizing emotions from vocal tone. However, their performance was significantly lower than that of humans in interpreting bodily gestures. GenAI models recognized positive emotions more accurately than negative ones. This bias was significant across all models for bodily gestures and in the advanced models for vocal tone. GenAI models exhibit a non-humanlike social-cognitive profile, excelling with positive emotions but struggling with the negative content. This finding carries profound clinical and theoretical relevance, highlighting the risks of integrating GenAI into sensitive fields and underscoring the need for continued validation.<\/jats:p>","DOI":"10.1038\/s41598-026-58013-z","type":"journal-article","created":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T10:02:58Z","timestamp":1788429778000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Generative AI emotion recognition from bodily gestures and vocal tone reveals modality-specific performance and positivity bias"],"prefix":"10.1038","volume":"16","author":[{"given":"David","family":"Piterman","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hadar","family":"Dery","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kfir","family":"Bar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gunther","family":"Meinlschmidt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alon","family":"Geller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dorit Hadar","family":"Shoval","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zohar","family":"Elyoseph","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elad","family":"Refoua","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,9,3]]},"reference":[{"key":"58013_CR1","first-page":"1","volume":"6","author":"R Ejjami","year":"2024","unstructured":"Ejjami, R. AI-driven justice: Evaluating the impact of artificial intelligence on legal systems. Int. J. Multidiscip Res. 6, 1\u201329 (2024).","journal-title":"Int. J. Multidiscip Res."},{"key":"58013_CR2","doi-asserted-by":"publisher","first-page":"e0000198","DOI":"10.1371\/journal.pdig.0000198","volume":"2","author":"TH Kung","year":"2023","unstructured":"Kung, T. H. et al. Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digit. Health. 2, e0000198. https:\/\/doi.org\/10.1371\/journal.pdig.0000198 (2023).","journal-title":"PLOS Digit. Health"},{"key":"58013_CR3","doi-asserted-by":"publisher","first-page":"887","DOI":"10.3390\/healthcare11060887","volume":"11","author":"M Sallam","year":"2023","unstructured":"Sallam, M. ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. Healthcare 11, 887. https:\/\/doi.org\/10.3390\/healthcare11060887 (2023).","journal-title":"Healthcare"},{"key":"58013_CR4","doi-asserted-by":"crossref","unstructured":"Chatterji, A. et al. How People Use ChatGPT (No. W34255; p. w34255). (2025).","DOI":"10.3386\/w34255"},{"key":"58013_CR5","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1001\/jamainternmed.2023.1838","volume":"183","author":"JW Ayers","year":"2023","unstructured":"Ayers, J. W. et al. Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum. JAMA Intern. Med. 183, 589\u2013596. https:\/\/doi.org\/10.1001\/jamainternmed.2023.1838 (2023).","journal-title":"JAMA Intern. Med."},{"key":"58013_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/20552076231183542","volume":"9","author":"S Coghlan","year":"2023","unstructured":"Coghlan, S. et al. To chat or bot to chat: Ethical issues with using chatbots in mental health. Digit. Health. 9, 1\u201310. https:\/\/doi.org\/10.1177\/20552076231183542 (2023).","journal-title":"Digit. Health"},{"key":"58013_CR7","unstructured":"Zao-Sanders, M. How people are really using gen AI in 2025. Harvard Business Rev., 9 . (2025)."},{"key":"58013_CR8","doi-asserted-by":"publisher","first-page":"e54781","DOI":"10.2196\/54781","volume":"11","author":"Y Haber","year":"2024","unstructured":"Haber, Y., Levkovich, I., Hadar-Shoval, D. & Elyoseph, Z. The artificial third: A broad view of the effects of introducing generative artificial intelligence on psychotherapy. JMIR Ment Health. 11, e54781. https:\/\/doi.org\/10.2196\/54781 (2024).","journal-title":"JMIR Ment Health"},{"key":"58013_CR9","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1080\/15265161.2023.2250297","volume":"23","author":"A Tal","year":"2023","unstructured":"Tal, A. et al. The Artificial Third: Utilizing ChatGPT in Mental Health. Am. J. Bioeth. 23, 74\u201377. https:\/\/doi.org\/10.1080\/15265161.2023.2250297 (2023).","journal-title":"Am. J. Bioeth."},{"key":"58013_CR10","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1146\/annurev-psych-120710-100449","volume":"63","author":"CD Frith","year":"2012","unstructured":"Frith, C. D. & Frith, U. Mechanisms of social cognition. Annu. Rev. Psychol. 63, 287\u2013313. https:\/\/doi.org\/10.1146\/annurev-psych-120710-100449 (2012).","journal-title":"Annu. Rev. Psychol."},{"key":"58013_CR11","doi-asserted-by":"publisher","unstructured":"Fonagy, P., Gergely, G. & Jurist, E. Affect regulation, mentalization, and the development of the self (Routledge, 2018). https:\/\/doi.org\/10.4324\/9780429471643","DOI":"10.4324\/9780429471643"},{"key":"58013_CR12","doi-asserted-by":"publisher","first-page":"655","DOI":"10.1097\/nmd.0b013e3181b3b20f","volume":"197","author":"G Baslet","year":"2009","unstructured":"Baslet, G., Termini, J. & Herbener, E. Deficits in emotional awareness in schizophrenia and their relationship to everyday functioning. J. Nerv. Ment Dis. 197, 655\u2013660. https:\/\/doi.org\/10.1097\/nmd.0b013e3181b3b20f (2009).","journal-title":"J. Nerv. Ment Dis."},{"key":"58013_CR13","doi-asserted-by":"publisher","first-page":"366","DOI":"10.1037\/per0000117","volume":"6","author":"P Luyten","year":"2015","unstructured":"Luyten, P. & Fonagy, P. The neurobiology of mentalizing. Personal Disord. 6, 366 (2015).","journal-title":"Personal Disord"},{"key":"58013_CR14","doi-asserted-by":"publisher","first-page":"737","DOI":"10.1111\/j.1467-9507.2007.00457.x","volume":"17","author":"C Sharp","year":"2008","unstructured":"Sharp, C. & Fonagy, P. The parent\u2019s capacity to treat the child as a psychological agent: Constructs, measures and implications for developmental psychopathology. Soc. Dev. 17, 737\u2013754. https:\/\/doi.org\/10.1111\/j.1467-9507.2007.00457.x (2008).","journal-title":"Soc. Dev."},{"key":"58013_CR15","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1002\/j.2051-5545.2010.tb00255.x","volume":"9","author":"A Bateman","year":"2010","unstructured":"Bateman, A. & Fonagy, P. Mentalization based treatment for borderline personality disorder. World Psychiatry. 9, 11. https:\/\/doi.org\/10.1002\/j.2051-5545.2010.tb00255.x (2010).","journal-title":"World Psychiatry"},{"key":"58013_CR16","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1111\/papt.12194","volume":"92","author":"KS Vogt","year":"2019","unstructured":"Vogt, K. S. & Norman, P. Is mentalization-based therapy effective in treating the symptoms of borderline personality disorder? A systematic review. Psychol. Psychother. 92, 441\u2013465. https:\/\/doi.org\/10.1111\/papt.12194 (2019).","journal-title":"Psychol. Psychother."},{"key":"58013_CR17","doi-asserted-by":"publisher","first-page":"1127","DOI":"10.1176\/appi.ajp.2008.07081360","volume":"165","author":"LW Choi-Kain","year":"2008","unstructured":"Choi-Kain, L. W., Gunderson, J. G. & Mentalization Ontogeny, assessment, and application in the treatment of borderline personality disorder. Am. J. Psychiatry. 165, 1127\u20131135 (2008).","journal-title":"Am. J. Psychiatry"},{"key":"58013_CR18","doi-asserted-by":"publisher","first-page":"1355","DOI":"10.1017\/S0954579409990198","volume":"21","author":"P Fonagy","year":"2009","unstructured":"Fonagy, P. & Luyten, P. A developmental, mentalization-based approach to the understanding and treatment of borderline personality disorder. Dev. Psychopathol. 21, 1355\u20131381. https:\/\/doi.org\/10.1017\/S0954579409990198 (2009).","journal-title":"Dev. Psychopathol."},{"key":"58013_CR19","doi-asserted-by":"publisher","first-page":"e70610","DOI":"10.2196\/70610","volume":"12","author":"X Wang","year":"2025","unstructured":"Wang, X., Zhou, Y. & Zhou, G. The Application and Ethical Implication of Generative AI in Mental Health: Systematic Review. JMIR Ment Health. 12, e70610. https:\/\/doi.org\/10.2196\/70610 (2025).","journal-title":"JMIR Ment Health"},{"key":"58013_CR20","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1038\/s44184-024-00067-w","volume":"3","author":"E Sezgin","year":"2024","unstructured":"Sezgin, E. & McKay, I. Behavioral health and generative AI: a perspective on future of therapies and patient care. npj Ment Health Res. 3, 25 (2024).","journal-title":"npj Ment Health Res."},{"key":"58013_CR21","doi-asserted-by":"publisher","first-page":"1199058","DOI":"10.3389\/fpsyg.2023.1199058","volume":"14","author":"Z Elyoseph","year":"2023","unstructured":"Elyoseph, Z., Hadar-Shoval, D., Asraf, K. & Lvovsky, M. ChatGPT outperforms humans in emotional awareness evaluations. Front. Psychol. 14, 1199058. https:\/\/doi.org\/10.3389\/fpsyg.2023.1199058 (2023).","journal-title":"Front. Psychol."},{"key":"58013_CR22","doi-asserted-by":"publisher","first-page":"1234397","DOI":"10.3389\/fpsyt.2023.1234397","volume":"14","author":"D Hadar-Shoval","year":"2023","unstructured":"Hadar-Shoval, D., Elyoseph, Z. & Lvovsky, M. The plasticity of ChatGPT\u2019s mentalizing abilities: personalization for personality structures. Front. Psychiatry. 14, 1234397. https:\/\/doi.org\/10.3389\/fpsyt.2023.1234397 (2023).","journal-title":"Front. Psychiatry"},{"key":"58013_CR23","doi-asserted-by":"publisher","first-page":"e54369","DOI":"10.2196\/54369","volume":"11","author":"Z Elyoseph","year":"2024","unstructured":"Elyoseph, Z. et al. Capacity of Generative AI to interpret human emotions from visual and textual data: Pilot evaluation study. JMIR Ment Health. 11, e54369. https:\/\/doi.org\/10.2196\/54369 (2024).","journal-title":"JMIR Ment Health"},{"key":"58013_CR24","doi-asserted-by":"crossref","unstructured":"Refoua, E. et al. D. Evaluation of cross-ethnic emotion recognition capabilities in multimodal large language models using the reading the mind in the eyes test. Scientific Reports. (2026).","DOI":"10.1038\/s41598-026-39292-y"},{"key":"58013_CR25","doi-asserted-by":"publisher","unstructured":"Strachan, J. W. et al. GPT-4o reads the mind in the eyes. arXiv preprint arXiv:2410.22309 (2024). https:\/\/doi.org\/10.48550\/arXiv.2410.22309","DOI":"10.48550\/arXiv.2410.22309"},{"key":"58013_CR26","doi-asserted-by":"publisher","unstructured":"Kosinski, M. Evaluating large language models in theory of mind tasks. Proc. Natl. Acad. Sci. USA. 121 (e2405460121). https:\/\/doi.org\/10.1073\/pnas.2405460121 (2024).","DOI":"10.1073\/pnas.2405460121"},{"key":"58013_CR27","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2310.20320","author":"M van Duijn","year":"2023","unstructured":"van Duijn, M. et al. (ed, J.) Theory of mind in large language models: Examining performance of 11 state-of-the-art models vs. children aged 7\u201310 on advanced tests. arXiv preprint arXiv:2310 20320 https:\/\/doi.org\/10.48550\/arXiv.2310.20320 (2023).","journal-title":"arXiv preprint arXiv:2310 20320"},{"key":"58013_CR28","doi-asserted-by":"publisher","first-page":"100156","DOI":"10.1016\/j.chbah.2025.100156","volume":"4","author":"RS Kramer","year":"2025","unstructured":"Kramer, R. S. Comparing ChatGPT with human judgements of social traits from face photographs. Comput. Hum. Behav. Artif. Hum. 4, 100156. https:\/\/doi.org\/10.1016\/j.chbah.2025.100156 (2025).","journal-title":"Comput. Hum. Behav. Artif. Hum."},{"key":"58013_CR29","doi-asserted-by":"publisher","first-page":"615","DOI":"10.1038\/s41746-025-01985-5","volume":"8","author":"BW Nelson","year":"2025","unstructured":"Nelson, B. W. et al. Evaluating the performance of general purpose large language models in identifying human facial emotions. npj Digit. Med. 8, 615 (2025).","journal-title":"npj Digit. Med."},{"key":"58013_CR30","doi-asserted-by":"publisher","first-page":"e0324127","DOI":"10.1371\/journal.pone.0324127","volume":"20","author":"H Alrasheed","year":"2025","unstructured":"Alrasheed, H., Alghihab, A., Pentland, A. & Alghowinem, S. Evaluating the capacity of large language models to interpret emotions in images. PLOS ONE. 20, e0324127 (2025).","journal-title":"PLOS ONE"},{"key":"58013_CR31","doi-asserted-by":"publisher","unstructured":"Refoua, E. et al. The Next Frontier in Mindreading? Assessing Generative Artificial Intelligence (GAI)\u2019s Social-Cognitive Capabilities using Dynamic Audiovisual Stimuli. Comput. Hum. Behav. Rep. 100702 https:\/\/doi.org\/10.1016\/j.chbr.2025.100702 (2025).","DOI":"10.1016\/j.chbr.2025.100702"},{"key":"58013_CR32","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2305.14763","author":"N Shapira","year":"2023","unstructured":"Shapira, N. et al. Clever Hans or neural theory of mind? Stress testing social reasoning in large language models. arXiv preprint arXiv:2305 14763. https:\/\/doi.org\/10.48550\/arXiv.2305.14763 (2023).","journal-title":"arXiv preprint arXiv:2305 14763"},{"key":"58013_CR33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/wps.21148","volume":"23","author":"J Torous","year":"2024","unstructured":"Torous, J. & Blease, C. Generative artificial intelligence in mental health care: potential benefits and current challenges. World Psychiatry. 23, 1. https:\/\/doi.org\/10.1002\/wps.21148 (2024).","journal-title":"World Psychiatry"},{"key":"58013_CR34","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1002\/jcpy.1393","volume":"34","author":"J De Freitas","year":"2024","unstructured":"De Freitas, J., U\u011furalp, A. K., O\u011fuz-U\u011furalp, Z. & Puntoni, S. Chatbots and mental health: Insights into the safety of generative AI. J. Consum. Psychol. 34, 481\u2013491 (2024).","journal-title":"J. Consum. Psychol."},{"key":"58013_CR35","doi-asserted-by":"publisher","first-page":"1378904","DOI":"10.3389\/fpsyg.2024.1378904","volume":"15","author":"A Babu","year":"2024","unstructured":"Babu, A. & Joseph, A. P. Artificial intelligence in mental healthcare: transformative potential vs. the necessity of human interaction. Front. Psychol. 15, 1378904 (2024).","journal-title":"Front. Psychol."},{"key":"58013_CR36","doi-asserted-by":"publisher","first-page":"1522915","DOI":"10.3389\/fpsyt.2024.1522915","volume":"15","author":"R Salil","year":"2025","unstructured":"Salil, R., Jose, B., Cherian, J., Vikraman, N. & R, S. P. & Digitalized therapy and the unresolved gap between artificial and human empathy. Front. Psychiatry. 15, 1522915 (2025).","journal-title":"Front. Psychiatry"},{"key":"58013_CR37","first-page":"e56472","volume":"16","author":"F Zafar","year":"2024","unstructured":"Zafar, F. et al. The role of artificial intelligence in identifying depression and anxiety: a comprehensive literature review. Cureus 16, e56472 (2024).","journal-title":"Cureus"},{"key":"58013_CR38","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1016\/S0167-6393(02)00084-5","volume":"40","author":"KR Scherer","year":"2003","unstructured":"Scherer, K. R. Vocal communication of emotion: A review of research paradigms. Speech Commun. 40, 227\u2013256 (2003).","journal-title":"Speech Commun."},{"key":"58013_CR39","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1002\/wcs.1335","volume":"6","author":"B De Gelder","year":"2015","unstructured":"De Gelder, B., de Borst, A. W. & Watson, R. The perception of emotion in body expressions. Wiley Interdiscip Rev. Cogn. Sci. 6, 149\u2013158 (2015).","journal-title":"Wiley Interdiscip Rev. Cogn. Sci."},{"key":"58013_CR40","first-page":"100058","volume-title":"EmoPulse: unveiling real-time mental health through facial expression and psychometrics","author":"MS Islam","year":"2025","unstructured":"Islam, M. S., Al-Sadi, A., Mohammad, R. & Alkhnbashi, O. S. EmoPulse: unveiling real-time mental health through facial expression and psychometrics 100058 (Computational and Structural Biotechnology Reports), (2025)."},{"key":"58013_CR41","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1038\/s41746-025-01933-3","volume":"8","author":"L Wang","year":"2025","unstructured":"Wang, L. et al. AI-assisted multi-modal information for the screening of depression: a systematic review and meta-analysis. npj Digit. Med. 8, 523 (2025).","journal-title":"npj Digit. Med."},{"key":"58013_CR42","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1145\/3129340","volume":"52","author":"BW Schuller","year":"2018","unstructured":"Schuller, B. W. Speech emotion recognition: Two decades in a nutshell, benchmarks, and ongoing trends. Comput. Speech Lang. 52, 97\u2013109. https:\/\/doi.org\/10.1145\/3129340 (2018).","journal-title":"Comput. Speech Lang."},{"key":"58013_CR43","doi-asserted-by":"publisher","first-page":"11824","DOI":"10.1038\/s41598-025-95734-z","volume":"15","author":"JH Chowdhury","year":"2025","unstructured":"Chowdhury, J. H., Ramanna, S. & Kotecha, K. Speech emotion recognition with light weight deep neural ensemble model using hand crafted features. Sci. Rep. 15, 11824 (2025).","journal-title":"Sci. Rep."},{"key":"58013_CR44","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1109\/T-AFFC.2013.29","volume":"4","author":"M Karg","year":"2013","unstructured":"Karg, M. et al. Body movements for affective expression: A survey of automatic recognition and generation. IEEE Trans. Affect. Comput. 4, 341\u2013359 (2013).","journal-title":"IEEE Trans. Affect. Comput."},{"key":"58013_CR45","unstructured":"Jo, K. et al. Artificial Behavior Intelligence: Technology, Challenges, and Future Directions. arXiv preprint arXiv:2505.03315 (2025)."},{"key":"58013_CR46","doi-asserted-by":"publisher","first-page":"102019","DOI":"10.1016\/j.inffus.2023.102019","volume":"102","author":"SK Khare","year":"2024","unstructured":"Khare, S. K., Blanes-Vidal, V., Nadimi, E. S. & Acharya, U. R. Emotion recognition and artificial intelligence: A systematic review (2014\u20132023) and research recommendations. Inf. Fusion. 102, 102019 (2024).","journal-title":"Inf. Fusion"},{"key":"58013_CR47","unstructured":"Buolamwini, J. & Gebru, T. Gender shades: Intersectional accuracy disparities in commercial gender classification. in Conference on fairness, accountability and transparency 77\u201391PMLR, (2018)."},{"key":"58013_CR48","doi-asserted-by":"publisher","first-page":"27730","DOI":"10.52202\/068431-2011","volume":"35","author":"L Ouyang","year":"2022","unstructured":"Ouyang, L. et al. Training language models to follow instructions with human feedback. Adv. Neural. Inf. Process. Syst. 35, 27730\u201327744 (2022).","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"58013_CR49","first-page":"13387","volume":"2023","author":"E Perez","year":"2023","unstructured":"Perez, E. et al. Discovering language model behaviors with model-written evaluations. Find. Association Comput. Linguistics: ACL. 2023, 13387\u201313434 (2023).","journal-title":"Find. Association Comput. Linguistics: ACL"},{"key":"58013_CR50","doi-asserted-by":"publisher","first-page":"4064","DOI":"10.1038\/s41598-025-88313-9","volume":"15","author":"W Guo","year":"2025","unstructured":"Guo, W. et al. Enhancing depression recognition through a mixed expert model by integrating speaker-related and emotion-related features. Sci. Rep. 15, 4064 (2025).","journal-title":"Sci. Rep."},{"key":"58013_CR51","doi-asserted-by":"publisher","unstructured":"Xu, Z. et al. Depression detection methods based on multimodal fusion of voice and text. Sci. Rep. 21907 https:\/\/doi.org\/10.1038\/s41598-025-03524-4 (15).","DOI":"10.1038\/s41598-025-03524-4"},{"key":"58013_CR52","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1038\/s44184-024-00097-4","volume":"3","author":"S Siddals","year":"2024","unstructured":"Siddals, S., Torous, J. & Coxon, A. It happened to be the perfect thing: experiences of generative AI chatbots for mental health. npj Ment Health Res. 3, 48 (2024).","journal-title":"npj Ment Health Res."},{"key":"58013_CR53","doi-asserted-by":"publisher","first-page":"567","DOI":"10.3758\/s13428-015-0601-4","volume":"48","author":"H O\u2019Reilly","year":"2016","unstructured":"O\u2019Reilly, H. et al. The EU-Emotion Stimulus Set: A validation study. Behav. Res. Methods. 48, 567\u2013576. https:\/\/doi.org\/10.3758\/s13428-015-0601-4 (2016).","journal-title":"Behav. Res. Methods"},{"key":"58013_CR54","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1038\/s41562-024-02077-2","volume":"9","author":"M Glickman","year":"2025","unstructured":"Glickman, M. & Sharot, T. How human\u2013AI feedback loops alter human perceptual, emotional and social judgements. Nat. Hum. Behav. 9, 345\u2013359. https:\/\/doi.org\/10.1038\/s41562-024-02077-2 (2025).","journal-title":"Nat. Hum. Behav."},{"key":"58013_CR55","doi-asserted-by":"publisher","first-page":"508","DOI":"10.1037\/ccp0000192","volume":"85","author":"S Zilcha-Mano","year":"2017","unstructured":"Zilcha-Mano, S. & Err\u00e1zuriz, P. Early development of mechanisms of change as a predictor of subsequent change and treatment outcome: The case of working alliance. J. Consult Clin. Psychol. 85, 508 (2017).","journal-title":"J. Consult Clin. Psychol."},{"key":"58013_CR56","unstructured":"Casper, S. et al. Open problems and fundamental limitations of reinforcement learning from human feedback. arXiv preprint arXiv:2307.15217 (2023)."},{"key":"58013_CR57","doi-asserted-by":"publisher","first-page":"770","DOI":"10.1037\/0033-2909.129.5.770","volume":"129","author":"PN Juslin","year":"2003","unstructured":"Juslin, P. N. & Laukka, P. Communication of emotions in vocal expression and music performance: Different channels, same code? Psychol. Bull. 129, 770\u2013814. https:\/\/doi.org\/10.1037\/0033-2909.129.5.770 (2003).","journal-title":"Psychol. Bull."},{"key":"58013_CR58","doi-asserted-by":"publisher","first-page":"e13216","DOI":"10.2196\/13216","volume":"21","author":"A Fiske","year":"2019","unstructured":"Fiske, A., Henningsen, P. & Buyx, A. Your robot therapist will see you now: ethical implications of embodied artificial intelligence in psychiatry, psychology, and psychotherapy. J. Med. Internet Res. 21, e13216. https:\/\/doi.org\/10.2196\/13216 (2019).","journal-title":"J. Med. Internet Res."},{"key":"58013_CR59","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1038\/s44184-024-00057-y","volume":"3","author":"DA Adler","year":"2024","unstructured":"Adler, D. A. et al. Measuring algorithmic bias to analyze the reliability of AI tools that predict depression risk using smartphone sensed-behavioral data. npj Ment Health Res. 3, 17 (2024).","journal-title":"npj Ment Health Res."},{"key":"58013_CR60","doi-asserted-by":"publisher","first-page":"1251","DOI":"10.1001\/jamapediatrics.2023.4212","volume":"177","author":"T Vial","year":"2023","unstructured":"Vial, T., & Almon, A. Artificial intelligence in mental health therapy for children and adolescents. JAMA pediatrics, 177(12), 1251-1252 (2023).","journal-title":"JAMA Pediatr."},{"key":"58013_CR61","doi-asserted-by":"publisher","first-page":"2389","DOI":"10.1073\/pnas.1411678112","volume":"112","author":"P. S Dodds","year":"2015","unstructured":"Dodds, P. S. et al. Human language reveals a universal positivity bias. Proc. Natl. Acad. Sci. USA. 112, 2389\u20132394 (2015).","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"58013_CR62","doi-asserted-by":"crossref","unstructured":"Min, T., Lee, H., Kwon, Y. & Lee, K. Understanding Impact of Human Feedback via Influence Functions. arXiv preprint arXiv:2501.05790 (2025).","DOI":"10.18653\/v1\/2025.acl-long.1333"},{"key":"58013_CR63","doi-asserted-by":"publisher","first-page":"493","DOI":"10.3758\/s13428-018-1048-1","volume":"51","author":"A Lassalle","year":"2019","unstructured":"Lassalle, A. et al. The EU-Emotion Voice Database. Behav. Res. Methods. 51, 493\u2013506. https:\/\/doi.org\/10.3758\/s13428-018-1048-1 (2019).","journal-title":"Behav. Res. Methods"},{"issue":"2","key":"58013_CR64","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1037\/0033-2909.128.2.203","volume":"128","author":"HA Elfenbein","year":"2002","unstructured":"Elfenbein, H. A. & Ambady, N. On the universality and cultural specificity of emotion recognition: a meta-analysis. Psychol. Bull. 128 (2), 203 (2002).","journal-title":"Psychol. Bull."},{"key":"58013_CR65","doi-asserted-by":"publisher","first-page":"623","DOI":"10.1007\/s10803-006-0107-0","volume":"36","author":"I Dziobek","year":"2006","unstructured":"Dziobek, I. et al. Introducing MASC: A movie for the assessment of social cognition. J. Autism Dev. Disord. 36, 623\u2013636. https:\/\/doi.org\/10.1007\/s10803-006-0107-0 (2006).","journal-title":"J. Autism Dev. Disord"},{"key":"58013_CR66","doi-asserted-by":"publisher","first-page":"1501","DOI":"10.1007\/s00146-021-01276-z","volume":"38","author":"N Munn","year":"2023","unstructured":"Munn, N. & Weijers, D. Corporate responsibility for the termination of digital friends. AI Soc. 38, 1501\u20131502. https:\/\/doi.org\/10.1007\/s00146-021-01276-z (2023).","journal-title":"AI Soc."},{"key":"58013_CR67","unstructured":"Google. Gemini, A. P. I. & Documentation Google for Developers at (2025). https:\/\/ai.google.dev\/gemini-api\/docs\/models"},{"key":"58013_CR68","doi-asserted-by":"publisher","first-page":"e0196391","DOI":"10.1371\/journal.pone.0196391","volume":"13","author":"SR Livingstone","year":"2018","unstructured":"Livingstone, S. R. & Russo, F. A. The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English. PLOS ONE. 13, e0196391. https:\/\/doi.org\/10.1371\/journal.pone.0196391 (2018).","journal-title":"PLOS ONE"},{"key":"58013_CR69","doi-asserted-by":"publisher","unstructured":"Cohen, J. Statistical Power Analysis for the Behavioral Sciences (Routledge, 2013). https:\/\/doi.org\/10.4324\/9780203771587","DOI":"10.4324\/9780203771587"},{"key":"58013_CR70","volume-title":"The EU-Emotion Stimulus Set","author":"H O'Reilly","year":"2012","unstructured":"O'Reilly, H. et al. The EU-Emotion Stimulus Set (Autism Research Centre, University of Cambridge, 2012)."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-58013-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-58013-z","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-58013-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T10:03:02Z","timestamp":1788429782000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-58013-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,3]]},"references-count":70,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["58013"],"URL":"https:\/\/doi.org\/10.1038\/s41598-026-58013-z","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,3]]},"assertion":[{"value":"29 October 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 June 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 September 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Declarations"}}],"article-number":"27663"}}