{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T16:13:18Z","timestamp":1792080798306,"version":"4.4.0"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,2,3]],"date-time":"2025-02-03T00:00:00Z","timestamp":1738540800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0"},{"start":{"date-parts":[[2025,2,3]],"date-time":"2025-02-03T00:00:00Z","timestamp":1738540800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62267008"],"award-info":[{"award-number":["62267008"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62267008"],"award-info":[{"award-number":["62267008"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62067008"],"award-info":[{"award-number":["62067008"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62267008"],"award-info":[{"award-number":["62267008"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"DOI":"10.1038\/s41598-025-88313-9","type":"journal-article","created":{"date-parts":[[2025,2,3]],"date-time":"2025-02-03T06:37:56Z","timestamp":1738564676000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Enhancing depression recognition through a mixed expert model by integrating speaker-related and emotion-related features"],"prefix":"10.1038","volume":"15","author":[{"given":"Weitong","family":"Guo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qian","family":"He","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ziyu","family":"Lin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaolong","family":"Bu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ziyang","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dong","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongwu","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,2,3]]},"reference":[{"key":"88313_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pmed.0030442","volume":"3","author":"CD Mathers","year":"2006","unstructured":"Mathers, C. D. & Loncar, D. Projections of global mortality and burden of disease from 2002 to 2030. PLOS Medicine 3, 1\u201320. https:\/\/doi.org\/10.1371\/journal.pmed.0030442 (2006).","journal-title":"PLOS Medicine"},{"key":"88313_CR2","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.specom.2015.03.004","volume":"71","author":"N Cummins","year":"2015","unstructured":"Cummins, N. et al. A review of depression and suicide risk assessment using speech analysis. Speech communication 71, 10\u201349 (2015).","journal-title":"Speech communication"},{"key":"88313_CR3","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1016\/j.neucom.2021.02.019","volume":"441","author":"Y Dong","year":"2021","unstructured":"Dong, Y. & Yang, X. A hierarchical depression detection model based on vocal and emotional cues. Neurocomputing 441, 279\u2013290 (2021).","journal-title":"Neurocomputing"},{"key":"88313_CR4","unstructured":"Depression, W. Other common mental disorders: global health estimates. Geneva: World Health Organization 24 (2017)."},{"key":"88313_CR5","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1002\/lio2.354","volume":"5","author":"DM Low","year":"2020","unstructured":"Low, D. M., Bentley, K. H. & Ghosh, S. S. Automated assessment of psychiatric disorders using speech: A systematic review. Laryngoscope investigative otolaryngology 5, 96\u2013116 (2020).","journal-title":"Laryngoscope investigative otolaryngology"},{"key":"88313_CR6","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.specom.2015.03.004","volume":"71","author":"N Cummins","year":"2015","unstructured":"Cummins, N. et al. A review of depression and suicide risk assessment using speech analysis. Speech communication 71, 10\u201349 (2015).","journal-title":"Speech communication"},{"key":"88313_CR7","doi-asserted-by":"crossref","unstructured":"Asgari, M., Shafran, I. & Sheeber, L.\u00a0B. Inferring clinical depression from speech and spoken utterances. In 2014 IEEE international workshop on Machine Learning for Signal Processing (MLSP), 1\u20135 (IEEE, 2014).","DOI":"10.1109\/MLSP.2014.6958856"},{"key":"88313_CR8","unstructured":"Wessman, A. Mood and personality (Holt, Reinhart and Winston, 1966)."},{"key":"88313_CR9","doi-asserted-by":"publisher","first-page":"788","DOI":"10.1109\/TASL.2010.2064307","volume":"19","author":"N Dehak","year":"2010","unstructured":"Dehak, N., Kenny, P. J., Dehak, R., Dumouchel, P. & Ouellet, P. Front-end factor analysis for speaker verification. IEEE Transactions on Audio, Speech, and Language Processing 19, 788\u2013798 (2010).","journal-title":"IEEE Transactions on Audio, Speech, and Language Processing"},{"key":"88313_CR10","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1111\/j.1745-6916.2006.00003.x","volume":"1","author":"LF Barrett","year":"2006","unstructured":"Barrett, L. F. Are emotions natural kinds?. Perspectives on psychological science 1, 28\u201358 (2006).","journal-title":"Perspectives on psychological science"},{"key":"88313_CR11","doi-asserted-by":"publisher","first-page":"688","DOI":"10.3390\/e22060688","volume":"22","author":"A V\u00e1zquez-Romero","year":"2020","unstructured":"V\u00e1zquez-Romero, A. & Gallardo-Antol\u00edn, A. Automatic detection of depression in speech using ensemble convolutional neural networks. Entropy 22, 688 (2020).","journal-title":"Entropy"},{"key":"88313_CR12","doi-asserted-by":"publisher","first-page":"701","DOI":"10.1049\/cit2.12113","volume":"8","author":"P Wu","year":"2023","unstructured":"Wu, P. et al. Automatic depression recognition by intelligent speech signal processing: A systematic survey. CAAI Transactions on Intelligence Technology 8, 701\u2013711 (2023).","journal-title":"CAAI Transactions on Intelligence Technology"},{"key":"88313_CR13","doi-asserted-by":"publisher","first-page":"668","DOI":"10.1109\/TCDS.2017.2721552","volume":"10","author":"A Jan","year":"2017","unstructured":"Jan, A., Meng, H., Gaus, Y. F. B. A. & Zhang, F. Artificial intelligent system for automatic depression level analysis through visual and vocal expressions. IEEE Transactions on Cognitive and Developmental Systems 10, 668\u2013680 (2017).","journal-title":"IEEE Transactions on Cognitive and Developmental Systems"},{"key":"88313_CR14","doi-asserted-by":"publisher","first-page":"1055","DOI":"10.1109\/TAFFC.2019.2916092","volume":"12","author":"J Gideon","year":"2019","unstructured":"Gideon, J., McInnis, M. G. & Provost, E. M. Improving cross-corpus speech emotion recognition with adversarial discriminative domain generalization (addog). IEEE Transactions on Affective Computing 12, 1055\u20131068 (2019).","journal-title":"IEEE Transactions on Affective Computing"},{"key":"88313_CR15","doi-asserted-by":"crossref","unstructured":"Huang, Z. et al. Domain adaptation for enhancing speech-based depression detection in natural environmental conditions using dilated cnns. In INTERSPEECH, 4561\u20134565 (2020).","DOI":"10.21437\/Interspeech.2020-3135"},{"key":"88313_CR16","doi-asserted-by":"crossref","unstructured":"Feraru, S.\u00a0M., Schuller, D. et al. Cross-language acoustic emotion recognition: An overview and some tendencies. In 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), 125\u2013131 (IEEE, 2015).","DOI":"10.1109\/ACII.2015.7344561"},{"key":"88313_CR17","doi-asserted-by":"crossref","unstructured":"Huang, Z. et al. Domain adaptation for enhancing speech-based depression detection in natural environmental conditions using dilated cnns. In INTERSPEECH, 4561\u20134565 (2020).","DOI":"10.21437\/Interspeech.2020-3135"},{"key":"88313_CR18","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1109\/29.21701","volume":"37","author":"G Hinton","year":"1989","unstructured":"Hinton, G. et al. Phoneme recognition using time-delay neural network. IEEE transactions on acoustics, speech, and signal processing 37, 328\u2013339 (1989).","journal-title":"IEEE transactions on acoustics, speech, and signal processing"},{"key":"88313_CR19","doi-asserted-by":"crossref","unstructured":"Desplanques, B., Thienpondt, J. & Demuynck, K. Ecapa-tdnn: Emphasized channel attention, propagation and aggregation in tdnn based speaker verification. arXiv preprint arXiv:2005.07143 (2020).","DOI":"10.21437\/Interspeech.2020-2650"},{"key":"88313_CR20","doi-asserted-by":"crossref","unstructured":"Snyder, D., Garcia-Romero, D., Sell, G., Povey, D. & Khudanpur, S. X-vectors: Robust dnn embeddings for speaker recognition. In 2018 IEEE international conference on acoustics, speech and signal processing (ICASSP), 5329\u20135333 (IEEE, 2018).","DOI":"10.1109\/ICASSP.2018.8461375"},{"key":"88313_CR21","unstructured":"Cai, H. et al. Modma dataset: A multi-modal open dataset for mental-disorder analysis. arxiv 2020. arXiv preprint arXiv:2002.09283 (2020)."},{"key":"88313_CR22","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1162\/neco.1991.3.1.79","volume":"3","author":"RA Jacobs","year":"1991","unstructured":"Jacobs, R. A., Jordan, M. I., Nowlan, S. J. & Hinton, G. E. Adaptive mixtures of local experts. Neural computation 3, 79\u201387 (1991).","journal-title":"Neural computation"},{"key":"88313_CR23","unstructured":"Zhao, S., Li, B., Xu, P. & Keutzer, K. Multi-source domain adaptation in the deep learning era: A systematic survey. arXiv preprint arXiv:2002.12169 (2020)."},{"key":"88313_CR24","unstructured":"Ruder, S., Ghaffari, P. & Breslin, J.\u00a0G. Knowledge adaptation: Teaching to adapt. arXiv preprint arXiv:1702.02052 (2017)."},{"key":"88313_CR25","doi-asserted-by":"crossref","unstructured":"Valstar, M. et al. Avec 2014: 3d dimensional affect and depression recognition challenge. In Proceedings of the 4th international workshop on audio\/visual emotion challenge, 3\u201310 (2014).","DOI":"10.1145\/2661806.2661807"},{"key":"88313_CR26","doi-asserted-by":"crossref","unstructured":"Ringeval, F. et al. Avec 2019 workshop and challenge: state-of-mind, detecting depression with ai, and cross-cultural affect recognition. In Proceedings of the 9th International on Audio\/visual Emotion Challenge and Workshop, 3\u201312 (2019).","DOI":"10.1145\/3347320.3357688"},{"key":"88313_CR27","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2021.609760","volume":"15","author":"W Guo","year":"2021","unstructured":"Guo, W., Yang, H., Liu, Z., Xu, Y. & Hu, B. Deep neural networks for depression recognition based on 2d and 3d facial expressions under emotional stimulus tasks. Frontiers in neuroscience 15, 609760 (2021).","journal-title":"Frontiers in neuroscience"},{"key":"88313_CR28","doi-asserted-by":"crossref","unstructured":"Valstar, M. et al. Avec 2013: the continuous audio\/visual emotion and depression recognition challenge. In Proceedings of the 3rd ACM international workshop on Audio\/visual emotion challenge, 3\u201310 (2013).","DOI":"10.1145\/2512530.2512533"},{"key":"88313_CR29","unstructured":"Povey, D. et al. The kaldi speech recognition toolkit. In IEEE 2011 workshop on automatic speech recognition and understanding (IEEE Signal Processing Society, 2011)."},{"key":"88313_CR30","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1016\/j.neucom.2021.02.019","volume":"441","author":"Y Dong","year":"2021","unstructured":"Dong, Y. & Yang, X. A hierarchical depression detection model based on vocal and emotional cues. Neurocomputing 441, 279\u2013290 (2021).","journal-title":"Neurocomputing"},{"key":"88313_CR31","unstructured":"Beck, Aaron T. & M. & Brad A. Alford, P. Depression (University of Pennsylvania Press, Philadelphia, 2009)."},{"key":"88313_CR32","doi-asserted-by":"crossref","unstructured":"Valstar, M. et al. Avec 2014: 3d dimensional affect and depression recognition challenge. In Proceedings of the 4th international workshop on audio\/visual emotion challenge, 3\u201310 (2014).","DOI":"10.1145\/2661806.2661807"},{"key":"88313_CR33","doi-asserted-by":"crossref","unstructured":"Senoussaoui, M., Sarria-Paja, M., Santos, J.\u00a0F. & Falk, T.\u00a0H. Model fusion for multimodal depression classification and level detection. In Proceedings of the 4th International Workshop on Audio\/Visual Emotion Challenge, 57\u201363 (2014).","DOI":"10.1145\/2661806.2661819"},{"key":"88313_CR34","doi-asserted-by":"crossref","unstructured":"Senoussaoui, M., Sarria-Paja, M., Santos, J.\u00a0F. & Falk, T.\u00a0H. Model fusion for multimodal depression classification and level detection. In In Proceedings of the 4th International Workshop on Audio\/Visual Emotion Challenge, 57\u201363 (2014).","DOI":"10.1145\/2661806.2661819"},{"key":"88313_CR35","doi-asserted-by":"publisher","first-page":"668","DOI":"10.1109\/TCDS.2017.2721552","volume":"10","author":"A Jan","year":"2017","unstructured":"Jan, A., Meng, H., Gaus, Y. F. B. A. & Zhang, F. Artificial intelligent system for automatic depression level analysis through visual and vocal expressions. IEEE Transactions on Cognitive and Developmental Systems 10, 668\u2013680 (2017).","journal-title":"IEEE Transactions on Cognitive and Developmental Systems"},{"key":"88313_CR36","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/j.jbi.2018.05.007","volume":"83","author":"L He","year":"2018","unstructured":"He, L. & Cao, C. Automated depression analysis using convolutional neural networks from speech. Journal of biomedical informatics 83, 103\u2013111 (2018).","journal-title":"Journal of biomedical informatics"},{"key":"88313_CR37","doi-asserted-by":"crossref","unstructured":"Niu, M., Tao, J., Liu, B. & Fan, C. Automatic depression level detection via lp-norm pooling 4559\u20134563 (Proc. INTERSPEECH, Graz, Austria, 2019).","DOI":"10.21437\/Interspeech.2019-1617"},{"key":"88313_CR38","doi-asserted-by":"publisher","first-page":"294","DOI":"10.1109\/TAFFC.2020.3031345","volume":"14","author":"M Niu","year":"2020","unstructured":"Niu, M., Tao, J., Liu, B., Huang, J. & Lian, Z. Multimodal spatiotemporal representation for automatic depression level detection. IEEE transactions on affective computing 14, 294\u2013307 (2020).","journal-title":"IEEE transactions on affective computing"},{"key":"88313_CR39","doi-asserted-by":"crossref","unstructured":"Zhao, Z. et al. Hybrid network feature extraction for depression assessment from speech. Neurocomputing (2020).","DOI":"10.21437\/Interspeech.2020-2396"},{"key":"88313_CR40","doi-asserted-by":"publisher","first-page":"208","DOI":"10.1016\/j.neucom.2021.04.056","volume":"450","author":"M Niu","year":"2021","unstructured":"Niu, M., Liu, B., Tao, J. & Li, Q. A time-frequency channel attention and vectorization network for automatic depression level prediction. Neurocomputing 450, 208\u2013218 (2021).","journal-title":"Neurocomputing"},{"key":"88313_CR41","doi-asserted-by":"crossref","unstructured":"Williamson, J.\u00a0R., Quatieri, T.\u00a0F., Helfer, B.\u00a0S., Ciccarelli, G. & Mehta, D.\u00a0D. Vocal and facial biomarkers of depression based on motor incoordination and timing. In In Proceedings of the 4th international workshop on audio\/visual emotion challenge, 65\u201372 (2014).","DOI":"10.1145\/2661806.2661809"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-88313-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-88313-9","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-88313-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,3]],"date-time":"2025-02-03T06:38:06Z","timestamp":1738564686000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-88313-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,3]]},"references-count":41,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["88313"],"URL":"https:\/\/doi.org\/10.1038\/s41598-025-88313-9","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,3]]},"assertion":[{"value":"19 November 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 January 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 February 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"We declare that we have no financial and personal relationships with other people or organizations that can inappropriately influence our work and that there is no professional or other personal interest of any nature or kind in any product, service, and\/or company that could be construed as influencing the position presented in or the review of the manuscript entitled.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"This study was conducted in accordance with the ethical standards specified by the Tianshui Third People\u2019s Hospital in Gansu Province, and all procedures involving human participants were approved by the Tianshui Third People\u2019s Hospital in Gansu Province. Written informed consent was obtained from all individual participants included in the study. For participants under the age of 18, written informed consent was also obtained from a parent or legal guardian.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Participants were informed that their data would be used for research purposes and that results might be published. We have taken measures to ensure that participants\u2019 identities are not disclosed in any published materials, including using anonymization techniques and removing personally identifiable information.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no conflicts of interest related to this research. This study complies with the current ethical standards for research involving human participants, as outlined in the Declaration of Helsinki. We have adhered to best practices in data protection, ensuring that all personal data collected is stored securely and access is restricted to authorized personnel only.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"Prior to the commencement of the study, a thorough risk assessment was conducted to identify potential harm to participants. Based on this assessment, mitigation strategies were implemented to minimize risks. For example, participants were provided with detailed information about the study\u2019s procedures, potential risks, and their rights as research subjects. Participants were also allowed to withdraw from the study at any time without penalty.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Risk assessment and mitigation"}},{"value":"All data collected during the study was stored in a secure, password-protected database accessible only to authorized researchers. The data was anonymized to protect participants\u2019 identities, and all personal identifiers were removed before analysis. Measures were taken to ensure that the data was handled in accordance with local data protection laws and regulations.","order":7,"name":"Ethics","group":{"name":"EthicsHeading","label":"Data privacy and security"}},{"value":"We acknowledge the importance of fairness, accountability, and transparency in AI research. Therefore, we have taken steps to ensure that our algorithms and models are designed to minimize bias and promote equitable outcomes. This includes conducting bias audits, implementing fairness constraints, and making our research methods and results publicly available to facilitate reproducibility and scrutiny by the wider research community. The corresponding author is responsible for submitting a\n                      \n                      on behalf of all authors of the paper. This statement must be included in the submitted article file.","order":8,"name":"Ethics","group":{"name":"EthicsHeading","label":"Fairness, accountability, and transparency"}}],"article-number":"4064"}}