{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T03:17:09Z","timestamp":1740107829834,"version":"3.37.3"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"11-12","license":[{"start":{"date-parts":[[2024,1,23]],"date-time":"2024-01-23T00:00:00Z","timestamp":1705968000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,1,23]],"date-time":"2024-01-23T00:00:00Z","timestamp":1705968000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100009482","name":"Santa Clara University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100009482","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Soft Comput"],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Using machine learning and deep learning methods to analyze text data from social media can effectively explore hidden emotional tendencies and evaluate the psychological state of social media account owners. However, the label noise caused by mislabeling may significantly influence the training and prediction results of traditional supervised models. To resolve this problem, this paper proposes a psychological evaluation method that incorporates a noisy label correction mechanism and designs an evaluation framework that consists of a primary classification model and a noisy label correction mechanism. Firstly, the social media text data are transformed into heterogeneous text graphs, and a classification model combining a pre-trained model with a graph neural network is constructed to extract semantic features and structural features, respectively. After that, the Gaussian mixture model is used to select the samples that are likely to be mislabeled. Then, soft labels are generated for them to enable noisy label correction without prior knowledge of the noise distribution information. Finally, the corrected and clean samples are composed into a new data set and re-input into the primary model for mental state classification. Results of experiments on three real data sets indicate that the proposed method outperforms current advanced models in classification accuracy and noise robustness under different noise ratio settings, and can efficiently explore the potential sentiment tendencies and users\u2019 psychological states in social media text data.<\/jats:p>","DOI":"10.1007\/s00500-023-09479-w","type":"journal-article","created":{"date-parts":[[2024,1,23]],"date-time":"2024-01-23T11:02:44Z","timestamp":1706007764000},"page":"7395-7407","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A psychological evaluation method incorporating noisy label correction mechanism"],"prefix":"10.1007","volume":"28","author":[{"given":"Zhigang","family":"Jin","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Renjun","family":"Su","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3717-427X","authenticated-orcid":false,"given":"Yuhong","family":"Liu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chenxu","family":"Duan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,1,23]]},"reference":[{"key":"9479_CR1","doi-asserted-by":"publisher","first-page":"6088","DOI":"10.1007\/s10489-020-02131-2","volume":"51","author":"J Aguilera","year":"2021","unstructured":"Aguilera J, Hernandez Farias D, Ortega-Mendoza R, Montes M (2021) Depression and anorexia detection in social media as a one-class classification problem. Appl Intell 51:6088\u20136103","journal-title":"Appl Intell"},{"key":"9479_CR2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2021.106771","volume":"215","author":"G Algan","year":"2021","unstructured":"Algan G, Ulusoy I (2021) Image classification with deep learning in the presence of noisy labels: a survey. Knowl Based Syst 215:106771","journal-title":"Knowl Based Syst"},{"key":"9479_CR3","doi-asserted-by":"publisher","first-page":"3091","DOI":"10.32604\/cmc.2022.022609","volume":"71","author":"A Almars","year":"2022","unstructured":"Almars A (2022) Attention-based bi-lstm model for arabic depression classification. Comput Mater Continua 71:3091\u20133106","journal-title":"Comput Mater Continua"},{"key":"9479_CR4","unstructured":"Arazo E, Ortego D, Albert P, O\u2019Connor N, Mcguinness K (2019) Unsupervised label noise modeling and loss correction. In: Proceedings of the 36th international conference on machine learning, vol 97. PMLR, Long Beach, California, USA, pp 312\u2013321"},{"key":"9479_CR5","unstructured":"Arpit D, Jastrzundefinedbski S, Ballas N, Krueger D, Bengio E, Kanwal MS, Maharaj T, Fischer A, Courville A, Bengio Y, Lacoste-Julien S (2017) A closer look at memorization in deep networks. In: Proceedings of the 34th international conference on machine learning, vol 70. JMLR.org, Sydney, NSW, Australia, pp 233\u2013242"},{"key":"9479_CR6","doi-asserted-by":"publisher","first-page":"351","DOI":"10.1016\/j.chb.2015.08.023","volume":"54","author":"PA Cavazos-Rehg","year":"2016","unstructured":"Cavazos-Rehg PA, Krauss MJ, Sowles S, Connolly S, Rosas C, Bharadwaj M, Bierut LJ (2016) A content analysis of depression-related tweets. Comput Hum Behav 54:351\u2013357","journal-title":"Comput Hum Behav"},{"key":"9479_CR7","doi-asserted-by":"publisher","first-page":"8187","DOI":"10.1007\/s00500-019-04402-8","volume":"24","author":"L-C Chen","year":"2020","unstructured":"Chen L-C, Lee C-M, Chen M-Y (2020) Exploration of social media for sentiment analysis using deep learning. Soft Comput 24:8187\u20138197","journal-title":"Soft Comput"},{"issue":"23","key":"9479_CR8","doi-asserted-by":"publisher","first-page":"14573","DOI":"10.1007\/s00500-021-06384-y","volume":"25","author":"N Cheng","year":"2021","unstructured":"Cheng N, Zhang H, Li Z (2021) Data sanitization against label flipping attacks using adaboost-based semi-supervised learning technology. Soft Comput 25(23):14573\u201314581","journal-title":"Soft Comput"},{"key":"9479_CR9","doi-asserted-by":"crossref","unstructured":"Cho K, Merri\u00ebnboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder\u2013decoder for statistical machine translation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). Association for Computational Linguistics, Doha, Qatar, pp 1724\u20131734","DOI":"10.3115\/v1\/D14-1179"},{"key":"9479_CR10","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K (2019) BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 conference of the North American chapter of the Association for Computational Linguistics: human language technologies, vol 1 (Long and Short Papers), pp 4171\u20134186. Association for Computational Linguistics, Minneapolis, Minnesota"},{"issue":"3","key":"9479_CR11","doi-asserted-by":"publisher","first-page":"923","DOI":"10.1016\/j.asoc.2006.04.007","volume":"7","author":"J Diederich","year":"2007","unstructured":"Diederich J, Al-Ajmi A, Yellowlees P (2007) Ex-ray: data mining and mental health. Appl Soft Comput 7(3):923\u2013928","journal-title":"Appl Soft Comput"},{"issue":"5","key":"9479_CR12","doi-asserted-by":"publisher","first-page":"1484","DOI":"10.1109\/TCSS.2021.3116242","volume":"9","author":"S Ghosh","year":"2022","unstructured":"Ghosh S, Ekbal A, Bhattacharyya P (2022) What does your bio say? Inferring Twitter users\u2019 depression status from multimodal profile information using deep learning. IEEE Trans Comput Soc Syst 9(5):1484\u20131494","journal-title":"IEEE Trans Comput Soc Syst"},{"key":"9479_CR13","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.cobeha.2017.07.005","volume":"18","author":"SC Guntuku","year":"2017","unstructured":"Guntuku SC, Yaden DB, Kern ML, Ungar LH, Eichstaedt JC (2017) Detecting depression and mental illness on social media: an integrative review. Curr Opin Behav Sci 18:43\u201349","journal-title":"Curr Opin Behav Sci"},{"key":"9479_CR14","doi-asserted-by":"publisher","first-page":"4395358","DOI":"10.1155\/2022\/4395358","volume":"2022","author":"S Gupta","year":"2022","unstructured":"Gupta S, Goel L, Singh A, Prasad A, Aman Ullah EM (2022) Psychological analysis for depression detection from social networking sites. Comput Intell Neurosci 2022:4395358","journal-title":"Comput Intell Neurosci"},{"key":"9479_CR15","unstructured":"Han B, Yao Q, Yu X, Niu G, Xu M, Hu W, Tsang IW, Sugiyama M (2018) Co-teaching: robust training of deep neural networks with extremely noisy labels. In: Proceedings of the 32nd international conference on neural information processing systems. Curran Associates Inc., Red Hook, NY, USA, pp 8536\u20138546"},{"key":"9479_CR16","doi-asserted-by":"crossref","unstructured":"Haque A, Reddi V, Giallanza T (2021) Deep learning for suicide and depression identification with unsupervised label correction. In: Artificial neural networks and machine learning\u2014ICANN 2021: 30th international conference on artificial neural networks. Springer, Bratislava, Slovakia, pp 436\u2013447","DOI":"10.1007\/978-3-030-86383-8_35"},{"issue":"8","key":"9479_CR17","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735\u20131780","journal-title":"Neural Comput"},{"key":"9479_CR18","unstructured":"Hong S, Cohn A, Hogg DC (2022) Using graph representation learning with schema encoders to measure the severity of depressive symptoms. In: International conference on learning representations"},{"key":"9479_CR19","doi-asserted-by":"crossref","unstructured":"Hu Y, Huang Z-A, Liu R, Xue X, Song L, Tan KC (2022) A dual-stage pseudo-labeling method for the diagnosis of mental disorder on mri scans. In: 2022 international joint conference on neural networks (IJCNN). IEEE, Padua, Italy, pp 1\u20138","DOI":"10.1109\/IJCNN55064.2022.9892792"},{"issue":"1","key":"9479_CR20","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1109\/TCSS.2020.3021467","volume":"8","author":"S Ji","year":"2020","unstructured":"Ji S, Pan S, Li X, Cambria E, Long G, Huang Z (2020) Suicidal ideation detection: a review of machine learning methods and applications. IEEE Trans Comput Soc Syst 8(1):214\u2013226","journal-title":"IEEE Trans Comput Soc Syst"},{"key":"9479_CR21","doi-asserted-by":"crossref","unstructured":"Ji S, Li X, Huang Z, Cambria E (2022a) Suicidal ideation and mental disorder detection with attentive relation networks. Neural Comput Appl 34:10309\u201310319","DOI":"10.1007\/s00521-021-06208-y"},{"key":"9479_CR22","unstructured":"Ji S, Zhang T, Ansari L, Fu J, Tiwari P, Cambria E (2022b) MentalBERT: publicly available pretrained language models for mental healthcare. In: Proceedings of the thirteenth language resources and evaluation conference. European Language Resources Association, Marseille, France, pp 7184\u20137190"},{"key":"9479_CR23","unstructured":"Li J, Socher R, Hoi S (2020) Dividemix: learning with noisy labels as semi-supervised learning. In: International conference on learning representations. Elsevier, Addis Ababa"},{"key":"9479_CR24","doi-asserted-by":"crossref","unstructured":"Lin Y, Meng Y, Sun X, Han Q, Kuang K, Li J, Wu F (2021) BertGCN: transductive text classification by combining GNN and BERT. In: Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021. Association for Computational Linguistics, Online, pp 1456\u20131462","DOI":"10.18653\/v1\/2021.findings-acl.126"},{"issue":"12","key":"9479_CR25","doi-asserted-by":"publisher","first-page":"3580","DOI":"10.1109\/TMI.2021.3091178","volume":"40","author":"J Liu","year":"2021","unstructured":"Liu J, Li R, Sun C (2021) Co-correcting: noise-tolerant medical image classification via mutual label correction. IEEE Trans Med Imaging 40(12):3580\u20133592","journal-title":"IEEE Trans Med Imaging"},{"key":"9479_CR26","doi-asserted-by":"publisher","first-page":"1373","DOI":"10.1613\/jair.1.12125","volume":"70","author":"C Northcutt","year":"2021","unstructured":"Northcutt C, Jiang L, Chuang I (2021) Confident learning: estimating uncertainty in dataset labels. J Artif Intell Res 70:1373\u20131411","journal-title":"J Artif Intell Res"},{"key":"9479_CR27","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1007\/s13042-017-0697-1","volume":"10","author":"Z Peng","year":"2019","unstructured":"Peng Z, Hu Q, Dang J (2019) Multi-kernel svm based depression recognition using social media data. Int J Mach Learn Cybernet 10:43\u201357","journal-title":"Int J Mach Learn Cybernet"},{"key":"9479_CR28","doi-asserted-by":"crossref","unstructured":"Pham H, Dai Z, Xie Q, Luong M-T, Le QV (2021) Meta pseudo labels. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition. IEEE, Online, pp 11557\u201311568","DOI":"10.1109\/CVPR46437.2021.01139"},{"key":"9479_CR29","doi-asserted-by":"crossref","unstructured":"Pirina I, \u00c7\u00f6ltekin \u00c7 (2018) Identifying depression on Reddit: the effect of training data. In: Proceedings of the 2018 EMNLP workshop SMM4H: the 3rd social media mining for health applications workshop & shared task. Association for Computational Linguistics, Brussels, Belgium, pp 9\u201312","DOI":"10.18653\/v1\/W18-5903"},{"key":"9479_CR30","unstructured":"Qiao D, Dai C, Ding Y, Li J, Chen Q, Chen W, Zhang M (2022) SelfMix: robust learning against textual label noise with self-mixup training. In: Proceedings of the 29th international conference on computational linguistics. International Committee on Computational Linguistics, Gyeongju, Republic of Korea, pp 960\u2013970"},{"key":"9479_CR31","doi-asserted-by":"crossref","unstructured":"Reece A, Reagan A, Lix K, Dodds P, Danforth C, Langer E (2017) Forecasting the onset and course of mental illness with twitter data. Sci Rep 7:13006","DOI":"10.1038\/s41598-017-12961-9"},{"issue":"9590","key":"9479_CR32","doi-asserted-by":"publisher","first-page":"878","DOI":"10.1016\/S0140-6736(07)61239-2","volume":"370","author":"S Saxena","year":"2007","unstructured":"Saxena S, Thornicroft G, Knapp M, Whiteford H (2007) Resources for mental health: scarcity, inequity, and inefficiency. Lancet 370(9590):878\u2013889","journal-title":"Lancet"},{"key":"9479_CR33","doi-asserted-by":"publisher","first-page":"8135","DOI":"10.1109\/TNNLS.2022.3152527","volume":"34","author":"H Song","year":"2022","unstructured":"Song H, Kim M, Park D, Shin Y, Lee J-G (2022) Learning from noisy labels with deep neural networks: a survey. IEEE Trans Neural Netw Learn Syst 34:8135\u20138153","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"9479_CR34","doi-asserted-by":"publisher","first-page":"480","DOI":"10.1016\/j.future.2021.05.032","volume":"124","author":"A-S Uban","year":"2021","unstructured":"Uban A-S, Chulvi B, Rosso P (2021) An emotion and cognitive based analysis of mental health disorders from social media data. Future Gener Comput Syst 124:480\u2013494","journal-title":"Future Gener Comput Syst"},{"issue":"6","key":"9479_CR35","doi-asserted-by":"publisher","first-page":"228","DOI":"10.2196\/jmir.7215","volume":"19","author":"A Wongkoblap","year":"2017","unstructured":"Wongkoblap A, Vadillo MA, Curcin V (2017) Researching mental health disorders in the era of social media: systematic review. J Med Internet Res 19(6):228","journal-title":"J Med Internet Res"},{"key":"9479_CR36","unstructured":"World Health Organization (2022) World mental health report: transforming mental health for all: executive summary. World Health Organization, Geneva"},{"key":"9479_CR37","doi-asserted-by":"crossref","unstructured":"Wu Z-F, Wei T, Jiang J, Mao C, Tang M, Li Y-F (2021) Ngc: a unified framework for learning with open-world noisy data. In: 2021 IEEE\/CVF international conference on computer vision (ICCV), pp 62\u201371","DOI":"10.1109\/ICCV48922.2021.00013"},{"issue":"3","key":"9479_CR38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3450352","volume":"39","author":"T Yang","year":"2021","unstructured":"Yang T, Hu L, Shi C, Ji H, Li X, Nie L (2021) Hgat: heterogeneous graph attention networks for semi-supervised short text classification. ACM Trans Inf Syst 39(3):1\u201329","journal-title":"ACM Trans Inf Syst"},{"issue":"18","key":"9479_CR39","doi-asserted-by":"publisher","first-page":"9587","DOI":"10.1007\/s00500-022-06786-6","volume":"26","author":"L Yang","year":"2022","unstructured":"Yang L, Li S, Luo X, Xu B, Geng Y, Zeng Z, Zhang F, Lin H (2022) Computational personality: a survey. Soft Comput 26(18):9587\u20139605","journal-title":"Soft Comput"},{"key":"9479_CR40","first-page":"7370","volume-title":"Graph convolutional networks for text classification","author":"L Yao","year":"2019","unstructured":"Yao L, Mao C, Luo Y (2019) Graph convolutional networks for text classification. AAAI Press, Honolulu, pp 7370\u20137377"},{"key":"9479_CR41","unstructured":"Yu X, Han B, Yao J, Niu G, Tsang I, Sugiyama M (2019) How does disagreement help generalization against label corruption? In: Proceedings of the 36th international conference on machine learning, vol 97. PMLR, Baltimore, Maryland, USA, pp 7164\u20137173"},{"issue":"3","key":"9479_CR42","doi-asserted-by":"publisher","first-page":"2758","DOI":"10.1016\/j.eswa.2010.08.066","volume":"38","author":"W Zhang","year":"2011","unstructured":"Zhang W, Yoshida T, Tang X (2011) A comparative study of tf* idf, lsi and multi-words for text classification. Expert Syst Appl 38(3):2758\u20132765","journal-title":"Expert Syst Appl"}],"container-title":["Soft Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00500-023-09479-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00500-023-09479-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00500-023-09479-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T13:06:38Z","timestamp":1721394398000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00500-023-09479-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,23]]},"references-count":42,"journal-issue":{"issue":"11-12","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["9479"],"URL":"https:\/\/doi.org\/10.1007\/s00500-023-09479-w","relation":{},"ISSN":["1432-7643","1433-7479"],"issn-type":[{"type":"print","value":"1432-7643"},{"type":"electronic","value":"1433-7479"}],"subject":[],"published":{"date-parts":[[2024,1,23]]},"assertion":[{"value":"14 November 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 January 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no conflicts of interest to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}