{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T16:52:36Z","timestamp":1777049556330,"version":"3.51.4"},"reference-count":51,"publisher":"Wiley","license":[{"start":{"date-parts":[[2024,3,20]],"date-time":"2024-03-20T00:00:00Z","timestamp":1710892800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62106117"],"award-info":[{"award-number":["62106117"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2022M711741"],"award-info":[{"award-number":["2022M711741"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["ZR2021QF084"],"award-info":[{"award-number":["ZR2021QF084"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2023KJ365"],"award-info":[{"award-number":["2023KJ365"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"publisher","award":["62106117"],"award-info":[{"award-number":["62106117"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"publisher","award":["2022M711741"],"award-info":[{"award-number":["2022M711741"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"publisher","award":["ZR2021QF084"],"award-info":[{"award-number":["ZR2021QF084"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"publisher","award":["2023KJ365"],"award-info":[{"award-number":["2023KJ365"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007129","name":"Natural Science Foundation of Shandong Province","doi-asserted-by":"publisher","award":["62106117"],"award-info":[{"award-number":["62106117"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007129","name":"Natural Science Foundation of Shandong Province","doi-asserted-by":"publisher","award":["2022M711741"],"award-info":[{"award-number":["2022M711741"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007129","name":"Natural Science Foundation of Shandong Province","doi-asserted-by":"publisher","award":["ZR2021QF084"],"award-info":[{"award-number":["ZR2021QF084"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007129","name":"Natural Science Foundation of Shandong Province","doi-asserted-by":"publisher","award":["2023KJ365"],"award-info":[{"award-number":["2023KJ365"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Shandong Province Higher Education Institutions Youth Innovation and Technology Support Program","award":["62106117"],"award-info":[{"award-number":["62106117"]}]},{"name":"Shandong Province Higher Education Institutions Youth Innovation and Technology Support Program","award":["2022M711741"],"award-info":[{"award-number":["2022M711741"]}]},{"name":"Shandong Province Higher Education Institutions Youth Innovation and Technology Support Program","award":["ZR2021QF084"],"award-info":[{"award-number":["ZR2021QF084"]}]},{"name":"Shandong Province Higher Education Institutions Youth Innovation and Technology Support Program","award":["2023KJ365"],"award-info":[{"award-number":["2023KJ365"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["International Journal of Intelligent Systems"],"published-print":{"date-parts":[[2024,3,20]]},"abstract":"<jats:p>Deterioration in the quality of a person\u2019s voice and speech is an early sign of Parkinson\u2019s disease (PD). Although a number of computer-based methods have been invested to use patients\u2019 speech for early diagnosis of Parkinson\u2019s disease, they only focus on a fixed pronunciation test, such as the subjects\u2019 monosyllabic pronunciation is analyzed to determine whether they have potential possibility of PD. Moreover, only using traditional speech analysis methods to extract single-view speech features cannot provide a comprehensive feature representation. This paper is dedicated to the study of various pronunciation tests for patients with PD, including the pronunciation of five monosyllabic vowels and a spontaneous dialogue. A triplet multimodel transfer learning network is designed and proposed for identifying subjects with PD in these two groups of tests. First, multisource data extract mel frequency cepstrum coefficient (MFCC) features of speech for preprocessing. Subsequently, a pretrained triplet model represents features from three dimensions as the upstream task of the transfer learning framework. Finally, the pretrained model is reconstructed as a novel model that integrates the triplet model, temporal model, and auxiliary layer as the downstream task, and weights are updated through fine-tuning to identify abnormal speech. Experimental results show that the highest PD detection rates in the two groups of tests are 99% and 90% , respectively, which outperform a large number of internationally popular pattern recognition algorithms and serve as a baseline for other academic researchers in this field.<\/jats:p>","DOI":"10.1155\/2024\/8890592","type":"journal-article","created":{"date-parts":[[2024,3,20]],"date-time":"2024-03-20T20:50:09Z","timestamp":1710967809000},"page":"1-20","source":"Crossref","is-referenced-by-count":12,"title":["A Triplet Multimodel Transfer Learning Network for Speech Disorder Screening of Parkinson\u2019s Disease"],"prefix":"10.1155","volume":"2024","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3494-175X","authenticated-orcid":true,"given":"Aite","family":"Zhao","sequence":"first","affiliation":[{"name":"College of Computer Science and Technology, Qingdao University, Qingdao, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5299-0611","authenticated-orcid":true,"given":"Nana","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Qingdao University, Qingdao, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-8828-3514","authenticated-orcid":true,"given":"Xuesen","family":"Niu","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Qingdao University, Qingdao, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2797-5564","authenticated-orcid":true,"given":"Ming","family":"Chen","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Qingdao University, Qingdao, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8416-7710","authenticated-orcid":true,"given":"Huimin","family":"Wu","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Qingdao University, Qingdao, China"}]}],"member":"311","reference":[{"issue":"1","key":"1","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1121\/1.3514381","article-title":"Quantitative acoustic measurements for characterization of speech and voice disorders in early untreated Parkinson\u2019s disease","volume":"129","author":"J. Rusz","year":"02 2011","journal-title":"Journal of the Acoustical Society of America"},{"key":"2","doi-asserted-by":"publisher","DOI":"10.1002\/mds.870100506"},{"key":"3","doi-asserted-by":"publisher","DOI":"10.1016\/j.parkreldis.2019.04.026"},{"key":"4","doi-asserted-by":"publisher","DOI":"10.1007\/s00702-012-0853-4"},{"key":"5","unstructured":"RuszJ.Detecting speech disorders in early Parkinson\u2019s disease by acoustic analysis2018Prague, CzechiaCzech Technical University in PragueHabilitation Thesis"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0265604"},{"key":"7","doi-asserted-by":"publisher","DOI":"10.1016\/j.gaitpost.2022.08.014"},{"key":"8","first-page":"1","article-title":"Associated spatio-temporal capsule network for gait recognition","volume":"24","author":"A. Zhao","year":"2021","journal-title":"IEEE Transactions on Multimedia"},{"key":"9","doi-asserted-by":"publisher","DOI":"10.1109\/jbhi.2022.3174249"},{"key":"10","first-page":"1","article-title":"Ataxia and Parkinson\u2019s disease patients classification using tree-based machine learning algorithms fed by spatiotemporal features: a pilot study","author":"G. Cesarelli"},{"key":"11","doi-asserted-by":"publisher","DOI":"10.1109\/tcyb.2021.3056104"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.116113"},{"key":"13","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/978-981-19-5194-7_21","article-title":"Speech recognition for Parkinson\u2019s disease based on improved genetic algorithm and data enhancement technology","volume-title":"Data Science","author":"J. Qin","year":"2022"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.1504\/ijsnet.2022.10049990"},{"key":"15","first-page":"209","article-title":"Early diagnosis of Parkinson\u2019s disease with speech pronunciation features based on xgboost model","author":"X. Wang"},{"key":"16","doi-asserted-by":"publisher","DOI":"10.1109\/jiot.2019.2917933"},{"key":"17","first-page":"1","article-title":"Classification of multiple pd sources by signal features and lstm networks","author":"B. Adam"},{"key":"18","first-page":"515","article-title":"Automatic speech recognition for the Nepali language using cnn, bidirectional lstm and resnet","author":"M. Dhakal"},{"key":"19","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1007\/978-3-030-00794-2_49","article-title":"Phonological posteriors and gru recurrent units to assess speech impairments of patients with Parkinson\u2019s disease","volume-title":"Text, Speech, and Dialogue","author":"J. C. V\u00e1squez-Correa","year":"2018"},{"key":"20","first-page":"1","article-title":"Fault identification based on pd ultrasonic signal using rnn, dnn and cnn","author":"Q. Zhang"},{"key":"21","doi-asserted-by":"publisher","DOI":"10.1109\/tase.2020.3034401"},{"key":"22","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-023-18014-w"},{"key":"23","first-page":"1","article-title":"Resnet-based Parkinson\u2019s disease classification","volume":"4","author":"O. E. Ariss","year":"2022","journal-title":"IEEE Transactions on Artificial Intelligence"},{"key":"24","doi-asserted-by":"crossref","DOI":"10.21437\/Interspeech.2022-10674","article-title":"Cross-lingual self-supervised speech representations for improved dysarthric speech recognition","author":"A. Hernandez","year":"2022"},{"key":"25","first-page":"1","article-title":"Identifying Parkinson\u2019s disease using multimodal approach and deep learning","author":"M. Mohaghegh"},{"key":"26","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2021.102849"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2020.102165"},{"key":"28","article-title":"Deep double-side learning ensemble model for few-shot Parkinson speech recognition","author":"Y. Li","year":"2020"},{"key":"29","doi-asserted-by":"publisher","DOI":"10.1002\/int.22846"},{"key":"30","doi-asserted-by":"publisher","DOI":"10.1007\/s10772-019-09647-0"},{"key":"31","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1007\/978-981-16-5157-1_65","article-title":"Extensive analysis of global presidents\u2019 speeches using natural language","volume-title":"Sentimental Analysis and Deep Learning","author":"S. Nivash","year":"2022"},{"key":"32","first-page":"27","article-title":"Enhancing speech recognition for Parkinson\u2019s disease patient using transfer learning technique","volume":"1","author":"Y. U. Qing","year":"2022","journal-title":"Journal of Shanghai Jiaotong University"},{"key":"33","doi-asserted-by":"publisher","DOI":"10.1016\/j.aei.2014.01.001"},{"key":"34","doi-asserted-by":"publisher","DOI":"10.1155\/2023\/9921809"},{"key":"35","doi-asserted-by":"publisher","DOI":"10.1002\/int.22813"},{"key":"36","first-page":"1","article-title":"Transferable self-supervised instance learning for sleep recognition","volume":"25","author":"A. Zhao","year":"05 2022","journal-title":"IEEE Transactions on Multimedia"},{"key":"37","article-title":"Cbam: convolutional block attention module","volume-title":"European Conference on Computer Vision","author":"S. Woo","year":"2018"},{"key":"38","first-page":"2261","article-title":"Densely connected convolutional networks","author":"G. Huang"},{"key":"39","article-title":"Mobile Device Voice Recordings at King\u2019s College London (MDVR-KCL) from both early and advanced Parkinson\u2019s disease patients and healthy controls","author":"H. Jaeger"},{"key":"40","article-title":"Italian Parkinson\u2019s voice and speech","author":"G. Dimauro","year":"2019"},{"key":"41","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1007\/978-981-19-2266-4_35","article-title":"Speech recognition for power customer service based on dnn and cnn models","volume-title":"Digital TV and Wireless Multimedia Communications","author":"Y. Yin","year":"2022"},{"key":"42","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-020-09490-5"},{"key":"43","first-page":"1","article-title":"Rescnn: an alternative implementation of convolutional neural networks","author":"S. Bose"},{"key":"44","article-title":"Masked face recognition using resnet-50","author":"B. Mandal","year":"2021"},{"key":"45","first-page":"1","article-title":"Fine-grained early frequency attention for deep speaker recognition","author":"A. Hajavi"},{"key":"46","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2022.03.038"},{"key":"47","article-title":"Self-attention-based bigru and capsule network for named entity recognition","author":"J. Deng","year":"2020"},{"key":"48","first-page":"6912","article-title":"Light-sernet: a lightweight fully convolutional neural network for speech emotion recognition","author":"A. Aftab"},{"key":"49","article-title":"Ctl-mtnet: a novel capsnet and transfer learning-based mixed task net for the single-corpus and cross-corpus speech emotion recognition","author":"X.-C. Wen","year":"2022"},{"key":"50","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2022.07.005"},{"key":"51","first-page":"1","article-title":"Temporal modeling matters: a novel temporal emotional modeling approach for speech emotion recognition","author":"J. Ye"}],"container-title":["International Journal of Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/ijis\/2024\/8890592.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/ijis\/2024\/8890592.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/ijis\/2024\/8890592.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,20]],"date-time":"2024-03-20T20:50:25Z","timestamp":1710967825000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/ijis\/2024\/8890592\/"}},"subtitle":[],"editor":[{"given":"Paolo","family":"Gastaldo","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2024,3,20]]},"references-count":51,"alternative-id":["8890592","8890592"],"URL":"https:\/\/doi.org\/10.1155\/2024\/8890592","relation":{},"ISSN":["1098-111X","0884-8173"],"issn-type":[{"value":"1098-111X","type":"electronic"},{"value":"0884-8173","type":"print"}],"subject":[],"published":{"date-parts":[[2024,3,20]]}}}