{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T20:02:39Z","timestamp":1780776159235,"version":"3.54.1"},"reference-count":55,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,7,23]],"date-time":"2024-07-23T00:00:00Z","timestamp":1721692800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Digit. Health"],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Dysarthria, a motor speech disorder caused by muscle weakness or paralysis, severely impacts speech intelligibility and quality of life. The condition is prevalent in motor speech disorders such as Parkinson's disease (PD), atypical parkinsonism such as progressive supranuclear palsy (PSP), Huntington's disease (HD), and amyotrophic lateral sclerosis (ALS). Improving intelligibility is not only an outcome that matters to patients but can also play a critical role as an endpoint in clinical research and drug development. This study validates a digital measure for speech intelligibility, the ki: SB-M intelligibility score, across various motor speech disorders and languages following the Digital Medicine Society (DiMe) V3 framework.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>The study used four datasets: healthy controls (HCs) and patients with PD, HD, PSP, and ALS from Czech, Colombian, and German populations. Participants\u2019 speech intelligibility was assessed using the ki: SB-M intelligibility score, which is derived from automatic speech recognition (ASR) systems. Verification with inter-ASR reliability and temporal consistency, analytical validation with correlations to gold standard clinical dysarthria scores in each disease, and clinical validation with group comparisons between HCs and patients were performed.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Verification showed good to excellent inter-rater reliability between ASR systems and fair to good consistency. Analytical validation revealed significant correlations between the SB-M intelligibility score and established clinical measures for speech impairments across all patient groups and languages. Clinical validation demonstrated significant differences in intelligibility scores between pathological groups and healthy controls, indicating the measure's discriminative capability.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>The ki: SB-M intelligibility score is a reliable, valid, and clinically relevant tool for assessing speech intelligibility in motor speech disorders. It holds promise for improving clinical trials through automated, objective, and scalable assessments. Future studies should explore its utility in monitoring disease progression and therapeutic efficacy as well as add data from further dysarthrias to the validation.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fdgth.2024.1440986","type":"journal-article","created":{"date-parts":[[2024,7,23]],"date-time":"2024-07-23T05:10:30Z","timestamp":1721711430000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["An automatic measure for speech intelligibility in dysarthrias\u2014validation across multiple languages and neurological disorders"],"prefix":"10.3389","volume":"6","author":[{"given":"Johannes","family":"Tr\u00f6ger","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Felix","family":"D\u00f6rr","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Louisa","family":"Schwed","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicklas","family":"Linz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandra","family":"K\u00f6nig","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tabea","family":"Thies","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael T.","family":"Barbe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juan Rafael","family":"Orozco-Arroyave","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jan","family":"Rusz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,7,23]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1044\/jshr.1202.246","article-title":"Differential diagnostic patterns of dysarthria","volume":"12","author":"Darley","year":"1969","journal-title":"J Speech Hear Res"},{"key":"B2","doi-asserted-by":"publisher","first-page":"166370","DOI":"10.1109\/ACCESS.2021.3135626","article-title":"Speech impairment in Parkinson\u2019s disease: acoustic analysis of unvoiced consonants in Italian native speakers","volume":"9","author":"Amato","year":"2021","journal-title":"IEEE Access"},{"key":"B3","doi-asserted-by":"publisher","first-page":"2171","DOI":"10.1121\/1.4816541","article-title":"Imprecise vowel articulation as a potential early marker of Parkinson\u2019s disease: effect of speaking task","volume":"134","author":"Rusz","year":"2013","journal-title":"J Acoust Soc Am"},{"key":"B4","doi-asserted-by":"publisher","first-page":"1394","DOI":"10.1007\/s00415-019-09271-7","article-title":"Distinctive speech signature in cerebellar and parkinsonian subtypes of multiple system atrophy","volume":"266","author":"Rusz","year":"2019","journal-title":"J Neurol"},{"key":"B5","doi-asserted-by":"publisher","first-page":"803","DOI":"10.1002\/mds.28465","article-title":"Guidelines for speech recording and acoustic analyses in dysarthrias of movement disorders","volume":"36","author":"Rusz","year":"2021","journal-title":"Mov Disord"},{"key":"B6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41531-021-00272-w","article-title":"Speech acoustic indices for differential diagnosis between Parkinson\u2019s disease, multiple system atrophy and progressive supranuclear palsy","volume":"8","author":"Daoudi","year":"2022","journal-title":"NPJ Parkinsons Dis"},{"key":"B7","first-page":"66","article-title":"Perceptual and acoustic features of dysarthria in multiple system atrophy","volume":"18","author":"Kim","year":"2010","journal-title":"J Med Speech-Lang Pathol"},{"key":"B8","doi-asserted-by":"publisher","first-page":"E2042","DOI":"10.1212\/WNL.0000000000008541","article-title":"Motor speech patterns in Huntington disease","volume":"93","author":"Diehl","year":"2019","journal-title":"Neurology"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1111\/ene.15726","article-title":"Speech biomarkers in Huntington disease: a cross-sectional study in pre-symptomatic, prodromal and early manifest stages","author":"Kouba","year":"2023","journal-title":"Eur J Neurol"},{"key":"B10","doi-asserted-by":"publisher","first-page":"4","DOI":"10.3109\/17482960802379004","article-title":"Dysarthria in amyotrophic lateral sclerosis: a review","volume":"11","author":"Tomik","year":"2010","journal-title":"Amyotroph Lateral Scler"},{"key":"B11","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1044\/jshr.1502.229","article-title":"Dysarthria in multiple sclerosis","volume":"15","author":"Darley","year":"1972","journal-title":"J Speech Hear Res"},{"key":"B12","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1016\/j.msard.2017.11.007","article-title":"Characteristics of motor speech phenotypes in multiple sclerosis","volume":"19","author":"Rusz","year":"2018","journal-title":"Mult Scler Relat Disord"},{"key":"B13","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1016\/j.neubiorev.2015.11.014","article-title":"Health-related quality of life in patients with Parkinson\u2019s disease\u2014a systematic review based on the ICF model","volume":"61","author":"Van Uem","year":"2016","journal-title":"Neurosci Biobehav Rev"},{"key":"B14","doi-asserted-by":"publisher","first-page":"485","DOI":"10.2174\/1874944501811010485","article-title":"Subjective self-rated speech intelligibility and quality of life in patients with Parkinson\u2019s disease in a Malaysian sample","volume":"11","author":"Chu","year":"2018","journal-title":"Open Public Health J"},{"key":"B15","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1080\/17549507.2016.1193900","article-title":"Variables associated with communicative participation in Parkinson\u2019s disease and its relationship to measures of health-related quality-of-life","volume":"19","author":"McAuliffe","year":"2017","journal-title":"Int J Speech Lang Pathol"},{"key":"B16","doi-asserted-by":"publisher","first-page":"1112","DOI":"10.1002\/1531-8257(200011)15:6%3C1112::AID-MDS1008%3E3.0.CO;2-A","article-title":"How does Parkinson\u2019s disease affect quality of life? A comparison with quality of life in the general population","volume":"15","author":"Schrag","year":"2000","journal-title":"Mov Disord"},{"key":"B17","first-page":"618","volume-title":"Management of motor speech disorders in children and adults","author":"Yorkston","year":"1999"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1188","DOI":"10.1136\/jnnp.2006.110171","article-title":"Prevalence and pattern of perceived intelligibility changes in Parkinson\u2019s disease","volume":"78","author":"Miller","year":"2007","journal-title":"J Neurol Neurosurg Amp Psychiatry"},{"key":"B19","doi-asserted-by":"publisher","first-page":"2128","DOI":"10.1044\/2022_JSLHR-21-00589","article-title":"Validity of off-the-shelf automatic speech recognition for assessing speech intelligibility and speech severity in speakers with amyotrophic lateral sclerosis","volume":"65","author":"Gutz","year":"2022","journal-title":"J Speech Lang Hear Res"},{"key":"B20","doi-asserted-by":"publisher","first-page":"482","DOI":"10.1044\/jshd.5404.482","article-title":"Toward phonetic intelligibility testing in dysarthria","volume":"54","author":"Kent","year":"1989","journal-title":"J Speech Hear Disord"},{"key":"B21","doi-asserted-by":"publisher","first-page":"2129","DOI":"10.1002\/mds.22340","article-title":"Movement disorder society-sponsored revision of the unified Parkinson\u2019s disease rating scale (MDS-UPDRS): scale presentation and clinimetric testing results: MDS-UPDRS: clinimetric assessment","volume":"23","author":"Goetz","year":"2008","journal-title":"Mov Disord"},{"key":"B22","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1016\/S0022-510X(99)00210-5","article-title":"The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function","volume":"169","author":"Cedarbaum","year":"1999","journal-title":"J Neurol Sci"},{"key":"B23","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1159\/000515346","article-title":"Voice for health: the use of vocal biomarkers from research to clinical practice","volume":"5","author":"Fagherazzi","year":"2021","journal-title":"Digit Biomark"},{"key":"B24","doi-asserted-by":"publisher","first-page":"657","DOI":"10.1002\/mds.27671","article-title":"A roadmap for implementation of patient-centered digital outcome measures in Parkinson\u2019s disease obtained using mobile health technologies","volume":"34","author":"Espay","year":"2019","journal-title":"Mov Disord"},{"key":"B25","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1002\/9781119745532.ch9","article-title":"Clinical trials in ALS\u2014current challenges and strategies for future directions","volume-title":"Spectrums of Amyotrophic Lateral Sclerosis","author":"Salmon","year":"2021"},{"key":"B26","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1038\/s41746-023-00959-9","article-title":"A systematic review and narrative analysis of digital speech biomarkers in motor neuron disease","volume":"6","author":"Bowden","year":"2023","journal-title":"NPJ Digit Med"},{"key":"B27","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1159\/000477383","article-title":"The first frontier: digital biomarkers for neurodegenerative disorders","volume":"1","author":"Dorsey","year":"2017","journal-title":"Digit Biomark"},{"key":"B28","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/j.jcomdis.2018.08.002","article-title":"Towards an automatic evaluation of the dysarthria level of patients with Parkinson\u2019s disease","volume":"76","author":"V\u00e1squez-Correa","year":"2018","journal-title":"J Commun Disord"},{"key":"B29","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1007\/s40860-019-00085-y","article-title":"On the impact of dysarthric speech on contemporary ASR cloud platforms","volume":"5","author":"De Russis","year":"2019","journal-title":"J Reliab Intell Environ"},{"key":"B30","doi-asserted-by":"publisher","first-page":"3924","DOI":"10.1016\/j.eswa.2015.01.033","article-title":"Exploring the influence of general and specific factors on the recognition accuracy of an ASR system for dysarthric speaker","volume":"42","author":"Mustafa","year":"2015","journal-title":"Expert Syst Appl"},{"key":"B31","doi-asserted-by":"publisher","first-page":"599","DOI":"10.1080\/17549507.2018.1510033","article-title":"Automatic speech recognition: a primer for speech-language pathology researchers","volume":"20","author":"Keshet","year":"2018","journal-title":"Int J Speech Lang Pathol"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-020-0260-4","article-title":"Verification, analytical validation, and clinical validation (V3): the foundation of determining fit-for-purpose for biometric monitoring technologies (BioMeTs)","volume":"3","author":"Goldsack","year":"2020","journal-title":"NPJ Digit Med"},{"key":"B33","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1038\/s41746-020-0237-3","article-title":"Modernizing and designing evaluation frameworks for connected sensor technologies in medicine","volume":"3","author":"Coravos","year":"2020","journal-title":"NPJ Digit Med"},{"key":"B34","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1159\/000514730","article-title":"Evaluation, acceptance, and qualification of digital measures: from proof of concept to endpoint","volume":"5","author":"Goldsack","year":"2021","journal-title":"Digit Biomark"},{"key":"B35","doi-asserted-by":"publisher","first-page":"1529","DOI":"10.1007\/s00702-014-1229-8","article-title":"Characteristics and occurrence of speech impairment in Huntington\u2019s disease: possible influence of antipsychotic medication","volume":"121","author":"Rusz","year":"2014","journal-title":"J Neural Transm"},{"key":"B36","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1038\/s41598-017-00047-5","article-title":"Automated analysis of connected speech reveals early biomarkers of Parkinson\u2019s disease in patients with rapid eye movement sleep behaviour disorder","volume":"7","author":"Hlavni\u010dka","year":"2017","journal-title":"Sci Rep"},{"key":"B37","doi-asserted-by":"publisher","first-page":"3453","DOI":"10.1044\/2020_JSLHR-20-00109","article-title":"Comparison of automated acoustic methods for oral diadochokinesis assessment in amyotrophic lateral sclerosis","volume":"63","author":"Novotny","year":"2020","journal-title":"J Speech Lang Hear Res"},{"key":"B38","first-page":"342","article-title":"New Spanish speech corpus database for the analysis of people suffering from Parkinson\u2019s disease","author":"Orozco-Arroyave","year":"2014"},{"key":"B39","doi-asserted-by":"publisher","first-page":"107306","DOI":"10.1016\/j.neuropsychologia.2019.107306","article-title":"Prominence marking in parkinsonian speech and its correlation with motor performance and cognitive abilities","volume":"137","author":"Thies","year":"2020","journal-title":"Neuropsychologia"},{"key":"B40","article-title":"The dysarthria analyzer","author":"Hlavni\u010dka","year":""},{"key":"B41","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1002\/mds.870110204","article-title":"Unified Huntington\u2019s disease rating scale: reliability and consistency","volume":"11","author":"Kieburtz","year":"1996","journal-title":"Mov Disord"},{"key":"B42","doi-asserted-by":"publisher","first-page":"e22293","DOI":"10.1371\/journal.pone.0022293","article-title":"Disease severity and progression in progressive supranuclear palsy and multiple system atrophy: validation of the NNIPPS\u2014Parkinson plus scale","volume":"6","author":"Payan","year":"2011","journal-title":"PLoS One"},{"key":"B43","article-title":"Google speech-to-text V2.25.1 (2023)","year":""},{"key":"B44","article-title":"Amazon Transcribe V1.20.15 (2023)","year":""},{"key":"B45","doi-asserted-by":"publisher","first-page":"716","DOI":"10.1080\/13682820802342062","article-title":"Speech technology-based assessment of phoneme intelligibility in dysarthria","volume":"44","author":"Van Nuffelen","year":"2009","journal-title":"Int J Lang Commun Disord"},{"key":"B46","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1159\/000531054","article-title":"Clinical validation of novel digital measures: statistical methods for reliability evaluation","author":"Ratitch","year":"2023","journal-title":"Digit Biomark"},{"key":"B47","doi-asserted-by":"publisher","first-page":"22199","DOI":"10.1109\/ACCESS.2017.2762475","article-title":"Assessment of speech intelligibility in Parkinson\u2019s disease using a speech-to-text system","volume":"5","author":"Dimauro","year":"2017","journal-title":"IEEE Access"},{"key":"B48","article-title":"Google USM: scaling automatic speech recognition beyond 100 languages. arXiv [preprint]. (2023)","author":"Zhang","year":""},{"key":"B49","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1016\/j.csl.2014.02.001","article-title":"Automatic intelligibility classification of sentence-level pathological speech","volume":"29","author":"Kim","year":"2015","journal-title":"Comput Speech Lang"},{"key":"B50","first-page":"19","article-title":"A review of automated intelligibility assessment for dysarthric speakers","author":"Huang","year":"2021"},{"key":"B51","doi-asserted-by":"publisher","first-page":"230","DOI":"10.1044\/2015_JSLHR-S-15-0271","article-title":"Comparison of intelligibility measures for adults with Parkinson\u2019s disease, adults with multiple sclerosis, and healthy controls","volume":"59","author":"Stipancic","year":"2016","journal-title":"J Speech Lang Hear Res"},{"key":"B52","doi-asserted-by":"publisher","first-page":"e0284667","DOI":"10.1371\/journal.pone.0284667","article-title":"Ataxic speech disorders and Parkinson\u2019s disease diagnostics via stochastic embedding of empirical mode decomposition","volume":"18","author":"Campi","year":"2023","journal-title":"PLoS One"},{"key":"B53","doi-asserted-by":"publisher","first-page":"770210","DOI":"10.3389\/fcomp.2022.770210","article-title":"Characterizing dysarthria diversity for automatic speech recognition: a tutorial from the clinical perspective","volume":"4","author":"Rowe","year":"2022","journal-title":"Front Comput Sci"},{"key":"B54","doi-asserted-by":"publisher","first-page":"EL416","DOI":"10.1121\/1.4967208","article-title":"The relationship between perceptual disturbances in dysarthric speech and automatic speech recognition performance","volume":"140","author":"Tu","year":"2016","journal-title":"J Acoust Soc Am"},{"key":"B55","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1016\/j.specom.2018.05.007","article-title":"Speaker models for monitoring Parkinson\u2019s disease progression considering different communication channels and acoustic conditions","volume":"101","author":"Arias-Vergara","year":"2018","journal-title":"Speech Commun"}],"container-title":["Frontiers in Digital Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2024.1440986\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,13]],"date-time":"2024-11-13T14:41:21Z","timestamp":1731508881000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2024.1440986\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,23]]},"references-count":55,"alternative-id":["10.3389\/fdgth.2024.1440986"],"URL":"https:\/\/doi.org\/10.3389\/fdgth.2024.1440986","relation":{},"ISSN":["2673-253X"],"issn-type":[{"value":"2673-253X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,23]]},"article-number":"1440986"}}