{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T16:27:15Z","timestamp":1791822435606,"version":"4.3.4"},"reference-count":22,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Form Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Speech sound disorders are common in children and are associated with an increased risk of academic reading difficulties. The COVID-19 pandemic further highlighted the need for remote and digitalized assessment tools. In South Korea, standardized instruments such as the Urimal Test of Articulation and Phonation and Assessment of Phonology and Articulation for children are widely used but have limitations, including reliance on face-to-face evaluation, and the absence of automated scoring.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to develop and establish the content validity of an articulation assessment tool that can overcome these limitations and be integrated into digital therapeutics (DTx).<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n A 3-round modified Delphi survey was conducted between July and September 2025 with 92% (23\/25) of the invited experts, including 52.2% (12\/23) physiatrists and 47.8% (11\/23) speech-language pathologists, with a mean professional experience of 10.69 (SD 5.09) years. All participants (23\/23, 100%) completed all rounds. Panelists evaluated the appropriateness of word lists, phonological environments, and scoring criteria. Quantitative analyses, including calculations of content validity ratio (CVR), content validity index (CVI), and median and IQR, were performed. Consensus thresholds were set at a CVR of \u22650.39, a CVI of \u22650.78, a median of \u22653.5, and an IQR of \u22641.0. Items were retained only when all 4 criteria were satisfied. While formal qualitative analysis was not performed, the research team internally reviewed and synthesized core keywords and themes from the experts\u2019 open-ended responses to guide the refinement of items.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n These findings were summarized into four key areas: (1) modernization of word stimuli, (2) expansion of phonological coverage, (3) refinement of scoring criteria to reduce ambiguity, and (4) enhancement of result interpretability through visualization. In round 2, a revised 35-word list was evaluated across 25 items, of which 20 (80%) met all consensus criteria. In total, 20% (5\/25) of the items failed to meet at least one threshold, including phonological environment adequacy (CVR=0.48; CVI=0.74), scoring redundancy (CVR=0.13; CVI=0.57), usefulness of proportion of whole-word correctness or percentage of word proximity (CVR=0.39; CVI=0.70), contribution of mean phonological length (CVR=0.22; CVI=0.61), and usefulness of feature-based indexes (CVR=0.30; CVI=0.65; IQR 2). Items that reached consensus showed CVR values of 0.57 to 0.91, CVI values of 0.78 to 0.96, a median score of 4, and IQR values of 0 to 1. In round 3, all remaining items achieved consensus.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n This Delphi study developed a novel articulation assessment tool with robust content validity. This tool includes updated word stimuli, diverse analysis indexes, and visualization features, thereby enhancing its clinical utility and suitability for integration into artificial intelligence\u2013based DTx. By standardizing and digitalizing articulation assessments, this tool has the potential to support personalized and accessible interventions for children with speech sound disorders.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/90110","type":"journal-article","created":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T20:42:00Z","timestamp":1776976920000},"page":"e90110-e90110","source":"Crossref","is-referenced-by-count":1,"title":["Development of a Child Articulation Screening Test Within Digital Therapeutics: Delphi Study"],"prefix":"10.2196","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0775-5073","authenticated-orcid":false,"given":"Jaewon","family":"Lee","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-5537-9623","authenticated-orcid":false,"given":"Sejin","family":"Kwon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6263-8355","authenticated-orcid":false,"given":"Jin Young","family":"Ko","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3103-293X","authenticated-orcid":false,"given":"Yulhyun","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-8419-7025","authenticated-orcid":false,"given":"Jinju","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3299-3038","authenticated-orcid":false,"given":"Ju Seok","family":"Ryu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0365-2923","authenticated-orcid":false,"given":"Seo Yeon","family":"Yoon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9789-0235","authenticated-orcid":false,"given":"Jee Hyun","family":"Suh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,4,23]]},"reference":[{"issue":"1","key":"R1","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1111\/j.1460-6984.2012.00195.x","article-title":"How should children with speech sound disorders be classified? A review and critical evaluation of current classification systems","volume":"48","author":"Waring","journal-title":"Int J Lang Commun Disord"},{"issue":"2","key":"R2","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1044\/2020_LSHSS-20-00057","article-title":"A comparison of intervention intensity and service delivery models with school-age children with speech sound disorders in a school setting","volume":"52","author":"Byers","journal-title":"Lang Speech Hear Serv Sch"},{"key":"R3","doi-asserted-by":"publisher","DOI":"10.2196\/60520","article-title":"Usefulness of automatic speech recognition assessment of children with speech sound disorders: validation study","volume":"27","author":"Kim","journal-title":"J Med Internet Res"},{"issue":"6","key":"R4","doi-asserted-by":"publisher","first-page":"578","DOI":"10.1111\/dmcn.12635","article-title":"Speech sound disorder at 4 years: prevalence, comorbidities, and predictors in a community cohort of children","volume":"57","author":"Eadie","journal-title":"Dev Med Child Neurol"},{"issue":"5","key":"R5","doi-asserted-by":"publisher","first-page":"1175","DOI":"10.1044\/1092-4388(2009\/08-0024)","article-title":"What influences literacy outcome in children with speech sound disorder?","volume":"52","author":"Peterson","journal-title":"J Speech Lang Hear Res"},{"issue":"6","key":"R6","doi-asserted-by":"publisher","DOI":"10.1111\/desc.13117","article-title":"Infants recognize words spoken through opaque masks but not through clear masks","volume":"24","author":"Singh","journal-title":"Dev Sci"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.1016\/j.earlhumdev.2024.106081","article-title":"Prolonged COVID-19 related effects on early language development: a longitudinal study","volume":"195","author":"Pejovic","journal-title":"Early Hum Dev"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.2196\/40690","article-title":"Health care professionals\u2019 experiences in telerehabilitation: qualitative content analysis","volume":"10","author":"Qvarfordt","journal-title":"JMIR Hum Factors"},{"issue":"11","key":"R9","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0291605","article-title":"Telerehabilitation use and experiences in occupational and physical therapy through the early stages of the COVID-19 pandemic","volume":"18","author":"Nguyen","journal-title":"PLoS One"},{"issue":"1","key":"R10","doi-asserted-by":"publisher","first-page":"77","DOI":"10.15724\/jslhd.2017.26.1.008","article-title":"Accuracy of final consonants at word-medial position according to percentage of correct consonants in children with speech sound disorders","volume":"26","author":"Park","journal-title":"J Speech Lang Hear Disord"},{"key":"R11","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2025.1541676","article-title":"More than a chatbot: a practical framework to harness artificial intelligence across key components to boost digital therapeutics quality","volume":"7","author":"Baumel","journal-title":"Front Digit Health"},{"issue":"5","key":"R12","doi-asserted-by":"publisher","first-page":"2207","DOI":"10.4103\/jfmpc.jfmpc_105_20","article-title":"Role of digital therapeutics and the changing future of healthcare","volume":"9","author":"Dang","journal-title":"J Family Med Prim Care"},{"issue":"4","key":"R13","doi-asserted-by":"publisher","DOI":"10.1002\/btm2.10536","article-title":"Digital therapeutics in the clinic","volume":"8","author":"Phan","journal-title":"Bioeng Transl Med"},{"issue":"3","key":"R14","doi-asserted-by":"publisher","first-page":"87","DOI":"10.13064\/KSSS.2024.16.3.087","article-title":"Automatic detection of speech sound disorder in children using automatic speech recognition and audio classification","volume":"16","author":"Sung","journal-title":"Phon Speech Sci"},{"issue":"8","key":"R15","doi-asserted-by":"publisher","DOI":"10.3390\/brainsci12081011","article-title":"The reliability and validity of speech-language pathologists\u2019 estimations of intelligibility in dysarthria","volume":"12","author":"Hirsch","journal-title":"Brain Sci"},{"issue":"6","key":"R16","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0020476","article-title":"Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review","volume":"6","author":"Boulkedid","journal-title":"PLoS One"},{"key":"R17","doi-asserted-by":"publisher","DOI":"10.2174\/17450179-v19-230615-2022-27","article-title":"Delphi survey of items for the Test of Stuttering Screening in Children (TSSC)","volume":"19","author":"Varghese","journal-title":"Clin Pract Epidemiol Ment Health"},{"issue":"4","key":"R18","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1080\/0144341970170401","article-title":"Delphi: a technique to harness expert opinion for critical decision\u2010making tasks in education","volume":"17","author":"Clayton","journal-title":"Educ Psychol"},{"issue":"1","key":"R19","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1177\/0748175613513808","article-title":"Critical values for Lawshe\u2019s content validity ratio: revisiting the original methods of calculation","volume":"47","author":"Ayre","journal-title":"Meas Eval Couns Dev"},{"issue":"9","key":"R20","doi-asserted-by":"publisher","first-page":"105768","DOI":"10.1016\/j.jamda.2025.105768","article-title":"Mental health-related quality indicators for long-term care: a modified Delphi consensus study","volume":"26","author":"Brooks","journal-title":"J Am Med Dir Assoc"},{"issue":"2","key":"R21","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pgph.0002752","article-title":"Matching the right study design to decision-maker questions: results from a Delphi study","volume":"4","author":"Mansilla","journal-title":"PLOS Glob Public Health"},{"issue":"5","key":"R22","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1016\/j.apnu.2010.02.001","article-title":"Seen as core: a Delphi consensus study of essential elements of mental health nursing care in Ireland","volume":"24","author":"MacNeela","journal-title":"Arch Psychiatr Nurs"}],"container-title":["JMIR Formative Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e90110","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:15:33Z","timestamp":1782839733000},"score":1,"resource":{"primary":{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e90110"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,23]]},"references-count":22,"URL":"https:\/\/doi.org\/10.2196\/90110","relation":{},"ISSN":["2561-326X"],"issn-type":[{"value":"2561-326X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,23]]},"article-number":"v10i1e90110"}}