{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,19]],"date-time":"2026-10-19T18:40:29Z","timestamp":1792435229259,"version":"4.5.0"},"reference-count":50,"publisher":"American Speech Language Hearing Association","funder":[{"name":"Maryland Technology Development Corporation","award":["No. 0425-011"],"award-info":[{"award-number":["No. 0425-011"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Speech Lang Hear Res"],"abstract":"<jats:sec>\n                    <jats:title>Purpose:<\/jats:title>\n                    <jats:p>Advances in automatic speech recognition (ASR) and natural language processing have the potential to meaningfully impact language assessment. Despite the increasing availability of these technologies, little is known about their performance in routine assessment tasks such as language sample analysis (LSA), which is commonly used in the identification of developmental language disorder (DLD). This study examined the performance of ASR in transcribing child language samples, as well as the concurrent validity and diagnostic accuracy of metrics derived from an automated LSA system.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Method:<\/jats:title>\n                    <jats:p>We used an existing corpus of narrative samples from 66 children with DLD and 285 with typical language (TL), which included audio recordings and transcripts. We conducted automated LSA using the proprietary software LSA+, which integrates ASR and natural language processing. We evaluated transcription accuracy by comparing ASR transcripts to those included in the corpus. We then examined associations between language ability metrics from ASR and manual transcripts, as well as the diagnostic accuracy of each, by using LSA+ as a common means of analysis for all transcripts.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>\n                      ASR produced less accurate transcripts for children with DLD than for those with TL and for younger children. Despite differences in transcription accuracy, automated LSA measures exhibited positive correlations with their manual counterparts, ranging from\n                      <jats:italic toggle=\"yes\">r<\/jats:italic>\n                      = .79 to .98. Manual LSA measures in isolation exhibited better diagnostic accuracy than that of their automated counterparts. However, composite models with multiple automated metrics yielded the highest accuracy when including mean length of utterance, number of different words, and total number of words, in addition to ASR-derived mean length of speech segment and pauses per word.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion:<\/jats:title>\n                    <jats:p>Full automation of LSA demonstrates the potential to improve the efficiency and robustness of language assessment, particularly when utilizing composite measures. Despite its advantages, automated LSA may result in inaccurate estimates of language ability if used without consideration of its limitations. Continued examination of ASR and related technologies is needed to better understand their efficacy across languages, ages, and types of communication disorders.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1044\/2026_jslhr-25-00543","type":"journal-article","created":{"date-parts":[[2026,10,19]],"date-time":"2026-10-19T18:13:27Z","timestamp":1792433607000},"page":"1-16","source":"Crossref","is-referenced-by-count":0,"title":["Automated Language Sample Analysis for Children With Developmental Language Disorder"],"prefix":"10.1044","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5686-5263","authenticated-orcid":false,"given":"Jos\u00e9 A.","family":"Ortiz","sequence":"first","affiliation":[{"name":"Department of Hearing and Speech Sciences, University of Maryland, College Park"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9528-3346","authenticated-orcid":false,"given":"Yi Ting","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Hearing and Speech Sciences, University of Maryland, College Park"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0955-9495","authenticated-orcid":false,"given":"Nina R.","family":"Benway","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Maryland, College Park"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1310","published-online":{"date-parts":[[2026,10,19]]},"reference":[{"key":"e_1_3_2_2_1","unstructured":"Adobe Inc. (2026). Audition (Version 26) [Computer software]. https:\/\/www.adobe.com\/products\/audition.html"},{"key":"e_1_3_2_3_1","doi-asserted-by":"publisher","DOI":"10.1044\/2023_JSLHR-23-00009"},{"key":"e_1_3_2_4_1","doi-asserted-by":"publisher","DOI":"10.1044\/2022_JSLHR-21-00667"},{"key":"e_1_3_2_5_1","volume-title":"Kid-Whisper: Towards bridging the performance gap in automatic speech recognition for children vs. adults","author":"Attia A. A.","year":"2023","unstructured":"Attia, A. A., Liu, J., Ai, W., Demszky, D., & Espy-Wilson, C. (2023). Kid-Whisper: Towards bridging the performance gap in automatic speech recognition for children vs. adults. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2309.07927"},{"key":"e_1_3_2_6_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4105.1185"},{"key":"e_1_3_2_7_1","doi-asserted-by":"publisher","DOI":"10.1044\/2020_JSLHR-19-00100"},{"key":"e_1_3_2_8_1","first-page":"7124","volume-title":"ICASSP 2020\u20132020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)","author":"Bredin H.","year":"2020","unstructured":"Bredin, H., Yin, R., Coria, J. M., Gelly, G., Korshunov, P., Lavechin, M., Fustes, D., Titeux, H., Bouaziz, W., & Gill, M.-P. (2020). Pyannote.Audio: Neural building blocks for speaker diarization. In ICASSP 2020\u20132020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 7124\u20137128). IEEE. https:\/\/doi.org\/10.1109\/ICASSP40776.2020.9052974"},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.1044\/2017_JSLHR-L-17-0152"},{"key":"e_1_3_2_10_1","doi-asserted-by":"publisher","DOI":"10.1044\/2020_AJSLP-19-00176"},{"key":"e_1_3_2_11_1","volume-title":"The handbook for evidence-based practice in communication disorders","author":"Dollaghan C. A.","year":"2007","unstructured":"Dollaghan, C. A. (2007). The handbook for evidence-based practice in communication disorders. Brookes. https:\/\/products.brookespublishing.com\/The-Handbook-for-Evidence-Based-Practice-in-Communication-Disorders-P72.aspx"},{"key":"e_1_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/0163853X.2021.1972391"},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.1044\/2021_JSLHR-21-00096"},{"key":"e_1_3_2_14_1","doi-asserted-by":"publisher","DOI":"10.1044\/2018_AJSLP-16-0121"},{"key":"e_1_3_2_15_1","volume-title":"Disfluency patterns and speech rate in Mandarin-speaking children with developmental language disorder: Evidence from narrative tasks [Paper presentation]","author":"Geng L.","year":"2025","unstructured":"Geng, L., & Sheng, L. (2025, May 31). Disfluency patterns and speech rate in Mandarin-speaking children with developmental language disorder: Evidence from narrative tasks [Paper presentation]. The 45th Annual Symposium on Research in Child Language Disorders, Madison, WI, United States."},{"key":"e_1_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-020-0260-4"},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.1089\/tmj.2014.0190"},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.1044\/2019_AJSLP-18-0228"},{"key":"e_1_3_2_19_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2008\/051)"},{"key":"e_1_3_2_20_1","doi-asserted-by":"publisher","DOI":"10.1044\/2018_JSLHR-L-17-0313"},{"key":"e_1_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2023-935"},{"key":"e_1_3_2_22_1","doi-asserted-by":"publisher","DOI":"10.1044\/2017_JSLHR-L-16-0335"},{"key":"e_1_3_2_23_1","doi-asserted-by":"publisher","DOI":"10.1044\/2024_JSLHR-24-00515"},{"key":"e_1_3_2_24_1","doi-asserted-by":"publisher","DOI":"10.1044\/2018_LSHSS-17-0046"},{"key":"e_1_3_2_25_1","doi-asserted-by":"publisher","DOI":"10.1044\/2023_JSLHR-22-00642"},{"key":"e_1_3_2_26_1","doi-asserted-by":"publisher","DOI":"10.1162\/coli.2000.26.4.657"},{"key":"e_1_3_2_27_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-5010"},{"key":"e_1_3_2_28_1","volume-title":"Systematic Analysis of Language Transcripts (SALT) (Research version) [Computer software]","author":"Miller J. F.","year":"2012","unstructured":"Miller, J. F., & Iglesias, A. (2012). Systematic Analysis of Language Transcripts (SALT) (Research version) [Computer software]. SALT Software. https:\/\/www.saltsoftware.com\/salt-24-research-license"},{"key":"e_1_3_2_29_1","unstructured":"OpenAI. (2023). Whisper (February 13 version) [Computer software]. https:\/\/pypi.org\/project\/whisper\/"},{"key":"e_1_3_2_30_1","doi-asserted-by":"publisher","DOI":"10.1044\/2019_AJSLP-18-0202"},{"key":"e_1_3_2_31_1","doi-asserted-by":"publisher","DOI":"10.1044\/2021_AJSLP-20-00237"},{"key":"e_1_3_2_32_1","volume-title":"LSA+ [Computer software]","author":"Ortiz J. A.","year":"2025","unstructured":"Ortiz, J. A. (2025). LSA+ [Computer software]."},{"key":"e_1_3_2_33_1","doi-asserted-by":"publisher","DOI":"10.1044\/2025_AJSLP-25-00201"},{"key":"e_1_3_2_34_1","doi-asserted-by":"publisher","DOI":"10.1044\/2024_JSLHR-24-00212"},{"key":"e_1_3_2_35_1","doi-asserted-by":"publisher","DOI":"10.1044\/2016_LSHSS-15-0044"},{"key":"e_1_3_2_36_1","volume-title":"Bilingual English\u2013Spanish Assessment","author":"Pe\u00f1a E. D.","year":"2018","unstructured":"Pe\u00f1a, E. D., Guti\u00e9rrez-Clellen, V., Iglesias, A., & Goldstein, B. (2018). Bilingual English\u2013Spanish Assessment. Brookes. https:\/\/products.brookespublishing.com\/Bilingual-English-Spanish-Assessment-BESA-P1044.aspx"},{"key":"e_1_3_2_37_1","doi-asserted-by":"publisher","DOI":"10.1044\/0161-1461.2501.15"},{"key":"e_1_3_2_38_1","volume-title":"Stanza: A Python natural language processing toolkit for many human languages","author":"Qi P.","year":"2020","unstructured":"Qi, P., Zhang, Y., Zhang, Y., Bolton, J., & Manning, C. D. (2020). Stanza: A Python natural language processing toolkit for many human languages. arXiv. https:\/\/doi.org\/10.18653\/v1\/2020.acl-demos.14"},{"key":"e_1_3_2_39_1","doi-asserted-by":"publisher","DOI":"10.1044\/2022_JSLHR-22-00121"},{"key":"e_1_3_2_40_1","volume-title":"R: A language and environment for statistical computing [Computer software]","author":"R Core Team","year":"2024","unstructured":"R Core Team. (2024). R: A language and environment for statistical computing [Computer software]. R Foundation for Statistical Computing. https:\/\/www.R-project.org\/"},{"key":"e_1_3_2_41_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4106.1398"},{"key":"e_1_3_2_42_1","unstructured":"Rev. (2024). Rev AI Speech-to-Text API [Computer software]. https:\/\/www.rev.ai\/"},{"key":"e_1_3_2_43_1","volume-title":"The Edmonton Narrative Norms Instrument","author":"Schneider P.","year":"2005","unstructured":"Schneider, P., Dub\u00e9, R. V., & Hayward, D. (2005). The Edmonton Narrative Norms Instrument. University of Alberta Faculty of Rehabilitation Medicine. https:\/\/www.rehabresearch.ualberta.ca\/enni"},{"issue":"4","key":"e_1_3_2_44_1","first-page":"224","article-title":"Storytelling from pictures using the Edmonton Narrative Norms Instrument","volume":"30","author":"Schneider P.","year":"2006","unstructured":"Schneider, P., Hayward, D., & Dub\u00e9, R. V. (2006). Storytelling from pictures using the Edmonton Narrative Norms Instrument. Canadian Journal of Speech-Language Pathology and Audiology, 30(4), 224\u2013238.","journal-title":"Canadian Journal of Speech-Language Pathology and Audiology"},{"key":"e_1_3_2_45_1","volume-title":"Clinical Evaluation of Language Fundamentals\u2013Third Edition: CELF-3","author":"Semel E. M.","year":"1995","unstructured":"Semel, E. M., Wiig, E. H., & Secord, W. (1995). Clinical Evaluation of Language Fundamentals\u2013Third Edition: CELF-3. Pearson. https:\/\/www.pearsonassessments.com\/en-us\/Store\/Professional-Assessments\/Developmental-Early-Childhood\/Clinical-Evaluation-of-Language-Fundamentals-Preschool-3\/p\/100002031"},{"key":"e_1_3_2_46_1","unstructured":"TalkBank. (n.d.). CHILDES. Retrieved July 11 2025 from https:\/\/talkbank.org\/childes\/"},{"key":"e_1_3_2_47_1","doi-asserted-by":"publisher","DOI":"10.1044\/2024_JSLHR-24-00045"},{"key":"e_1_3_2_48_1","volume-title":"Clinical Evaluation of Language Fundamentals\u2013Preschool","author":"Wiig E. H.","year":"1991","unstructured":"Wiig, E. H., Secord, W., & Semel, E. M. (1991). Clinical Evaluation of Language Fundamentals\u2013Preschool. Psychological Corporation."},{"key":"e_1_3_2_49_1","doi-asserted-by":"publisher","DOI":"10.1044\/2024_LSHSS-24-00035"},{"key":"e_1_3_2_50_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2018-2297"},{"key":"e_1_3_2_51_1","doi-asserted-by":"publisher","DOI":"10.21037\/atm-19-3097"}],"container-title":["Journal of Speech, Language, and Hearing Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.asha.org\/doi\/pdf\/10.1044\/2026_JSLHR-25-00543","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,19]],"date-time":"2026-10-19T18:13:30Z","timestamp":1792433610000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.asha.org\/doi\/10.1044\/2026_JSLHR-25-00543"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,19]]},"references-count":50,"alternative-id":["10.1044\/2026_JSLHR-25-00543"],"URL":"https:\/\/doi.org\/10.1044\/2026_jslhr-25-00543","relation":{},"ISSN":["1092-4388","1558-9102"],"issn-type":[{"value":"1092-4388","type":"print"},{"value":"1558-9102","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,19]]}}}