{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T19:52:14Z","timestamp":1792785134493,"version":"4.5.0"},"reference-count":62,"publisher":"American Speech Language Hearing Association","funder":[{"name":"AI Research Institutes program by National Science Foundation and the Institute of Education Sciences, U.S. Department of Education","award":["Award # 2229873 - National AI Institute for Exceptional Education"],"award-info":[{"award-number":["Award # 2229873 - National AI Institute for Exceptional Education"]}],"id":[{"id":"https:\/\/ror.org\/04et59085","id-type":"ROR","asserted-by":"crossref"}]},{"name":"National Institute on Deafness and Other Communication Disorders","award":["Grant R01DC011023"],"award-info":[{"award-number":["Grant R01DC011023"]}],"id":[{"id":"https:\/\/ror.org\/04mhx6838","id-type":"ROR","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["LSHSS"],"abstract":"<jats:sec>\n                    <jats:title>Purpose:<\/jats:title>\n                    <jats:p>Children with developmental language disorder (DLD) produce more speech disruptions and have a slower speech rate than their peers. This study validated measures of effortful sentence production by examining their association with general language ability and differences between groups of children with DLD and typical language development (TLD). Measures of effort were expected to be related to general language ability, and children with DLD were expected to produce more stall-type disruptions (i.e., repetitions, filled pauses, and unfilled pauses) and use fewer words per minute (WPM) than their peers with TLD.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Method:<\/jats:title>\n                    <jats:p>\n                      Audio-recorded responses to the Redmond Sentence Recall task for 139 children with TLD (\n                      <jats:italic toggle=\"yes\">M<\/jats:italic>\n                      <jats:sub>age<\/jats:sub>\n                      = 86.85 months) and 58 children with DLD (\n                      <jats:italic toggle=\"yes\">M<\/jats:italic>\n                      <jats:sub>age<\/jats:sub>\n                      = 90.64 months) were transcribed, aligned to the audio, and coded for sentence disruptions using the Codes for the Human Analysis of Transcripts form from TalkBank. A custom-made Python script computed measures of stall rate, nondisrupted rate (e.g., the percentage of utterances with no disruptions), and WPM and were examined relative to child performance on the Clinical Evaluation of Language Fundamentals\u2013Fourth Edition.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>When controlling for age, stall rate and nondisrupted rate were moderately correlated with general language ability, and WPM was strongly correlated with general language ability. The DLD group used significantly more stalls and fewer WPM and nondisrupted utterances than did the TLD group.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions:<\/jats:title>\n                    <jats:p>The findings demonstrate that measures of effortful sentence production are systematically associated with language ability. Future directions for leveraging artificial intelligence to automate these measures and exploring their utility as value-added indicators of DLD are discussed.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1044\/2026_lshss-25-00256","type":"journal-article","created":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T13:33:24Z","timestamp":1791552804000},"page":"1-13","source":"Crossref","is-referenced-by-count":1,"title":["Novel Approaches to Language Assessment Part 2: Evaluating Measures of Effort in a Sentence Recall Task for School-Age Children"],"prefix":"10.1044","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0863-9402","authenticated-orcid":false,"given":"Tracy","family":"Preza","sequence":"first","affiliation":[{"name":"Department of Speech and Hearing Science, University of Illinois Urbana\u2013Champaign"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-6107-5612","authenticated-orcid":false,"given":"Dancheng","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, University at Buffalo, NY"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2772-9531","authenticated-orcid":false,"given":"Carol A.","family":"Miller","sequence":"additional","affiliation":[{"name":"Department of Communication Sciences and Disorders, The Pennsylvania State University, University Park"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-2999-5707","authenticated-orcid":false,"given":"Abdlrahman","family":"Alabdallah","sequence":"additional","affiliation":[{"name":"Department of Communication Sciences and Disorders, The Pennsylvania State University, University Park"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2620-4859","authenticated-orcid":false,"given":"Jinjun","family":"Xiong","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, University at Buffalo, NY"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3321-6022","authenticated-orcid":false,"given":"Sean M.","family":"Redmond","sequence":"additional","affiliation":[{"name":"Department of Communication Sciences and Disorders, University of Utah, Salt Lake City"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6814-8288","authenticated-orcid":false,"given":"Pamela A.","family":"Hadley","sequence":"additional","affiliation":[{"name":"Department of Speech and Hearing Science, University of Illinois Urbana\u2013Champaign"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1310","published-online":{"date-parts":[[2026,10,8]]},"reference":[{"key":"e_1_3_2_2_1","doi-asserted-by":"publisher","DOI":"10.3390\/brainsci13111606"},{"key":"e_1_3_2_3_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2009\/08-0099)"},{"key":"e_1_3_2_4_1","volume-title":"Disruptions in sentence production in individuals with and without developmental language disorder: A scoping review [Unpublished manuscript]","author":"Alabdallah A.","year":"2025","unstructured":"Alabdallah, A., & Miller, C. (2025). Disruptions in sentence production in individuals with and without developmental language disorder: A scoping review [Unpublished manuscript]. Department of Communication Sciences and Disorders, The Pennsylvania State University."},{"key":"e_1_3_2_5_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4204.895"},{"key":"e_1_3_2_6_1","doi-asserted-by":"publisher","DOI":"10.1044\/2019_JSLHR-19-00187"},{"key":"e_1_3_2_7_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-024-01199-1"},{"key":"e_1_3_2_8_1","first-page":"129","volume-title":"Late talkers: Language development, interventions, and outcomes","author":"Bernstein Ratner N.","year":"2013","unstructured":"Bernstein Ratner, N. (2013). Using fluency to measure formulation effort in late talkers. In L. A. Rescorla & P. S. Dale (Eds.), Late talkers: Language development, interventions, and outcomes (pp. 129\u2013143). Brookes."},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshd.5203.278"},{"key":"e_1_3_2_10_1","doi-asserted-by":"publisher","DOI":"10.1111\/jcpp.12721"},{"key":"e_1_3_2_11_1","first-page":"945","volume-title":"Handbook of psycholinguistics","author":"Bock K.","year":"1994","unstructured":"Bock, K., & Levelt, W. (1994). Language production: Grammatical encoding. In M. A. Gernsbacher (Ed.), Handbook of psycholinguistics (pp. 945\u2013984). Academic Press."},{"key":"e_1_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.1044\/1058-0360(2002\/005)"},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.1111\/1460-6984.12518"},{"key":"e_1_3_2_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcomdis.2004.04.002"},{"key":"e_1_3_2_15_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699206.2023.2204511"},{"key":"e_1_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1044\/1058-0360(2010\/09-0096)"},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.1080\/13682820902841385"},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.1044\/2021_JSLHR-21-00096"},{"key":"e_1_3_2_19_1","doi-asserted-by":"publisher","DOI":"10.3109\/02699206.2014.882991"},{"key":"e_1_3_2_20_1","doi-asserted-by":"publisher","DOI":"10.1044\/2023_JSLHR-22-00595"},{"key":"e_1_3_2_21_1","volume-title":"Disfluency patterns and speech rate in Mandarin-speaking children with developmental language disorder: Evidence from narrative tasks [Oral presentation]","author":"Geng L.","year":"2025","unstructured":"Geng, L., & Sheng, L. (2025, June). Disfluency patterns and speech rate in Mandarin-speaking children with developmental language disorder: Evidence from narrative tasks [Oral presentation]. Symposium for Research on Child Language Disorders. Madison, WI, United States."},{"key":"e_1_3_2_22_1","doi-asserted-by":"publisher","DOI":"10.1177\/15257401241271417"},{"key":"e_1_3_2_23_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699206.2022.2135024"},{"key":"e_1_3_2_24_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2008\/051)"},{"key":"e_1_3_2_25_1","doi-asserted-by":"publisher","DOI":"10.17759\/cpse.2020090303"},{"key":"e_1_3_2_26_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0272263121000395"},{"key":"e_1_3_2_27_1","unstructured":"Krok W. C. & Hadley P. A. (2023). Sentence Diversity Priming Task: Examiner's manual. https:\/\/sdptonline.web.illinois.edu\/wp-content\/uploads\/2023\/11\/SDPT-Examiners-Manual.pdf [PDF]"},{"key":"e_1_3_2_28_1","doi-asserted-by":"publisher","DOI":"10.1598\/RRQ.45.2.4"},{"key":"e_1_3_2_29_1","doi-asserted-by":"publisher","DOI":"10.1111\/1460-6984.12433"},{"key":"e_1_3_2_30_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2009\/08-0142)"},{"key":"e_1_3_2_31_1","volume-title":"Children with specific language impairment","author":"Leonard L. B.","year":"2017","unstructured":"Leonard, L. B. (2017). Children with specific language impairment (2nd ed). MIT Press.","edition":"2"},{"key":"e_1_3_2_32_1","doi-asserted-by":"publisher","DOI":"10.1044\/2024_JSLHR-24-00039"},{"key":"e_1_3_2_33_1","unstructured":"Liu D. (2025). Automated-effortful-sentence-production-measures [Computer software repository]. GitHub. https:\/\/github.com\/DanchengLiu\/Automated-Effortful-Sentence-Production-Measures"},{"key":"e_1_3_2_34_1","volume-title":"Novel approaches to language screening: AI automated scoring of a sentence recall task for school-age children [Manuscript under review]","author":"Liu D.","year":"2026","unstructured":"Liu, D., Yang, J., Miller, C., Hadley, P., Redmond, S., & Xiong, J. (2026). Novel approaches to language screening: AI automated scoring of a sentence recall task for school-age children [Manuscript under review]."},{"key":"e_1_3_2_35_1","unstructured":"MacWhinney B. (2000). The CHILDES Project: Tools for analyzing talk (3rd ed.). Erlbaum."},{"key":"e_1_3_2_36_1","doi-asserted-by":"publisher","DOI":"10.2307\/jj.26931964.9"},{"key":"e_1_3_2_37_1","volume-title":"Assessment of language disorders in children","author":"McCauley R. J.","year":"2001","unstructured":"McCauley, R. J. (2001). Assessment of language disorders in children. Psychology Press. https:\/\/www.routledge.com\/Assessment-of-Language-Disorders-in-Children\/McCauley\/p\/book\/9780805825626"},{"key":"e_1_3_2_38_1","first-page":"1","article-title":"Benchmarking automatic speech recognition technology for natural language samples of children with and without developmental delays","volume":"2024","author":"McGonigle E.","year":"2024","unstructured":"McGonigle, E., VanDam, M., Wilkinson, C., & Johnson, K. T. (2024). Benchmarking automatic speech recognition technology for natural language samples of children with and without developmental delays. 2024 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2024, 1\u20135. https:\/\/doi.org\/10.1109\/embc53108.2024.10782773","journal-title":"2024 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)"},{"key":"e_1_3_2_39_1","doi-asserted-by":"publisher","DOI":"10.1111\/1460-6984.12008"},{"key":"e_1_3_2_40_1","doi-asserted-by":"publisher","DOI":"10.1111\/1460-6984.70063"},{"key":"e_1_3_2_41_1","doi-asserted-by":"publisher","DOI":"10.1044\/2016_LSHSS-15-0044"},{"key":"e_1_3_2_42_1","doi-asserted-by":"publisher","DOI":"10.1111\/1460-6984.12126"},{"key":"e_1_3_2_43_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699200310001611612"},{"key":"e_1_3_2_44_1","author":"Redmond S. M.","year":"2007","unstructured":"Redmond, S. M. (2007). Redmond Sentence Recall manual. https:\/\/health.utah.edu\/sites\/g\/files\/zrelqx131\/files\/media\/documents\/2021\/R012011_RSRManual_20210310.pdf [PDF]","journal-title":"Redmond Sentence Recall manual"},{"key":"e_1_3_2_45_1","doi-asserted-by":"publisher","DOI":"10.1044\/2019_JSLHR-L-18-0388"},{"key":"e_1_3_2_46_1","unstructured":"Redmond S. M. & Xiong J. (2024). Redmond-sentence-recall [Data set]. AI4ExceptionalEd. Hugging Face. https:\/\/huggingface.co\/datasets\/ai4exceptionaled\/Redmond-Sentence-Recall"},{"key":"e_1_3_2_47_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4106.1412"},{"key":"e_1_3_2_48_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2006\/090)"},{"key":"e_1_3_2_49_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2003\/064)"},{"key":"e_1_3_2_50_1","doi-asserted-by":"publisher","DOI":"10.1044\/2017_JSLHR-L-17-0216"},{"key":"e_1_3_2_51_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2001\/089)"},{"key":"e_1_3_2_52_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2008\/070)"},{"key":"e_1_3_2_53_1","doi-asserted-by":"publisher","DOI":"10.1080\/1057356970130202"},{"key":"e_1_3_2_54_1","volume-title":"Clinical Evaluation of Language Fundamentals\u2013Fourth Edition (CELF-4)","author":"Semel E.","year":"2003","unstructured":"Semel, E., Wiig, E. H., & Secord, W. A. (2003). Clinical Evaluation of Language Fundamentals\u2013Fourth Edition (CELF-4). Pearson."},{"key":"e_1_3_2_55_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4001.95"},{"key":"e_1_3_2_56_1","doi-asserted-by":"publisher","DOI":"10.3109\/02699206.2010.514969"},{"key":"e_1_3_2_57_1","doi-asserted-by":"publisher","DOI":"10.1044\/2019_JSLHR-19-00145"},{"key":"e_1_3_2_58_1","doi-asserted-by":"publisher","DOI":"10.1006\/brcg.2001.1422"},{"key":"e_1_3_2_59_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3504.832"},{"key":"e_1_3_2_60_1","doi-asserted-by":"publisher","DOI":"10.1044\/2025_JSLHR-25-00058"},{"key":"e_1_3_2_61_1","doi-asserted-by":"publisher","DOI":"10.1177\/0265532215594643"},{"key":"e_1_3_2_62_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4202.329"},{"key":"e_1_3_2_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/icassp55912.2026.11461434"}],"container-title":["Language, Speech, and Hearing Services in Schools"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.asha.org\/doi\/pdf\/10.1044\/2026_LSHSS-25-00256","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T18:36:14Z","timestamp":1791830174000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.asha.org\/doi\/10.1044\/2026_LSHSS-25-00256"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,8]]},"references-count":62,"alternative-id":["10.1044\/2026_LSHSS-25-00256"],"URL":"https:\/\/doi.org\/10.1044\/2026_lshss-25-00256","relation":{},"ISSN":["0161-1461","1558-9129"],"issn-type":[{"value":"0161-1461","type":"print"},{"value":"1558-9129","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,8]]}}}