{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,19]],"date-time":"2026-11-19T17:47:17Z","timestamp":1795110437930,"version":"4.10.3"},"reference-count":70,"publisher":"American Speech Language Hearing Association","issue":"9S","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Speech Lang Hear Res"],"published-print":{"date-parts":[[2024,9,26]]},"abstract":"<jats:sec>\n            <jats:title>Purpose:<\/jats:title>\n            <jats:p>The current standard for clinical diagnosis of childhood apraxia of speech (CAS) is expert clinician judgment. The psychometric properties of this standard are not well understood; however, they are important for improving clinical diagnosis. The purpose of this study is to determine the extent to which experts agree on the clinical diagnosis of CAS using two cohorts of children with mixed speech sound disorders (SSDs).<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Method:<\/jats:title>\n            <jats:p>\n              Speech samples of children with SSDs were obtained from previous and ongoing research from video recordings of children aged 3\u20138 years (\n              <jats:italic>n<\/jats:italic>\n              = 36) and audio recordings of children aged 8\u201317 years (\n              <jats:italic>n<\/jats:italic>\n              = 56). A total of 23 expert, English-speaking clinicians were recruited internationally. Three of these experts rated each speech sample to provide a description of the observed features and a diagnosis. Intrarater reliability was acceptable at 85% agreement.\n            <\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results:<\/jats:title>\n            <jats:p>Interrater reliability on the presence or absence of CAS among experts was poor both as a categorical diagnosis (\u03ba = .187, 95% confidence interval [CI] [0.089, 0.286]) and on a continuous \u201clikelihood of CAS\u201d scale (0\u2013100; intraclass correlation = .183, 95% CI [.037, .347]). Reliability was similar across the video-recorded and audio-only samples. There was greater agreement on other diagnoses (such as articulation disorder) than on the diagnosis of CAS, although these too did not meet the predetermined standard. Likelihood of CAS was greater in children who presented with more American Speech-Language-Hearing Association CAS consensus features.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusions:<\/jats:title>\n            <jats:p>Different expert raters had different thresholds for applying the diagnosis of CAS. If expert clinician judgment is to be used for diagnosis of CAS or other SSDs, further standardization and calibration is needed to increase interrater reliability. Diagnosis may require operationalized checklists or reliable measures that operate along a diagnostic continuum.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Supplemental Material:<\/jats:title>\n            <jats:p>\n              <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/doi.org\/10.23641\/asha.23949105\">https:\/\/doi.org\/10.23641\/asha.23949105<\/jats:ext-link>\n            <\/jats:p>\n          <\/jats:sec>","DOI":"10.1044\/2023_jslhr-22-00677","type":"journal-article","created":{"date-parts":[[2023,8,29]],"date-time":"2023-08-29T13:27:11Z","timestamp":1693315631000},"page":"3309-3326","source":"Crossref","is-referenced-by-count":17,"title":["The Reliability of Expert Diagnosis of Childhood Apraxia of Speech"],"prefix":"10.1044","volume":"67","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0883-155X","authenticated-orcid":false,"given":"Elizabeth","family":"Murray","sequence":"first","affiliation":[{"name":"The University of Sydney, New South Wales, Australia"},{"name":"Remarkable Speech + Movement, Sydney, New South Wales, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2235-901X","authenticated-orcid":false,"given":"Shelley","family":"Velleman","sequence":"additional","affiliation":[{"name":"The University of Vermont, Burlington"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9971-6321","authenticated-orcid":false,"given":"Jonathan L.","family":"Preston","sequence":"additional","affiliation":[{"name":"Syracuse University, NY"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2089-0752","authenticated-orcid":false,"given":"Robert","family":"Heard","sequence":"additional","affiliation":[{"name":"The University of Sydney, New South Wales, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6409-9922","authenticated-orcid":false,"given":"Akhila","family":"Shibu","sequence":"additional","affiliation":[{"name":"The University of Sydney, New South Wales, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5182-1007","authenticated-orcid":false,"given":"Patricia","family":"McCabe","sequence":"additional","affiliation":[{"name":"The University of Sydney, New South Wales, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1310","reference":[{"issue":"95","key":"e_1_3_2_2_1","first-page":"1129","article-title":"Variations in breast cancer detection rates during mammogram-reading sessions: Does experience have an impact?","volume":"1","author":"Alshabibi A. S.","year":"2022","unstructured":"Alshabibi, A. S., Suleiman, M. E., Albeshan, S. M., Tapia, K. A., Heard, R., & Brennan, P. C. (2022). Variations in breast cancer detection rates during mammogram-reading sessions: Does experience have an impact? British Journal of Radiology, 1(95), 1129. https:\/\/doi.org\/10.1259\/bjr.20210895","journal-title":"British Journal of Radiology"},{"key":"e_1_3_2_3_1","unstructured":"American Speech-Language-Hearing Association. (2007). Childhood apraxia of speech [Technical report]. http:\/\/www.asha.org\/policy\/TR2007-00278\/"},{"key":"e_1_3_2_4_1","doi-asserted-by":"publisher","DOI":"10.1044\/0161-1461(2010\/09-0075)"},{"key":"e_1_3_2_5_1","doi-asserted-by":"publisher","DOI":"10.1044\/2020_PERSP-19-00086"},{"key":"e_1_3_2_6_1","unstructured":"Boersma P. & Weenink D. (2022). Praat: Doing phonetics by computer (Version 6.3.01) [Computer program]. http:\/\/www.praat.org\/"},{"key":"e_1_3_2_7_1","doi-asserted-by":"publisher","DOI":"10.1080\/17549507.2021.2018496"},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcomdis.2020.106033"},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcomdis.2021.106168"},{"key":"e_1_3_2_10_1","doi-asserted-by":"publisher","DOI":"10.1044\/2020_AJSLP-20-00239"},{"key":"e_1_3_2_11_1","doi-asserted-by":"publisher","DOI":"10.3109\/02699209808985211"},{"key":"e_1_3_2_12_1","volume-title":"Motor speech disorders","author":"Duffy J. R.","year":"2019","unstructured":"Duffy, J. R. (2019). Motor speech disorders (4th ed.). Elsevier Health Sciences Division.","edition":"4"},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0031619"},{"key":"e_1_3_2_14_1","doi-asserted-by":"publisher","DOI":"10.1044\/1058-0360(2003\/083)"},{"key":"e_1_3_2_15_1","doi-asserted-by":"publisher","DOI":"10.1177\/0956797615594896"},{"key":"e_1_3_2_16_1","volume-title":"Handbook of inter-rater reliability","author":"Gewt K. L.","year":"2012","unstructured":"Gewt, K. L. (2012). Handbook of inter-rater reliability (5th ed.). AgreeStat Analytics.","edition":"5"},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.1044\/cicsd_43_S_87"},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.1044\/lle19.1.12"},{"key":"e_1_3_2_19_1","volume-title":"Goldman-Fristoe Test of Articulation","author":"Goldman R.","year":"1999","unstructured":"Goldman, R., & Fristoe, M. (1999). Goldman-Fristoe Test of Articulation (2nd ed.). Pearson.","edition":"2"},{"key":"e_1_3_2_20_1","volume-title":"Goldman-Fristoe Test of Articulation","author":"Goldman R.","year":"2015","unstructured":"Goldman, R., & Fristoe, M. (2015). Goldman-Fristoe Test of Articulation (3rd ed.). Pearson.","edition":"3"},{"key":"e_1_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.1044\/2015_JSLHR-S-13-0221"},{"key":"e_1_3_2_22_1","unstructured":"IBM Corp. (2017). IBM SPSS statistics for windows Version 25.0 [Computer software]."},{"key":"e_1_3_2_23_1","doi-asserted-by":"publisher","DOI":"10.1044\/2022_LSHSS-21-00164"},{"key":"e_1_3_2_24_1","doi-asserted-by":"publisher","DOI":"10.1044\/2016_JSLHR-S-15-0184"},{"key":"e_1_3_2_25_1","doi-asserted-by":"publisher","DOI":"10.1044\/persp2.SIG2.47"},{"key":"e_1_3_2_26_1","doi-asserted-by":"publisher","DOI":"10.1044\/1058-0360(2008\/08-0017)"},{"key":"e_1_3_2_27_1","unstructured":"Lauretta M. L. Jarmolowicz A. Amor D. J. Best S. & Morgan A. T. (in press). An investigation of barriers and enablers for genetics in speech-language pathology explored through a case study of childhood apraxia of speech. Journal of Speech Language and Hearing Research."},{"key":"e_1_3_2_28_1","doi-asserted-by":"publisher","DOI":"10.1044\/0161-1461(2004\/014)"},{"issue":"1","key":"e_1_3_2_29_1","first-page":"39","article-title":"Comprehensive assessment of speech sound production in preschool children","volume":"1","author":"Macrae T.","year":"2016","unstructured":"Macrae, T. (2016). Comprehensive assessment of speech sound production in preschool children. SIG 1 Perspectives Language and Education, 1(1), 39\u201356. https:\/\/doi.org\/10.1044\/persp1.SIG1.39","journal-title":"SIG 1 Perspectives Language and Education"},{"key":"e_1_3_2_30_1","doi-asserted-by":"publisher","DOI":"10.1080\/14015439.2016.1185147"},{"key":"e_1_3_2_31_1","first-page":"S130","article-title":"What happens when they grow up: A survey of adults who had childhood apraxia of speech","volume":"22","author":"McCabe P.","year":"2017","unstructured":"McCabe, P., Preston, J., Murray, E., Bricker, G., & Morgan, A. (2017). What happens when they grow up: A survey of adults who had childhood apraxia of speech. Stem-, Spraal en Taalpathologie, 22, S130.","journal-title":"Stem-, Spraal en Taalpathologie"},{"key":"e_1_3_2_32_1","doi-asserted-by":"publisher","DOI":"10.3109\/02699209808985216"},{"key":"e_1_3_2_33_1","doi-asserted-by":"publisher","DOI":"10.1044\/2017_JSLHR-S-16-0385"},{"key":"e_1_3_2_34_1","doi-asserted-by":"publisher","DOI":"10.1044\/2015_LSHSS-14-0120"},{"key":"e_1_3_2_35_1","doi-asserted-by":"publisher","DOI":"10.1044\/2022_LSHSS-21-00149"},{"key":"e_1_3_2_36_1","doi-asserted-by":"publisher","DOI":"10.1177\/1525740110384131"},{"key":"e_1_3_2_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11136-010-9606-8"},{"key":"e_1_3_2_38_1","doi-asserted-by":"publisher","DOI":"10.1044\/2020_AJSLP-20-00063"},{"key":"e_1_3_2_39_1","doi-asserted-by":"publisher","DOI":"10.1044\/2015_JSLHR-S-13-0179"},{"key":"e_1_3_2_40_1","doi-asserted-by":"publisher","DOI":"10.1044\/2014_JSLHR-S-12-0358"},{"key":"e_1_3_2_41_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699206.2018.1513565"},{"key":"e_1_3_2_42_1","doi-asserted-by":"publisher","DOI":"10.1111\/1460-6984.12154"},{"key":"e_1_3_2_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.hpe.2017.12.008"},{"key":"e_1_3_2_44_1","doi-asserted-by":"publisher","DOI":"10.1080\/09638280410001658658"},{"key":"e_1_3_2_45_1","doi-asserted-by":"publisher","DOI":"10.1044\/2022_JSLHR-21-00519"},{"key":"e_1_3_2_46_1","doi-asserted-by":"publisher","DOI":"10.3109\/02699206.2012.736011"},{"key":"e_1_3_2_47_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2016.00440"},{"key":"e_1_3_2_48_1","doi-asserted-by":"publisher","DOI":"10.1044\/2014_JSLHR-S-14-0031"},{"key":"e_1_3_2_49_1","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.13122581"},{"key":"e_1_3_2_50_1","doi-asserted-by":"publisher","DOI":"10.1080\/09638288.2020.1773547"},{"key":"e_1_3_2_51_1","doi-asserted-by":"publisher","DOI":"10.1044\/aas8.2.3"},{"issue":"4","key":"e_1_3_2_52_1","first-page":"146","article-title":"Obtaining and interpreting maximum performance tasks from children: A tutorial","volume":"29","author":"Rvachew S.","year":"2005","unstructured":"Rvachew, S., Hodge, M., & Ohberg, A. (2005). Obtaining and interpreting maximum performance tasks from children: A tutorial. Journal of Speech-Language Pathology & Audiology, 29(4), 146\u2013157.","journal-title":"Journal of Speech-Language Pathology & Audiology"},{"key":"e_1_3_2_53_1","doi-asserted-by":"publisher","DOI":"10.1080\/0269920031000138123"},{"key":"e_1_3_2_54_1","doi-asserted-by":"publisher","DOI":"10.3109\/02699206.2012.655841"},{"key":"e_1_3_2_55_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2010\/10-0068)"},{"key":"e_1_3_2_56_1","doi-asserted-by":"publisher","DOI":"10.1044\/2016_JSLHR-S-15-0297"},{"key":"e_1_3_2_57_1","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.13122399"},{"key":"e_1_3_2_58_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.crad.2013.11.010"},{"key":"e_1_3_2_59_1","doi-asserted-by":"publisher","DOI":"10.1111\/1754-9485.12301"},{"key":"e_1_3_2_60_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12887-020-02421-1"},{"key":"e_1_3_2_61_1","doi-asserted-by":"publisher","DOI":"10.1044\/leader.FTR1.13102008.10"},{"key":"e_1_3_2_62_1","volume-title":"The Dynamic Evaluation of Motor Speech Skill (DEMSS)","author":"Strand E. A.","year":"2019","unstructured":"Strand, E. A., & McCauley, R. J. (2019). The Dynamic Evaluation of Motor Speech Skill (DEMSS). Brookes."},{"key":"e_1_3_2_63_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2012\/12-0094)"},{"issue":"4","key":"e_1_3_2_64_1","first-page":"112","article-title":"Lateral jaw stability in children with developmental speech disorders","volume":"20","author":"Terband H.","year":"2012","unstructured":"Terband, H., van Zaalen, Y., & Maassen, B. (2012). Lateral jaw stability in children with developmental speech disorders. Journal of Medical Speech-Language Pathology, 20(4), 112\u2013118.","journal-title":"Journal of Medical Speech-Language Pathology"},{"key":"e_1_3_2_65_1","doi-asserted-by":"publisher","DOI":"10.1080\/026992099299211"},{"key":"e_1_3_2_66_1","doi-asserted-by":"publisher","DOI":"10.3109\/02699209608985178"},{"key":"e_1_3_2_67_1","unstructured":"Tilkens C. M. Karlsson H. B. Fourakis M. Hall S. D. Mabie H. L. McSweeny J. L. Wilson D. L. & Shriberg L. D. (2017). A diagnostic marker to discriminate childhood apraxia of speech (CAS) from speech delay (SD): The pause marker [Technical report no. 22]. University of Wisconsin-Madison. https:\/\/d76t3e2z91xsi.cloudfront.net\/wp-content\/uploads\/sites\/532\/2018\/05\/TREP22.pdf"},{"key":"e_1_3_2_68_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00787-009-0025-8"},{"key":"e_1_3_2_69_1","doi-asserted-by":"publisher","DOI":"10.1044\/2017_AJSLP-15-0193"},{"key":"e_1_3_2_70_1","volume-title":"Language neutral assessment of motor speech in young children (LAMS)","author":"Velleman S.","unstructured":"Velleman, S., Andrianopoulos, M., & Rupela, V. (in press). Language neutral assessment of motor speech in young children (LAMS). Academic Therapy Publications."},{"key":"e_1_3_2_71_1","doi-asserted-by":"publisher","DOI":"10.1044\/2022_AJSLP-21-00355"}],"container-title":["Journal of Speech, Language, and Hearing Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.asha.org\/doi\/pdf\/10.1044\/2023_JSLHR-22-00677","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,27]],"date-time":"2024-09-27T16:20:26Z","timestamp":1727454026000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.asha.org\/doi\/10.1044\/2023_JSLHR-22-00677"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,26]]},"references-count":70,"journal-issue":{"issue":"9S","published-print":{"date-parts":[[2024,9,26]]}},"alternative-id":["10.1044\/2023_JSLHR-22-00677"],"URL":"https:\/\/doi.org\/10.1044\/2023_jslhr-22-00677","relation":{},"ISSN":["1092-4388","1558-9102"],"issn-type":[{"value":"1092-4388","type":"print"},{"value":"1558-9102","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,26]]}}}