{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T11:47:47Z","timestamp":1780487267446,"version":"3.54.1"},"reference-count":35,"publisher":"American Speech Language Hearing Association","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Am J Speech Lang Pathol"],"published-print":{"date-parts":[[2022,5,10]]},"abstract":"<jats:sec>\n            <jats:title>Purpose:<\/jats:title>\n            <jats:p>Although many valid, reliable, and developmentally sensitive measures exist to monitor the language gains of children who rely on spoken language to communicate, the same is not true for graphic symbol communicators. This study is a first step in developing such measures by examining the interobserver agreement (IOA) and within-observer agreement of 13 measures designed to monitor the language progress of children who use aided augmentative and alternative communication (AAC). These measures are based on the Graphic Symbol Utterance and Sentence Development Framework (Binger et al., 2020) and are hypothesized to capture various phases of graphic symbol communication.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Method:<\/jats:title>\n            <jats:p>Four graduate student observers coded 13 measures across 57 different play-based sessions of children with Down syndrome ages 3;0\u20135;11 (years;months). For IOA, sessions were coded by two different observers. For within-observer agreement, all sessions were recoded by the same coders. Corpus-level analyses were completed to characterize the nature of the samples (e.g., average mean length of utterance for the samples). IOA and within-observer agreement were examined for each utterance.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results:<\/jats:title>\n            <jats:p>Across all observers and measures, acceptable levels of IOA and within-observer agreement were achieved, with most measures yielding relatively high levels of agreement. Some differences were noted across measures, with the less experienced coders demonstrating less agreement on select measures.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusions:<\/jats:title>\n            <jats:p>Results provide initial evidence that many measures based on the Graphic Symbol Utterance and Sentence Development Framework can be reliably coded. These findings are a first step in developing psychometrically sound measures to monitor the expressive language progress of children who use AAC.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Supplemental Material:<\/jats:title>\n            <jats:p>\n              <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/doi.org\/10.23641\/asha.19601551\">https:\/\/doi.org\/10.23641\/asha.19601551<\/jats:ext-link>\n            <\/jats:p>\n          <\/jats:sec>","DOI":"10.1044\/2022_ajslp-21-00341","type":"journal-article","created":{"date-parts":[[2022,4,20]],"date-time":"2022-04-20T22:09:46Z","timestamp":1650492586000},"page":"1394-1411","source":"Crossref","is-referenced-by-count":5,"title":["Aided Language Measures: Establishing Observer Agreement for Communicators in Early Language Phases"],"prefix":"10.1044","volume":"31","author":[{"given":"Jisun P.","family":"Lee","sequence":"first","affiliation":[{"name":"Department of Speech and Hearing Sciences, University of New Mexico, Albuquerque"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4286-0052","authenticated-orcid":false,"given":"Cathy","family":"Binger","sequence":"additional","affiliation":[{"name":"Department of Speech and Hearing Sciences, University of New Mexico, Albuquerque"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nancy","family":"Harrington","sequence":"additional","affiliation":[{"name":"School of Communication Sciences and Disorders, University of Central Florida, Orlando"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Seana","family":"Evelyn","sequence":"additional","affiliation":[{"name":"Department of Speech and Hearing Sciences, University of New Mexico, Albuquerque"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer","family":"Kent-Walsh","sequence":"additional","affiliation":[{"name":"School of Communication Sciences and Disorders, University of Central Florida, Orlando"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cindy","family":"Gevarter","sequence":"additional","affiliation":[{"name":"Department of Speech and Hearing Sciences, University of New Mexico, Albuquerque"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jessica","family":"Richardson","sequence":"additional","affiliation":[{"name":"Department of Speech and Hearing Sciences, University of New Mexico, Albuquerque"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Debbie","family":"Hahs-Vaughn","sequence":"additional","affiliation":[{"name":"College of Community Innovation and Education, University of Central Florida, Orlando"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1310","reference":[{"key":"e_1_3_2_2_1","doi-asserted-by":"publisher","DOI":"10.1080\/07434618.2021.1881824"},{"key":"e_1_3_2_3_1","doi-asserted-by":"publisher","DOI":"10.1044\/2019_LSHSS-19-00065"},{"key":"e_1_3_2_4_1","doi-asserted-by":"publisher","DOI":"10.1044\/2017_JSLHR-L-15-0408"},{"key":"e_1_3_2_5_1","doi-asserted-by":"publisher","DOI":"10.1177\/1525740116655804"},{"key":"e_1_3_2_6_1","doi-asserted-by":"publisher","DOI":"10.1080\/07434618.2019.1576224"},{"issue":"1","key":"e_1_3_2_7_1","first-page":"1","article-title":"The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials","volume":"71","author":"Borrelli B.","year":"2011","unstructured":"Borrelli, B. (2011). The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials. Journal Public Health Dentistry, 71(s1), 1\u201321. https:\/\/doi.org\/10.1111\/j.1752-7325.2011.00233.x","journal-title":"Journal Public Health Dentistry"},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.1044\/2017_JSLHR-L-17-0152"},{"key":"e_1_3_2_9_1","first-page":"167","volume-title":"The Oxford handbook of intellectual disability and development","author":"Chapman R. S.","year":"2011","unstructured":"Chapman, R. S. , & Kay-Raining Bird, E. (2011). Language development in childhood, adolescence, and young adulthood in persons with Down syndrome. In J. A. Burack , R. M. Hodapp , G. Iarocci , & E. Zigler (Eds.), The Oxford handbook of intellectual disability and development (pp. 167\u2013183). Oxford University Press. https:\/\/doi.org\/10.1093\/oxfordhb\/9780195305012.013.0012"},{"key":"e_1_3_2_10_1","doi-asserted-by":"publisher","DOI":"10.1080\/07434619712331277838"},{"key":"e_1_3_2_11_1","unstructured":"EQUATOR Network. (2017). Enhancing the QUAlity and Transparency Of health Research. \nhttp:\/\/www.equator-network.org\/"},{"key":"e_1_3_2_12_1","volume-title":"MacArthur Communicative Development Inventories","author":"Fenson L.","year":"2007","unstructured":"Fenson, L. , Marchman, V. A. , Thal, D. J. , Dale, P. S. , Reznick, S. J. , & Bates, E. (2007). MacArthur Communicative Development Inventories (2nd ed.). Brookes. https:\/\/doi.org\/10.1037\/t11538-000","edition":"2"},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.1348\/000711006X126600"},{"key":"e_1_3_2_14_1","doi-asserted-by":"publisher","DOI":"10.1044\/2014_LSHSS-14-0017"},{"key":"e_1_3_2_15_1","doi-asserted-by":"publisher","DOI":"10.1044\/2017_AJSLP-17-0098"},{"key":"e_1_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1044\/0161-1461(2009\/09-0023)"},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.1080\/02687038.2018.1561416"},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/136828200247197"},{"key":"e_1_3_2_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jaac.2014.01.019"},{"key":"e_1_3_2_20_1","doi-asserted-by":"publisher","DOI":"10.1044\/2015_AJSLP-14-0066"},{"key":"e_1_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.1097\/00011363-199202000-00005"},{"key":"e_1_3_2_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcm.2016.02.012"},{"key":"e_1_3_2_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2010.03.002"},{"key":"e_1_3_2_24_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshd.3801.73"},{"key":"e_1_3_2_25_1","volume-title":"A research primer for communication sciences and disorders","author":"Meline T.","year":"2010","unstructured":"Meline, T. (2010). A research primer for communication sciences and disorders. Pearson."},{"key":"e_1_3_2_26_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3602.338"},{"key":"e_1_3_2_27_1","volume-title":"Language disorders from infancy through adolescence: Listening, speaking, writing, and communicating","author":"Paul R.","year":"2018","unstructured":"Paul, R. , Norbury, C. , & Gosse, C. (2018). Language disorders from infancy through adolescence: Listening, speaking, writing, and communicating (5th ed.). Elsevier.","edition":"5"},{"key":"e_1_3_2_28_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2009\/08-0183)"},{"key":"e_1_3_2_29_1","doi-asserted-by":"publisher","DOI":"10.1080\/03004430212126"},{"key":"e_1_3_2_30_1","doi-asserted-by":"publisher","DOI":"10.1080\/07434618.2019.1584642"},{"key":"e_1_3_2_31_1","first-page":"40","volume-title":"Augmentative and alternative communication: New directions in research and practice","author":"Soto G.","year":"1999","unstructured":"Soto, G. (1999). Understanding the impact of graphic sign use on the message structure. In L. L. Loncke , F. T. Clibbens , J. Arvidson , & H. H. Lloyd (Eds.), Augmentative and alternative communication: New directions in research and practice (pp. 40\u201348). Whurr Publishers."},{"key":"e_1_3_2_32_1","doi-asserted-by":"publisher","DOI":"10.1080\/07434610212331281271"},{"key":"e_1_3_2_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0010-0277(99)00069-4"},{"key":"e_1_3_2_34_1","doi-asserted-by":"publisher","DOI":"10.3109\/07434618.2014.965846"},{"issue":"5","key":"e_1_3_2_35_1","first-page":"360","article-title":"Understanding interobserver agreement: The kappa statistic","volume":"37","author":"Viera A. J.","year":"2005","unstructured":"Viera, A. J. , & Garrett, J. M. (2005). Understanding interobserver agreement: The kappa statistic. Family Medicine, 37(5), 360\u2013363.","journal-title":"Family Medicine"},{"key":"e_1_3_2_36_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3501.130"}],"container-title":["American Journal of Speech-Language Pathology"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/pubs.asha.org\/doi\/pdf\/10.1044\/2022_AJSLP-21-00341","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T15:25:45Z","timestamp":1652196345000},"score":1,"resource":{"primary":{"URL":"http:\/\/pubs.asha.org\/doi\/10.1044\/2022_AJSLP-21-00341"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,10]]},"references-count":35,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,5,10]]}},"alternative-id":["10.1044\/2022_AJSLP-21-00341"],"URL":"https:\/\/doi.org\/10.1044\/2022_ajslp-21-00341","relation":{},"ISSN":["1058-0360","1558-9110"],"issn-type":[{"value":"1058-0360","type":"print"},{"value":"1558-9110","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,10]]}}}