{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,7]],"date-time":"2026-02-07T18:30:40Z","timestamp":1770489040355,"version":"3.49.0"},"reference-count":40,"publisher":"American Speech Language Hearing Association","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Am J Speech Lang Pathol"],"published-print":{"date-parts":[[2020,5,8]]},"abstract":"<jats:sec><jats:title>Purpose<\/jats:title><jats:p>Interventions for speech disorders aim to produce changes that are not only acoustically measurable or perceptible to trained professionals but are also apparent to naive listeners. Due to challenges associated with obtaining ratings from suitably large listener samples, however, few studies currently evaluate speech interventions by this criterion. Online crowdsourcing technologies could enhance the measurement of intervention effects by making it easier to obtain real-world listeners' ratings.<\/jats:p><\/jats:sec><jats:sec><jats:title>Method<\/jats:title><jats:p>Stimuli, drawn from a published study by Sapir et al. (\u201cEffects of intensive voice treatment (Lee Silverman Voice Treatment [LSVT]) on vowel articulation in dysarthric individuals with idiopathic Parkinson disease: Acoustic and perceptual findings\u201d in<jats:italic>Journal of Speech, Language, and Hearing Research, 50<\/jats:italic>(4), 2007), were words produced by individuals who received intensive treatment (LSVT LOUD) for hypokinetic dysarthria secondary to Parkinson's disease. Thirty-six online naive listeners heard randomly ordered pairs of words elicited pre- and posttreatment and reported which they perceived as \u201cmore clearly articulated.\u201d<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Mixed-effects logistic regression indicated that words elicited posttreatment were significantly more likely to be rated \u201cmore clear.\u201d Across individuals, acoustically measured magnitude of change was significantly correlated with pre\u2013post difference in listener ratings.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>These results partly replicate the findings of Sapir et al. (2007) and demonstrate that their acoustically measured changes are detectable by everyday listeners. This supports the viability of using crowdsourcing to obtain more functionally relevant measures of change in clinical speech samples.<\/jats:p><\/jats:sec><jats:sec><jats:title>Supplemental Material<\/jats:title><jats:p><jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/doi.org\/10.23641\/asha.12170112\">https:\/\/doi.org\/10.23641\/asha.12170112<\/jats:ext-link><\/jats:p><\/jats:sec>","DOI":"10.1044\/2019_ajslp-19-00162","type":"journal-article","created":{"date-parts":[[2020,4,25]],"date-time":"2020-04-25T00:46:36Z","timestamp":1587775596000},"page":"873-882","source":"Crossref","is-referenced-by-count":23,"title":["Using Crowdsourced Listeners' Ratings to Measure Speech Changes in Hypokinetic Dysarthria: A Proof-of-Concept Study"],"prefix":"10.1044","volume":"29","author":[{"given":"Christopher","family":"Nightingale","sequence":"first","affiliation":[{"name":"New York University, New York, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michelle","family":"Swartz","sequence":"additional","affiliation":[{"name":"Montclair State University, Bloomfield, NJ"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lorraine Olson","family":"Ramig","sequence":"additional","affiliation":[{"name":"University of Colorado at Boulder, Boulder, CO"},{"name":"The National Center for Voice and Speech, Denver, CO"},{"name":"Columbia University, New York, NY"},{"name":"LSVT Global, Inc., Tucson, AZ"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tara","family":"McAllister","sequence":"additional","affiliation":[{"name":"New York University, New York, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1310","reference":[{"key":"e_1_3_2_2_1","unstructured":"Becker M. & Levine J. (2013). Experigen\u2014An online experiment platform. https:\/\/github.com\/tlozoot\/experigen"},{"key":"e_1_3_2_3_1","unstructured":"Boersma P. & Weenink D. (2010). Praat: Doing phonetics by computer . http:\/\/www.praat.org\/"},{"key":"e_1_3_2_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2018.04.031"},{"key":"e_1_3_2_5_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0057410"},{"key":"e_1_3_2_6_1","volume-title":"Motor speech disorders, 3rd Edition: Substrates, differential diagnosis, and management","author":"Duffy J.","year":"2013"},{"key":"e_1_3_2_7_1","doi-asserted-by":"publisher","DOI":"10.1044\/2016_JSLHR-S-15-0355"},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.1044\/1058-0360(2002\/012)"},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1749-818X.2011.00295.x"},{"key":"e_1_3_2_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.1753"},{"key":"e_1_3_2_11_1","doi-asserted-by":"publisher","DOI":"10.3109\/02699206.2016.1174306"},{"key":"e_1_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.1212\/WNL.17.5.427"},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10683-011-9273-9"},{"key":"e_1_3_2_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-013-0306-1"},{"key":"e_1_3_2_15_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3601.21"},{"key":"e_1_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1044\/2015_AJSLP-15-0059"},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2016.01.032"},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcomdis.2014.11.003"},{"key":"e_1_3_2_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcomdis.2016.07.001"},{"key":"e_1_3_2_20_1","doi-asserted-by":"crossref","first-page":"4464","DOI":"10.1145\/2858036.2858321","volume-title":"Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems","author":"McNaney R.","year":"2016"},{"key":"e_1_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.1044\/2017_AJSLP-17-0032"},{"key":"e_1_3_2_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbef.2017.12.004"},{"issue":"5","key":"e_1_3_2_23_1","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1017\/S1930297500002205","article-title":"Running experiments on Amazon Mechanical Turk","volume":"5","author":"Paolacci G.","year":"2010","journal-title":"Judgment and Decision Making"},{"key":"e_1_3_2_24_1","doi-asserted-by":"publisher","DOI":"10.1044\/2019_AJSLP-18-0261"},{"key":"e_1_3_2_25_1","volume-title":"R: A language and environment for statistical computing","author":"R Core Team","year":"2015"},{"key":"e_1_3_2_26_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3806.1232"},{"key":"e_1_3_2_27_1","doi-asserted-by":"publisher","DOI":"10.1002\/mds.27460"},{"key":"e_1_3_2_28_1","volume-title":"Voice therapy and Parkinson's disease: A longitudinal study of efficacy","author":"Ramig L. O.","year":"1988"},{"key":"e_1_3_2_29_1","doi-asserted-by":"publisher","DOI":"10.1136\/jnnp.71.4.493"},{"key":"e_1_3_2_30_1","doi-asserted-by":"publisher","DOI":"10.1002\/1531-8257(200101)16:1<79::AID-MDS1013>3.0.CO;2-H"},{"key":"e_1_3_2_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcomdis.2007.03.009"},{"key":"e_1_3_2_32_1","doi-asserted-by":"publisher","DOI":"10.1159\/000066148"},{"key":"e_1_3_2_33_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2007\/064)"},{"key":"e_1_3_2_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2018.06.032"},{"key":"e_1_3_2_35_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699206.2019.1604806"},{"key":"e_1_3_2_36_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-010-0039-7"},{"key":"e_1_3_2_37_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2011\/11-0048)"},{"key":"e_1_3_2_38_1","doi-asserted-by":"publisher","DOI":"10.1044\/2014_JSLHR-S-12-0372"},{"key":"e_1_3_2_39_1","doi-asserted-by":"publisher","DOI":"10.1159\/000052649"},{"issue":"4","key":"e_1_3_2_40_1","first-page":"229","article-title":"Perceptual and acoustic predictors of intelligibility and acceptability in Cantonese speakers with dysarthria","volume":"12","author":"Whitehill T. L.","year":"2004","journal-title":"Journal of Medical Speech-Language Pathology"},{"key":"e_1_3_2_41_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2005\/090)"}],"container-title":["American Journal of Speech-Language Pathology"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/pubs.asha.org\/doi\/pdf\/10.1044\/2019_AJSLP-19-00162","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,30]],"date-time":"2023-09-30T09:40:46Z","timestamp":1696066846000},"score":1,"resource":{"primary":{"URL":"http:\/\/pubs.asha.org\/doi\/10.1044\/2019_AJSLP-19-00162"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,8]]},"references-count":40,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,5,8]]}},"alternative-id":["10.1044\/2019_AJSLP-19-00162"],"URL":"https:\/\/doi.org\/10.1044\/2019_ajslp-19-00162","relation":{},"ISSN":["1058-0360","1558-9110"],"issn-type":[{"value":"1058-0360","type":"print"},{"value":"1558-9110","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,5,8]]}}}