{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T05:01:18Z","timestamp":1788238878238,"version":"build-2803163510"},"reference-count":19,"publisher":"American Speech Language Hearing Association","issue":"5","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Speech Lang Hear Res"],"published-print":{"date-parts":[[1992,10]]},"abstract":"<jats:p>This study evaluated the reliability with which relatively sophisticated and unsophisticated judges used a 9-point scale to rate the speech naturalness of speech samples from 10 clients in a treatment program for stuttering that employed prolonged speech. Judges rated repeated speech samples from different speakers during various phases of the program. Different groups of sophisticated and unsophisticated judges made ratings at either 15 sec, 30 sec, or 60 sec intervals while listening to the samples. Of the reliability indices, intraclass correlations were significantly higher for sophisticated judges although the consistency and agreement of unsophisticated judges were generally equivalent to that of sophisticated judges. Both agreement scores and intraclass correlations were higher when ratings were made at 60 sec rather than 30 sec intervals. The predominant variable that influenced judgment reliability appeared to be differences among the subjects. The methodology partially replicated Martin, Haroldson, and Triden\u2019s (1984) initial investigation on the use of this scale. However, the levels of intra- or interjudge reliability in this study were lower than the levels achieved by Martin et al.\u2019s judges. There were important differences between the Martin et al. study and this one that may account for the findings, and these are discussed.<\/jats:p>","DOI":"10.1044\/jshr.3505.994","type":"journal-article","created":{"date-parts":[[2014,7,29]],"date-time":"2014-07-29T21:21:07Z","timestamp":1406668867000},"page":"994-1001","source":"Crossref","is-referenced-by-count":34,"title":["Reliability of Speech Naturalness Ratings of Stuttered Speech During Treatment"],"prefix":"10.1044","volume":"35","author":[{"given":"Mark","family":"Onslow","sequence":"first","affiliation":[{"name":"School of Communication Disorders The University of Sydney, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roger","family":"Adams","sequence":"additional","affiliation":[{"name":"Department of Behavioural Sciences The University of Sydney, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roger","family":"Ingham","sequence":"additional","affiliation":[{"name":"Department of Speech and Hearing Sciences University of California Santa Barbara"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1310","reference":[{"key":"e_1_3_2_2_1","first-page":"460","article-title":"Generalizability of behavioral observations: A clarification of interobserver agreement and interobserver reliability","volume":"83","author":"Berk R. A.","year":"1979","journal-title":"American Journal of Mental Deficiency"},{"key":"e_1_3_2_3_1","first-page":"303","volume-title":"Nature and treatment of stuttering","author":"Costello J. M.","year":"1984"},{"key":"e_1_3_2_4_1","unstructured":"Fowler S. C. & Ingham R. J. (1986). Stuttering treatment rating recorder. Santa Barbara: University of California."},{"key":"e_1_3_2_5_1","unstructured":"Hays W. L. (1963). Statistics for the social sciences. New York: Holt Rinehart and Winston."},{"key":"e_1_3_2_6_1","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1037\/0033-2909.93.3.586","article-title":"Intraclass correlations: There\u2019s more there than meets the eye","volume":"93","author":"Lahey M. A.","year":"1983","journal-title":"Psychological Bulletin"},{"key":"e_1_3_2_7_1","unstructured":"Ingham R. J. (1981). Stuttering therapy manual: Hierarchy control schedule. Sydney: Cumberland College of Health Sciences."},{"key":"e_1_3_2_8_1","unstructured":"Ingham R. J. (1990). Stuttering. In A. S. Bellack M. Hersen A. E. & Kazdin (Eds). International handbook of behavior modification and therapy (2nd Ed.) (pp. 599\u2013631). New York: Plenum Press."},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshd.5002.217"},{"key":"e_1_3_2_10_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3202.419"},{"key":"e_1_3_2_11_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.2804.495"},{"key":"e_1_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshd.5003.261"},{"key":"e_1_3_2_13_1","volume-title":"Paper presented at American Speech-Language-Hearing Association Convention","author":"Ingham R. J.","year":"1990"},{"key":"e_1_3_2_14_1","volume-title":"Unpublished masters thesis","author":"Mackey L. S.","year":"1988"},{"key":"e_1_3_2_15_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshd.4901.53"},{"key":"e_1_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshd.5503.516"},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshd.5201.02"},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshd.5503.434"},{"key":"e_1_3_2_19_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.86.2.420"},{"key":"e_1_3_2_20_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0076640"}],"container-title":["Journal of Speech, Language, and Hearing Research"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/pubs.asha.org\/doi\/pdf\/10.1044\/jshr.3505.994","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,4,19]],"date-time":"2021-04-19T04:56:23Z","timestamp":1618808183000},"score":1,"resource":{"primary":{"URL":"http:\/\/pubs.asha.org\/doi\/10.1044\/jshr.3505.994"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1992,10]]},"references-count":19,"journal-issue":{"issue":"5","published-print":{"date-parts":[[1992,10]]}},"alternative-id":["10.1044\/jshr.3505.994"],"URL":"https:\/\/doi.org\/10.1044\/jshr.3505.994","relation":{},"ISSN":["1092-4388","1558-9102"],"issn-type":[{"value":"1092-4388","type":"print"},{"value":"1558-9102","type":"electronic"}],"subject":[],"published":{"date-parts":[[1992,10]]}}}