{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T18:20:40Z","timestamp":1758824440096},"reference-count":107,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2014,6,11]],"date-time":"2014-06-11T00:00:00Z","timestamp":1402444800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Intl J Lang &amp;amp; Comm Disor"],"published-print":{"date-parts":[[2015,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Event\u2010 and interval\u2010based measurements are two different ways of computing frequency of stuttering. Interval\u2010based methodology emerged as an alternative measure to overcome problems associated with reproducibility in the event\u2010based methodology. No review has been made to study the effect of methodological factors in interval\u2010based absolute reliability data or to compute the agreement between the two methodologies in terms of inter\u2010judge, intra\u2010judge and accuracy (i.e., correspondence between raters\u2019 scores and an established criterion).<\/jats:p><\/jats:sec><jats:sec><jats:title>Aims<\/jats:title><jats:p>To provide a review related to reproducibility of event\u2010based and time\u2010interval measurement, and to verify the effect of methodological factors (training, experience, interval duration, sample presentation order and judgment conditions) on agreement of time\u2010interval measurement; in addition, to determine if it is possible to quantify the agreement between the two methodologies<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods &amp; Procedures<\/jats:title><jats:p>The first two authors searched for articles on ERIC, MEDLINE, PubMed, B\u2010on, CENTRAL and Dissertation Abstracts during January\u2013February 2013 and retrieved 495 articles. Forty\u2010eight articles were selected for review. Content tables were constructed with the main findings.<\/jats:p><\/jats:sec><jats:sec><jats:title>Main Contribution<\/jats:title><jats:p>Articles related to event\u2010based measurements revealed values of inter\u2010 and intra\u2010judge greater than 0.70 and agreement percentages beyond 80%. The articles related to time\u2010interval measures revealed that, in general, judges with more experience with stuttering presented significantly higher levels of intra\u2010 and inter\u2010judge agreement. Inter\u2010 and intra\u2010judge values were beyond the references for high reproducibility values for both methodologies. Accuracy (regarding the closeness of raters\u2019 judgements with an established criterion), intra\u2010 and inter\u2010judge agreement were higher for trained groups when compared with non\u2010trained groups. Sample presentation order and audio\/video conditions did not result in differences in inter\u2010 or intra\u2010judge results. A duration of 5 s for an interval appears to be an acceptable agreement. Explanation for high reproducibility values as well as parameter choice to report those data are discussed.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions &amp; Implications<\/jats:title><jats:p>Both interval\u2010 and event\u2010based methodologies used trained or experienced judges for inter\u2010 and intra\u2010judge determination and data were beyond the references for good reproducibility values. Inter\u2010 and intra\u2010judge values were reported in different metric scales among event\u2010 and interval\u2010based methods studies, making it unfeasible to quantify the agreement between the two methods.<\/jats:p><\/jats:sec>","DOI":"10.1111\/1460-6984.12113","type":"journal-article","created":{"date-parts":[[2014,7,29]],"date-time":"2014-07-29T09:57:55Z","timestamp":1406627875000},"page":"14-30","update-policy":"http:\/\/dx.doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Event\u2010 and interval\u2010based measurement of stuttering: a review"],"prefix":"10.1111","volume":"50","author":[{"given":"Ana Rita S.","family":"Valente","sequence":"first","affiliation":[{"name":"Institute of Electronics and Informatics Engineering of Aveiro (IEETA) University of Aveiro  Aveiro Portugal"},{"name":"Department of Education (DE) University of Aveiro  Aveiro Portugal"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luis M. T.","family":"Jesus","sequence":"additional","affiliation":[{"name":"Institute of Electronics and Informatics Engineering of Aveiro (IEETA) University of Aveiro  Aveiro Portugal"},{"name":"School of Health Sciences (ESSUA) University of Aveiro  Aveiro Portugal"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andreia","family":"Hall","sequence":"additional","affiliation":[{"name":"Institute of Electronics and Informatics Engineering of Aveiro (IEETA) University of Aveiro  Aveiro Portugal"},{"name":"Department of Mathematics University of Aveiro  Aveiro Portugal"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Margaret","family":"Leahy","sequence":"additional","affiliation":[{"name":"Department of Clinical Speech and Language Studies Trinity College Dublin  Dublin Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2014,6,11]]},"reference":[{"key":"e_1_2_9_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2010.05.007"},{"key":"e_1_2_9_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2011.11.006"},{"key":"e_1_2_9_4_1","first-page":"287","article-title":"Meta\u2010analysis of the effect of stuttering treatment","volume":"45","author":"Andrews G.","year":"1980","journal-title":"Journal of Speech and Hearing Research"},{"key":"e_1_2_9_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2008.09.002"},{"key":"e_1_2_9_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2008.04.002"},{"key":"e_1_2_9_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2006.04.004"},{"key":"e_1_2_9_8_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4103.479"},{"key":"e_1_2_9_9_1","doi-asserted-by":"publisher","DOI":"10.1901\/jaba.1987.20-313"},{"key":"e_1_2_9_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/uog.5256"},{"key":"e_1_2_9_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2011.05.002"},{"key":"e_1_2_9_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2012.05.003"},{"key":"e_1_2_9_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(86)90837-8"},{"key":"e_1_2_9_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijnurstu.2009.10.001"},{"key":"e_1_2_9_15_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshd.5503.392"},{"key":"e_1_2_9_16_1","volume-title":"A Handbook On Stuttering","author":"Bloodstein O.","year":"2008"},{"key":"e_1_2_9_17_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3705.1050"},{"key":"e_1_2_9_18_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2008\/063)"},{"key":"e_1_2_9_19_1","doi-asserted-by":"publisher","DOI":"10.1044\/1058-0360(2006\/031)"},{"key":"e_1_2_9_20_1","doi-asserted-by":"publisher","DOI":"10.1186\/1475-2875-8-267"},{"key":"e_1_2_9_21_1","volume-title":"Research Methods in Psychology","author":"Breakwell G.","year":"2012"},{"key":"e_1_2_9_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2006.07.002"},{"key":"e_1_2_9_23_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3702.264"},{"key":"e_1_2_9_24_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4304.951"},{"key":"e_1_2_9_25_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3706.1295"},{"key":"e_1_2_9_26_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3702.279"},{"key":"e_1_2_9_27_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3704.779"},{"key":"e_1_2_9_28_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3801.33"},{"key":"e_1_2_9_29_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3902.298"},{"key":"e_1_2_9_30_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4204.862"},{"key":"e_1_2_9_31_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3503.483"},{"key":"e_1_2_9_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/0094-730X(79)90028-7"},{"key":"e_1_2_9_33_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshd.5502.290"},{"key":"e_1_2_9_34_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2009\/09-0080)"},{"key":"e_1_2_9_35_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.2404.595"},{"key":"e_1_2_9_36_1","first-page":"1033","article-title":"When to use agreement versus reliability measures","volume":"59","author":"De Vet H. C. W.","year":"2006","journal-title":"Journal of Epidemiology"},{"key":"e_1_2_9_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0094-730X(98)00017-5"},{"key":"e_1_2_9_38_1","doi-asserted-by":"publisher","DOI":"10.1044\/1058-0360(2005\/026)"},{"key":"e_1_2_9_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2008.05.004"},{"key":"e_1_2_9_40_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.0302.181"},{"key":"e_1_2_9_41_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4004.821"},{"key":"e_1_2_9_42_1","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/123.10.1985"},{"key":"e_1_2_9_43_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3401.37"},{"key":"e_1_2_9_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2012.07.001"},{"key":"e_1_2_9_45_1","volume-title":"Test of Childhood Stuttering","author":"Gillam R. B.","year":"2009"},{"key":"e_1_2_9_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sapharm.2012.04.004"},{"key":"e_1_2_9_47_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2006\/013)"},{"key":"e_1_2_9_48_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3504.742"},{"key":"e_1_2_9_49_1","doi-asserted-by":"publisher","DOI":"10.1080\/13682820500126627"},{"key":"e_1_2_9_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/0094-730X(89)90008-9"},{"key":"e_1_2_9_51_1","doi-asserted-by":"publisher","DOI":"10.1044\/cicsd_33_S_61"},{"key":"e_1_2_9_52_1","volume-title":"Applied Statistics for the Behavioral Sciences","author":"Hinkle D. E.","year":"2003"},{"key":"e_1_2_9_53_1","first-page":"364","article-title":"The effect of using time intervals of different length on judgements about stuttering","volume":"1","author":"Howell P.","year":"2005","journal-title":"Stammering Research"},{"key":"e_1_2_9_54_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.423937"},{"key":"e_1_2_9_55_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4104.802"},{"key":"e_1_2_9_56_1","doi-asserted-by":"publisher","DOI":"10.1159\/000098342"},{"key":"e_1_2_9_57_1","volume-title":"Stuttering Measurement System (SMS)","author":"Ingham R. J.","year":"1999"},{"key":"e_1_2_9_58_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4003.581"},{"key":"e_1_2_9_59_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3606.1168"},{"key":"e_1_2_9_60_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3603.503"},{"key":"e_1_2_9_61_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3802.315"},{"key":"e_1_2_9_62_1","volume-title":"Stuttering Measurement Assessment and Training (SMAAT)","author":"Ingham R. J.","year":"1998"},{"key":"e_1_2_9_63_1","volume-title":"Stuttering Measurement Assessment and Training (SMAAT)","author":"Ingham R.","year":"1998"},{"key":"e_1_2_9_64_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4002.361"},{"key":"e_1_2_9_65_1","doi-asserted-by":"publisher","DOI":"10.1016\/0094-730X(94)00010-Q"},{"key":"e_1_2_9_66_1","doi-asserted-by":"publisher","DOI":"10.3109\/13682829609033157"},{"key":"e_1_2_9_67_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4206.1347"},{"key":"e_1_2_9_68_1","doi-asserted-by":"publisher","DOI":"10.1016\/0094-730X(88)90001-0"},{"key":"e_1_2_9_69_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"e_1_2_9_70_1","first-page":"158","article-title":"Results of an intensive stuttering therapy program","volume":"17","author":"Langevin M.","year":"1993","journal-title":"Canadian Journal of Speech\u2013Language Pathology and Audiology"},{"key":"e_1_2_9_71_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2006.06.001"},{"key":"e_1_2_9_72_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2010.04.002"},{"key":"e_1_2_9_73_1","volume-title":"The Assessment of Speech\u2010Related Attitudes and Beliefs of People who Stutter","author":"Leith W.","year":"1993"},{"key":"e_1_2_9_74_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3403.492"},{"key":"e_1_2_9_75_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2009\/07-0266)"},{"key":"e_1_2_9_76_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.1604.691"},{"key":"e_1_2_9_77_1","doi-asserted-by":"publisher","DOI":"10.1016\/0021-9924(94)00010-W"},{"key":"e_1_2_9_78_1","volume-title":"Clinical Decision Making in Fluency Disorders","author":"Manning W. H.","year":"2010"},{"key":"e_1_2_9_79_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2013.02.001"},{"key":"e_1_2_9_80_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.2401.59"},{"key":"e_1_2_9_81_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3503.521"},{"key":"e_1_2_9_82_1","doi-asserted-by":"publisher","DOI":"10.1016\/0094-730X(88)90026-5"},{"key":"e_1_2_9_83_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2009.12.003"},{"key":"e_1_2_9_84_1","doi-asserted-by":"publisher","DOI":"10.11613\/BM.2012.031"},{"key":"e_1_2_9_85_1","doi-asserted-by":"publisher","DOI":"10.1901\/jaba.2007.40-501"},{"key":"e_1_2_9_86_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2008\/07-0070)"},{"key":"e_1_2_9_87_1","volume-title":"Stottern: Erkenntnisse, Theorien, Behandlungsmethoden","author":"Natke U.","year":"2010"},{"key":"e_1_2_9_88_1","volume-title":"Psychometric Theory","author":"Nunnally J. C.","year":"1994"},{"key":"e_1_2_9_89_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2003\/073)"},{"key":"e_1_2_9_90_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2008\/014)"},{"key":"e_1_2_9_91_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2008.02.001"},{"key":"e_1_2_9_92_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshd.5503.405"},{"key":"e_1_2_9_93_1","first-page":"27","volume-title":"Treatment Efficacy for Stuttering: A Search for Empirical Bases","author":"Packman A.","year":"1998"},{"key":"e_1_2_9_94_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3704.724"},{"key":"e_1_2_9_95_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3104.696"},{"key":"e_1_2_9_96_1","volume-title":"Stuttering Severity Instrument\u2014Fourth Edition","author":"Riley G.","year":"2009"},{"key":"e_1_2_9_97_1","doi-asserted-by":"publisher","DOI":"10.1016\/0094-730X(87)90031-3"},{"key":"e_1_2_9_98_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0094-730X(02)00128-6"},{"key":"e_1_2_9_99_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3902.396"},{"key":"e_1_2_9_100_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2012.02.001"},{"key":"e_1_2_9_101_1","volume-title":"The Nature of Stuttering","author":"Van Riper C.","year":"1982"},{"key":"e_1_2_9_102_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfludis.2012.01.001"},{"key":"e_1_2_9_103_1","doi-asserted-by":"publisher","DOI":"10.1519\/15184.1"},{"key":"e_1_2_9_104_1","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1044\/cicsd_24_S_27","article-title":"Clinical measurement of stuttering behaviors","volume":"24","author":"Yaruss J. S.","year":"1997","journal-title":"Contemporary Issues in Communication Science and Disorders"},{"key":"e_1_2_9_105_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0094-730X(98)00003-5"},{"key":"e_1_2_9_106_1","first-page":"484","article-title":"Observer agreement for marking moments of stuttering","volume":"29","author":"Young M. A.","year":"1975","journal-title":"Journal of Speech and Hearing Research"},{"key":"e_1_2_9_107_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3403.183"},{"key":"e_1_2_9_108_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4005.1130"}],"container-title":["International Journal of Language &amp; Communication Disorders"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2F1460-6984.12113","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2F1460-6984.12113","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/1460-6984.12113","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,2]],"date-time":"2023-10-02T12:14:48Z","timestamp":1696248888000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/1460-6984.12113"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,6,11]]},"references-count":107,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2015,1]]}},"alternative-id":["10.1111\/1460-6984.12113"],"URL":"https:\/\/doi.org\/10.1111\/1460-6984.12113","archive":["Portico"],"relation":{},"ISSN":["1368-2822","1460-6984"],"issn-type":[{"value":"1368-2822","type":"print"},{"value":"1460-6984","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,6,11]]},"assertion":[{"value":"2013-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-06-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}