{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T04:18:13Z","timestamp":1780978693450,"version":"3.54.1"},"reference-count":67,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2018,2,19]],"date-time":"2018-02-19T00:00:00Z","timestamp":1518998400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Child Psychology Psychiatry"],"published-print":{"date-parts":[[2019,1]]},"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>\n                      A better understanding of factors contributing to the observed variability in estimates of test\u2013retest reliability in published studies on standardized diagnostic interviews (\n                      <jats:styled-content style=\"fixed-case\">SDI<\/jats:styled-content>\n                      ) is needed. The objectives of this systematic review and meta\u2010analysis were to estimate the pooled test\u2013retest reliability for parent and youth assessments of seven common disorders, and to examine sources of between\u2010study heterogeneity in reliability.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Following a systematic review of the literature, multilevel random effects meta\u2010analyses were used to analyse 202 reliability estimates (Cohen's kappa\u00a0=\u00a0\u04a1) from 31 eligible studies and 5,369 assessments of 3,344 children and youth.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Pooled reliability was moderate at \u04a1\u00a0=\u00a0.58 (\n                      <jats:styled-content style=\"fixed-case\">CI<\/jats:styled-content>\n                      95% 0.53\u20130.63) and between\u2010study heterogeneity was substantial (\n                      <jats:italic>Q\u00a0<\/jats:italic>\n                      =\n                      <jats:italic>\u00a0<\/jats:italic>\n                      2,063 (\n                      <jats:italic>df<\/jats:italic>\n                      \u00a0=\u00a0201),\n                      <jats:italic>p<\/jats:italic>\n                      \u00a0&lt;\u00a0.001 and\n                      <jats:italic>I<\/jats:italic>\n                      <jats:sup>2<\/jats:sup>\n                      \u00a0=\u00a079%). In subgroup analysis, reliability varied across informants for specific types of psychiatric disorder (\u04a1\u00a0=\u00a0.53\u2013.69 for parent vs. \u04a1\u00a0=\u00a0.39\u2013.68 for youth) with estimates significantly higher for parents on attention deficit hyperactivity disorder, oppositional defiant disorder and the broad groupings of externalizing and any disorder. Reliability was also significantly higher in studies with indicators of poor or fair study methodology quality (sample size &lt;50, retest interval &lt;7\u00a0days).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>\n                      Our findings raise important questions about the meaningfulness of published evidence on the test\u2013retest reliability of\n                      <jats:styled-content style=\"fixed-case\">SDI<\/jats:styled-content>\n                      s and the usefulness of these tools in both clinical and research contexts. Potential remedies include the introduction of standardized study and reporting requirements for reliability studies, and exploration of other approaches to assessing and classifying child and adolescent psychiatric disorder.\n                    <\/jats:p>\n                  <\/jats:sec>","DOI":"10.1111\/jcpp.12876","type":"journal-article","created":{"date-parts":[[2018,2,21]],"date-time":"2018-02-21T11:55:17Z","timestamp":1519214117000},"page":"16-29","source":"Crossref","is-referenced-by-count":19,"title":["Research Review: Test\u2013retest reliability of standardized diagnostic interviews to assess child and adolescent psychiatric disorders: a systematic review and meta\u2010analysis"],"prefix":"10.1111","volume":"60","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7120-6629","authenticated-orcid":false,"given":"Laura","family":"Duncan","sequence":"first","affiliation":[{"name":"Offord Centre for Child Studies McMaster University Hamilton ON Canada"},{"name":"Department of Psychiatry &amp; Behavioural Neurosciences McMaster University Hamilton ON Canada"},{"name":"Department of Health Research Methods, Evidence &amp; Impact (formerly Clinical Epidemiology and Biostatistics) McMaster University Hamilton ON Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinette","family":"Comeau","sequence":"additional","affiliation":[{"name":"Offord Centre for Child Studies McMaster University Hamilton ON Canada"},{"name":"Department of Psychiatry &amp; Behavioural Neurosciences McMaster University Hamilton ON Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Li","family":"Wang","sequence":"additional","affiliation":[{"name":"Offord Centre for Child Studies McMaster University Hamilton ON Canada"},{"name":"Department of Psychiatry &amp; Behavioural Neurosciences McMaster University Hamilton ON Canada"},{"name":"Department of Health Research Methods, Evidence &amp; Impact (formerly Clinical Epidemiology and Biostatistics) McMaster University Hamilton ON Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Irene","family":"Vitoroulis","sequence":"additional","affiliation":[{"name":"Offord Centre for Child Studies McMaster University Hamilton ON Canada"},{"name":"Department of Psychiatry &amp; Behavioural Neurosciences McMaster University Hamilton ON Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael H.","family":"Boyle","sequence":"additional","affiliation":[{"name":"Offord Centre for Child Studies McMaster University Hamilton ON Canada"},{"name":"Department of Psychiatry &amp; Behavioural Neurosciences McMaster University Hamilton ON Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kathryn","family":"Bennett","sequence":"additional","affiliation":[{"name":"Offord Centre for Child Studies McMaster University Hamilton ON Canada"},{"name":"Department of Health Research Methods, Evidence &amp; Impact (formerly Clinical Epidemiology and Biostatistics) McMaster University Hamilton ON Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2018,2,19]]},"reference":[{"key":"e_1_2_8_2_1","volume-title":"ASEBA school\u2010age forms & profiles","author":"Achenbach T.M.","year":"2001"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1176\/appi.books.9780890425596"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jaac.2012.02.020"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1995.tb02031.x"},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.12"},{"key":"e_1_2_8_7_1","doi-asserted-by":"publisher","DOI":"10.1002\/mpr.1544"},{"key":"e_1_2_8_8_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-7610.1993.tb00979.x"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1097\/00004583-199810000-00018"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.1097\/00004583-199507000-00019"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0033291799008880"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.4135\/9781412985642"},{"key":"e_1_2_8_13_1","doi-asserted-by":"publisher","DOI":"10.1002\/sim.1180"},{"key":"e_1_2_8_14_1","first-page":"127","article-title":"Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior","volume":"86","author":"Cicchetti D.V.","year":"1981","journal-title":"American Journal of Mental Deficiency"},{"key":"e_1_2_8_15_1","volume-title":"Epidemiology for the uninitiated","author":"Coggon D.","year":"2009"},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.131.4.483"},{"key":"e_1_2_8_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/0197-2456(86)90046-2"},{"key":"e_1_2_8_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0197-2456(05)80019-4"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1097\/NMD.0000000000000300"},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.2307\/1130193"},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.1177\/1049731504265832"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-7610.1994.tb01282.x"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/0895-4356(90)90158-L"},{"key":"e_1_2_8_24_1","volume-title":"Statistical methods for rates and proportions","author":"Fleiss J.L.","year":"1981"},{"key":"e_1_2_8_25_1","doi-asserted-by":"publisher","DOI":"10.1097\/00004583-200111000-00015"},{"key":"e_1_2_8_26_1","doi-asserted-by":"publisher","DOI":"10.1097\/00004583-198709000-00003"},{"key":"e_1_2_8_27_1","volume-title":"Cochrane handbook for systematic reviews of interventions (Vol. 4)","author":"Higgins J.P.","year":"2011"},{"key":"e_1_2_8_28_1","doi-asserted-by":"publisher","DOI":"10.1002\/sim.1186"},{"key":"e_1_2_8_29_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-7610.1993.tb00967.x"},{"key":"e_1_2_8_30_1","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.2010.09091379"},{"key":"e_1_2_8_31_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1021971724048"},{"key":"e_1_2_8_32_1","doi-asserted-by":"publisher","DOI":"10.1001\/archpsyc.1995.03950130061007"},{"key":"e_1_2_8_33_1","doi-asserted-by":"publisher","DOI":"10.22237\/jmasm\/1177992480"},{"key":"e_1_2_8_34_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1025785008050"},{"key":"e_1_2_8_35_1","doi-asserted-by":"publisher","DOI":"10.1002\/sim.1482"},{"key":"e_1_2_8_36_1","doi-asserted-by":"publisher","DOI":"10.1177\/016146811111300708"},{"key":"e_1_2_8_37_1","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.2011.11010050"},{"key":"e_1_2_8_38_1","unstructured":"Kunz A.(2017).Misclassification and kappa\u2010statistic: theoretical relationship and consequences in application. Data Analysis Seminar from University of Munich. Available fromhttps:\/\/parameterd.files.wordpress.com\/2013\/09\/anne-kunz-misclassification-and-kappa-statistic-theoretical-relationship-and-consequences-in-application-seminar-analyse-fehlerbehafteter-daten-ludwig-maximilians-universit-mc3a4unchen.pdf[last accessed 22 April 2017]."},{"key":"e_1_2_8_39_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"e_1_2_8_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4684-1265-9_8"},{"key":"e_1_2_8_41_1","doi-asserted-by":"publisher","DOI":"10.1177\/1073191114561253"},{"key":"e_1_2_8_42_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0023678"},{"key":"e_1_2_8_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0895-4356(03)00084-2"},{"key":"e_1_2_8_44_1","doi-asserted-by":"publisher","DOI":"10.1097\/00004583-200001000-00013"},{"issue":"2535","key":"e_1_2_8_45_1","article-title":"Preferred reporting items for systematic reviews and meta\u2010analyses: The PRISMA statement","volume":"339","author":"Moher D.","year":"2009","journal-title":"British Medical Journal"},{"key":"e_1_2_8_46_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.2051-5545.2012.tb00128.x"},{"key":"e_1_2_8_47_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1021923808118"},{"key":"e_1_2_8_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11136-014-0632-9"},{"key":"e_1_2_8_49_1","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.2012.12070999"},{"key":"e_1_2_8_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0013-7006(04)95422-X"},{"key":"e_1_2_8_51_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-7610.1996.tb01391.x"},{"key":"e_1_2_8_52_1","doi-asserted-by":"publisher","DOI":"10.1177\/096228029900800102"},{"key":"e_1_2_8_53_1","doi-asserted-by":"publisher","DOI":"10.1097\/00004583-199607000-00013"},{"key":"e_1_2_8_54_1","doi-asserted-by":"publisher","DOI":"10.1097\/00004583-200001000-00014"},{"key":"e_1_2_8_55_1","doi-asserted-by":"publisher","DOI":"10.4088\/JCP.09m05305whi"},{"key":"e_1_2_8_56_1","doi-asserted-by":"publisher","DOI":"10.1177\/096228029800700306"},{"key":"e_1_2_8_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-1498-9_15"},{"key":"e_1_2_8_58_1","doi-asserted-by":"publisher","DOI":"10.1192\/bjp.125.4.341"},{"key":"e_1_2_8_59_1","doi-asserted-by":"publisher","DOI":"10.1093\/med\/9780199685219.001.0001"},{"key":"e_1_2_8_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10742-011-0077-3"},{"key":"e_1_2_8_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11136-011-9960-1"},{"key":"e_1_2_8_62_1","doi-asserted-by":"publisher","DOI":"10.3102\/1076998609346961"},{"key":"e_1_2_8_63_1","doi-asserted-by":"crossref","first-page":"765","DOI":"10.1177\/0013164403251027","article-title":"Multilevel meta\u2010analysis: A comparison with traditional meta\u2010analytical procedures","volume":"63","author":"Noortgate W.","year":"2003","journal-title":"Educational and Psychological Measurement"},{"key":"e_1_2_8_64_1","doi-asserted-by":"publisher","DOI":"10.1159\/000358809"},{"key":"e_1_2_8_65_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v036.i03"},{"key":"e_1_2_8_66_1","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.11"},{"key":"e_1_2_8_67_1","volume-title":"The ICD\u201010 classification of mental and behavioural disorders: Diagnostic criteria for research","author":"World Health Organization","year":"1993"},{"key":"e_1_2_8_68_1","doi-asserted-by":"publisher","DOI":"10.1097\/00004583-198709000-00002"}],"container-title":["Journal of Child Psychology and Psychiatry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fjcpp.12876","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/acamh.onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/jcpp.12876","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,3]],"date-time":"2025-11-03T15:38:29Z","timestamp":1762184309000},"score":1,"resource":{"primary":{"URL":"https:\/\/acamh.onlinelibrary.wiley.com\/doi\/10.1111\/jcpp.12876"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,2,19]]},"references-count":67,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,1]]}},"alternative-id":["10.1111\/jcpp.12876"],"URL":"https:\/\/doi.org\/10.1111\/jcpp.12876","archive":["Portico"],"relation":{},"ISSN":["0021-9630","1469-7610"],"issn-type":[{"value":"0021-9630","type":"print"},{"value":"1469-7610","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,2,19]]}}}