{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T05:55:13Z","timestamp":1785390913460,"version":"3.55.0"},"reference-count":38,"publisher":"Wiley","issue":"7","license":[{"start":{"date-parts":[[2017,3,16]],"date-time":"2017-03-16T00:00:00Z","timestamp":1489622400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"},{"start":{"date-parts":[[2017,3,16]],"date-time":"2017-03-16T00:00:00Z","timestamp":1489622400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"funder":[{"DOI":"10.13039\/100000026","name":"National Institute on Drug Abuse","doi-asserted-by":"publisher","award":["R01 DA036520"],"award-info":[{"award-number":["R01 DA036520"]}],"id":[{"id":"10.13039\/100000026","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Addiction"],"published-print":{"date-parts":[[2017,7]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Aims<\/jats:title>\n                    <jats:p>To compare randomized controlled trial (RCT) sample treatment effects with the population effects of substance use disorder (SUD) treatment.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design<\/jats:title>\n                    <jats:p>Statistical weighting was used to re\u2010compute the effects from 10 RCTs such that the participants in the trials had characteristics that resembled those of patients in the target populations.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Settings<\/jats:title>\n                    <jats:p>Multi\u2010site RCTs and usual SUD treatment settings in the United States.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Participants<\/jats:title>\n                    <jats:p>A total of 3592 patients in 10 RCTs and 1\u2009602\u2009226 patients from usual SUD treatment settings between 2001 and 2009.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Measurements<\/jats:title>\n                    <jats:p>Three outcomes of SUD treatment were examined: retention, urine toxicology and abstinence. We weighted the RCT sample treatment effects using propensity scores representing the conditional probability of participating in RCTs.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Findings<\/jats:title>\n                    <jats:p>Weighting the samples changed the significance of estimated sample treatment effects. Most commonly, positive effects of trials became statistically non\u2010significant after weighting (three trials for retention and urine toxicology and one trial for abstinence); also, non\u2010significant effects became significantly positive (one trial for abstinence) and significantly negative effects became non\u2010significant (two trials for abstinence). There was suggestive evidence of treatment effect heterogeneity in subgroups that are under\u2010 or over\u2010represented in the trials, some of which were consistent with the differences in average treatment effects between weighted and unweighted results.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The findings of randomized controlled trials (RCTs) for substance use disorder treatment do not appear to be directly generalizable to target populations when the RCT samples do not reflect adequately the target populations and there is treatment effect heterogeneity across patient subgroups.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1111\/add.13789","type":"journal-article","created":{"date-parts":[[2017,2,13]],"date-time":"2017-02-13T00:26:38Z","timestamp":1486945598000},"page":"1210-1219","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":55,"title":["Generalizability of findings from randomized controlled trials: application to the National Institute of Drug Abuse Clinical Trials Network"],"prefix":"10.1111","volume":"112","author":[{"given":"Ryoko","family":"Susukida","sequence":"first","affiliation":[{"name":"Department of Mental Health Johns Hopkins Bloomberg School of Public Health  Baltimore MD USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rosa M.","family":"Crum","sequence":"additional","affiliation":[{"name":"Department of Mental Health Johns Hopkins Bloomberg School of Public Health  Baltimore MD USA"},{"name":"Department of Epidemiology Johns Hopkins Bloomberg School of Public Health  Baltimore MD USA"},{"name":"Department of Psychiatry and Behavioral Sciences Johns Hopkins University School of Medicine  Baltimore MD USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cyrus","family":"Ebnesajjad","sequence":"additional","affiliation":[{"name":"Department of Mental Health Johns Hopkins Bloomberg School of Public Health  Baltimore MD USA"},{"name":"The Fred Hutchinson Cancer Research Center  Seattle WA USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elizabeth A.","family":"Stuart","sequence":"additional","affiliation":[{"name":"Department of Mental Health Johns Hopkins Bloomberg School of Public Health  Baltimore MD USA"},{"name":"Department of Biostatistics Johns Hopkins Bloomberg School of Public Health  Baltimore MD USA"},{"name":"Department of Health Policy and Management Johns Hopkins Bloomberg School of Public Health  Baltimore MD USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ramin","family":"Mojtabai","sequence":"additional","affiliation":[{"name":"Department of Mental Health Johns Hopkins Bloomberg School of Public Health  Baltimore MD USA"},{"name":"Department of Psychiatry and Behavioral Sciences Johns Hopkins University School of Medicine  Baltimore MD USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2017,3,16]]},"reference":[{"key":"e_1_2_5_2_1","doi-asserted-by":"publisher","DOI":"10.4088\/JCP.v69n0810"},{"key":"e_1_2_5_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.drugalcdep.2010.04.009"},{"key":"e_1_2_5_4_1","doi-asserted-by":"publisher","DOI":"10.1002\/da.21937"},{"key":"e_1_2_5_5_1","doi-asserted-by":"publisher","DOI":"10.1037\/per0000091"},{"key":"e_1_2_5_6_1","doi-asserted-by":"publisher","DOI":"10.4088\/JCP.12m07935"},{"key":"e_1_2_5_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(04)17670-8"},{"key":"e_1_2_5_8_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-7610.2011.02425.x"},{"key":"e_1_2_5_9_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pctr.0010036"},{"key":"e_1_2_5_10_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1530-0277.2007.00391.x"},{"key":"e_1_2_5_11_1","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.157.4.588"},{"key":"e_1_2_5_12_1","doi-asserted-by":"publisher","DOI":"10.1111\/dar.12438"},{"key":"e_1_2_5_13_1","first-page":"757","article-title":"Assessing sample representativeness in randomized control trials: application to the National Institute of drug abuse clinical trials network","volume":"5","author":"Susukida R.","year":"2016","journal-title":"Addiction"},{"key":"e_1_2_5_14_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1360-0443.2005.01175.x"},{"key":"e_1_2_5_15_1","doi-asserted-by":"publisher","DOI":"10.15288\/jsad.2008.69.757"},{"key":"e_1_2_5_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-985X.2010.00673.x"},{"key":"e_1_2_5_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11121-014-0513-z"},{"key":"e_1_2_5_18_1","doi-asserted-by":"publisher","DOI":"10.1093\/aje\/kwq084"},{"key":"e_1_2_5_19_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.i189"},{"key":"e_1_2_5_20_1","unstructured":"National Institute on Drug Abuse Clinical Trials Network.Clinical trials network (CTN): research studies [internet]. Available at:http:\/\/www.drugabuse.gov\/about\u2010nida\/organization\/cctn\/ctn\/research\u2010studies(accessed 25 February 2017) (Archived athttp:\/\/www.webcitation.org\/6oXVXZtU9)."},{"key":"e_1_2_5_21_1","unstructured":"Substance Abuse and Mental Health Services and Quality.Quick statistics from the drug and alcohol services information system [internet]. Available at:https:\/\/wwwdasis.samhsa.gov\/webt\/tedsweb\/tab_year.choose_year?t_state=HI(accessed 6 November 2016) (Archived athttp:\/\/www.webcitation.org\/6oXXJMRF0on 25 February 2017)."},{"key":"e_1_2_5_22_1","first-page":"18","article-title":"Classification and regression by random Forest","volume":"2","author":"Liaw A.","year":"2002","journal-title":"R News"},{"key":"e_1_2_5_23_1","first-page":"409","volume-title":"R: A Language and Environment for Statistical Computing","author":"R Development Core Team","year":"2016"},{"key":"e_1_2_5_24_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_5_25_1","doi-asserted-by":"publisher","DOI":"10.1002\/sim.3782"},{"key":"e_1_2_5_26_1","first-page":"34","article-title":"Seemingly unrelated estimation and the cluster\u2010adjusted sandwich estimator","volume":"52","author":"Weesie J.","year":"1999","journal-title":"Stata Tech Bull"},{"key":"e_1_2_5_27_1","doi-asserted-by":"publisher","DOI":"10.1214\/09-STS313"},{"key":"e_1_2_5_28_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1360-0443.2005.01154.x"},{"key":"e_1_2_5_29_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1360-0443.2008.02455.x"},{"key":"e_1_2_5_30_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2008.574"},{"key":"e_1_2_5_31_1","doi-asserted-by":"publisher","DOI":"10.1001\/archgenpsychiatry.2011.121"},{"key":"e_1_2_5_32_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-006X.75.4.556"},{"key":"e_1_2_5_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.drugalcdep.2005.08.002"},{"key":"e_1_2_5_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsat.2007.09.006"},{"key":"e_1_2_5_35_1","doi-asserted-by":"publisher","DOI":"10.1001\/archpsyc.62.10.1148"},{"key":"e_1_2_5_36_1","doi-asserted-by":"publisher","DOI":"10.1001\/archpsyc.63.2.201"},{"key":"e_1_2_5_37_1","doi-asserted-by":"publisher","DOI":"10.1377\/hlthaff.28.3.783"},{"key":"e_1_2_5_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11121-005-5553-y"},{"key":"e_1_2_5_39_1","volume-title":"Center for Medicaid and CHIP Services. Affordable Care Act"}],"container-title":["Addiction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fadd.13789","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/add.13789","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/add.13789","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/add.13789","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T05:12:11Z","timestamp":1780981931000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/add.13789"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,3,16]]},"references-count":38,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2017,7]]}},"alternative-id":["10.1111\/add.13789"],"URL":"https:\/\/doi.org\/10.1111\/add.13789","archive":["Portico"],"relation":{},"ISSN":["0965-2140","1360-0443"],"issn-type":[{"value":"0965-2140","type":"print"},{"value":"1360-0443","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,3,16]]},"assertion":[{"value":"2016-07-27","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-02-06","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-03-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}