{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,21]],"date-time":"2026-03-21T09:35:57Z","timestamp":1774085757362,"version":"3.50.1"},"reference-count":49,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2021,5,10]],"date-time":"2021-05-10T00:00:00Z","timestamp":1620604800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000060","name":"National Institute of Allergy and Infectious Diseases","doi-asserted-by":"publisher","award":["P30AI050410"],"award-info":[{"award-number":["P30AI050410"]}],"id":[{"id":"10.13039\/100000060","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000060","name":"National Institute of Allergy and Infectious Diseases","doi-asserted-by":"publisher","award":["R25AI140495"],"award-info":[{"award-number":["R25AI140495"]}],"id":[{"id":"10.13039\/100000060","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000060","name":"National Institute of Allergy and Infectious Diseases","doi-asserted-by":"publisher","award":["AI069481"],"award-info":[{"award-number":["AI069481"]}],"id":[{"id":"10.13039\/100000060","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000060","name":"National Institute of Allergy and Infectious Diseases","doi-asserted-by":"publisher","award":["U01AI068636"],"award-info":[{"award-number":["U01AI068636"]}],"id":[{"id":"10.13039\/100000060","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000060","name":"National Institute of Allergy and Infectious Diseases","doi-asserted-by":"publisher","award":["K01AI125087"],"award-info":[{"award-number":["K01AI125087"]}],"id":[{"id":"10.13039\/100000060","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["R01MH100970"],"award-info":[{"award-number":["R01MH100970"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["R00MH112413"],"award-info":[{"award-number":["R00MH112413"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,10,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In an analysis of randomized trials, use of efavirenz for treatment of human immunodeficiency virus (HIV) infection was associated with increased suicidal thoughts\/behaviors. However, analyses of observational data have found no evidence of increased risk. To assess whether population differences might explain this divergence, we transported the effect of efavirenz use from these trials to a specific target population. Using inverse odds weights and multiple imputation, we transported the effect of efavirenz on suicidal thoughts\/behaviors in these randomized trials (participants were enrolled in 2001\u20132007) to a trials-eligible cohort of US adults initiating antiretroviral therapy while receiving HIV clinical care at medical centers between 1999 and 2015. Overall, 8,291 cohort participants and 3,949 trial participants were eligible. Prescription of antidepressants (19% vs. 13%) and injection drug history (16% vs. 10%) were more frequent in the cohort than in the trial participants. Compared with the effect in trials, the estimated hazard ratio for efavirenz on suicidal thoughts\/behaviors was attenuated in our target population (trials:\u00a0hazard ratio (HR) =\u00a02.3 (95% confidence interval (CI): 1.2, 4.4); transported: HR\u00a0=\u00a01.8 (95% CI: 0.9, 4.4)), whereas the incidence rate difference was similar (trials: HR\u00a0=\u00a05.1 (95% CI: 1.6, 8.7); transported: HR\u00a0=\u00a05.4 (95% CI: \u22120.4, 11.4)). In our target population, there was greater than 20% attenuation of the hazard ratio estimate as compared with the trials-only estimate. Transporting results from trials to a target population is informative for addressing external validity.<\/jats:p>","DOI":"10.1093\/aje\/kwab136","type":"journal-article","created":{"date-parts":[[2021,5,5]],"date-time":"2021-05-05T20:28:49Z","timestamp":1620246529000},"page":"2075-2084","source":"Crossref","is-referenced-by-count":12,"title":["Transportability From Randomized Trials to Clinical Care: On Initial HIV Treatment With Efavirenz and Suicidal Thoughts or Behaviors"],"prefix":"10.1093","volume":"190","author":[{"given":"Katie R","family":"Mollan","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brian W","family":"Pence","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Steven","family":"Xu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jessie K","family":"Edwards","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"W Christopher","family":"Mathews","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Conall","family":"O\u2019Cleirigh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Heidi M","family":"Crane","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ellen F","family":"Eaton","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ann C","family":"Collier","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ann Marie K","family":"Weideman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"Westreich","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephen R","family":"Cole","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Camlin","family":"Tierney","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Angela M","family":"Bengtson","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"name":"for the CFAR Network of Integrated Clinical Systems and the AIDS Clinical Trials Group","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2021,5,10]]},"reference":[{"issue":"4","key":"2021110908094620700_ref1","doi-asserted-by":"crossref","first-page":"363","DOI":"10.3851\/IMP3223","article-title":"Patterns of efavirenz use as first-line antiretroviral therapy in the United States: 1999\u20132015","volume":"23","author":"Bengtson","year":"2018","journal-title":"Antivir Ther"},{"key":"2021110908094620700_ref2","author":"World Health Organization"},{"issue":"7","key":"2021110908094620700_ref3","doi-asserted-by":"crossref","first-page":"1742","DOI":"10.1093\/jac\/dku058","article-title":"Has the time come to abandon efavirenz for first-line antiretroviral therapy?","volume":"69","author":"Raffi","year":"2014","journal-title":"J Antimicrob Chemother"},{"issue":"5","key":"2021110908094620700_ref4","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0124279","article-title":"Efavirenz-based regimens in antiretroviral-naive HIV-infected patients: a systematic review and meta-analysis of randomized controlled trials","volume":"10","author":"Kryst","year":"2015","journal-title":"PLoS One"},{"key":"2021110908094620700_ref5","author":"Bristol-Myers Squibb","year":"2019"},{"issue":"1","key":"2021110908094620700_ref6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.7326\/M14-0293","article-title":"Association between efavirenz as initial therapy for HIV-1 infection and increased risk for suicidal ideation or attempted or completed suicide: an analysis of trial data","volume":"161","author":"Mollan","year":"2014","journal-title":"Ann Intern Med"},{"issue":"3","key":"2021110908094620700_ref7","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1093\/cid\/ciy051","article-title":"Risk of suicidal behavior with use of efavirenz: results from the strategic timing of antiretroviral treatment trial","volume":"67","author":"Arenas-Pinto","year":"2018","journal-title":"Clin Infect Dis"},{"issue":"1","key":"2021110908094620700_ref8","doi-asserted-by":"crossref","DOI":"10.7448\/IAS.17.1.19214","article-title":"No evident association between efavirenz use and suicidality was identified from a disproportionality analysis using the FAERS database","volume":"17","author":"Napoli","year":"2014","journal-title":"J Int AIDS Soc"},{"issue":"4 suppl 3","key":"2021110908094620700_ref9","doi-asserted-by":"crossref","first-page":"19512","DOI":"10.7448\/IAS.17.4.19512","article-title":"Lack of association between use of efavirenz and death from suicide: evidence from the D:A:D study","volume":"17","author":"Smith","year":"2014","journal-title":"J Int AIDS Soc"},{"issue":"4","key":"2021110908094620700_ref10","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1097\/QAI.0000000000001510","article-title":"The relationship between efavirenz as initial antiretroviral therapy and suicidal thoughts among HIV-infected adults in routine care","volume":"76","author":"Bengtson","year":"2017","journal-title":"J Acquir Immune Defic Syndr"},{"issue":"9","key":"2021110908094620700_ref11","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1046\/j.1525-1497.2001.016009606.x","article-title":"The PHQ-9: validity of a brief depression severity measure","volume":"16","author":"Kroenke","year":"2001","journal-title":"J Gen Intern Med"},{"issue":"4","key":"2021110908094620700_ref12","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1097\/EDE.0000000000000664","article-title":"Generalizing study results: a potential outcomes perspective","volume":"28","author":"Lesko","year":"2017","journal-title":"Epidemiology"},{"issue":"8","key":"2021110908094620700_ref13","doi-asserted-by":"crossref","first-page":"1010","DOI":"10.1093\/aje\/kwx164","article-title":"Transportability of trial results using inverse odds of sampling weights","volume":"186","author":"Westreich","year":"2017","journal-title":"Am J Epidemiol"},{"key":"2021110908094620700_ref14","doi-asserted-by":"crossref","DOI":"10.1093\/aje\/kwaa270","article-title":"Study designs for extending causal inferences from a randomized trial to a target population","volume-title":"Am J Epidemiol","author":"Dahabreh"},{"issue":"6","key":"2021110908094620700_ref15","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1097\/EDE.0000000000001097","article-title":"On the relation between G-formula and inverse probability weighting estimators for generalizing trial results","volume":"30","author":"Dahabreh","year":"2019","journal-title":"Epidemiology"},{"issue":"1","key":"2021110908094620700_ref16","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1093\/aje\/kwq084","article-title":"Generalizing evidence from randomized clinical trials to target populations: the ACTG 320 trial","volume":"172","author":"Cole","year":"2010","journal-title":"Am J Epidemiol"},{"issue":"3","key":"2021110908094620700_ref17","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1007\/s11121-014-0513-z","article-title":"Assessing the generalizability of randomized trial results to target populations","volume":"16","author":"Stuart","year":"2015","journal-title":"Prev Sci"},{"issue":"2","key":"2021110908094620700_ref18","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1136\/jech-2017-209976","article-title":"Generalisability of an online randomised controlled trial: an empirical analysis","volume":"72","author":"Wang","year":"2018","journal-title":"J Epidemiol Community Health"},{"issue":"5","key":"2021110908094620700_ref19","doi-asserted-by":"crossref","first-page":"948","DOI":"10.1093\/ije\/dym231","article-title":"Cohort profile: the Centers for AIDS Research Network of Integrated Clinical Systems","volume":"37","author":"Kitahata","year":"2008","journal-title":"Int J Epidemiol"},{"key":"2021110908094620700_ref20","author":"R Core Team","year":"2019"},{"issue":"3","key":"2021110908094620700_ref21","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1111\/j.0006-341X.2000.00779.x","article-title":"Correcting for noncompliance and dependent censoring in an AIDS clinical trial with inverse probability of censoring weighted (IPCW) log-rank tests","volume":"56","author":"Robins","year":"2000","journal-title":"Biometrics"},{"issue":"12","key":"2021110908094620700_ref22","doi-asserted-by":"crossref","first-page":"1170","DOI":"10.1089\/aid.2014.0037","article-title":"Worth the weight: using inverse probability weighted Cox models in AIDS research","volume":"30","author":"Buchanan","year":"2014","journal-title":"AIDS Res Hum Retroviruses"},{"issue":"1","key":"2021110908094620700_ref23","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1093\/ije\/dyv352","article-title":"The effect of antiretroviral therapy on all-cause mortality, generalized to persons diagnosed with HIV in the USA, 2009\u201311","volume":"45","author":"Lesko","year":"2016","journal-title":"Int J Epidemiol"},{"key":"2021110908094620700_ref24","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780190665760.001.0001","volume-title":"Epidemiology by Design","author":"Westreich","year":"2019"},{"issue":"12","key":"2021110908094620700_ref25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0208795","article-title":"Sensitivity analyses for effect modifiers not observed in the target population when generalizing treatment effects from a randomized controlled trial: assumptions, models, effect scales, data scenarios, and implementation details","volume":"13","author":"Nguyen","year":"2018","journal-title":"PLoS One"},{"issue":"6","key":"2021110908094620700_ref26","doi-asserted-by":"crossref","first-page":"874","DOI":"10.1097\/EDE.0b013e31823029dd","article-title":"Splines for trend analysis and continuous confounder control","volume":"22","author":"Howe","year":"2011","journal-title":"Epidemiology"},{"issue":"1","key":"2021110908094620700_ref27","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1097\/EDE.0b013e3181c30eba","article-title":"On the origin of risk relativism","volume":"21","author":"Poole","year":"2010","journal-title":"Epidemiology"},{"issue":"1","key":"2021110908094620700_ref28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1515\/jci-2012-0002","article-title":"Causal inference under multiple versions of treatment","volume":"1","author":"VanderWeele","year":"2013","journal-title":"J Causal Inference"},{"issue":"5","key":"2021110908094620700_ref29","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1097\/00001648-200009000-00012","article-title":"Marginal structural models to estimate the causal effect of zidovudine on the survival of HIV-positive men","volume":"11","author":"Hern\u00e1n","year":"2000","journal-title":"Epidemiology"},{"issue":"359","key":"2021110908094620700_ref30","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1080\/01621459.1977.10480613","article-title":"The efficiency of Cox\u2019s likelihood function for censored data","volume":"72","author":"Efron","year":"1977","journal-title":"J Am Stat Assoc"},{"issue":"8","key":"2021110908094620700_ref31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v009.i08","article-title":"Analysis of complex survey samples","volume":"9","author":"Lumley","year":"2004","journal-title":"J Stat Softw"},{"issue":"14","key":"2021110908094620700_ref32","doi-asserted-by":"crossref","first-page":"2252","DOI":"10.1002\/sim.7654","article-title":"Bootstrap inference when using multiple imputation","volume":"37","author":"Schomaker","year":"2018","journal-title":"Stat Med"},{"issue":"1","key":"2021110908094620700_ref33","doi-asserted-by":"crossref","DOI":"10.2202\/1557-4679.1106","article-title":"Missing confounding data in marginal structural models: a comparison of inverse probability weighting and multiple imputation","volume":"4","author":"Moodie","year":"2008","journal-title":"Int J Biostat"},{"issue":"1","key":"2021110908094620700_ref34","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1177\/0962280217713032","article-title":"Propensity score analysis with partially observed covariates: how should multiple imputation be used?","volume":"28","author":"Leyrat","year":"2019","journal-title":"Stat Methods Med Res"},{"issue":"4","key":"2021110908094620700_ref35","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1093\/aje\/kwaa225","article-title":"Common methods for handling missing data in marginal structural models: what works and why","volume":"190","author":"Leyrat","year":"2021","journal-title":"Am J Epidemiol"},{"issue":"4","key":"2021110908094620700_ref36","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1002\/sim.4067","article-title":"Multiple imputation using chained equations: issues and guidance for practice","volume":"30","author":"White","year":"2011","journal-title":"Stat Med"},{"issue":"3","key":"2021110908094620700_ref37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v045.i03","article-title":"mice: Multivariate imputation by chained equations in R","volume":"45","author":"Buuren","year":"2011","journal-title":"J Stat Softw"},{"key":"2021110908094620700_ref38","doi-asserted-by":"crossref","first-page":"Article 75","DOI":"10.1186\/1471-2288-14-75","article-title":"Tuning multiple imputation by predictive mean matching and local residual draws","volume":"14","author":"Morris","year":"2014","journal-title":"BMC Med Res Methodol"},{"issue":"6","key":"2021110908094620700_ref39","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1093\/aje\/kwt312","article-title":"Comparison of random forest and parametric imputation models for imputing missing data using MICE: a CALIBER study","volume":"179","author":"Shah","year":"2014","journal-title":"Am J Epidemiol"},{"issue":"10","key":"2021110908094620700_ref40","doi-asserted-by":"crossref","first-page":"1092","DOI":"10.1016\/j.jclinepi.2006.01.009","article-title":"Using the outcome for imputation of missing predictor values was preferred","volume":"59","author":"Moons","year":"2006","journal-title":"J Clin Epidemiol"},{"issue":"3","key":"2021110908094620700_ref41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1097\/MD.0000000000002480","article-title":"No evidence of an association between efavirenz exposure and suicidality among HIV patients initiating antiretroviral therapy in a retrospective cohort study of real world data","volume":"95","author":"Nkhoma","year":"2016","journal-title":"Medicine (Baltimore)"},{"issue":"6","key":"2021110908094620700_ref42","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1046\/j.1525-1497.2003.20938.x","article-title":"Underdiagnosis of depression in HIV: who are we missing?","volume":"18","author":"Asch","year":"2003","journal-title":"J Gen Intern Med"},{"issue":"5","key":"2021110908094620700_ref43","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1097\/QAD.0b013e3283519aae","article-title":"Falling through the cracks: the gaps between depression prevalence, diagnosis, treatment, and response in HIV care","volume":"26","author":"Pence","year":"2012","journal-title":"AIDS"},{"issue":"27","key":"2021110908094620700_ref44","doi-asserted-by":"crossref","first-page":"7345","DOI":"10.1073\/pnas.1510507113","article-title":"Causal inference and the data-fusion problem","volume":"113","author":"Bareinboim","year":"2016","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"2","key":"2021110908094620700_ref45","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1111\/biom.13009","article-title":"Generalizing causal inferences from individuals in randomized trials to all trial-eligible individuals","volume":"75","author":"Dahabreh","year":"2019","journal-title":"Biometrics"},{"issue":"14","key":"2021110908094620700_ref46","doi-asserted-by":"crossref","first-page":"1999","DOI":"10.1002\/sim.8426","article-title":"Extending inferences from a randomized trial to a new target population","volume":"39","author":"Dahabreh","year":"2020","journal-title":"Stat Med"},{"issue":"4","key":"2021110908094620700_ref47","doi-asserted-by":"crossref","first-page":"1193","DOI":"10.1111\/rssa.12357","article-title":"Generalizing evidence from randomized trials using inverse probability of sampling weights","volume":"181","author":"Buchanan","year":"2018","journal-title":"J R Stat Soc Ser A Stat Soc"},{"issue":"2","key":"2021110908094620700_ref48","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1093\/aje\/kwy228","article-title":"Target validity and the hierarchy of study designs","volume":"188","author":"Westreich","year":"2019","journal-title":"Am J Epidemiol"},{"key":"2021110908094620700_ref49","author":"University of North Carolina at Chapel Hill Center for AIDS Research (CFAR) Biostatistics Core"}],"container-title":["American Journal of Epidemiology"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/aje\/advance-article-pdf\/doi\/10.1093\/aje\/kwab136\/39458306\/kwab136.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/aje\/article-pdf\/190\/10\/2075\/41110448\/kwab136.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/aje\/article-pdf\/190\/10\/2075\/41110448\/kwab136.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,26]],"date-time":"2022-12-26T12:16:41Z","timestamp":1672057001000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/aje\/article\/190\/10\/2075\/6273328"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,10]]},"references-count":49,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,5,10]]},"published-print":{"date-parts":[[2021,10,1]]}},"URL":"https:\/\/doi.org\/10.1093\/aje\/kwab136","relation":{},"ISSN":["0002-9262","1476-6256"],"issn-type":[{"value":"0002-9262","type":"print"},{"value":"1476-6256","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,10]]},"published":{"date-parts":[[2021,5,10]]}}}