{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T12:03:16Z","timestamp":1792756996784,"version":"4.5.0"},"reference-count":31,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2024,11,8]],"date-time":"2024-11-08T00:00:00Z","timestamp":1731024000000},"content-version":"vor","delay-in-days":36,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100009210","name":"Food and Drug Administration","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100009210","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000016","name":"U.S. Department of Health and Human Services","doi-asserted-by":"publisher","award":["FD007206"],"award-info":[{"award-number":["FD007206"]}],"id":[{"id":"10.13039\/100000016","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000038","name":"FDA","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000038","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["R01AI157758"],"award-info":[{"award-number":["R01AI157758"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,10,3]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n               <jats:p>We consider the challenges associated with causal inference in settings where data from a randomized trial are augmented with control data from an external source to improve efficiency in estimating the average treatment effect (ATE). This question is motivated by the SUNFISH trial, which investigated the effect of risdiplam on motor function in patients with spinal muscular atrophy. While the original analysis used only data generated by the trial, we explore an alternative analysis incorporating external controls from the placebo arm of a historical trial. We cast the setting into a formal causal inference framework and show how these designs are characterized by a lack of full randomization to treatment and heightened dependency on modeling. To address this, we outline sufficient causal assumptions about the exchangeability between the internal and external controls to identify the ATE and establish a connection with novel graphical criteria. Furthermore, we propose estimators, review efficiency bounds, develop an approach for efficient doubly robust estimation even when unknown nuisance models are estimated with flexible machine learning methods, suggest model diagnostics, and demonstrate finite-sample performance of the methods through a simulation study. The ideas and methods are illustrated through their application to the SUNFISH trial, where we find that external controls can increase the efficiency of treatment effect estimation.<\/jats:p>","DOI":"10.1093\/biomtc\/ujae095","type":"journal-article","created":{"date-parts":[[2024,11,8]],"date-time":"2024-11-08T17:34:00Z","timestamp":1731087240000},"source":"Crossref","is-referenced-by-count":8,"title":["A causal inference framework for leveraging external controls in hybrid trials"],"prefix":"10.1093","volume":"80","author":[{"given":"Michael","family":"Valancius","sequence":"first","affiliation":[{"name":"Department of Biostatistics, University of North Carolina at Chapel Hill , Chapel Hill, NC 27599 ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Herbert","family":"Pang","sequence":"additional","affiliation":[{"name":"Product Development Data Sciences , Genentech, South San Francisco, CA 94080 ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiawen","family":"Zhu","sequence":"additional","affiliation":[{"name":"Product Development Data Sciences , Genentech, South San Francisco, CA 94080 ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephen R","family":"Cole","sequence":"additional","affiliation":[{"name":"Department of Epidemiology, University of North Carolina at Chapel Hill , Chapel Hill, NC 27599 ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michele","family":"Jonsson\u00a0Funk","sequence":"additional","affiliation":[{"name":"Department of Epidemiology, University of North Carolina at Chapel Hill , Chapel Hill, NC 27599 ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6070-9738","authenticated-orcid":false,"given":"Michael R","family":"Kosorok","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, University of North Carolina at Chapel Hill , Chapel Hill, NC 27599 ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2024,11,8]]},"reference":[{"key":"2025010313113940500_bib1","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1515\/jci-2012-0004","article-title":"A general algorithm for deciding transportability of experimental results","volume":"1","author":"Bareinboim","year":"2013","journal-title":"Journal of Causal Inference"},{"key":"2025010313113940500_bib2","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1002\/cpt.1586","article-title":"Using electronic health records to derive control arms for early phase single-arm lung cancer trials: proof-of-concept in randomized controlled trials","volume":"107","author":"Carrigan","year":"2020","journal-title":"Clinical Pharmacology & Therapeutics"},{"key":"2025010313113940500_bib3","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1093\/aje\/kwq084","article-title":"Generalizing evidence from randomized clinical trials to target populations: the ACTG 320 trial","volume":"172","author":"Cole","year":"2010","journal-title":"American Journal of Epidemiology"},{"key":"2025010313113940500_bib4","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1111\/biom.13009","article-title":"Generalizing causal inferences from individuals in randomized trials to all trial-eligible individuals","volume":"75","author":"Dahabreh","year":"2019","journal-title":"Biometrics"},{"key":"2025010313113940500_bib5","first-page":"685","article-title":"Generalizing causal inferences from randomized trials: counterfactual and graphical identification","volume-title":"Biometrics","author":"Dahabreh","year":"2019"},{"key":"2025010313113940500_bib6","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1056\/NEJMoa2102047","article-title":"Risdiplam-treated infants with Type 1 spinal muscular atrophy versus historical controls","volume":"385","author":"Darras","year":"2021","journal-title":"New England Journal of Medicine"},{"key":"2025010313113940500_bib7","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1146\/annurev-statistics-042522-103837","article-title":"A review of generalizability and transportability","volume":"10","author":"Degtiar","year":"2023","journal-title":"Annual Review of Statistics and Its Application"},{"key":"2025010313113940500_bib8","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1002\/cpt.1970","article-title":"Historical controls in randomized clinical trials: opportunities and challenges","volume":"109","author":"Hall","year":"2021","journal-title":"Clinical Pharmacology & Therapeutics"},{"key":"2025010313113940500_bib9","volume-title":"Causal Inference: What If","author":"Hern\u00e1n","year":"2020"},{"key":"2025010313113940500_bib10","doi-asserted-by":"crossref","first-page":"3724","DOI":"10.1002\/sim.6728","article-title":"The power prior: theory and applications","volume":"34","author":"Ibrahim","year":"2015","journal-title":"Statistics in Medicine"},{"key":"2025010313113940500_bib11","first-page":"1","article-title":"Rare disease registries: potential applications towards impact on development of new drug treatments","volume":"13","author":"Jansen-Van\u00a0Der\u00a0Weide","year":"2018","journal-title":"Orphanet Journal of Rare Diseases"},{"key":"2025010313113940500_bib12","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1080\/00031305.2021.2021984","article-title":"Demystifying statistical learning based on efficient influence functions","volume":"76","author":"Hines","year":"2022","journal-title":"The American Statistician"},{"key":"2025010313113940500_bib13","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-74978-5","volume-title":"Introduction to Empirical Processes and Semiparametric Inference","author":"Kosorok","year":"2008"},{"key":"2025010313113940500_bib14","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1111\/biom.13583","article-title":"Improving efficiency of inference in clinical trials with external control data","volume":"79","author":"Li","year":"2023","journal-title":"Biometrics"},{"key":"2025010313113940500_bib15","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1002\/pst.1879","article-title":"Propensity score matched augmented controls in randomized clinical trials: a case study","volume":"17","author":"Lin","year":"2018","journal-title":"Pharmaceutical Statistics"},{"key":"2025010313113940500_bib16","doi-asserted-by":"crossref","first-page":"4794","DOI":"10.1002\/sim.9095","article-title":"Propensity-score-based meta-analytic predictive prior for incorporating real-world and historical data","volume":"40","author":"Liu","year":"2021","journal-title":"Statistics in Medicine"},{"key":"2025010313113940500_bib17","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1111\/rssb.12299","article-title":"An omnibus non-parametric test of equality in distribution for unknown functions","volume":"81","author":"Luedtke","year":"2019","journal-title":"Journal of the Royal Statistical Society Series B: Statistical Methodology"},{"key":"2025010313113940500_bib18","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.jcf.2021.11.007","article-title":"A new path for CF clinical trials through the use of historical controls","volume":"21","author":"Magaret","year":"2022","journal-title":"Journal of Cystic Fibrosis"},{"key":"2025010313113940500_bib19","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/S0049-3848(03)00059-8","article-title":"An open-label randomized controlled trial of low molecular weight heparin compared to heparin and coumadin for the treatment of venous thromboembolic events in children: the REVIVE trial","volume":"109","author":"Massicotte","year":"2003","journal-title":"Thrombosis Research"},{"key":"2025010313113940500_bib20","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/S1474-4422(21)00367-7","article-title":"Safety and efficacy of once-daily risdiplam in Type 2 and non-ambulant Type 3 spinal muscular atrophy (SUNFISH part 2): a phase 3, double-blind, randomised, placebo-controlled trial","volume":"21","author":"Mercuri","year":"2022","journal-title":"The Lancet Neurology"},{"key":"2025010313113940500_bib21","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/0021-9681(76)90044-8","article-title":"The combination of randomized and historical controls in clinical trials","volume":"29","author":"Pocock","year":"1976","journal-title":"Journal of Chronic Diseases"},{"key":"2025010313113940500_bib22","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1080\/07474930600972590","article-title":"Testing the significance of categorical predictor variables in nonparametric regression models","volume":"25","author":"Racine","year":"2006","journal-title":"Econometric Reviews"},{"key":"2025010313113940500_bib23","article-title":"Single world intervention graphs (SWIGs): a unification of the counterfactual and graphical approaches to causality","author":"Richardson","year":"2013"},{"key":"2025010313113940500_bib24","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1198\/016214504000001880","article-title":"Causal inference using potential outcomes: design, modeling, decisions","volume":"100","author":"Rubin","year":"2005","journal-title":"Journal of the American Statistical Association"},{"key":"2025010313113940500_bib25","doi-asserted-by":"crossref","first-page":"1023","DOI":"10.1111\/biom.12242","article-title":"Robust meta-analytic-predictive priors in clinical trials with historical control information","volume":"70","author":"Schmidli","year":"2014","journal-title":"Biometrics"},{"key":"2025010313113940500_bib26","doi-asserted-by":"crossref","first-page":"e1581","DOI":"10.1002\/wics.1581","article-title":"Data integration in causal inference","volume":"15","author":"Shi","year":"2023","journal-title":"Wiley Interdisciplinary Reviews: Computational Statistics"},{"key":"2025010313113940500_bib27","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1111\/j.1467-985X.2010.00673.x","article-title":"The use of propensity scores to assess the generalizability of results from randomized trials","volume":"174","author":"Stuart","year":"2011","journal-title":"Journal of the Royal Statistical Society Series A: Statistics in Society"},{"key":"2025010313113940500_bib28","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4419-9782-1","volume-title":"Targeted Learning","author":"Van\u00a0der\u00a0Laan","year":"2011"},{"key":"2025010313113940500_bib29","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1002\/pst.1589","article-title":"Use of historical control data for assessing treatment effects in clinical trials","volume":"13","author":"Viele","year":"2014","journal-title":"Pharmaceutical Statistics"},{"key":"2025010313113940500_bib30","doi-asserted-by":"crossref","first-page":"6421","DOI":"10.1002\/sim.9191","article-title":"Incorporating external data into the analysis of clinical trials via Bayesian additive regression trees","volume":"40","author":"Zhou","year":"2021","journal-title":"Statistics in Medicine"},{"key":"2025010313113940500_bib31","doi-asserted-by":"crossref","first-page":"105856","DOI":"10.1016\/j.cct.2019.105856","article-title":"Hybrid clinical trials to generate real-world evidence: design considerations from a sponsor\u2019s perspective","volume":"94","author":"Zhu","year":"2020","journal-title":"Contemporary Clinical Trials"}],"container-title":["Biometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/biometrics\/article-pdf\/80\/4\/ujae095\/61199680\/ujae095.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/biometrics\/article-pdf\/80\/4\/ujae095\/61199680\/ujae095.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,3]],"date-time":"2025-01-03T13:11:58Z","timestamp":1735909918000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/biometrics\/article\/doi\/10.1093\/biomtc\/ujae095\/7887652"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,3]]},"references-count":31,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,10,3]]}},"URL":"https:\/\/doi.org\/10.1093\/biomtc\/ujae095","relation":{},"ISSN":["0006-341X","1541-0420"],"issn-type":[{"value":"0006-341X","type":"print"},{"value":"1541-0420","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,12]]},"published":{"date-parts":[[2024,10,3]]},"article-number":"ujae095"}}