{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T10:02:49Z","timestamp":1784887369625,"version":"3.55.0"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T00:00:00Z","timestamp":1784851200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T00:00:00Z","timestamp":1784851200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001826","name":"ZonMw","doi-asserted-by":"publisher","award":["10580012210025"],"award-info":[{"award-number":["10580012210025"]}],"id":[{"id":"10.13039\/501100001826","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001826","name":"ZonMw","doi-asserted-by":"publisher","award":["10580012210025"],"award-info":[{"award-number":["10580012210025"]}],"id":[{"id":"10.13039\/501100001826","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001826","name":"ZonMw","doi-asserted-by":"publisher","award":["10580012210025"],"award-info":[{"award-number":["10580012210025"]}],"id":[{"id":"10.13039\/501100001826","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Diagn Progn Res"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>\n                      One non-randomized approach to estimate the average effect of a newly introduced treatment is to compare\n                      <jats:italic>observed<\/jats:italic>\n                      outcomes under the new treatment with\n                      <jats:italic>predicted<\/jats:italic>\n                      outcomes under the standard treatment. These counterfactual predictions are made using a model developed before the new treatment was introduced, using patient characteristics and individualized treatment information. Although the approach has been intuitively applied (e.g., as model-based clinical evaluation in radiotherapy) and can be recognized as a specific case of standardization, a method of virtual controls or a g-method, the theory and conditions required for unbiased treatment effect estimation have not been formally described. The objective of this paper is to formalize the approach and clarify these conditions.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We formalize the approach within the potential outcomes framework for causal inference. We explain the methodology, its necessary conditions, and approaches for assessing their validity. These conditions are furthermore illustrated through a case study from radiotherapy, estimating the benefit of proton therapy compared to photon therapy on dysphagia in patients with head and neck cancer.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We describe a set of five sufficient conditions, including examples of violations: transportability, ignorability of treatment assignment, consistency, positivity, and correct model specification. While these conditions are largely untestable, we describe how empirical evidence, such as comparing predicted and observed outcomes in related samples, can increase confidence in their plausibility.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>When the prediction model predicts well in relevant (sub)populations, the approach can yield unbiased treatment effect estimates. However, there are many possible sources of bias. Therefore, we recommend systematic consideration of all required conditions, informed by domain expertise, and the use of empirical evidence whenever possible to support their plausibility.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s41512-026-00233-y","type":"journal-article","created":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T09:17:02Z","timestamp":1784884622000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Treatment effect estimation by comparing observed and predicted outcomes: conditions for valid inference and practical illustration"],"prefix":"10.1186","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1511-6781","authenticated-orcid":false,"given":"Lotta M.","family":"Meijerink","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Artuur M.","family":"Leeuwenberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jungyeon","family":"Choi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bas B. L.","family":"Penning de Vries","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Johannes A.","family":"Langendijk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Judith G. M.","family":"van Loon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Remi A.","family":"Nout","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Karel G. M.","family":"Moons","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ewoud","family":"Schuit","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,7,24]]},"reference":[{"issue":"13","key":"233_CR1","doi-asserted-by":"publisher","first-page":"1716","DOI":"10.1111\/1471-0528.15199","volume":"125","author":"E Hariton","year":"2018","unstructured":"Hariton E, Locascio JJ. Randomised controlled trials\u2013the gold standard for effectiveness research. BJOG Int J Obstet Gynaecol. 2018;125(13):1716. https:\/\/doi.org\/10.1111\/1471-0528.15199.","journal-title":"BJOG Int J Obstet Gynaecol"},{"key":"233_CR2","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1016\/j.ejca.2023.03.013","volume":"186","author":"R Saesen","year":"2023","unstructured":"Saesen R, Van Hemelrijck M, Bogaerts J, Booth CM, Cornelissen JJ, Dekker A, et al. Defining the role of real-world data in cancer clinical research: The position of the European Organisation for Research and Treatment of Cancer. Eur J Cancer. 2023;186:52\u201361. https:\/\/doi.org\/10.1016\/j.ejca.2023.03.013.","journal-title":"Eur J Cancer"},{"key":"233_CR3","unstructured":"Evaluation of new technology in health care: in need for guidance for relevant evidence. Amsterdam: KNAW; 2014. https:\/\/www.knaw.nl\/publicaties\/evaluation-new-technology-health-care."},{"issue":"2","key":"233_CR4","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1016\/j.semradonc.2017.11.008","volume":"28","author":"JA Langendijk","year":"2018","unstructured":"Langendijk JA, Boersma LJ, Rasch CRN, van Vulpen M, Reitsma JB, van der Schaaf A, et al. Clinical Trial Strategies to Compare Protons With Photons. Semin Radiat Oncol. 2018;28(2):79\u201387. https:\/\/doi.org\/10.1016\/j.semradonc.2017.11.008.","journal-title":"Semin Radiat Oncol"},{"key":"233_CR5","volume-title":"Causal Inference: What if","author":"M Hern\u00e1n","year":"2020","unstructured":"Hern\u00e1n M, Robins J. Causal Inference: What if. Boca Raton: Chapman & Hall\/CRC; 2020."},{"issue":"1","key":"233_CR6","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1186\/s12874-020-01191-9","volume":"21","author":"JM Strayhorn Jr","year":"2021","unstructured":"Strayhorn JM Jr. Virtual controls as an alternative to randomized controlled trials for assessing efficacy of interventions. BMC Med Res Methodol. 2021;21(1):3.","journal-title":"BMC Med Res Methodol"},{"issue":"2","key":"233_CR7","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1111\/biom.13009","volume":"75","author":"IJ Dahabreh","year":"2019","unstructured":"Dahabreh IJ, Robertson SE, Tchetgen EJ, Stuart EA, Hern\u00e1n MA. Generalizing causal inferences from individuals in randomized trials to all trial-eligible individuals. Biometrics. 2019;75(2):685\u201394. https:\/\/doi.org\/10.1111\/biom.13009.","journal-title":"Biometrics"},{"key":"233_CR8","unstructured":"Lash TL, VanderWeele TJ, Haneuse S, Rothman KJ. Modern Epidemiology. 4th ed. Wolters Kluwer; 2021."},{"key":"233_CR9","doi-asserted-by":"publisher","unstructured":"Lester-Coll NH, Margalit DN. Modeling the Potential Benefits of Proton Therapy for Patients With Oropharyngeal Head and Neck Cancer. Int J Radiat Oncol*Biol*Phys. 2019;104(3):563\u20136. https:\/\/doi.org\/10.1016\/j.ijrobp.2019.03.040.","DOI":"10.1016\/j.ijrobp.2019.03.040"},{"key":"233_CR10","doi-asserted-by":"publisher","unstructured":"Rwigema JCM, Langendijk JA, Paul van\u00a0der Laan H, Lukens JN, Swisher-McClure SD, Lin A. A Model-Based Approach to Predict Short-Term Toxicity Benefits With Proton Therapy for Oropharyngeal Cancer. Int J Radiat Oncol*Biol*Phys. 2019;104(3):553\u2013562. https:\/\/doi.org\/10.1016\/j.ijrobp.2018.12.055.","DOI":"10.1016\/j.ijrobp.2018.12.055"},{"key":"233_CR11","doi-asserted-by":"publisher","unstructured":"Christianen MEMC, van der Schaaf A, van der Laan HP, Verdonck-de Leeuw IM, Doornaert P, Chouvalova O, et al. Swallowing sparing intensity modulated radiotherapy (SW-IMRT) in head and neck cancer: Clinical validation according to the model-based approach. Radiother Oncol J Eur Soc Ther Radiol Oncol. 2016;118(2):298\u2013303. https:\/\/doi.org\/10.1016\/j.radonc.2015.11.009.","DOI":"10.1016\/j.radonc.2015.11.009"},{"key":"233_CR12","doi-asserted-by":"publisher","unstructured":"Jia Z, Lilly MB, Koziol JA, Chen X, Xia XQ, Wang Y, et al. Generation of \u201cVirtual\u201d Control Groups for Single Arm Prostate Cancer Adjuvant Trials. PLoS ONE. 2014;9(1):e85010. https:\/\/doi.org\/10.1371\/journal.pone.0085010.","DOI":"10.1371\/journal.pone.0085010"},{"issue":"1","key":"233_CR13","doi-asserted-by":"publisher","first-page":"e51951","DOI":"10.1371\/journal.pone.0051951","volume":"8","author":"ML Neal","year":"2013","unstructured":"Neal ML, Trister AD, Cloke T, Sodt R, Ahn S, Baldock AL, et al. Discriminating Survival Outcomes in Patients with Glioblastoma Using a Simulation-Based, Patient-Specific Response Metric. PLoS ONE. 2013;8(1):e51951. https:\/\/doi.org\/10.1371\/journal.pone.0051951.","journal-title":"PLoS ONE"},{"issue":"6","key":"233_CR14","doi-asserted-by":"publisher","first-page":"552","DOI":"10.1192\/bjp.bp.108.052373","volume":"194","author":"T Ford","year":"2009","unstructured":"Ford T, Hutchings J, Bywater T, Goodman A, Goodman R. Strengths and Difficulties Questionnaire Added Value Scores:evaluating effectiveness in child mental healthinterventions. Br J Psychiatry. 2009;194(6):552\u20138. https:\/\/doi.org\/10.1192\/bjp.bp.108.052373.","journal-title":"Br J Psychiatry"},{"issue":"9","key":"233_CR15","doi-asserted-by":"publisher","first-page":"1021","DOI":"10.1016\/j.healun.2010.05.002","volume":"29","author":"ES Ketchum","year":"2010","unstructured":"Ketchum ES, Moorman AJ, Fishbein DP, Mokadam NA, Verrier ED, Aldea GS, et al. Predictive value of the Seattle Heart Failure Model in patients undergoing left ventricular assist device placement. J Heart Lung Transplant. 2010;29(9):1021\u20135. https:\/\/doi.org\/10.1016\/j.healun.2010.05.002.","journal-title":"J Heart Lung Transplant"},{"issue":"1107","key":"233_CR16","doi-asserted-by":"publisher","first-page":"20190955","DOI":"10.1259\/bjr.20190955","volume":"93","author":"TWH Meijer","year":"2020","unstructured":"Meijer TWH, Scandurra D, Langendijk JA. Reduced radiation-induced toxicity by using proton therapy for the treatment of oropharyngeal cancer. Br J Radiol. 2020;93(1107):20190955. https:\/\/doi.org\/10.1259\/bjr.20190955.","journal-title":"Br J Radiol"},{"issue":"3","key":"233_CR17","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1016\/j.radonc.2013.05.007","volume":"107","author":"JA Langendijk","year":"2013","unstructured":"Langendijk JA, Lambin P, De Ruysscher D, Widder J, Bos M, Verheij M. Selection of patients for radiotherapy with protons aiming at reduction of side effects: The model-based approach. Radiother Oncol. 2013;107(3):267\u201373. https:\/\/doi.org\/10.1016\/j.radonc.2013.05.007.","journal-title":"Radiother Oncol"},{"key":"233_CR18","doi-asserted-by":"crossref","unstructured":"Rubin DB. Causal Inference Using Potential Outcomes: Design, Modeling, Decisions. J Am Stat Assoc. 2005;100(469):322\u201331. Publisher: [American Statistical Association, Taylor & Francis, Ltd.]. https:\/\/www.jstor.org\/stable\/27590541.","DOI":"10.1198\/016214504000001880"},{"issue":"1","key":"233_CR19","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1177\/0962280210386207","volume":"21","author":"ML Petersen","year":"2012","unstructured":"Petersen ML, Porter KE, Gruber S, Wang Y, van der Laan MJ. Diagnosing and responding to violations in the positivity assumption. Stat Methods Med Res. 2012;21(1):31\u201354. https:\/\/doi.org\/10.1177\/0962280210386207.","journal-title":"Stat Methods Med Res"},{"key":"233_CR20","unstructured":"Zivich PN, Cole SR, Westreich D. Positivity: Identifiability and Estimability. 2022. arXiv:2207.05010."},{"issue":"1","key":"233_CR21","doi-asserted-by":"publisher","first-page":"230","DOI":"10.1186\/s12916-019-1466-7","volume":"17","author":"B Van Calster","year":"2019","unstructured":"Van Calster B, McLernon DJ, van Smeden M, Wynants L, Steyerberg EW, Bossuyt P, et al. Calibration: the Achilles heel of predictive analytics. BMC Med. 2019;17(1):230. https:\/\/doi.org\/10.1186\/s12916-019-1466-7.","journal-title":"BMC Med"},{"issue":"3","key":"233_CR22","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1097\/EDE.0000000000001724","volume":"35","author":"M Piccininni","year":"2024","unstructured":"Piccininni M, Stensrud MJ. Using Negative Control Populations to Assess Unmeasured Confounding and Direct Effects. Epidemiology. 2024;35(3):313. https:\/\/doi.org\/10.1097\/EDE.0000000000001724.","journal-title":"Epidemiology"},{"key":"233_CR23","unstructured":"Bias Analysis. In: Modern Epidemiology. 4th ed. Wolters Kluwer; 2021. pp. 1556\u20131616."},{"key":"233_CR24","doi-asserted-by":"publisher","unstructured":"Nguyen TQ, Ebnesajjad C, Cole SR, Stuart EA. Sensitivity analysis for an unobserved moderator in RCT-to-target-population generalization of treatment effects. Ann Appl Stat. 2017;11(1):225\u201347. https:\/\/doi.org\/10.1214\/16-AOAS1001.","DOI":"10.1214\/16-AOAS1001"},{"issue":"13","key":"233_CR25","doi-asserted-by":"publisher","first-page":"2029","DOI":"10.1002\/sim.9550","volume":"42","author":"IJ Dahabreh","year":"2023","unstructured":"Dahabreh IJ, Robins JM, Haneuse SJPA, Saeed I, Robertson SE, Stuart EA, et al. Sensitivity analysis using bias functions for studies extending inferences from a randomized trial to a target population. Stat Med. 2023;42(13):2029\u201343. https:\/\/doi.org\/10.1002\/sim.9550.","journal-title":"Stat Med"},{"key":"233_CR26","unstructured":"Shen X, B\u00fchlmann P, Taeb A. Causality-oriented robustness: exploiting general additive interventions. 2023. arXiv:2307.10299."},{"issue":"2","key":"233_CR27","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1111\/rssb.12398","volume":"83","author":"D Rothenh\u00e4usler","year":"2021","unstructured":"Rothenh\u00e4usler D, Meinshausen N, B\u00fchlmann P, Peters J. Anchor Regression: Heterogeneous Data Meet Causality. J R Stat Soc Ser B Stat Methodol. 2021;83(2):215\u201346. https:\/\/doi.org\/10.1111\/rssb.12398.","journal-title":"J R Stat Soc Ser B Stat Methodol"},{"issue":"4","key":"233_CR28","doi-asserted-by":"publisher","first-page":"962","DOI":"10.1111\/j.1541-0420.2005.00377.x","volume":"61","author":"H Bang","year":"2005","unstructured":"Bang H, Robins JM. Doubly Robust Estimation in Missing Data and Causal Inference Models. Biometrics. 2005;61(4):962\u201373. https:\/\/doi.org\/10.1111\/j.1541-0420.2005.00377.x.","journal-title":"Biometrics"},{"key":"233_CR29","doi-asserted-by":"publisher","unstructured":"Van Der\u00a0Laan MJ, Rose S. Targeted Learning: Causal Inference for Observational and Experimental Data. Springer Series in Statistics. New York: Springer; 2011. https:\/\/doi.org\/10.1007\/978-1-4419-9782-1.","DOI":"10.1007\/978-1-4419-9782-1"},{"key":"233_CR30","doi-asserted-by":"publisher","unstructured":"Robins JM, Rotnitzky A, Zhao LP. Estimation of Regression Coefficients When Some Regressors Are Not Always Observed. J Am Stat Assoc. 1994;89(427):846\u201366. Publisher: [American Statistical Association, Taylor & Francis, Ltd.]. https:\/\/doi.org\/10.2307\/2290910.","DOI":"10.2307\/2290910"},{"issue":"3","key":"233_CR31","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1016\/0021-9681(76)90044-8","volume":"29","author":"SJ Pocock","year":"1976","unstructured":"Pocock SJ. The combination of randomized and historical controls in clinical trials. J Chronic Dis. 1976;29(3):175\u201388. https:\/\/doi.org\/10.1016\/0021-9681(76)90044-8.","journal-title":"J Chronic Dis"},{"key":"233_CR32","doi-asserted-by":"publisher","unstructured":"Choi J, Leeuwenberg AM, Meijerink LM, Moons KGM, Reitsma JJB, Penning de Vries BBL, et\u00a0al. Missing confounding information in counterfactual prediction models: a simulation study on model-based treatment effect evaluation in radiotherapy techniques. Radiother Oncol. 2026;220:111537. https:\/\/doi.org\/10.1016\/j.radonc.2026.111537.","DOI":"10.1016\/j.radonc.2026.111537"},{"key":"233_CR33","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1016\/j.radonc.2021.01.024","volume":"157","author":"L Van den Bosch","year":"2021","unstructured":"Van den Bosch L, van der Schaaf A, van der Laan HP, Hoebers FJ, Wijers OB, van den Hoek JG, et al. Comprehensive toxicity risk profiling in radiation therapy for head and neck cancer: A new concept for individually optimised treatment. Radiother Oncol. 2021;157:147\u201354.","journal-title":"Radiother Oncol"}],"container-title":["Diagnostic and Prognostic Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41512-026-00233-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s41512-026-00233-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41512-026-00233-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T09:17:04Z","timestamp":1784884624000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s41512-026-00233-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,24]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["233"],"URL":"https:\/\/doi.org\/10.1186\/s41512-026-00233-y","relation":{},"ISSN":["2397-7523"],"issn-type":[{"value":"2397-7523","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,24]]},"assertion":[{"value":"6 January 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 July 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 July 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"No patient data was used for the manuscript, except to generate synthetic data for the case study in R in the appendix. The data generating mechanism for the case study was based on data described in [\n                      \n                      ], where the requirement of informed consent was waived by the ethics committee.","order":1,"name":"Ethics","label":"Ethics approval and consent to participate","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","label":"Consent for publication","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All authors have completed the ICMJE uniform disclosure form and declare: support from ZonMW for the submitted work. RN reports research grants and honoraria from Elekta, Varian, Accuray, Sensius, dr Sennewald, MSD, and GSK, paid to their institution; JAL reports research grants from the European Union and the Dutch Cancer Society, consulting fees and honoraria paid to UMCG Research BV by IBA, is chair of the safety monitoring board of the UPGRADE trial (UMC Nijmegen), member of scientific advisory committees for IBA and RaySearch, and reports departmental research collaborations with IBA, RaySearch, Elekta, Mirada, and Siemens; Other authors declare no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.","order":3,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Declarations"}}],"article-number":"20"}}