{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,19]],"date-time":"2026-10-19T06:04:10Z","timestamp":1792389850556,"version":"4.4.0"},"reference-count":142,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T00:00:00Z","timestamp":1785801600000},"content-version":"vor","delay-in-days":28,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,7,7]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To clarify how validation requirements should be specified for medical digital twins used in clinical decision support, particularly when such systems are intended to compare interventions, treatment timings, dosages, or sequential care strategies.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Perspective<\/jats:title>\n                    <jats:p>Medical digital twins are heterogeneous systems that may combine prediction, simulation, mechanistic modeling, machine learning, data assimilation, uncertainty quantification, and decision-support functions. Their evaluation should therefore be driven by their intended use rather than by a single definition of what a digital twin is. For digital twins used primarily for visualization, monitoring, or short-term forecasting, predictive accuracy, calibration, discrimination, and robustness may be the central validation targets. However, when digital twins are used to support intervention-oriented clinical decisions, retrospective accuracy under historical clinical practice is insufficient on its own.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Key message<\/jats:title>\n                    <jats:p>Intervention-oriented digital twins address action-conditioned questions: what is predicted to happen under specified alternative actions, assumptions, time horizons, and clinical contexts. Their validation should therefore extend beyond scalar performance metrics to include uncertainty representation, updating stability, robustness under regime change, action-regime validity, counterfactual consistency, clinically weighted error, and decision-level consequences. This requires drawing on established traditions in forecast verification, causal inference, uncertainty quantification, model verification and validation, decision theory, control theory, and post-deployment monitoring. The level of causal or mechanistic support required should match the clinical claim being made, whether at the genotype, phenotype, physiological, or care-process level.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>The scientific-instrument framing is proposed as a pragmatic validation lens for intervention-oriented digital twins, not as a universal definition of digital twins. It helps define the scope within which their outputs can support clinical reasoning. Medical digital twins should be accompanied by explicit validation statements specifying their target population, prediction horizon, supported interventions, uncertainty bounds, and known failure conditions.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamiaopen\/ooag160","type":"journal-article","created":{"date-parts":[[2026,7,20]],"date-time":"2026-07-20T11:18:58Z","timestamp":1784546338000},"source":"Crossref","is-referenced-by-count":1,"title":["Validating medical digital twins for clinical decision support: beyond predictive accuracy"],"prefix":"10.1093","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9158-4467","authenticated-orcid":false,"given":"Alexandre","family":"Vall\u00e9e","sequence":"first","affiliation":[{"name":"Department of Epidemiology and Public Health, Foch Hospital , Suresnes 92150,","place":["France"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,8,4]]},"reference":[{"key":"2026080604264036300_ooag160-B1","doi-asserted-by":"publisher","first-page":"503","DOI":"10.3390\/jpm15110503","article-title":"Digital twins in personalized medicine: bridging innovation and clinical reality","volume":"15","author":"Silva","year":"2025","journal-title":"J Pers Med"},{"key":"2026080604264036300_ooag160-B2","doi-asserted-by":"publisher","first-page":"1055","DOI":"10.1080\/00015385.2025.2569027","article-title":"Digital twins for cardiovascular diseases: towards personalised and sustainable care","volume":"80","author":"Vall\u00e9e","year":"2025","journal-title":"Acta Cardiol"},{"key":"2026080604264036300_ooag160-B3","doi-asserted-by":"publisher","first-page":"100165","DOI":"10.1016\/j.dajour.2023.100165","article-title":"Digital twin: Benefits, use cases, challenges, and opportunities","volume":"6","author":"Attaran","year":"2023","journal-title":"Decis Anal J"},{"key":"2026080604264036300_ooag160-B4","doi-asserted-by":"publisher","first-page":"1253050","DOI":"10.3389\/fdgth.2023.1253050","article-title":"Digital twin for healthcare systems","volume":"5","author":"Vall\u00e9e","year":"2023","journal-title":"Front Digit Health"},{"key":"2026080604264036300_ooag160-B5","doi-asserted-by":"publisher","first-page":"e50204","DOI":"10.2196\/50204","article-title":"Envisioning the future of personalized medicine: role and realities of digital twins","volume":"26","author":"Vall\u00e9e","year":"2024","journal-title":"J Med Internet Res."},{"key":"2026080604264036300_ooag160-B6","doi-asserted-by":"publisher","first-page":"e72411","DOI":"10.2196\/72411","article-title":"Digital twins for personalized medicine require epidemiological data and mathematical modeling: viewpoint","volume":"27","author":"Vall\u00e9e","year":"2025","journal-title":"J Med Internet Res."},{"key":"2026080604264036300_ooag160-B7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s12199-012-0294-6","article-title":"An overview of health forecasting","volume":"18","author":"Soyiri","year":"2013","journal-title":"Environ Health Prev Med"},{"key":"2026080604264036300_ooag160-B8","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1186\/s12911-024-02606-z","article-title":"Clinical decision making under uncertainty: a bootstrapped counterfactual inference approach","volume":"24","author":"Wu","year":"2024","journal-title":"BMC Med Inform Decis Mak"},{"key":"2026080604264036300_ooag160-B9","volume-title":"Causal Inference: What If","author":"Hernan","year":"2024"},{"key":"2026080604264036300_ooag160-B10","doi-asserted-by":"publisher","first-page":"7345","DOI":"10.1073\/pnas.1510507113","article-title":"Causal inference and the data-fusion problem","volume":"113","author":"Bareinboim","year":"2016","journal-title":"Proc Natl Acad Sci USA"},{"key":"2026080604264036300_ooag160-B11","doi-asserted-by":"publisher","first-page":"641","DOI":"10.1126\/science.263.5147.641","article-title":"Verification, validation, and confirmation of numerical models in the earth sciences","volume":"263","author":"Oreskes","year":"1994","journal-title":"Science"},{"key":"2026080604264036300_ooag160-B12","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1093\/biostatistics\/kxz041","article-title":"From development to deployment: dataset shift, causality, and shift-stable models in health AI","volume":"21","author":"Subbaswamy","year":"2020","journal-title":"Biostatistics"},{"key":"2026080604264036300_ooag160-B13","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","article-title":"Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead","volume":"1","author":"Rudin","year":"2019","journal-title":"Nat Mach Intell"},{"key":"2026080604264036300_ooag160-B14","doi-asserted-by":"publisher","DOI":"10.1214\/10-STS330","article-title":"To explain or to predict?","volume":"25","author":"Shmueli","year":"2010","journal-title":"Statist Sci"},{"key":"2026080604264036300_ooag160-B15","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1214\/ss\/1009213726","article-title":"Statistical modeling: the two cultures","volume":"16","author":"Breiman","year":"2001","journal-title":"Stat Sci"},{"key":"2026080604264036300_ooag160-B16","doi-asserted-by":"crossref","DOI":"10.7208\/chicago\/9780226902050.001.0001","volume-title":"Science in the Age of Computer Simulation","author":"Winsberg","year":"2010"},{"key":"2026080604264036300_ooag160-B17","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/978-1-4419-9076-1_11","volume-title":"Proceedings of the Second Seattle Symposium in Biostatistics","author":"Robins","year":"2004"},{"key":"2026080604264036300_ooag160-B18","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1111\/1467-9868.00389","article-title":"Optimal dynamic treatment regimes","volume":"65","author":"Murphy","year":"2003","journal-title":"J R Stat Soc Ser B Stat Methodol"},{"key":"2026080604264036300_ooag160-B19","doi-asserted-by":"crossref","DOI":"10.1093\/0198247044.001.0001","volume-title":"How the Laws of Physics Lie","author":"Cartwright","year":"1983"},{"key":"2026080604264036300_ooag160-B20","doi-asserted-by":"crossref","DOI":"10.1093\/0195171276.001.0001","volume-title":"Inventing Temperature: Measurement and Scientific Progress","author":"Chang","year":"2004"},{"key":"2026080604264036300_ooag160-B21","volume-title":"Thing Knowledge: A Philosophy of Scientific Instruments","author":"Baird","year":"2004"},{"key":"2026080604264036300_ooag160-B22","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1080\/02513625.2021.1981016","article-title":"Knowing in uncertainty: on epistemic conditions differentiated for situations in varying degrees of uncertainty, the distinction between hierarchical and flat ontology, and the necessary merger with the axiological domain of values","volume":"57","author":"de Roo","year":"2021","journal-title":"DisP - Plan Rev"},{"key":"2026080604264036300_ooag160-B23","doi-asserted-by":"publisher","first-page":"735","DOI":"10.1038\/s41746-025-02115-x","article-title":"The role of digital twins in P4 medicine: a paradigm for modern healthcare","volume":"8","author":"Emmert-Streib","year":"2025","journal-title":"NPJ Digit Med"},{"key":"2026080604264036300_ooag160-B24","doi-asserted-by":"publisher","first-page":"e204","DOI":"10.1371\/journal.pcbi.0030204","article-title":"From inverse problems in mathematical physiology to quantitative differential diagnoses","volume":"3","author":"Zenker","year":"2007","journal-title":"PLoS Comput Biol"},{"key":"2026080604264036300_ooag160-B25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/jamia\/ocaf209","article-title":"Interdisciplinary development and application of computational methods in informatics for clinical applications","volume":"33","author":"Albers","year":"2026","journal-title":"J Am Med Inform Assoc"},{"key":"2026080604264036300_ooag160-B26","doi-asserted-by":"publisher","first-page":"1392","DOI":"10.1093\/jamia\/ocy106","article-title":"Mechanistic machine learning: how data assimilation leverages physiologic knowledge using Bayesian inference to forecast the future, infer the present, and phenotype","volume":"25","author":"Albers","year":"2018","journal-title":"J Am Med Inform Assoc"},{"key":"2026080604264036300_ooag160-B27","doi-asserted-by":"publisher","first-page":"1242","DOI":"10.1093\/jamia\/ocab006","article-title":"Healthcare process modeling to phenotype clinician behaviors for exploiting the signal gain of clinical expertise (HPM-ExpertSignals): development and evaluation of a conceptual framework","volume":"28","author":"Rossetti","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2026080604264036300_ooag160-B28","author":"An","year":"2024"},{"key":"2026080604264036300_ooag160-B29","doi-asserted-by":"publisher","first-page":"e35","DOI":"10.1055\/s-0042-1743170","article-title":"Evaluating prediction of continuous clinical values: a glucose case study","volume":"61","author":"Hripcsak","year":"2022","journal-title":"Methods Inf Med."},{"key":"2026080604264036300_ooag160-B30","doi-asserted-by":"publisher","first-page":"234","DOI":"10.1093\/jamia\/ocae323","article-title":"A perspective on individualized treatment effects estimation from time-series health data","volume":"33","author":"Ghosheh","year":"2026","journal-title":"J Am Med Inform Assoc"},{"key":"2026080604264036300_ooag160-B31","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1093\/jamia\/ocaf035","article-title":"Integrating state-space modeling, parameter estimation, deep learning, and docking techniques in drug repurposing: a case study on COVID-19 cytokine storm","volume":"33","author":"Bakshi","year":"2026","journal-title":"J Am Med Inform Assoc"},{"key":"2026080604264036300_ooag160-B32","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1093\/jamia\/ocaf144","article-title":"Navigating the landscape of personalized oncology: overcoming challenges and expanding horizons with computational modeling","volume":"33","author":"Sirlanci","year":"2026","journal-title":"J Am Med Inform Assoc"},{"key":"2026080604264036300_ooag160-B33","doi-asserted-by":"crossref","DOI":"10.1137\/1.9781611976977","volume-title":"A Toolbox for Digital Twins: From Model-Based to Data-Driven","author":"Asch","year":"2022"},{"key":"2026080604264036300_ooag160-B34","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A new approach to linear filtering and prediction problems","volume":"82","author":"Kalman","year":"1960","journal-title":"J Basic Eng"},{"key":"2026080604264036300_ooag160-B35","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139344203","volume-title":"Bayesian Filtering and Smoothing","author":"Sarkka","year":"2013."},{"key":"2026080604264036300_ooag160-B36","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-3437-9","volume-title":"Sequential Monte Carlo Methods in Practice","author":"Doucet","year":"2001"},{"key":"2026080604264036300_ooag160-B37","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1016\/S0004-3702(98)00023-X","article-title":"Planning and acting in partially observable stochastic domains","volume":"101","author":"Kaelbling","year":"1998","journal-title":"Artif Intell"},{"key":"2026080604264036300_ooag160-B38","doi-asserted-by":"publisher","first-page":"1036","DOI":"10.3390\/make5030054","article-title":"Defining a digital twin: a data science-based unification","volume":"5","author":"Emmert-Streib","year":"2023","journal-title":"MAKE"},{"key":"2026080604264036300_ooag160-B39","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-03711-5","volume-title":"Data Assimilation: The Ensemble Kalman Filter","author":"Evensen","year":"2009"},{"key":"2026080604264036300_ooag160-B40","first-page":"316","author":"Bengtsson","year":"2008"},{"key":"2026080604264036300_ooag160-B41","doi-asserted-by":"publisher","first-page":"1330","DOI":"10.1038\/s41551-022-00898-y","article-title":"Shifting machine learning for healthcare from development to deployment and from models to data","volume":"6","author":"Zhang","year":"2022","journal-title":"Nat Biomed Eng"},{"key":"2026080604264036300_ooag160-B42","doi-asserted-by":"publisher","DOI":"10.1214\/14-STS511","article-title":"On particle methods for parameter estimation in state-space models","volume":"30","author":"Kantas","year":"2015","journal-title":"Statist Sci"},{"key":"2026080604264036300_ooag160-B43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2307\/1912526","article-title":"Maximum likelihood estimation of misspecified models","volume":"50","author":"White","year":"1982","journal-title":"Econometrica"},{"key":"2026080604264036300_ooag160-B44","doi-asserted-by":"crossref","DOI":"10.1093\/0195158709.001.0001","volume-title":"Extending Ourselves: Computational Science, Empiricism, and Scientific Method","author":"Humphreys","year":"2004"},{"key":"2026080604264036300_ooag160-B45","volume-title":"Advances in Neural Information Processing Systems","author":"Sculley","year":"2015"},{"key":"2026080604264036300_ooag160-B46","first-page":"5389","author":"Recht","year":":"},{"key":"2026080604264036300_ooag160-B47","author":"Amodei","year":"2016"},{"key":"2026080604264036300_ooag160-B48","doi-asserted-by":"publisher","first-page":"e35675","DOI":"10.2196\/35675","article-title":"Dynamic digital twin: diagnosis, treatment, prediction, and prevention of disease during the life course","volume":"24","author":"Mulder","year":"2022","journal-title":"J Med Internet Res"},{"key":"2026080604264036300_ooag160-B49","doi-asserted-by":"publisher","first-page":"1101","DOI":"10.3390\/jpm14111101","article-title":"Digital twins\u2019 advancements and applications in healthcare, towards precision medicine","volume":"14","author":"Papachristou","year":"2024","journal-title":"J Pers Med"},{"key":"2026080604264036300_ooag160-B50","doi-asserted-by":"publisher","first-page":"100851","DOI":"10.1016\/j.landig.2025.01.007","article-title":"Digital twins, synthetic patient data, and in-silico trials: can they empower paediatric clinical trials?","volume":"7","author":"Pammi","year":"2025","journal-title":"Lancet Digit Health"},{"key":"2026080604264036300_ooag160-B51","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1038\/s41540-025-00592-0","article-title":"Enhancing randomized clinical trials with digital twins","volume":"11","author":"Akbarialiabad","year":"2025","journal-title":"NPJ Syst Biol Appl"},{"key":"2026080604264036300_ooag160-B52","doi-asserted-by":"publisher","first-page":"101028","DOI":"10.1016\/j.patter.2024.101028","article-title":"Concepts and applications of digital twins in healthcare and medicine","volume":"5","author":"Zhang","year":"2024","journal-title":"Patterns"},{"key":"2026080604264036300_ooag160-B53","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1016\/j.csbj.2025.08.017","article-title":"Harnessing the power of virtual (digital) twins: graphical causal tools for understanding patient and hospital differences","volume":"28","author":"Ishwaran","year":"2025","journal-title":"Comput Struct Biotechnol J"},{"key":"2026080604264036300_ooag160-B54","doi-asserted-by":"publisher","first-page":"114571","DOI":"10.1016\/j.socscimed.2021.114571","article-title":"Simulated patients and their reality: an inquiry into theory and method","volume":"300","author":"Das","year":"2022","journal-title":"Soc Sci Med"},{"key":"2026080604264036300_ooag160-B55","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1080\/13697137.2025.2567693","article-title":"Simulation-based model of menopause: hormonal changes and cardiovascular risk in a digital twin view","volume":"29","author":"Vall\u00e9e","year":"2026","journal-title":"Climacteric"},{"key":"2026080604264036300_ooag160-B56","doi-asserted-by":"publisher","first-page":"3654","DOI":"10.1016\/j.csbj.2025.08.013","article-title":"A semi-mechanistic mathematical framework for simulating multi-hormone dynamics in reproductive endocrinology","volume":"27","author":"Vall\u00e9e","year":"2025","journal-title":"Comput Struct Biotechnol J"},{"key":"2026080604264036300_ooag160-B57","doi-asserted-by":"publisher","first-page":"e171058","DOI":"10.1172\/JCI171058","article-title":"Guidelines for repeated measures statistical analysis approaches with basic science research considerations","volume":"133","author":"Muhammad","year":"2023","journal-title":"J Clin Invest"},{"key":"2026080604264036300_ooag160-B58","doi-asserted-by":"publisher","first-page":"4972","DOI":"10.1128\/IAI.00908-10","article-title":"Reproducible science","volume":"78","author":"Casadevall","year":"2010","journal-title":"Infect Immun"},{"key":"2026080604264036300_ooag160-B59","doi-asserted-by":"publisher","first-page":"1633539","DOI":"10.3389\/fdgth.2025.1633539","article-title":"Digital twins in healthcare: a comprehensive review and future directions","volume":"7","author":"Khoshfekr Rudsari","year":"2025","journal-title":"Front Digit Health"},{"key":"2026080604264036300_ooag160-B60","doi-asserted-by":"publisher","first-page":"109338","DOI":"10.1016\/j.ymssp.2022.109338","article-title":"Digital twins for design in the presence of uncertainties","volume":"179","author":"Yang","year":"2022","journal-title":"Mech Syst Signal Process"},{"key":"2026080604264036300_ooag160-B61","doi-asserted-by":"publisher","first-page":"e12","DOI":"10.1017\/dce.2025.4","article-title":"The philosophical foundations of digital twinning","volume":"6","author":"Wagg","year":"2025","journal-title":"Data-Centric Eng."},{"key":"2026080604264036300_ooag160-B62","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1038\/s41746-025-01897-4","article-title":"A consensus statement on the use of digital twins in medicine","volume":"8","author":"Iqbal","year":"2025","journal-title":"NPJ Digit Med"},{"key":"2026080604264036300_ooag160-B63","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/j.cirpj.2020.02.002","article-title":"Characterising the digital twin: a systematic literature review","volume":"29","author":"Jones","year":"2020","journal-title":"CIRP J Manuf Sci Technol"},{"key":"2026080604264036300_ooag160-B64","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1007\/s10994-024-06642-8","article-title":"Calibrated explanations for regression","volume":"114","author":"L\u00f6fstr\u00f6m","year":"2025","journal-title":"Mach Learn"},{"key":"2026080604264036300_ooag160-B65","author":"Sokol","year":"2025"},{"key":"2026080604264036300_ooag160-B66","doi-asserted-by":"publisher","first-page":"717","DOI":"10.1016\/S0140-6736(24)00313-1","article-title":"The clinical potential of counterfactual AI models","volume":"403","author":"Lee","year":"2024","journal-title":"Lancet"},{"key":"2026080604264036300_ooag160-B67","doi-asserted-by":"publisher","first-page":"105681","DOI":"10.1016\/j.ijmedinf.2024.105681","article-title":"Counterfactual reasoning using causal Bayesian networks as a healthcare governance tool","volume":"193","author":"Kyrimi","year":"2025","journal-title":"Int J Med Inform"},{"key":"2026080604264036300_ooag160-B68","doi-asserted-by":"publisher","first-page":"1425693","DOI":"10.1155\/2016\/1425693","article-title":"Complementarity of clinician judgment and evidence based models in medical decision making: antecedents, prospects, and challenges","volume":"2016","author":"Lulin","year":"2016","journal-title":"Biomed Res Int"},{"key":"2026080604264036300_ooag160-B69","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1038\/s41746-024-01073-0","article-title":"Digital twins for health: a scoping review","volume":"7","author":"Katsoulakis","year":"2024","journal-title":"NPJ Digit Med"},{"key":"2026080604264036300_ooag160-B70","doi-asserted-by":"publisher","first-page":"1371","DOI":"10.1002\/bimj.201900112","article-title":"Dynamic prediction of time to a clinical event with sparse and irregularly measured longitudinal biomarkers","volume":"62","author":"Zhu","year":"2020","journal-title":"Biom J"},{"key":"2026080604264036300_ooag160-B71","doi-asserted-by":"publisher","first-page":"1386922","DOI":"10.3389\/fepid.2024.1386922","article-title":"Pitfalls in time-to-event analysis of registry data: a tutorial based on simulated and real cases","volume":"4","author":"Alligon","year":"2024","journal-title":"Front Epidemiol"},{"key":"2026080604264036300_ooag160-B72","doi-asserted-by":"crossref","first-page":"37","DOI":"10.18203\/2349-3259.ijct20161408","article-title":"In silico clinical trials: how computer simulation will transform the biomedical industry","volume":"3","author":"Viceconti","year":"2016","journal-title":"Int J Clin Trials"},{"key":"2026080604264036300_ooag160-B73","volume-title":"A Probabilistic Theory of Causality","author":"Suppes","year":"1970"},{"key":"2026080604264036300_ooag160-B74","volume-title":"Models and Theories","author":"Frigg","year":"2013"},{"key":"2026080604264036300_ooag160-B75","doi-asserted-by":"crossref","first-page":"947","DOI":"10.1111\/rssb.12167","article-title":"Causal inference by using invariant prediction: identification and confidence intervals","volume":"78","author":"Peters","year":"2016","journal-title":"J R Stat Soc Ser B"},{"key":"2026080604264036300_ooag160-B76","volume-title":"The Stanford Encyclopedia of Philosophy","author":"Starr","year":"2025"},{"key":"2026080604264036300_ooag160-B77","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1136\/jech.2002.006361","article-title":"A definition of causal effect for epidemiological research","volume":"58","author":"Hern\u00e1n","year":"2004","journal-title":"J Epidemiol Community Health"},{"key":"2026080604264036300_ooag160-B78","doi-asserted-by":"publisher","first-page":"793","DOI":"10.1056\/NEJMp1500523","article-title":"A new initiative on precision medicine","volume":"372","author":"Collins","year":"2015","journal-title":"N Engl J Med"},{"key":"2026080604264036300_ooag160-B79","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1038\/s41746-018-0029-1","article-title":"Scalable and accurate deep learning with electronic health records","volume":"1","author":"Rajkomar","year":"2018","journal-title":"NPJ Digit Med"},{"key":"2026080604264036300_ooag160-B80","doi-asserted-by":"publisher","first-page":"1589","DOI":"10.1109\/JBHI.2017.2767063","article-title":"Deep EHR: a survey of recent advances in deep learning techniques for electronic health record (EHR) analysis","volume":"22","author":"Shickel","year":"2018","journal-title":"IEEE J Biomed Health Inform"},{"key":"2026080604264036300_ooag160-B81","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1038\/s41746-020-00367-3","article-title":"Second opinion needed: communicating uncertainty in medical machine learning","volume":"4","author":"Kompa","year":"2021","journal-title":"NPJ Digit Med"},{"key":"2026080604264036300_ooag160-B82","author":"Ovadia","year":"2019"},{"key":"2026080604264036300_ooag160-B83","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1186\/s12916-019-1426-2","article-title":"Key challenges for delivering clinical impact with artificial intelligence","volume":"17","author":"Kelly","year":"2019","journal-title":"BMC Med"},{"key":"2026080604264036300_ooag160-B84","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1056\/NEJMp1714229","article-title":"Implementing machine learning in health care\u2013addressing ethical challenges","volume":"378","author":"Char","year":"2018","journal-title":"N Engl J Med"},{"key":"2026080604264036300_ooag160-B85","doi-asserted-by":"publisher","first-page":"e15182","DOI":"10.2196\/15182","article-title":"Real-World integration of a sepsis deep learning technology into routine clinical care: implementation study","volume":"8","author":"Sendak","year":"2020","journal-title":"JMIR Med Inform"},{"key":"2026080604264036300_ooag160-B86","doi-asserted-by":"publisher","first-page":"310","DOI":"10.1186\/s12911-020-01332-6","article-title":"Explainability for artificial intelligence in healthcare: a multidisciplinary perspective","volume":"20","author":"Amann","year":"2020","journal-title":"BMC Med Inform Decis Mak"},{"key":"2026080604264036300_ooag160-B87","doi-asserted-by":"publisher","first-page":"1818","DOI":"10.1001\/jama.2016.16435","article-title":"Confounding by indication in clinical research","volume":"316","author":"Kyriacou","year":"2016","journal-title":"JAMA"},{"key":"2026080604264036300_ooag160-B88","doi-asserted-by":"publisher","first-page":"S114","DOI":"10.1097\/MLR.0b013e3181dbebe3","article-title":"Confounding control in healthcare database research: challenges and potential approaches","volume":"48","author":"Brookhart","year":"2010","journal-title":"Med Care"},{"key":"2026080604264036300_ooag160-B89","doi-asserted-by":"publisher","first-page":"674","DOI":"10.1093\/aje\/kwp436","article-title":"Invited commentary: positivity in practice","volume":"171","author":"Westreich","year":"2010","journal-title":"Am J Epidemiol"},{"key":"2026080604264036300_ooag160-B90","doi-asserted-by":"publisher","first-page":"413","DOI":"10.1093\/ije\/15.3.413","article-title":"Identifiability, exchangeability, and epidemiological confounding","volume":"15","author":"Greenland","year":"1986","journal-title":"Int J Epidemiol"},{"key":"2026080604264036300_ooag160-B91","doi-asserted-by":"publisher","first-page":"E167","DOI":"10.1001\/amajethics.2019.167","article-title":"Can AI help reduce disparities in general medical and mental health care?","volume":"21","author":"Chen","year":"2019","journal-title":"AMA J Ethics"},{"key":"2026080604264036300_ooag160-B92","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1056\/NEJMc2104626","article-title":"The clinician and dataset shift in artificial intelligence","volume":"385","author":"Finlayson","year":"2021","journal-title":"N Engl J Med"},{"key":"2026080604264036300_ooag160-B93","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s44174-023-00063-2","article-title":"Drawbacks of artificial intelligence and their potential solutions in the healthcare sector","author":"Khan","year":"2023","journal-title":"Biomed Mater Devices"},{"key":"2026080604264036300_ooag160-B94","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting racial bias in an algorithm used to manage the health of populations","volume":"366","author":"Obermeyer","year":"2019","journal-title":"Science"},{"key":"2026080604264036300_ooag160-B95","author":"Saria","year":"2019"},{"key":"2026080604264036300_ooag160-B96","author":"Guo","year":"2017"},{"key":"2026080604264036300_ooag160-B97","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1038\/s41591-018-0310-5","article-title":"Guidelines for reinforcement learning in healthcare","volume":"25","author":"Gottesman","year":"2019","journal-title":"Nat Med"},{"key":"2026080604264036300_ooag160-B98","doi-asserted-by":"publisher","first-page":"108855","DOI":"10.1016\/j.ymssp.2022.108855","article-title":"Uncertainty quantification of large-scale dynamical systems using parametric model order reduction","volume":"171","author":"Fr\u00f6hlich","year":"2022","journal-title":"Mech Syst Signal Process"},{"key":"2026080604264036300_ooag160-B99","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1038\/nature08227","article-title":"Early-warning signals for critical transitions","volume":"461","author":"Scheffer","year":"2009","journal-title":"Nature"},{"key":"2026080604264036300_ooag160-B100","author":"B\u00fchlmann","year":"2018"},{"key":"2026080604264036300_ooag160-B101","doi-asserted-by":"publisher","first-page":"103010","DOI":"10.1016\/j.mex.2024.103010","article-title":"A method to improve binary forecast skill verification","volume":"13","author":"Sitthiyot","year":"2024","journal-title":"MethodsX"},{"key":"2026080604264036300_ooag160-B102","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1080\/02664763.2021.1981833","article-title":"Testing the reliability of forecasting systems","volume":"50","author":"Br\u00f6cker","year":"2023","journal-title":"J Appl Stat"},{"key":"2026080604264036300_ooag160-B103","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1111\/j.1467-9868.2007.00587.x","article-title":"Probabilistic forecasts, calibration and sharpness","volume":"69","author":"Gneiting","year":"2007","journal-title":"J R Stat Soc Ser B Stat Methodol"},{"key":"2026080604264036300_ooag160-B104","doi-asserted-by":"publisher","first-page":"1317","DOI":"10.1001\/jama.2017.18391","article-title":"Big data and machine learning in health care","volume":"319","author":"Beam","year":"2018","journal-title":"JAMA"},{"key":"2026080604264036300_ooag160-B105","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-23395-6","volume-title":"Introduction to Uncertainty Quantification","author":"Sullivan","year":"2015"},{"key":"2026080604264036300_ooag160-B106","doi-asserted-by":"publisher","first-page":"20150142","DOI":"10.1098\/rspa.2015.0142","article-title":"Probabilistic numerics and uncertainty in computations","volume":"471","author":"Hennig","year":"2015","journal-title":"Proc Math Phys Eng Sci"},{"key":"2026080604264036300_ooag160-B107","doi-asserted-by":"publisher","first-page":"1143","DOI":"10.2337\/diacare.23.8.1143","article-title":"A new consensus error grid to evaluate the clinical significance of inaccuracies in the measurement of blood glucose","volume":"23","author":"Parkes","year":"2000","journal-title":"Diabetes Care"},{"key":"2026080604264036300_ooag160-B108","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1097\/EDE.0b013e3181c30fb2","article-title":"Assessing the performance of prediction models: a framework for traditional and novel measures","volume":"21","author":"Steyerberg","year":"2010","journal-title":"Epidemiology"},{"key":"2026080604264036300_ooag160-B109","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1093\/biostatistics\/kxv043","article-title":"Measurement error models with interactions","volume":"17","author":"Midthune","year":"2016","journal-title":"Biostatistics"},{"key":"2026080604264036300_ooag160-B110","doi-asserted-by":"publisher","first-page":"e0000651","DOI":"10.1371\/journal.pdig.0000651","article-title":"Bias in medical AI: implications for clinical decision-making","volume":"3","author":"Cross","year":"2024","journal-title":"PLOS Digit Health"},{"key":"2026080604264036300_ooag160-B111","doi-asserted-by":"publisher","first-page":"230","DOI":"10.1186\/s12916-019-1466-7","article-title":"Calibration: the Achilles heel of predictive analytics","volume":"17","author":"Van Calster","year":"2019","journal-title":"BMC Med"},{"key":"2026080604264036300_ooag160-B112","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1097\/EDE.0b013e3181d61eeb","article-title":"Negative controls: a tool for detecting confounding and bias in observational studies","volume":"21","author":"Lipsitch","year":"2010","journal-title":"Epidemiology"},{"key":"2026080604264036300_ooag160-B113","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-4286-2","volume-title":"Statistical Decision Theory and Bayesian Analysis","author":"Berger","year":"1985"},{"key":"2026080604264036300_ooag160-B114","doi-asserted-by":"publisher","first-page":"428","DOI":"10.1089\/dia.2013.0377","article-title":"The university of Virginia\/padova type 1 diabetes simulator matches the glucose traces of a clinical trial","volume":"16","author":"Visentin","year":"2014","journal-title":"Diabetes Technol Ther"},{"key":"2026080604264036300_ooag160-B115","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1177\/193229680900300207","article-title":"In silico preclinical trials: methodology and engineering guide to closed-loop control in type 1 diabetes mellitus","volume":"3","author":"Patek","year":"2009","journal-title":"J Diabetes Sci Technol"},{"key":"2026080604264036300_ooag160-B116","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1177\/193229680900300106","article-title":"In silico preclinical trials: a proof of concept in closed-loop control of type 1 diabetes","volume":"3","author":"Kovatchev","year":"2009","journal-title":"J Diabetes Sci Technol"},{"key":"2026080604264036300_ooag160-B117","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1177\/1932296818757747","article-title":"The UVA\/padova type 1 diabetes simulator goes from single meal to single day","volume":"12","author":"Visentin","year":"2018","journal-title":"J Diabetes Sci Technol"},{"key":"2026080604264036300_ooag160-B118","doi-asserted-by":"publisher","first-page":"271","DOI":"10.2337\/diacare.29.02.06.dc05-1689","article-title":"Multicentric, randomized, controlled trial to evaluate blood glucose control by the model predictive control algorithm versus routine glucose management protocols in intensive care unit patients","volume":"29","author":"Plank","year":"2006","journal-title":"Diabetes Care"},{"key":"2026080604264036300_ooag160-B119","doi-asserted-by":"publisher","first-page":"1224","DOI":"10.1007\/s00134-008-1033-8","article-title":"Tight glycaemic control by an automated algorithm with time-variant sampling in medical ICU patients","volume":"34","author":"Pachler","year":"2008","journal-title":"Intensive Care Med"},{"key":"2026080604264036300_ooag160-B120","doi-asserted-by":"publisher","first-page":"1493","DOI":"10.1177\/19322968231195081","article-title":"Developing the UVA\/padova type 1 diabetes simulator: modeling, validation, refinements, and utility","volume":"17","author":"Cobelli","year":"2023","journal-title":"J Diabetes Sci Technol"},{"key":"2026080604264036300_ooag160-B121","doi-asserted-by":"publisher","first-page":"e013660","DOI":"10.1161\/CIRCEP.124.013660","article-title":"Heart digital twins predict features of invasive reentrant circuits and ablation lesions in scar-dependent ventricular tachycardia","volume":"18","author":"Waight","year":"2025","journal-title":"Circ Arrhythm Electrophysiol"},{"key":"2026080604264036300_ooag160-B122","doi-asserted-by":"publisher","first-page":"1512","DOI":"10.3389\/fphys.2019.01512","article-title":"Clinical usefulness of computational modeling-guided persistent atrial fibrillation ablation: updated outcome of multicenter randomized study","volume":"10","author":"Kim","year":"2019","journal-title":"Front Physiol"},{"key":"2026080604264036300_ooag160-B123","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1038\/s41746-025-01579-1","article-title":"MRI-based digital twins to improve treatment response of breast cancer by optimizing neoadjuvant chemotherapy regimens","volume":"8","author":"Wu","year":"2025","journal-title":"NPJ Digit Med"},{"key":"2026080604264036300_ooag160-B124","doi-asserted-by":"publisher","first-page":"116839","DOI":"10.1016\/j.neuroimage.2020.116839","article-title":"The Bayesian virtual epileptic patient: a probabilistic framework designed to infer the spatial map of epileptogenicity in a personalized large-scale brain model of epilepsy spread","volume":"217","author":"Hashemi","year":"2020","journal-title":"Neuroimage"},{"key":"2026080604264036300_ooag160-B125","doi-asserted-by":"publisher","first-page":"1942","DOI":"10.1111\/epi.17310","article-title":"Virtual epileptic patient brain modeling: relationships with seizure onset and surgical outcome","volume":"63","author":"Makhalova","year":"2022","journal-title":"Epilepsia"},{"key":"2026080604264036300_ooag160-B126","doi-asserted-by":"publisher","first-page":"100144","DOI":"10.1016\/j.comtox.2020.100144","article-title":"The role of validation in establishing the scientific credibility of predictive toxicology approaches intended for regulatory application","volume":"17","author":"Patterson","year":"2021","journal-title":"Comput Toxicol"},{"key":"2026080604264036300_ooag160-B127","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","article-title":"High-performance medicine: the convergence of human and artificial intelligence","volume":"25","author":"Topol","year":"2019","journal-title":"Nat Med"},{"key":"2026080604264036300_ooag160-B128","doi-asserted-by":"publisher","first-page":"2199","DOI":"10.1001\/jama.2018.17163","article-title":"Clinical decision support in the era of artificial intelligence","volume":"320","author":"Shortliffe","year":"2018","journal-title":"JAMA"},{"key":"2026080604264036300_ooag160-B129","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1016\/j.amjmed.2017.10.035","article-title":"Artificial intelligence in medical practice: the question to the answer?","volume":"131","author":"Miller","year":"2018","journal-title":"Am J Med"},{"key":"2026080604264036300_ooag160-B130","doi-asserted-by":"publisher","first-page":"1123","DOI":"10.1001\/archinternmed.2012.3319","article-title":"Overdiagnosis of disease: a modern epidemic","volume":"172","author":"Hoffman","year":"2012","journal-title":"Arch Intern Med"},{"key":"2026080604264036300_ooag160-B131","doi-asserted-by":"publisher","first-page":"h5527","DOI":"10.1136\/bmj.h5527","article-title":"STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies","volume":"351","author":"Bossuyt","year":"2015","journal-title":"BMJ"},{"key":"2026080604264036300_ooag160-B132","doi-asserted-by":"publisher","first-page":"758","DOI":"10.1093\/aje\/kwv254","article-title":"Using big data to emulate a target trial when a randomized trial is not available","volume":"183","author":"Hern\u00e1n","year":"2016","journal-title":"Am J Epidemiol"},{"key":"2026080604264036300_ooag160-B133","doi-asserted-by":"publisher","first-page":"4556","DOI":"10.1093\/eurheartj\/ehaa159","article-title":"The \u201cdigital twin\u201d to enable the vision of precision cardiology","volume":"41","author":"Corral-Acero","year":"2020","journal-title":"Eur Heart J"},{"key":"2026080604264036300_ooag160-B134","doi-asserted-by":"publisher","first-page":"2701","DOI":"10.1001\/jama.283.20.2701","article-title":"What makes clinical research ethical?","volume":"283","author":"Emanuel","year":"2000","journal-title":"JAMA"},{"key":"2026080604264036300_ooag160-B135","doi-asserted-by":"publisher","first-page":"e1002049","DOI":"10.1371\/journal.pmed.1002049","article-title":"Why most clinical research is not useful","volume":"13","author":"Ioannidis","year":"2016","journal-title":"PLoS Med"},{"key":"2026080604264036300_ooag160-B136","author":"Sch\u00f6lkopf","year":"2021"},{"key":"2026080604264036300_ooag160-B137","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/biom.12248","article-title":"Causal mediation analysis with multiple mediators","volume":"71","author":"Daniel","year":"2015","journal-title":"Biometrics"},{"key":"2026080604264036300_ooag160-B138","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1002\/hast.973","article-title":"Artificial intelligence and black-box medical decisions: accuracy versus explainability","volume":"49","author":"London","year":"2019","journal-title":"Hastings Cent Rep"},{"key":"2026080604264036300_ooag160-B139","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1038\/s41746-020-00324-0","article-title":"The state of artificial intelligence-based FDA-approved medical devices and algorithms: an online database","volume":"3","author":"Benjamens","year":"2020","journal-title":"NPJ Digit Med"},{"key":"2026080604264036300_ooag160-B140","doi-asserted-by":"publisher","first-page":"2423","DOI":"10.11124\/JBIES-24-00042","article-title":"Monitoring performance of clinical artificial intelligence in health care: a scoping review","volume":"22","author":"Andersen","year":"2024","journal-title":"JBI Evid Synth"},{"key":"2026080604264036300_ooag160-B141","doi-asserted-by":"publisher","first-page":"2053951716679679","DOI":"10.1177\/2053951716679679","article-title":"The ethics of algorithms: Mapping the debate","volume":"3","author":"Mittelstadt","year":"2016","journal-title":"Big Data Soc"},{"key":"2026080604264036300_ooag160-B142","author":"Leslie","year":"2019"}],"container-title":["JAMIA Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamiaopen\/article-pdf\/9\/4\/ooag160\/70481816\/ooag160.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamiaopen\/article-pdf\/9\/4\/ooag160\/70481816\/ooag160.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,6]],"date-time":"2026-08-06T08:26:56Z","timestamp":1786004816000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamiaopen\/article\/doi\/10.1093\/jamiaopen\/ooag160\/8751220"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,7]]},"references-count":142,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2026,7,7]]}},"URL":"https:\/\/doi.org\/10.1093\/jamiaopen\/ooag160","relation":{},"ISSN":["2574-2531"],"issn-type":[{"value":"2574-2531","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,8]]},"published":{"date-parts":[[2026,7,7]]},"article-number":"ooag160"}}