{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,13]],"date-time":"2026-09-13T23:04:08Z","timestamp":1789340648385,"version":"build-2803163510"},"reference-count":24,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T00:00:00Z","timestamp":1777852800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T00:00:00Z","timestamp":1777852800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001734","name":"Copenhagen University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001734","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Eur J Epidemiol"],"published-print":{"date-parts":[[2026,7]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Dynamic treatment regimes have been proposed to personalize treatment decisions by utilizing historical patient data, but they may not always improve on the current standard of care. It is thus meaningful to integrate the standard of care into the evaluation of treatment strategies, and previous works have suggested doing so through the concept of\n                    <jats:italic>clinical utility<\/jats:italic>\n                    . Here we will focus on the comparative component of clinical utility as the average outcome had the full population received treatment based on the proposed dynamic treatment regime in comparison to the full population receiving the \u201cstandard\" treatment assignment mechanism, such as a physician\u2019s choice. Clinical trials to evaluate clinical utility are rarely conducted, and thus, previous works have proposed an emulated clinical trial framework using observational data. However, only one simple estimator was previously suggested, and the practical details of how one would conduct this emulated trial were not detailed. Here, we illuminate these details and propose several estimators of clinical utility based on estimators proposed in the dynamic treatment regime literature. We illustrate the considerations and the estimators in a real data example investigating treatment rules for rheumatoid arthritis, where we highlight that in addition to the standard of care, the current medical guidelines should also be compared to any estimated \u201coptimal\u201d decision rule.\n                  <\/jats:p>","DOI":"10.1007\/s10654-026-01385-3","type":"journal-article","created":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T07:40:37Z","timestamp":1777880437000},"page":"829-839","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Evaluation of clinical utility in emulated clinical trials"],"prefix":"10.1007","volume":"41","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-9028-4103","authenticated-orcid":false,"given":"Johannes","family":"Hruza","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arvid","family":"Sj\u00f6lander","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erin","family":"E Gabriel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Samir","family":"Bhatt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1279-8676","authenticated-orcid":false,"given":"Michael","family":"C Sachs","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,5,4]]},"reference":[{"key":"1385_CR1","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-14-40","author":"GS Collins","year":"2014","unstructured":"Collins GS, Groot JA, Dutton S, Omar O, Shanyinde M, Tajar A, et al. External validation of multivariable prediction models: a systematic review of methodological conduct and reporting. BMC Med Res Methodol. 2014. https:\/\/doi.org\/10.1186\/1471-2288-14-40.","journal-title":"BMC Med Res Methodol"},{"key":"1385_CR2","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.l5358","author":"V Bellou","year":"2019","unstructured":"Bellou V, Belbasis L, Konstantinidis AK, Tzoulaki I, Evangelou E. Prognostic models for outcome prediction in patients with chronic obstructive pulmonary disease: systematic review and critical appraisal. BMJ. 2019. https:\/\/doi.org\/10.1136\/bmj.l5358.","journal-title":"BMJ"},{"key":"1385_CR3","doi-asserted-by":"publisher","DOI":"10.1097\/EDE.0000000000001173","author":"M Sachs","year":"2020","unstructured":"Sachs MC, Sj\u00f6lander A, Gabriel EE. Aim for clinical utility, not just predictive accuracy. Epidemiology. 2020;31(3):359\u2013364. https:\/\/doi.org\/10.1097\/EDE.0000000000001173.","journal-title":"Epidemiology"},{"issue":"1","key":"1385_CR4","doi-asserted-by":"publisher","first-page":"1410","DOI":"10.1198\/016214501753382327","volume":"456","author":"SA Murphy","year":"2001","unstructured":"Murphy SA, van der Laan MJ, Robins JM. Marginal mean models for dynamic regimes. J Am Stat Assoc. 2001;456(1):1410\u201323.","journal-title":"J Am Stat Assoc"},{"key":"1385_CR5","first-page":"1","volume":"6","author":"L Orellana","year":"2010","unstructured":"Orellana L, Rotnitzky A, Robins JM. Dynamic regime marginal structural mean models for estimation of optimal dynamic treatment regimes, part i: Main content. The International Journal of Biostatistics. 2010;6:1\u201349.","journal-title":"The International Journal of Biostatistics"},{"issue":"37","key":"1385_CR6","doi-asserted-by":"publisher","first-page":"5500","DOI":"10.1016\/j.vaccine.2018.06.061","volume":"36","author":"World Health Organization","year":"2018","unstructured":"World Health Organization. Rabies vaccines: Who position paper, April 2018 - recommendations. Vaccine. 2018;36(37):5500\u20133. https:\/\/doi.org\/10.1016\/j.vaccine.2018.06.061.","journal-title":"Vaccine"},{"key":"1385_CR7","doi-asserted-by":"publisher","unstructured":"Tsiatis AA, Davidian M, Holloway ST, Laber EB. Dynamic Treatment Regimes: Statistical Methods for Precision Medicine. Chapman and Hall\/CRC, Boca Raton, Florida 2019; https:\/\/doi.org\/10.1201\/9780429192692","DOI":"10.1201\/9780429192692"},{"issue":"427","key":"1385_CR8","doi-asserted-by":"publisher","first-page":"846","DOI":"10.1080\/01621459.1994.10476818","volume":"89","author":"JM Robins","year":"1994","unstructured":"Robins JM, Rotnitzky A, Zhao LP. Estimation of regression coefficients when some regressors are not always observed. J Am Stat Assoc. 1994;89(427):846\u201366. https:\/\/doi.org\/10.1080\/01621459.1994.10476818.","journal-title":"J Am Stat Assoc"},{"key":"1385_CR9","doi-asserted-by":"crossref","unstructured":"Smolen JS, Landew\u00e9 RBM, Bergstra SA, Kerschbaumer A, Sepriano A, Aletaha D, Caporali R, Edwards CJ, Hyrich KL, Pope JE, Souza S, Stamm TA, Takeuchi T, Verschueren P, Winthrop KL, Balsa A, Bathon JM, Buch MH, Burmester GR, Buttgereit F, Cardiel MH, Chatzidionysiou K, Codreanu C, Cutolo M, Broeder AA, El Aoufy K, Finckh A, Fonseca JE, Gottenberg J-E, Haavardsholm EA, Iagnocco A, Lauper K, Li Z, McInnes IB, Mysler EF, Nash P, Poor G, Ristic GG, Rivellese F, Rubbert-Roth A, Schulze-Koops H, Stoilov N, Strangfeld A, Helm-van Mil A, Duuren E, Vliet Vlieland TPM, Westhovens R, Heijde D: Eular recommendations for the management of rheumatoid arthritis with synthetic and biological disease-modifying antirheumatic drugs: 2022 update. Annals of the Rheumatic Diseases2023; 82(1):3\u201318 10.1136\/ard-2022-223356 https:\/\/ard.bmj.com\/content\/82\/1\/3.full.pdf.","DOI":"10.1136\/ard-2022-223356"},{"issue":"5","key":"1385_CR10","doi-asserted-by":"publisher","first-page":"1030","DOI":"10.1093\/ije\/31.5.1030","volume":"31","author":"S Greenland","year":"2002","unstructured":"Greenland S, Brumback B. An overview of relations among causal modelling methods. Int J Epidemiol. 2002;31(5):1030\u20137. https:\/\/doi.org\/10.1093\/ije\/31.5.1030.","journal-title":"Int J Epidemiol"},{"key":"1385_CR11","doi-asserted-by":"crossref","unstructured":"Venables WN, Ripley BD. Modern Applied Statistics with S. 4th ed. New York: Springer; 2002.","DOI":"10.1007\/978-0-387-21706-2"},{"key":"1385_CR12","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1016\/s0720-048x(98)00038-2","volume":"27","author":"W Grassi","year":"1998","unstructured":"Grassi W, De Angelis R, Lamanna G, Cervini C. The clinical features of rheumatoid arthritis. Eur J Radiol. 1998;27:18\u201324. https:\/\/doi.org\/10.1016\/s0720-048x(98)00038-2.","journal-title":"Eur J Radiol"},{"issue":"2","key":"1385_CR13","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1016\/j.semarthrit.2014.05.001","volume":"44","author":"F Matcham","year":"2014","unstructured":"Matcham F, Scott IC, Rayner L, Hotopf M, Kingsley GH, Norton S, et al. The impact of rheumatoid arthritis on quality-of-life assessed using the sf-36: A systematic review and meta-analysis. Semin Arthritis Rheum. 2014;44(2):123\u201330. https:\/\/doi.org\/10.1016\/j.semarthrit.2014.05.001.","journal-title":"Semin Arthritis Rheum"},{"key":"1385_CR14","doi-asserted-by":"publisher","first-page":"469","DOI":"10.2147\/CLEP.S245060","volume":"10","author":"JFH Arendt","year":"2020","unstructured":"Arendt JFH, Hansen AT, Ladefoged SA, S\u00f8rensen HT, Pedersen L, Adelborg K. Existing data sources in clinical epidemiology: laboratory information system databases in denmark. Clin Epidemiol. 2020;10:469\u201375. https:\/\/doi.org\/10.2147\/clep.s245060","journal-title":"Clin Epidemiol"},{"issue":"8","key":"1385_CR15","doi-asserted-by":"publisher","first-page":"758","DOI":"10.1093\/aje\/kwv254","volume":"183","author":"MA Hern\u00e1n","year":"2016","unstructured":"Hern\u00e1n MA, Robins JM. Using big data to emulate a target trial when a randomized trial is not available. Am J Epidemiol. 2016;183(8):758\u201364. https:\/\/doi.org\/10.1093\/aje\/kwv254","journal-title":"Am J Epidemiol"},{"issue":"16","key":"1385_CR16","doi-asserted-by":"publisher","first-page":"1376","DOI":"10.1001\/jama.2023.4221","volume":"329","author":"SV Wang","year":"2023","unstructured":"Wang SV, Schneeweiss S, Franklin JM, Desai RJ, Feldman W, Garry EM, et al. Emulation of randomized clinical trials with nonrandomized database analyses: Results of 32 clinical trials. JAMA. 2023;329(16):1376. https:\/\/doi.org\/10.1001\/jama.2023.4221.","journal-title":"JAMA"},{"issue":"8","key":"1385_CR17","doi-asserted-by":"publisher","first-page":"1164","DOI":"10.1016\/j.jval.2023.04.010","volume":"26","author":"S Moler-Zapata","year":"2023","unstructured":"Moler-Zapata S, Hutchings A, O\u2019Neill S, Silverwood RJ, Grieve R. Emulating target trials with real-world data to inform health technology assessment: Findings and lessons from an application to emergency surgery. Value in Health. 2023;26(8):1164\u201374. https:\/\/doi.org\/10.1016\/j.jval.2023.04.010.","journal-title":"Value in Health"},{"issue":"4","key":"1385_CR18","doi-asserted-by":"publisher","first-page":"1089","DOI":"10.1093\/biomet\/asae016","volume":"111","author":"MJ Stensrud","year":"2024","unstructured":"Stensrud MJ, Laurendeau JD, Sarvet AL. Optimal regimes for algorithm-assisted human decision-making. Biometrika. 2024;111(4):1089\u2013108. https:\/\/doi.org\/10.1093\/biomet\/asae016.","journal-title":"Biometrika"},{"key":"1385_CR19","first-page":"1","volume-title":"Advances in Neural Information Processing Systems","author":"A Rahimi","year":"2007","unstructured":"Rahimi A, Recht B. Random features for large-scale kernel machines. In: Platt J, Koller D, Singer Y, Roweis S, editors. Advances in Neural Information Processing Systems, vol. 20. New York: Curran Associates Inc; 2007. p. 1\u20138."},{"issue":"100362","key":"1385_CR20","doi-asserted-by":"publisher","first-page":"100362","DOI":"10.1016\/j.epidem.2019.100362","volume":"29","author":"P Milton","year":"2019","unstructured":"Milton P, Coupland H, Giorgi E, Bhatt S. Spatial analysis made easy with linear regression and kernels. Epidemics. 2019;29(100362):100362. https:\/\/doi.org\/10.1016\/j.epidem.2019.100362","journal-title":"Epidemics"},{"issue":"1","key":"1385_CR21","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1515\/jci-2012-0004","volume":"1","author":"E Bareinboim","year":"2013","unstructured":"Bareinboim E, Pearl J. A general algorithm for deciding transportability of experimental results. Journal of causal Inference. 2013;1(1):107\u201334. https:\/\/doi.org\/10.1259\/bjr.20220878","journal-title":"Journal of causal Inference"},{"key":"1385_CR22","doi-asserted-by":"publisher","unstructured":"Sahiner B, Chen W, Samala RK, Petrick N. Data drift in medical machine learning: implications and potential remedies. Br J Radiol. 2023;96(1150): https:\/\/doi.org\/10.1259\/bjr.20220878.","DOI":"10.1259\/bjr.20220878"},{"issue":"1","key":"1385_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1515\/em-2012-0001","volume":"3","author":"JG Young","year":"2014","unstructured":"Young JG, Hern\u00e1n MA, Robins JM. Identification, estimation and approximation of risk under interventions that depend on the natural value of treatment using observational data. Epidemiol Method. 2014;3(1):1\u201319. https:\/\/doi.org\/10.1515\/em-2012-0001.","journal-title":"Epidemiol Method"},{"key":"1385_CR24","unstructured":"Levis AW, Ben-Michael E, Kennedy EH. Intervention effects based on potential benefit. arXiv preprint arXiv:2405.08727 2024;"}],"container-title":["European Journal of Epidemiology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10654-026-01385-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10654-026-01385-3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10654-026-01385-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,13]],"date-time":"2026-09-13T23:02:10Z","timestamp":1789340530000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10654-026-01385-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,4]]},"references-count":24,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2026,7]]}},"alternative-id":["1385"],"URL":"https:\/\/doi.org\/10.1007\/s10654-026-01385-3","relation":{},"ISSN":["0393-2990","1573-7284"],"issn-type":[{"value":"0393-2990","type":"print"},{"value":"1573-7284","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,4]]},"assertion":[{"value":"15 April 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 February 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 May 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}