{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T05:23:49Z","timestamp":1777440229028,"version":"3.51.4"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,3,30]],"date-time":"2023-03-30T00:00:00Z","timestamp":1680134400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,30]],"date-time":"2023-03-30T00:00:00Z","timestamp":1680134400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100010767","name":"Innovative Medicines Initiative","doi-asserted-by":"publisher","award":["80696"],"award-info":[{"award-number":["80696"]}],"id":[{"id":"10.13039\/501100010767","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100010767","name":"Innovative Medicines Initiative","doi-asserted-by":"publisher","award":["80696"],"award-info":[{"award-number":["80696"]}],"id":[{"id":"10.13039\/501100010767","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Treatment effects are often anticipated to vary across groups of patients with different baseline risk. The Predictive Approaches to Treatment Effect Heterogeneity (PATH) statement focused on baseline risk as a robust predictor of treatment effect and provided guidance on risk-based assessment of treatment effect heterogeneity in a randomized controlled trial. The aim of this study is to extend this approach to the observational setting using a standardized scalable framework. The proposed framework consists of five steps: (1) definition of the research aim, i.e., the population, the treatment, the comparator and the outcome(s) of interest; (2) identification of relevant databases; (3) development of a prediction model for the outcome(s) of interest; (4) estimation of relative and absolute treatment effect within strata of predicted risk, after adjusting for observed confounding; (5) presentation of the results. We demonstrate our framework by evaluating heterogeneity of the effect of thiazide or thiazide-like diuretics versus angiotensin-converting enzyme inhibitors on three efficacy and nine safety outcomes across three observational databases. We provide a publicly available R software package for applying this framework to any database mapped to the Observational Medical Outcomes Partnership Common Data Model. In our demonstration, patients at low risk of acute myocardial infarction receive negligible absolute benefits for all three efficacy outcomes, though they are more pronounced in the highest risk group, especially for acute myocardial infarction. Our framework allows for the evaluation of differential treatment effects across risk strata, which offers the opportunity to consider the benefit-harm trade-off between alternative treatments.<\/jats:p>","DOI":"10.1038\/s41746-023-00794-y","type":"journal-article","created":{"date-parts":[[2023,3,30]],"date-time":"2023-03-30T02:03:03Z","timestamp":1680141783000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["A standardized framework for risk-based assessment of treatment effect heterogeneity in observational healthcare databases"],"prefix":"10.1038","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5352-943X","authenticated-orcid":false,"given":"Alexandros","family":"Rekkas","sequence":"first","affiliation":[]},{"given":"David","family":"van Klaveren","sequence":"additional","affiliation":[]},{"given":"Patrick B.","family":"Ryan","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7787-0122","authenticated-orcid":false,"given":"Ewout W.","family":"Steyerberg","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9205-5070","authenticated-orcid":false,"given":"David M.","family":"Kent","sequence":"additional","affiliation":[]},{"given":"Peter R.","family":"Rijnbeek","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,3,30]]},"reference":[{"key":"794_CR1","doi-asserted-by":"publisher","first-page":"1616","DOI":"10.1016\/S0140-6736(95)90120-5","volume":"345","author":"PM Rothwell","year":"1995","unstructured":"Rothwell, P. M. Can overall results of clinical trials be applied to all patients? Lancet 345, 1616\u20131619 (1995).","journal-title":"Lancet"},{"key":"794_CR2","doi-asserted-by":"publisher","first-page":"661","DOI":"10.1111\/j.0887-378X.2004.00327.x","volume":"82","author":"RL Kravitz","year":"2004","unstructured":"Kravitz, R. L., Duan, N. & Braslow, J. Evidence-based medicine, heterogeneity of treatment effects, and the trouble with averages. Milbank Q. 82, 661\u2013687 (2004).","journal-title":"Milbank Q."},{"key":"794_CR3","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-6-18","volume":"6","author":"RA Hayward","year":"2006","unstructured":"Hayward, R. A., Kent, D. M., Vijan, S. & Hofer, T. P. Multivariable risk prediction can greatly enhance the statistical power of clinical trial subgroup analysis. BMC Med. Res. Methodol. 6, 18 (2006).","journal-title":"BMC Med. Res. Methodol."},{"key":"794_CR4","doi-asserted-by":"publisher","unstructured":"Kent, D. M., Steyerberg, E. & Klaveren, D. van. Personalized evidence based medicine: predictive approaches to heterogeneous treatment effects. BMJ k4245 https:\/\/doi.org\/10.1136\/bmj.k4245 (2018).","DOI":"10.1136\/bmj.k4245"},{"key":"794_CR5","doi-asserted-by":"publisher","first-page":"256","DOI":"10.1016\/S0140-6736(05)70156-2","volume":"365","author":"PM Rothwell","year":"2005","unstructured":"Rothwell, P. M., Mehta, Z., Howard, S. C., Gutnikov, S. A. & Warlow, C. P. From subgroups to individuals: general principles and the example of carotid endarterectomy. Lancet 365, 256\u2013265 (2005).","journal-title":"Lancet"},{"key":"794_CR6","doi-asserted-by":"publisher","first-page":"1209","DOI":"10.1001\/jama.298.10.1209","volume":"298","author":"DM Kent","year":"2007","unstructured":"Kent, D. M. & Hayward, R. A. Limitations of applying summary results of clinical trials to individual patients: the need for risk stratification. JAMA 298, 1209\u20131212 (2007).","journal-title":"JAMA"},{"key":"794_CR7","doi-asserted-by":"publisher","DOI":"10.1186\/1745-6215-9-30","volume":"9","author":"DM Kent","year":"2008","unstructured":"Kent, D. M., Alsheikh-Ali, A. & Hayward, R. A. Competing risk and heterogeneity of treatment effect in clinical trials. Trials 9, 30 (2008).","journal-title":"Trials"},{"key":"794_CR8","doi-asserted-by":"publisher","DOI":"10.1186\/1745-6215-11-85","volume":"11","author":"DM Kent","year":"2010","unstructured":"Kent, D. M., Rothwell, P. M., Ioannidis, J. P., Altman, D. G. & Hayward, R. A. Assessing and reporting heterogeneity in treatment effects in clinical trials: a proposal. Trials 11, 85 (2010).","journal-title":"Trials"},{"key":"794_CR9","doi-asserted-by":"publisher","first-page":"2017","DOI":"10.1161\/CIRCULATIONAHA.105.558676","volume":"112","author":"JJ Thune","year":"2005","unstructured":"Thune, J. J. et al. Simple risk stratification at admission to identify patients with reduced mortality from primary angioplasty. Circulation 112, 2017\u20132021 (2005).","journal-title":"Circulation"},{"key":"794_CR10","doi-asserted-by":"publisher","first-page":"h454","DOI":"10.1136\/bmj.h454","volume":"350","author":"JB Sussman","year":"2015","unstructured":"Sussman, J. B., Kent, D. M., Nelson, J. P. & Hayward, R. A. Improving diabetes prevention with benefit based tailored treatment: risk based reanalysis of Diabetes Prevention Program. BMJ 350, h454\u2013h454 (2015).","journal-title":"BMJ"},{"key":"794_CR11","doi-asserted-by":"publisher","first-page":"35","DOI":"10.7326\/M18-3667","volume":"172","author":"DM Kent","year":"2019","unstructured":"Kent, D. M. et al. The Predictive Approaches to Treatment effect Heterogeneity (PATH) Statement. Ann. Intern. Med. 172, 35 (2019).","journal-title":"Ann. Intern. Med."},{"key":"794_CR12","doi-asserted-by":"publisher","first-page":"W1","DOI":"10.7326\/M18-3668","volume":"172","author":"DM Kent","year":"2019","unstructured":"Kent, D. M. et al. The Predictive Approaches to Treatment effect Heterogeneity (PATH) Statement: Explanation and Elaboration. Ann. Intern. Med. 172, W1 (2019).","journal-title":"Ann. Intern. Med."},{"key":"794_CR13","first-page":"574","volume":"216","author":"G Hripcsak","year":"2015","unstructured":"Hripcsak, G. et al. Observational Health Data Sciences and Informatics (OHDSI): opportunities for observational researchers. Stud. Health Technol. Inform. 216, 574 (2015).","journal-title":"Stud. Health Technol. Inform."},{"key":"794_CR14","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1136\/amiajnl-2011-000376","volume":"19","author":"JM Overhage","year":"2012","unstructured":"Overhage, J. M., Ryan, P. B., Reich, C. G., Hartzema, A. G. & Stang, P. E. Validation of a common data model for active safety surveillance research. J. Am. Med. Inform. Assoc. 19, 54\u201360 (2012).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"794_CR15","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1007\/s40264-013-0099-6","volume":"36","author":"PB Ryan","year":"2013","unstructured":"Ryan, P. B., Schuemie, M. J., Gruber, S., Zorych, I. & Madigan, D. Empirical performance of a new user cohort method: lessons for developing a risk identification and analysis system. Drug Saf. 36, 59\u201372 (2013).","journal-title":"Drug Saf."},{"key":"794_CR16","doi-asserted-by":"publisher","first-page":"1816","DOI":"10.1016\/S0140-6736(19)32317-7","volume":"394","author":"MA Suchard","year":"2019","unstructured":"Suchard, M. A. et al. Comprehensive comparative effectiveness and safety of first-line antihypertensive drug classes: a systematic, multinational, large-scale analysis. Lancet 394, 1816\u20131826 (2019).","journal-title":"Lancet"},{"key":"794_CR17","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1002\/sim.5925","volume":"33","author":"MJ Schuemie","year":"2014","unstructured":"Schuemie, M. J., Ryan, P. B., DuMouchel, W., Suchard, M. A. & Madigan, D. Interpreting observational studies: why empirical calibration is needed to correct p-values. Stat. Med. 33, 209\u2013218 (2014).","journal-title":"Stat. Med."},{"key":"794_CR18","doi-asserted-by":"publisher","first-page":"2571","DOI":"10.1073\/pnas.1708282114","volume":"115","author":"MJ Schuemie","year":"2018","unstructured":"Schuemie, M. J., Hripcsak, G., Ryan, P. B., Madigan, D. & Suchard, M. A. Empirical confidence interval calibration for population-level effect estimation studies in observational healthcare data. Proc. Natl Acad. Sci. USA 115, 2571\u20132577 (2018).","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"794_CR19","doi-asserted-by":"publisher","first-page":"20170356","DOI":"10.1098\/rsta.2017.0356","volume":"376","author":"MJ Schuemie","year":"2018","unstructured":"Schuemie, M. J., Ryan, P. B., Hripcsak, G., Madigan, D. & Suchard, M. A. Improving reproducibility by using high-throughput observational studies with empirical calibration. Philos. Trans. R. Soc. A: Math. Phys. Eng. Sci. 376, 20170356 (2018).","journal-title":"Philos. Trans. R. Soc. A: Math. Phys. Eng. Sci."},{"key":"794_CR20","doi-asserted-by":"publisher","DOI":"10.1186\/s12874-020-01145-1","volume":"20","author":"A Rekkas","year":"2020","unstructured":"Rekkas, A. et al. Predictive approaches to heterogeneous treatment effects: a scoping review. BMC Med. Res. Methodol. 20, 264 (2020).","journal-title":"BMC Med. Res. Methodol."},{"key":"794_CR21","doi-asserted-by":"publisher","first-page":"818","DOI":"10.1016\/j.jclinepi.2013.02.009","volume":"66","author":"R Varadhan","year":"2013","unstructured":"Varadhan, R., Segal, J. B., Boyd, C. M., Wu, A. W. & Weiss, C. O. A framework for the analysis of heterogeneity of treatment effect in patient-centered outcomes research. J. Clin. Epidemiol. 66, 818\u2013825 (2013).","journal-title":"J. Clin. Epidemiol."},{"key":"794_CR22","first-page":"MR000034","volume":"2014","author":"A Anglemyer","year":"2014","unstructured":"Anglemyer, A., Horvath, H. T. & Bero, L. Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials. Cochrane Database Syst. Rev. 2014, MR000034 (2014).","journal-title":"Cochrane Database Syst. Rev."},{"key":"794_CR23","first-page":"2184","volume":"45","author":"IJ Dahabreh","year":"2016","unstructured":"Dahabreh, I. J., Hayward, R. & Kent, D. M. Using group data to treat individuals: understanding heterogeneous treatment effects in the age of precision medicine and patient-centred evidence. Int. J. Epidemiol. 45, 2184\u20132193 (2016).","journal-title":"Int. J. Epidemiol."},{"key":"794_CR24","first-page":"e13","volume":"71","author":"PK Whelton","year":"2018","unstructured":"Whelton, P. K. et al. 2017 ACC\/AHA\/AAPA\/ABC\/ACPM\/AGS\/APhA\/ASH\/ASPC\/NMA\/PCNA Guideline for the Prevention, Detection, Evaluation, and Management of High Blood Pressure in Adults: a report of the American College of Cardiology\/American Heart Association Task Force on Clinical Practice Guidelines. Hypertension 71, e13\u2013e115 (2018).","journal-title":"Hypertension"},{"key":"794_CR25","doi-asserted-by":"publisher","first-page":"969","DOI":"10.1093\/jamia\/ocy032","volume":"25","author":"JM Reps","year":"2018","unstructured":"Reps, J. M., Schuemie, M. J., Suchard, M. A., Ryan, P. B. & Rijnbeek, P. R. Design and implementation of a standardized framework to generate and evaluate patient-level prediction models using observational healthcare data. J. Am. Med. Inform. Assoc. 25, 969\u2013975 (2018).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"794_CR26","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-014-0241-z","volume":"13","author":"GS Collins","year":"2015","unstructured":"Collins, G. S., Reitsma, J. B., Altman, D. G. & Moons, K. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement. BMC Med. 13, 1 (2015).","journal-title":"BMC Med."},{"key":"794_CR27","doi-asserted-by":"publisher","first-page":"W1","DOI":"10.7326\/M14-0698","volume":"162","author":"KGM Moons","year":"2015","unstructured":"Moons, K. G. M. et al. Transparent reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): explanation and elaboration. Ann. Intern. Med. 162, W1\u2013W73 (2015).","journal-title":"Ann. Intern. Med."},{"key":"794_CR28","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1161\/CIRCOUTCOMES.113.000497","volume":"7","author":"JF Burke","year":"2014","unstructured":"Burke, J. F., Hayward, R. A., Nelson, J. P. & Kent, D. M. Using internally developed risk models to assess heterogeneity in treatment effects in clinical trials. Circ. Cardiovasc. Qual. Outcomes 7, 163\u2013169 (2014).","journal-title":"Circ. Cardiovasc. Qual. Outcomes"},{"key":"794_CR29","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1016\/j.jclinepi.2019.05.029","volume":"114","author":"D Klaveren","year":"2019","unstructured":"Klaveren, D., van, Balan, T. A., Steyerberg, E. W. & Kent, D. M. Models with interactions overestimated heterogeneity of treatment effects and were prone to treatment mistargeting. J. Clin. Epidemiol. 114, 72\u201383 (2019).","journal-title":"J. Clin. Epidemiol."},{"key":"794_CR30","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1080\/00273171.2011.568786","volume":"46","author":"PC Austin","year":"2011","unstructured":"Austin, P. C. An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivar. Behav. Res. 46, 399\u2013424 (2011).","journal-title":"Multivar. Behav. Res."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00794-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00794-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00794-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,30]],"date-time":"2023-03-30T02:04:58Z","timestamp":1680141898000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00794-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,30]]},"references-count":30,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["794"],"URL":"https:\/\/doi.org\/10.1038\/s41746-023-00794-y","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,30]]},"assertion":[{"value":"1 July 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 March 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 March 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A.R. and P.R.R. work for a group that received unconditional research grants from Boehringer-Ingelheim, GSK, Janssen Research & Development, Novartis, Pfizer, Yamanouchi, and Servier. None of these grants result in a conflict of interest for the content of this paper. P.B.R. is an employee of Janssen R&D, subsidiary of Johnson & Johnson. D.V.K., D.M.K., E.W.S. have nothing to declare.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"58"}}