{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T02:15:14Z","timestamp":1793067314654,"version":"4.5.0"},"reference-count":44,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T00:00:00Z","timestamp":1772582400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100022795","name":"Hamilton Health Sciences Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100022795","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100022795","name":"Data Science and Digital Health at Hamilton Health Sciences","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100022795","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,3,4]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Aims<\/jats:title>\n                    <jats:p>Nearly, 40% of patients undergoing elective invasive coronary angiography (ICA) are diagnosed with non-obstructive coronary artery disease (CAD) or normal coronary anatomy, resulting in unnecessary risk exposure and increased costs to the healthcare system. In this study, we externally validate an artificial intelligence model for optimizing patient selection for ICA vs. coronary computed tomography angiography (CCTA) to reduce unnecessary ICAs.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods and results<\/jats:title>\n                    <jats:p>The model was trained on data from outpatients undergoing elective ICA at two cardiac centres in Ontario, Canada between 2008 and 2019. It uses 42 predictors including demographic characteristics, risk factors, and medical history (including ECG stress testing and\/or functional imaging) to predict the probability of obstructive CAD. Geographical validation assessed the discrimination performance on patients seen at the other 20 cardiac centres in Ontario, Canada during the same period. Temporal validation evaluated the model\u2019s performance on outpatients receiving ICA at the original centres between 2020 and 2023. Reclassification analysis was employed to estimate health system impact. Subgroup analysis was used to assess model fairness. Following external validation, the model was updated on data from the entire outpatient population (N = 319 012) receiving ICA from 2008 to 2023. As expected, performance of the local model was lower on the geographical validation cohort (AUROC = 0.714 [95% CI: 0.714, 0.714], Sensitivity = 0.73, Specificity = 0.57) than on the local test set. However, following updating, performance recovered (AUROC = 0.794 [95% CI: 0.794, 0.795], Sensitivity = 0.708, Specificity = 0.699). Analysis of health system impact indicates that 27 of every 39 unnecessary ICAs could be avoided through use of the model.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Use of the model could result in an absolute reduction of 27% in the proportion of ICAs that result in a diagnosis of normal\/non-obstructive disease. This could contribute to a reduction in complications from ICA and more efficient utilization of cardiac catheterization lab capacity for higher-value cardiac interventions such as revascularization and structural procedures. Additionally, use of the model would create significant efficiencies for payors, given the much lower cost of CCTA compared with ICA. If implemented within clinical practice, the model has the potential to improve the patient experience and reduce existing health inequities.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/ehjdh\/ztag040","type":"journal-article","created":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T12:30:07Z","timestamp":1772541007000},"source":"Crossref","is-referenced-by-count":1,"title":["An artificial intelligence prediction model for optimizing patient selection for cardiac imaging for the investigation of suspected coronary artery disease"],"prefix":"10.1093","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1614-1046","authenticated-orcid":false,"given":"Jeremy","family":"Petch","sequence":"first","affiliation":[{"name":"Centre for Data Science and Digital Health, Hamilton Health Sciences , Hamilton, ON ,","place":["Canada"]},{"name":"Institute for Health Policy, Management and Evaluation, University of Toronto , Toronto, ON ,","place":["Canada"]},{"name":"Division of Cardiology, McMaster University , Hamilton, ON ,","place":["Canada"]},{"name":"Hamilton Health Sciences, Population Health Research Institute , Hamilton, ON ,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuang","family":"Di","sequence":"additional","affiliation":[{"name":"Centre for Data Science and Digital Health, Hamilton Health Sciences , Hamilton, ON ,","place":["Canada"]},{"name":"Dalla Lana School of Public Health, University of Toronto , Toronto, ON ,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tristan","family":"Watson","sequence":"additional","affiliation":[{"name":"Dalla Lana School of Public Health, University of Toronto , Toronto, ON ,","place":["Canada"]},{"name":"ICES , Toronto, ON ,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4127-4660","authenticated-orcid":false,"given":"Maria P","family":"Becerra","sequence":"additional","affiliation":[{"name":"Centre for Data Science and Digital Health, Hamilton Health Sciences , Hamilton, ON ,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura C","family":"Rosella","sequence":"additional","affiliation":[{"name":"Dalla Lana School of Public Health, University of Toronto , Toronto, ON ,","place":["Canada"]},{"name":"ICES , Toronto, ON ,","place":["Canada"]},{"name":"Institute for Better Health, Trillium Health Partners, Mississauga , ON ,","place":["Canada"]},{"name":"Department of Laboratory Medicine and Pathology, Temerty Faculty of Medicine, University of Toronto , Toronto, ON ,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Madhu K","family":"Natarajan","sequence":"additional","affiliation":[{"name":"Division of Cardiology, McMaster University , Hamilton, ON ,","place":["Canada"]},{"name":"Hamilton Health Sciences, Population Health Research Institute , Hamilton, ON ,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tej","family":"Sheth","sequence":"additional","affiliation":[{"name":"Division of Cardiology, McMaster University , Hamilton, ON ,","place":["Canada"]},{"name":"Hamilton Health Sciences, Population Health Research Institute , Hamilton, ON ,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jon-David","family":"Schwalm","sequence":"additional","affiliation":[{"name":"Division of Cardiology, McMaster University , Hamilton, ON ,","place":["Canada"]},{"name":"Hamilton Health Sciences, Population Health Research Institute , Hamilton, ON ,","place":["Canada"]},{"name":"Centre for Evidence-Based Implementation, Hamilton Health Sciences , Hamilton, ON ,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,3,4]]},"reference":[{"key":"2026031709572098700_ztag040-B1","doi-asserted-by":"crossref","first-page":"2100","DOI":"10.1016\/S0140-6736(24)00367-2","article-title":"Global burden of 288 causes of death and life expectancy decomposition in 204 countries and territories and 811 subnational locations, 1990\u20132021: a systematic analysis for the Global Burden of Disease Study 2021","volume":"403","author":"Naghavi","year":"2024","journal-title":"Lancet"},{"key":"2026031709572098700_ztag040-B2","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1016\/j.jacc.2013.09.055","article-title":"Normal coronary rates for elective angiography in the veterans affairs healthcare system: insights from the VA CART program (veterans affairs clinical assessment reporting and tracking)","volume":"63","author":"Bradley","year":"2014","journal-title":"J Am Coll Cardiol"},{"key":"2026031709572098700_ztag040-B3","doi-asserted-by":"crossref","first-page":"694","DOI":"10.1016\/j.ahj.2013.07.030","article-title":"Predictors of normal coronary arteries at coronary angiography","volume":"166","author":"Levitt","year":"2013","journal-title":"Am Heart J"},{"key":"2026031709572098700_ztag040-B4","doi-asserted-by":"crossref","first-page":"886","DOI":"10.1056\/NEJMoa0907272","article-title":"Low diagnostic yield of elective coronary angiography","volume":"362","author":"Patel","year":"2010","journal-title":"N Engl J Med"},{"key":"2026031709572098700_ztag040-B5","first-page":"65","article-title":"Risks and complications of coronary angiography: a comprehensive review","volume":"4","author":"Tavakol","year":"2012","journal-title":"Glob J Health Sci"},{"key":"2026031709572098700_ztag040-B6","volume-title":"The relative cost-effectiveness of five non-invasive cardiac imaging technologies for diagnosing coronary artery disease in Ontario","author":"Toronto Health Economics and Technology Assessment Collaborative","year":"2010"},{"key":"2026031709572098700_ztag040-B7","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1007\/s10198-014-0616-2","article-title":"Cost-effectiveness of computed tomography coronary angiography versus conventional invasive coronary angiography","volume":"16","author":"Darlington","year":"2015","journal-title":"Eur J Health Econ"},{"key":"2026031709572098700_ztag040-B8","doi-asserted-by":"crossref","first-page":"996","DOI":"10.1001\/jamainternmed.2022.2602","article-title":"Assessment of prices for cardiovascular tests and procedures at top-ranked US hospitals","volume":"182","author":"Oseran","year":"2022","journal-title":"JAMA Intern Med"},{"key":"2026031709572098700_ztag040-B9","doi-asserted-by":"crossref","first-page":"1787","DOI":"10.1161\/CIRCULATIONAHA.107.726562","article-title":"Impact of ethnicity and gender differences on angiographic coronary artery disease prevalence and in-hospital mortality in the American College of Cardiology-National Cardiovascular Data Registry","volume":"117","author":"Shaw","year":"2008","journal-title":"Circulation"},{"key":"2026031709572098700_ztag040-B10","doi-asserted-by":"crossref","first-page":"1331","DOI":"10.1093\/eurheartj\/ehr009","article-title":"Are we using cardiovascular medications and coronary angiography appropriately in men and women with chest pain?","volume":"32","author":"Johnston","year":"2011","journal-title":"Eur Heart J"},{"key":"2026031709572098700_ztag040-B11","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1007\/s11239-012-0847-y","article-title":"Gender related differences in predictors of vascular complications: role of vessel size and BMI","volume":"36","author":"Ahmed","year":"2013","journal-title":"J Thromb Thrombolysis"},{"key":"2026031709572098700_ztag040-B12","doi-asserted-by":"crossref","first-page":"l1945","DOI":"10.1136\/bmj.l1945","article-title":"Diagnosis of obstructive coronary artery disease using computed tomography angiography in patients with stable chest pain depending on clinical probability and in clinically important subgroups: meta-analysis of individual patient data","volume":"365","author":"Haase","year":"2019","journal-title":"BMJ"},{"key":"2026031709572098700_ztag040-B13","doi-asserted-by":"crossref","first-page":"918","DOI":"10.1016\/j.ahj.2007.11.035","article-title":"Computed tomographic coronary angiographic assessment of high-risk coronary anatomy in patients with suspected coronary artery disease and intermediate pretest probability","volume":"155","author":"Sheth","year":"2008","journal-title":"Am Heart J"},{"key":"2026031709572098700_ztag040-B14","doi-asserted-by":"crossref","first-page":"E015800","DOI":"10.1161\/CIRCIMAGING.123.015800","article-title":"Coronary computed tomography angiography versus invasive coronary angiography in stable chest pain: a meta-analysis of randomized controlled trials","volume":"16","author":"Machado","year":"2023","journal-title":"Circ Cardiovasc Imaging"},{"key":"2026031709572098700_ztag040-B15","first-page":"E368","article-title":"2021 AHA\/ACC\/ASE\/CHEST\/SAEM\/SCCT\/SCMR guideline for the evaluation and diagnosis of chest pain: a report of the American College of Cardiology\/American Heart Association joint committee on clinical practice guidelines","volume":"144","author":"Gulati","year":"2021","journal-title":"Circulation"},{"key":"2026031709572098700_ztag040-B16","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1093\/eurheartj\/ehz425","article-title":"2019 ESC guidelines for the diagnosis and management of chronic coronary syndromes: the Task Force for the diagnosis and management of chronic coronary syndromes of the European Society of Cardiology (ESC)","volume":"41","author":"Neumann","year":"2020","journal-title":"Eur Heart J"},{"key":"2026031709572098700_ztag040-B17","volume-title":"Canadian Medical Imaging Inventory 2022\u20132023: CT: CMII Report","author":"CADTH Health Technology Review"},{"key":"2026031709572098700_ztag040-B18","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1016\/j.jcct.2025.04.006","article-title":"Access to CCTA at safety-net hospitals across the United States","volume":"19","author":"Delshad","year":"2025","journal-title":"J Cardiovasc Comput Tomogr"},{"key":"2026031709572098700_ztag040-B19","doi-asserted-by":"crossref","first-page":"466","DOI":"10.1016\/j.jcct.2025.06.011","article-title":"Geographical distribution and accessibility to cardiac CT readers in the United States: a snapshot from the 2022 medicare analysis","volume":"19","author":"El Yaman","year":"2025","journal-title":"J Cardiovasc Comput Tomogr"},{"key":"2026031709572098700_ztag040-B20","doi-asserted-by":"crossref","first-page":"921","DOI":"10.1136\/heartjnl-2017-311846","article-title":"Challenges in delivering computed tomography coronary angiography as the first-line test for stable chest pain","volume":"104","author":"Dreisbach","year":"2018","journal-title":"Heart"},{"key":"2026031709572098700_ztag040-B21","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1186\/s13244-021-01122-2","article-title":"The impact and challenges of implementing CTCA according to the 2019 ESC guidelines on chronic coronary syndromes: a survey and projection of CTCA services in The Netherlands","volume":"12","author":"van den Boogert","year":"2021","journal-title":"Insights Imaging"},{"key":"2026031709572098700_ztag040-B22","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1093\/eurheartj\/ehac640","article-title":"Use of cardiac imaging in chronic coronary syndromes: the EURECA imaging registry","volume":"44","author":"Neglia","year":"2023","journal-title":"Eur Heart J"},{"key":"2026031709572098700_ztag040-B23","doi-asserted-by":"crossref","first-page":"E442","DOI":"10.1503\/cmaj.190848","article-title":"Calibration and discrimination of the framingham risk score and the pooled cohort equations","volume":"192","author":"Ko","year":"2020","journal-title":"CMAJ"},{"key":"2026031709572098700_ztag040-B24","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1503\/cmaj.050432","article-title":"Determining optimal population rates of cardiac catheterization: a phantom alternative?","volume":"173","author":"Natarajan","year":"2005","journal-title":"CMAJ"},{"key":"2026031709572098700_ztag040-B25","first-page":"1805","article-title":"Moving beyond regression techniques in cardiovascular risk prediction: applying machine learning to address analytic challenges","volume":"38","author":"Goldstein","year":"2017","journal-title":"Eur Heart J"},{"key":"2026031709572098700_ztag040-B26","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.cvdhj.2021.12.001","article-title":"A machine learning\u2013based clinical decision support algorithm for reducing unnecessary coronary angiograms","volume":"3","author":"Schwalm","year":"2022","journal-title":"Cardiovasc Digit Health J"},{"key":"2026031709572098700_ztag040-B27","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.cjco.2022.10.009","article-title":"Centralized triage of suspected coronary artery disease using coronary computed tomographic angiography to optimize the diagnostic yield of invasive angiography","volume":"5","author":"Schwalm","year":"2023","journal-title":"CJC Open"},{"key":"2026031709572098700_ztag040-B28","doi-asserted-by":"crossref","first-page":"691","DOI":"10.1136\/heartjnl-2011-301247","article-title":"Risk prediction models: II. External validation, model updating, and impact assessment","volume":"98","author":"Moons","year":"2012","journal-title":"Heart"},{"key":"2026031709572098700_ztag040-B29","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1093\/ckj\/sfaa188","article-title":"External validation of prognostic models: what, why, how, when and where?","volume":"14","author":"Ramspek","year":"2021","journal-title":"Clin Kidney J"},{"key":"2026031709572098700_ztag040-B30","doi-asserted-by":"crossref","first-page":"q902","DOI":"10.1136\/bmj-2023-078378","article-title":"TRIPOD + AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods","volume":"385","author":"Collins","year":"2024","journal-title":"BMJ"},{"key":"2026031709572098700_ztag040-B31","doi-asserted-by":"crossref","first-page":"m1731","DOI":"10.1136\/bmj.m1731","article-title":"Interventions supporting long term adherence and decreasing cardiovascular events after myocardial infarction (ISLAND): pragmatic randomised controlled trial","volume":"369","author":"Ivers","year":"2020","journal-title":"BMJ"},{"key":"2026031709572098700_ztag040-B32","doi-asserted-by":"crossref","first-page":"e22","DOI":"10.1097\/MLR.0b013e3182329778","article-title":"Administrative hospitalization database validation of cardiac procedure codes","volume":"51","author":"Lee","year":"2013","journal-title":"Med Care"},{"key":"2026031709572098700_ztag040-B33","first-page":"1155","article-title":"Influence of coronary anatomy and SYNTAX score on the variations in revascularization strategies for patients with multivessel disease","volume":"30","author":"Schwalm","year":"2014","journal-title":"Can J Cardiol"},{"key":"2026031709572098700_ztag040-B34","volume-title":"Ontario Marginalization Index: User Guide","author":"Matheson","year":"2021"},{"key":"2026031709572098700_ztag040-B35","author":"CorHealth Ontario","year":"2024"},{"key":"2026031709572098700_ztag040-B36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1471-2288-14-137","article-title":"Modern modelling techniques are data hungry: a simulation study for predicting dichotomous endpoints","volume":"14","author":"Van Der Ploeg","year":"2014","journal-title":"BMC Med Res Methodol"},{"key":"2026031709572098700_ztag040-B37","doi-asserted-by":"crossref","first-page":"1880","DOI":"10.1093\/eurheartj\/ehy345","article-title":"Application of net reclassification index to non-nested and point-based risk prediction models: a review","volume":"40","author":"Thomas","year":"2019","journal-title":"Eur Heart J"},{"key":"2026031709572098700_ztag040-B38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41746-021-00394-8","article-title":"Predicting adverse outcomes due to diabetes complications with machine learning using administrative health data","volume":"4","author":"Ravaut","year":"2021","journal-title":"NPJ Digit Med"},{"key":"2026031709572098700_ztag040-B39","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1007\/s10554-015-0758-z","article-title":"Costs and clinical outcomes for non-invasive versus invasive diagnostic approaches to patients with suspected in-stent restenosis","volume":"32","author":"Min","year":"2015","journal-title":"Int J Cardiovasc Imaging"},{"key":"2026031709572098700_ztag040-B40","doi-asserted-by":"crossref","first-page":"5644","DOI":"10.1007\/s00330-023-10554-x","article-title":"Patient satisfaction with coronary CT angiography versus invasive coronary angiography: results of a single-center randomized trial","volume":"34","author":"Bosserdt","year":"2024","journal-title":"Eur Radiol"},{"key":"2026031709572098700_ztag040-B41","doi-asserted-by":"crossref","first-page":"1503","DOI":"10.1056\/NEJMoa070829","article-title":"Optimal medical therapy with or without PCI for stable coronary disease","volume":"356","author":"Boden","year":"2007","journal-title":"N Engl J Med"},{"key":"2026031709572098700_ztag040-B42","doi-asserted-by":"crossref","first-page":"1395","DOI":"10.1056\/NEJMoa1915922","article-title":"Initial invasive or conservative strategy for stable coronary disease","volume":"382","author":"Maron","year":"2020","journal-title":"N Engl J Med"},{"key":"2026031709572098700_ztag040-B43","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting racial bias in an algorithm used to manage the health of populations","volume":"366","author":"Obermeyer","year":"2019","journal-title":"Science"},{"key":"2026031709572098700_ztag040-B44","doi-asserted-by":"crossref","first-page":"e71726","DOI":"10.2196\/71726","article-title":"Coronary computed tomographic angiography to optimize the diagnostic yield of invasive angiography for low-risk patients screened with artificial intelligence: protocol for the CarDIA-AI randomized controlled trial","volume":"14","author":"Petch","year":"2025","journal-title":"JMIR Res Protoc"}],"container-title":["European Heart Journal - Digital Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/ehjdh\/advance-article-pdf\/doi\/10.1093\/ehjdh\/ztag040\/67225417\/ztag040.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ehjdh\/article-pdf\/7\/3\/ztag040\/67225417\/ztag040.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ehjdh\/article-pdf\/7\/3\/ztag040\/67225417\/ztag040.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T13:57:33Z","timestamp":1773755853000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/ehjdh\/article\/doi\/10.1093\/ehjdh\/ztag040\/8505608"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,4]]},"references-count":44,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,3,4]]}},"URL":"https:\/\/doi.org\/10.1093\/ehjdh\/ztag040","relation":{},"ISSN":["2634-3916"],"issn-type":[{"value":"2634-3916","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,4]]},"published":{"date-parts":[[2026,3,4]]},"article-number":"ztag040"}}