{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T23:48:18Z","timestamp":1774050498563,"version":"3.50.1"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,9,12]],"date-time":"2023-09-12T00:00:00Z","timestamp":1694476800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,9,12]],"date-time":"2023-09-12T00:00:00Z","timestamp":1694476800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DGE-1656518"],"award-info":[{"award-number":["DGE-1656518"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The electrocardiogram (ECG) is the most frequently performed cardiovascular diagnostic test, but it is unclear how much information resting ECGs contain about long term cardiovascular risk. Here we report that a deep convolutional neural network can accurately predict the long-term risk of cardiovascular mortality and disease based on a resting ECG alone. Using a large dataset of resting 12-lead ECGs collected at Stanford University Medical Center, we developed SEER, the Stanford Estimator of Electrocardiogram Risk. SEER predicts 5-year cardiovascular mortality with an area under the receiver operator characteristic curve (AUC) of 0.83 in a held-out test set at Stanford, and with AUCs of 0.78 and 0.83 respectively when independently evaluated at Cedars-Sinai Medical Center and Columbia University Irving Medical Center. SEER predicts 5-year atherosclerotic disease (ASCVD) with an AUC of 0.67, similar to the Pooled Cohort Equations for ASCVD Risk, while being only modestly correlated. When used in conjunction with the Pooled Cohort Equations, SEER accurately reclassified 16% of patients from low to moderate risk, uncovering a group with an actual average 9.9% 10-year ASCVD risk who would not have otherwise been indicated for statin therapy. SEER can also predict several other cardiovascular conditions such as heart failure and atrial fibrillation. Using only lead I of the ECG it predicts 5-year cardiovascular mortality with an AUC of 0.80. SEER, used alongside the Pooled Cohort Equations and other risk tools, can substantially improve cardiovascular risk stratification and aid in medical decision making.<\/jats:p>","DOI":"10.1038\/s41746-023-00916-6","type":"journal-article","created":{"date-parts":[[2023,9,12]],"date-time":"2023-09-12T10:02:14Z","timestamp":1694512934000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":52,"title":["A deep learning-based electrocardiogram risk score for long term cardiovascular death and disease"],"prefix":"10.1038","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7042-4031","authenticated-orcid":false,"given":"J. Weston","family":"Hughes","sequence":"first","affiliation":[]},{"given":"James","family":"Tooley","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0490-4448","authenticated-orcid":false,"given":"Jessica","family":"Torres Soto","sequence":"additional","affiliation":[]},{"given":"Anna","family":"Ostropolets","sequence":"additional","affiliation":[]},{"given":"Tim","family":"Poterucha","sequence":"additional","affiliation":[]},{"given":"Matthew Kai","family":"Christensen","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5782-7437","authenticated-orcid":false,"given":"Neal","family":"Yuan","sequence":"additional","affiliation":[]},{"given":"Ben","family":"Ehlert","sequence":"additional","affiliation":[]},{"given":"Dhamanpreet","family":"Kaur","sequence":"additional","affiliation":[]},{"given":"Guson","family":"Kang","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6585-534X","authenticated-orcid":false,"given":"Albert","family":"Rogers","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7552-5053","authenticated-orcid":false,"given":"Sanjiv","family":"Narayan","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9643-3024","authenticated-orcid":false,"given":"Pierre","family":"Elias","sequence":"additional","affiliation":[]},{"given":"David","family":"Ouyang","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9418-9577","authenticated-orcid":false,"given":"Euan","family":"Ashley","sequence":"additional","affiliation":[]},{"given":"James","family":"Zou","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2746-0202","authenticated-orcid":false,"given":"Marco V.","family":"Perez","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,9,12]]},"reference":[{"key":"916_CR1","doi-asserted-by":"publisher","first-page":"1829","DOI":"10.1001\/jama.2021.5469","volume":"325","author":"FB Ahmad","year":"2021","unstructured":"Ahmad, F. B. & Anderson, R. N. The leading causes of death in the US for 2020. JAMA 325, 1829\u20131830 (2021).","journal-title":"JAMA"},{"key":"916_CR2","doi-asserted-by":"publisher","first-page":"1007","DOI":"10.1016\/0735-1097(96)87733-3","volume":"27","author":"RM Califf","year":"1996","unstructured":"Califf, R. M., Armstrong, P. W., Carver, J. R., D\u2019Agostino, R. B. & Strauss, W. E. 27th Bethesda conference: matching the intensity of risk factor management with the hazard for coronary disease events. Task Force 5. Stratification of patients into high, medium and low risk subgroups for purposes of risk factor management. J. Am. Coll. Cardiol. 27, 1007\u20131019 (1996).","journal-title":"J. Am. Coll. Cardiol."},{"key":"916_CR3","doi-asserted-by":"publisher","first-page":"S49","DOI":"10.1161\/01.cir.0000437741.48606.98","volume":"129","author":"DC Goff Jr","year":"2014","unstructured":"Goff, D. C. Jr et al. ACC\/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology\/American Heart association task force on practice guidelines. Circulation 129, S49\u2013S73 (2014).","journal-title":"Circulation"},{"key":"916_CR4","doi-asserted-by":"publisher","first-page":"e1162","DOI":"10.1161\/CIR.0000000000000638","volume":"139","author":"DM Lloyd-Jones","year":"2019","unstructured":"Lloyd-Jones, D. M. et al. Use of risk assessment tools to guide decision-making in the primary prevention of atherosclerotic cardiovascular disease: a special report from the american heart association and american college of cardiology. Circulation 139, e1162\u2013e1177 (2019).","journal-title":"Circulation"},{"key":"916_CR5","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1161\/CIRCULATIONAHA.116.025471","volume":"135","author":"JW McEvoy","year":"2017","unstructured":"McEvoy, J. W. et al. Coronary artery calcium to guide a personalized risk-based approach to initiation and intensification of antihypertensive therapy. Circulation 135, 153\u2013165 (2017).","journal-title":"Circulation"},{"key":"916_CR6","doi-asserted-by":"publisher","first-page":"e003304","DOI":"10.1161\/CIRCGEN.120.003304","volume":"14","author":"F Riveros-Mckay","year":"2021","unstructured":"Riveros-Mckay, F. et al. Integrated polygenic tool substantially enhances coronary artery disease prediction. Circ. Genom. Precis. Med. 14, e003304 (2021).","journal-title":"Circ. Genom. Precis. Med."},{"key":"916_CR7","doi-asserted-by":"publisher","first-page":"100364","DOI":"10.1016\/j.patter.2021.100364","volume":"0","author":"S Agrawal","year":"2021","unstructured":"Agrawal, S. et al. Selection of 51 predictors from 13,782 candidate multimodal features using machine learning improves coronary artery disease prediction. Patterns 0, 100364 (2021).","journal-title":"Patterns"},{"key":"916_CR8","doi-asserted-by":"publisher","first-page":"652","DOI":"10.1016\/j.ahj.2009.12.035","volume":"159","author":"A Jain","year":"2010","unstructured":"Jain, A. et al. Diagnostic and prognostic utility of electrocardiography for left ventricular hypertrophy defined by magnetic resonance imaging in relationship to ethnicity: the Multi-Ethnic Study of Atherosclerosis (MESA). Am. Heart J. 159, 652\u2013658 (2010).","journal-title":"Am. Heart J."},{"key":"916_CR9","first-page":"1160","volume":"105","author":"PV Rasmussen","year":"2019","unstructured":"Rasmussen, P. V. et al. Clinical implications of electrocardiographic bundle branch block in primary care. Heart 105, 1160\u20131167 (2019).","journal-title":"Heart"},{"key":"916_CR10","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1111\/j.1542-474X.2007.00150.x","volume":"12","author":"G Engel","year":"2007","unstructured":"Engel, G. et al. Prognostic significance of PVCs and resting heart rate. Ann. Noninvasive Electrocardiol. 12, 121\u2013129 (2007).","journal-title":"Ann. Noninvasive Electrocardiol."},{"key":"916_CR11","doi-asserted-by":"publisher","first-page":"1560","DOI":"10.1136\/heartjnl-2020-318097","volume":"107","author":"MM Pinto-Filho","year":"2021","unstructured":"Pinto-Filho, M. M. et al. Prognostic value of electrocardiographic abnormalities in adults from the Brazilian longitudinal study of adults\u2019 health. Heart 107, 1560\u20131566 (2021).","journal-title":"Heart"},{"key":"916_CR12","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/j.pcad.2007.03.003","volume":"50","author":"GA Lanza","year":"2007","unstructured":"Lanza, G. A. The electrocardiogram as a prognostic tool for predicting major cardiac events. Prog. Cardiovasc. Dis. 50, 87\u2013111 (2007).","journal-title":"Prog. Cardiovasc. Dis."},{"key":"916_CR13","doi-asserted-by":"publisher","first-page":"2308","DOI":"10.1001\/jama.2018.6848","volume":"319","author":"U. S. Preventive Services Task Force","year":"2018","unstructured":"U. S. Preventive Services Task Force et al. Screening for cardiovascular disease risk with electrocardiography: US preventive services task force recommendation statement. JAMA 319, 2308\u20132314 (2018).","journal-title":"JAMA"},{"key":"916_CR14","doi-asserted-by":"publisher","unstructured":"Hughes, J. W. et al. Performance of a convolutional neural network and explainability technique for 12-lead electrocardiogram interpretation. JAMA Cardiol. (2021) https:\/\/doi.org\/10.1001\/jamacardio.2021.2746.","DOI":"10.1001\/jamacardio.2021.2746"},{"key":"916_CR15","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1038\/s41591-018-0240-2","volume":"25","author":"ZI Attia","year":"2019","unstructured":"Attia, Z. I. et al. Screening for cardiac contractile dysfunction using an artificial intelligence\u2013enabled electrocardiogram. Nat. Med. 25, 70\u201374 (2019).","journal-title":"Nat. Med."},{"key":"916_CR16","doi-asserted-by":"publisher","first-page":"380","DOI":"10.1093\/ehjdh\/ztac033","volume":"3","author":"J Torres Soto","year":"2022","unstructured":"Torres Soto, J. et al. Multimodal deep learning enhances diagnostic precision in left ventricular hypertrophy. Eur. Heart J. - Digit. Health 3, 380\u2013389 (2022).","journal-title":"Eur. Heart J. - Digit. Health"},{"key":"916_CR17","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1016\/S0140-6736(19)31721-0","volume":"394","author":"ZI Attia","year":"2019","unstructured":"Attia, Z. I. et al. An artificial intelligence-enabled ECG algorithm for the identification of patients with atrial fibrillation during sinus rhythm: a retrospective analysis of outcome prediction. Lancet 394, 861\u2013867 (2019).","journal-title":"Lancet"},{"key":"916_CR18","doi-asserted-by":"publisher","first-page":"886","DOI":"10.1038\/s41591-020-0870-z","volume":"26","author":"S Raghunath","year":"2020","unstructured":"Raghunath, S. et al. Prediction of mortality from 12-lead electrocardiogram voltage data using a deep neural network. Nat. Med. 26, 886\u2013891 (2020).","journal-title":"Nat. Med."},{"key":"916_CR19","unstructured":"Ouyang, D. et al. Electrocardiographic Deep Learning for Predicting Post-Procedural Mortality. Preprint at https:\/\/arxiv.org\/abs\/2205.03242 (2022)."},{"key":"916_CR20","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1002\/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4","volume":"15","author":"FE Harrell Jr","year":"1996","unstructured":"Harrell, F. E. Jr, Lee, K. L. & Mark, D. B. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat. Med. 15, 361\u2013387 (1996).","journal-title":"Stat. Med."},{"key":"916_CR21","doi-asserted-by":"publisher","first-page":"546","DOI":"10.1038\/s41551-020-00667-9","volume":"5","author":"AE Ulloa Cerna","year":"2021","unstructured":"Ulloa Cerna, A. E. et al. Deep-learning-assisted analysis of echocardiographic videos improves predictions of all-cause mortality. Nat. Biomed. Eng. 5, 546\u2013554 (2021).","journal-title":"Nat. Biomed. Eng."},{"key":"916_CR22","doi-asserted-by":"publisher","first-page":"122","DOI":"10.7326\/M13-1522","volume":"160","author":"MJG Leening","year":"2014","unstructured":"Leening, M. J. G., Vedder, M. M., Witteman, J. C. M., Pencina, M. J. & Steyerberg, E. W. Net reclassification improvement: computation, interpretation, and controversies: a literature review and clinician\u2019s guide. Ann. Intern. Med. 160, 122\u2013131 (2014).","journal-title":"Ann. Intern. Med."},{"key":"916_CR23","first-page":"e1082","volume":"139","author":"SM Grundy","year":"2019","unstructured":"Grundy, S. M. et al. AHA\/ACC\/AACVPR\/AAPA\/ABC\/ACPM\/ADA\/AGS\/APhA\/ASPC\/NLA\/PCNA Guideline on the Management of Blood Cholesterol: A Report of the American College of Cardiology\/American Heart Association Task Force on Clinical Practice Guidelines. Circulation 139, e1082\u2013e1143 (2019).","journal-title":"Circulation"},{"key":"916_CR24","doi-asserted-by":"publisher","first-page":"2401","DOI":"10.1093\/eurheartj\/ehy217","volume":"39","author":"MJ Budoff","year":"2018","unstructured":"Budoff, M. J. et al. Ten-year association of coronary artery calcium with atherosclerotic cardiovascular disease (ASCVD) events: the multi-ethnic study of atherosclerosis (MESA). Eur. Heart J. 39, 2401\u20132408 (2018).","journal-title":"Eur. Heart J."},{"key":"916_CR25","doi-asserted-by":"publisher","first-page":"1305","DOI":"10.1093\/ehjci\/jev328","volume":"17","author":"R Nakanishi","year":"2015","unstructured":"Nakanishi, R. et al. All-cause mortality by age and gender based on coronary artery calcium scores. Eur. Heart J. Cardiovasc. Imaging 17, 1305\u20131314 (2015).","journal-title":"Eur. Heart J. Cardiovasc. Imaging"},{"key":"916_CR26","doi-asserted-by":"publisher","first-page":"e011684","DOI":"10.1136\/bmjopen-2016-011684","volume":"7","author":"Q Yang","year":"2017","unstructured":"Yang, Q. et al. Assessing potential population impact of statin treatment for primary prevention of atherosclerotic cardiovascular diseases in the USA: population-based modelling study. BMJ Open 7, e011684 (2017).","journal-title":"BMJ Open"},{"key":"916_CR27","unstructured":"Datta, S. et al. A new paradigm for accelerating clinical data science at Stanford Medicine. Preprint available at https:\/\/arxiv.org\/abs\/2003.10534 (2020)."},{"key":"916_CR28","doi-asserted-by":"publisher","first-page":"1816","DOI":"10.1016\/S0140-6736(19)32317-7","volume":"394","author":"MA Suchard","year":"2019","unstructured":"Suchard, M. A. et al. Comprehensive comparative effectiveness and safety of first-line antihypertensive drug classes: a systematic, multinational, large-scale analysis. Lancet 394, 1816\u20131826 (2019).","journal-title":"Lancet"},{"key":"916_CR29","unstructured":"Kingma, D. P. & Ba, J. L. Adam: a method for stochastic gradient descent. in ICLR: International Conference on Learning Representations 1\u201315 (2015)."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00916-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00916-6","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00916-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,18]],"date-time":"2023-11-18T20:40:35Z","timestamp":1700340035000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00916-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,12]]},"references-count":29,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["916"],"URL":"https:\/\/doi.org\/10.1038\/s41746-023-00916-6","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,12]]},"assertion":[{"value":"10 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 September 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"S.N. reports consulting compensation from Abbott Inc., Up to Date, and LifeSignals.ai, and intellectual property rights from University of California Regents and Stanford University. E.A. reports consulting fees from Apple Inc. M.V.P. reports research funding from NIH\/NHLBI and Apple Inc., consulting fees from Apple Inc., Boston Scientific, Biotronik Inc., Bristol Myers Squibb, QALY, Johnson & Johnson, and has an equity interest in QALY. Stanford University has filed a provisional patent on the described work.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"169"}}