{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T23:44:34Z","timestamp":1789688674890,"version":"4.0.1"},"reference-count":37,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2023,12,20]],"date-time":"2023-12-20T00:00:00Z","timestamp":1703030400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,3,18]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Aims<\/jats:title>\n                  <jats:p>The diagnostic application of artificial intelligence (AI)-based models to detect cardiovascular diseases from electrocardiograms (ECGs) evolves, and promising results were reported. However, external validation is not available for all published algorithms. The aim of this study was to validate an existing algorithm for the detection of left ventricular systolic dysfunction (LVSD) from 12-lead ECGs.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods and results<\/jats:title>\n                  <jats:p>Patients with digitalized data pairs of 12-lead ECGs and echocardiography (at intervals of \u22647 days) were retrospectively selected from the Heart Center Leipzig ECG and electronic medical records databases. A previously developed AI-based model was applied to ECGs and calculated probabilities for LVSD. The area under the receiver operating characteristic curve (AUROC) was computed overall and in cohorts stratified for baseline and ECG characteristics. Repeated echocardiography studies recorded \u22653 months after index diagnostics were used for follow-up (FU) analysis. At baseline, 42 291 ECG-echocardiography pairs were analysed, and AUROC for LVSD detection was 0.88. Sensitivity and specificity were 82% and 77% for the optimal LVSD probability cut-off based on Youden\u2019s J. AUROCs were lower in ECG subgroups with tachycardia, atrial fibrillation, and wide QRS complexes. In patients without LVSD at baseline and available FU, model-generated high probability for LVSD was associated with a four-fold increased risk of developing LVSD during FU.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>We provide the external validation of an existing AI-based ECG-analysing model for the detection of LVSD with robust performance metrics. The association of false positive LVSD screenings at baseline with a deterioration of ventricular function during FU deserves a further evaluation in prospective trials.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/ehjdh\/ztad081","type":"journal-article","created":{"date-parts":[[2023,12,19]],"date-time":"2023-12-19T15:54:13Z","timestamp":1703001253000},"page":"144-151","source":"Crossref","is-referenced-by-count":20,"title":["Artificial intelligence-based identification of left ventricular systolic dysfunction from 12-lead electrocardiograms: external validation and advanced application of an existing model"],"prefix":"10.1093","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3759-3052","authenticated-orcid":false,"given":"Sebastian","family":"K\u00f6nig","sequence":"first","affiliation":[{"name":"Department of Electrophysiology, Heart Center Leipzig at University of Leipzig , Str\u00fcmpellstr. 39, 04289 Leipzig , Germany"},{"name":"Helios Health Institute, Real World Evidence & Health Technology Assessment , Schwanebecker Chaussee 50, 13125 Berlin , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sven","family":"Hohenstein","sequence":"additional","affiliation":[{"name":"Helios Health Institute, Real World Evidence & Health Technology Assessment , Schwanebecker Chaussee 50, 13125 Berlin , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3174-5166","authenticated-orcid":false,"given":"Anne","family":"Nitsche","sequence":"additional","affiliation":[{"name":"Helios Health Institute, Real World Evidence & Health Technology Assessment , Schwanebecker Chaussee 50, 13125 Berlin , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2809-0063","authenticated-orcid":false,"given":"Vincent","family":"Pellissier","sequence":"additional","affiliation":[{"name":"Helios Health Institute, Real World Evidence & Health Technology Assessment , Schwanebecker Chaussee 50, 13125 Berlin , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3678-0208","authenticated-orcid":false,"given":"Johannes","family":"Leiner","sequence":"additional","affiliation":[{"name":"Department of Electrophysiology, Heart Center Leipzig at University of Leipzig , Str\u00fcmpellstr. 39, 04289 Leipzig , Germany"},{"name":"Helios Health Institute, Real World Evidence & Health Technology Assessment , Schwanebecker Chaussee 50, 13125 Berlin , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lars","family":"Stellmacher","sequence":"additional","affiliation":[{"name":"Department of Electrophysiology, Heart Center Leipzig at University of Leipzig , Str\u00fcmpellstr. 39, 04289 Leipzig , Germany"},{"name":"Helios Health Institute, Real World Evidence & Health Technology Assessment , Schwanebecker Chaussee 50, 13125 Berlin , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gerhard","family":"Hindricks","sequence":"additional","affiliation":[{"name":"Department of Electrophysiology, Heart Center Leipzig at University of Leipzig , Str\u00fcmpellstr. 39, 04289 Leipzig , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5441-3906","authenticated-orcid":false,"given":"Andreas","family":"Bollmann","sequence":"additional","affiliation":[{"name":"Department of Electrophysiology, Heart Center Leipzig at University of Leipzig , Str\u00fcmpellstr. 39, 04289 Leipzig , Germany"},{"name":"Helios Health Institute, Real World Evidence & Health Technology Assessment , Schwanebecker Chaussee 50, 13125 Berlin , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,12,20]]},"reference":[{"key":"2024031800232920600_ztad081-B1","doi-asserted-by":"crossref","first-page":"1241","DOI":"10.1186\/s12913-022-08614-x","article-title":"Healthcare resource utilization and costs among patients with heart failure with preserved, mildly reduced, and reduced ejection fraction in Spain","volume":"22","author":"Escobar","year":"2022","journal-title":"BMC Health Serv Res"},{"key":"2024031800232920600_ztad081-B2","doi-asserted-by":"crossref","first-page":"1917","DOI":"10.1002\/ehf2.12773","article-title":"Incidence, prevalence, and mortality of heart failure: a nationwide registry study from 2013 to 2016","volume":"7","author":"Odegaard","year":"2020","journal-title":"ESC Heart Fail"},{"key":"2024031800232920600_ztad081-B3","doi-asserted-by":"crossref","first-page":"3599","DOI":"10.1093\/eurheartj\/ehab368","article-title":"2021 ESC guidelines for the diagnosis and treatment of acute and chronic heart failure","volume":"42","author":"McDonagh","year":"2021","journal-title":"Eur Heart J"},{"key":"2024031800232920600_ztad081-B4","doi-asserted-by":"crossref","first-page":"1954","DOI":"10.1002\/ehf2.13906","article-title":"NT-ProBNP and high-sensitivity troponin T as screening tests for subclinical chronic heart failure in a general population","volume":"9","author":"Averina","year":"2022","journal-title":"ESC Heart Fail"},{"key":"2024031800232920600_ztad081-B5","doi-asserted-by":"crossref","first-page":"e008437","DOI":"10.1161\/CIRCEP.120.008437","article-title":"Artificial intelligence-enabled ECG algorithm to identify patients with left ventricular systolic dysfunction presenting to the emergency department with dyspnea","volume":"13","author":"Adedinsewo","year":"2020","journal-title":"Circ Arrhythm Electrophysiol"},{"key":"2024031800232920600_ztad081-B6","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1038\/s41591-018-0240-2","article-title":"Screening for cardiac contractile dysfunction using an artificial intelligence-enabled electrocardiogram","volume":"25","author":"Attia","year":"2019","journal-title":"Nat Med"},{"key":"2024031800232920600_ztad081-B7","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1038\/s41569-020-00503-2","article-title":"Artificial intelligence-enhanced electrocardiography in cardiovascular disease management","volume":"18","author":"Siontis","year":"2021","journal-title":"Nat Rev Cardiol"},{"key":"2024031800232920600_ztad081-B8","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1093\/europace\/euaa377","article-title":"Deep learning and the electrocardiogram: review of the current state-of-the-art","volume":"23","author":"Somani","year":"2021","journal-title":"Europace"},{"key":"2024031800232920600_ztad081-B9","doi-asserted-by":"crossref","first-page":"1095","DOI":"10.1111\/jce.14936","article-title":"A method to screen left ventricular dysfunction through ECG based on convolutional neural network","volume":"32","author":"Sun","year":"2021","journal-title":"J Cardiovasc Electrophysiol"},{"key":"2024031800232920600_ztad081-B10","doi-asserted-by":"crossref","first-page":"4717","DOI":"10.1093\/eurheartj\/ehab649","article-title":"Application of artificial intelligence to the electrocardiogram","volume":"42","author":"Attia","year":"2021","journal-title":"Eur Heart J"},{"key":"2024031800232920600_ztad081-B11","first-page":"419","article-title":"Artificial intelligence enabled ECG screening for left ventricular systolic dysfunction: a systematic review","volume":"28","author":"Bjerken","year":"2023","journal-title":"Heart Fail Rev"},{"key":"2024031800232920600_ztad081-B12","doi-asserted-by":"crossref","first-page":"455","DOI":"10.3390\/jpm12030455","article-title":"Artificial intelligence-enabled electrocardiography predicts left ventricular dysfunction and future cardiovascular outcomes: a retrospective analysis","volume":"12","author":"Chen","year":"2022","journal-title":"J Pers Med"},{"key":"2024031800232920600_ztad081-B13","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1186\/s42444-022-00075-x","article-title":"Clinical significance, challenges and limitations in using artificial intelligence for electrocardiography-based diagnosis","volume":"23","author":"Chung","year":"2022","journal-title":"Int J Arrhythmia"},{"key":"2024031800232920600_ztad081-B14","doi-asserted-by":"crossref","first-page":"654","DOI":"10.1093\/ehjdh\/ztac065","article-title":"Importance of external validation and subgroup analysis of artificial intelligence in the detection of low ejection fraction from electrocardiograms","volume":"3","author":"Yagi","year":"2022","journal-title":"Eur Heart J Digit Health"},{"key":"2024031800232920600_ztad081-B15","doi-asserted-by":"crossref","first-page":"e009355","DOI":"10.1161\/CIRCEP.120.009355","article-title":"Artificial intelligence-electrocardiography to predict incident atrial fibrillation: a population-based study","volume":"13","author":"Christopoulos","year":"2020","journal-title":"Circ Arrhythm Electrophysiol"},{"key":"2024031800232920600_ztad081-B16","doi-asserted-by":"crossref","first-page":"e007988","DOI":"10.1161\/CIRCEP.119.007988","article-title":"Assessing and mitigating bias in medical artificial intelligence: the effects of race and ethnicity on a deep learning model for ECG analysis","volume":"13","author":"Noseworthy","year":"2020","journal-title":"Circ Arrhythm Electrophysiol"},{"key":"2024031800232920600_ztad081-B17","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1016\/j.jacc.2022.05.029","article-title":"Deep learning electrocardiographic analysis for detection of left-sided valvular heart disease","volume":"80","author":"Elias","year":"2022","journal-title":"J Am Coll Cardiol"},{"key":"2024031800232920600_ztad081-B18","doi-asserted-by":"crossref","first-page":"27","DOI":"10.18637\/jss.v098.i11","article-title":"cutpointr: improved estimation and validation of optimal cutpoints in R","volume":"98","author":"Thiele","year":"2021","journal-title":"J Stat Softw"},{"key":"2024031800232920600_ztad081-B19","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1016\/j.ijcard.2020.12.065","article-title":"External validation of a deep learning electrocardiogram algorithm to detect ventricular dysfunction","volume":"329","author":"Attia","year":"2021","journal-title":"Int J Cardiol"},{"key":"2024031800232920600_ztad081-B20","doi-asserted-by":"crossref","first-page":"1332","DOI":"10.1536\/ihj.21-407","article-title":"The effectiveness of a deep learning model to detect left ventricular systolic dysfunction from electrocardiograms","volume":"62","author":"Katsushika","year":"2021","journal-title":"Int Heart J"},{"key":"2024031800232920600_ztad081-B21","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1097\/MAT.0000000000001218","article-title":"Artificial intelligence algorithm for screening heart failure with reduced ejection fraction using electrocardiography","volume":"67","author":"Cho","year":"2021","journal-title":"ASAIO J"},{"key":"2024031800232920600_ztad081-B22","doi-asserted-by":"crossref","first-page":"629","DOI":"10.4070\/kcj.2018.0446","article-title":"Development and validation of deep-learning algorithm for electrocardiography-based heart failure identification","volume":"49","author":"Kwon","year":"2019","journal-title":"Korean Circ J"},{"key":"2024031800232920600_ztad081-B23","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1016\/j.jcmg.2021.08.004","article-title":"Using deep-learning algorithms to simultaneously identify right and left ventricular dysfunction from the electrocardiogram","volume":"15","author":"Vaid","year":"2021","journal-title":"JACC Cardiovasc Imaging"},{"key":"2024031800232920600_ztad081-B24","doi-asserted-by":"crossref","first-page":"668","DOI":"10.1111\/jce.13889","article-title":"Prospective validation of a deep learning electrocardiogram algorithm for the detection of left ventricular systolic dysfunction","volume":"30","author":"Attia","year":"2019","journal-title":"J Cardiovasc Electrophysiol"},{"key":"2024031800232920600_ztad081-B25","doi-asserted-by":"crossref","first-page":"2576","DOI":"10.1016\/j.mayocp.2021.02.029","article-title":"Artificial intelligence-augmented electrocardiogram detection of left ventricular systolic dysfunction in the general population","volume":"96","author":"Kashou","year":"2021","journal-title":"Mayo Clin Proc"},{"key":"2024031800232920600_ztad081-B26","doi-asserted-by":"crossref","first-page":"e009871","DOI":"10.1161\/CIRCEP.121.009871","article-title":"Impact of ECG characteristics on the performance of an artificial intelligence enabled ECG for predicting left ventricular dysfunction","volume":"14","author":"Perez-Downes","year":"2021","journal-title":"Circ Arrhythm Electrophysiol"},{"key":"2024031800232920600_ztad081-B27","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1038\/s41591-021-01335-4","article-title":"Artificial intelligence-enabled electrocardiograms for identification of patients with low ejection fraction: a pragmatic, randomized clinical trial","volume":"27","author":"Yao","year":"2021","journal-title":"Nat Med"},{"key":"2024031800232920600_ztad081-B28","first-page":"93","article-title":"Advanced electrocardiography identifies left ventricular systolic dysfunction in non-ischemic cardiomyopathy and tracks serial change over time","volume":"2","author":"Johnson","year":"2015","journal-title":"J Cardiovasc Dev Dis"},{"key":"2024031800232920600_ztad081-B29","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1161\/CIRCULATIONAHA.105.537415","article-title":"Electrocardiographic predictors of incident congestive heart failure and all-cause mortality in postmenopausal women: the Women\u2019s Health Initiative","volume":"113","author":"Rautaharju","year":"2006","journal-title":"Circulation"},{"key":"2024031800232920600_ztad081-B30","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1016\/j.amjcard.2013.05.011","article-title":"Electrocardiographic predictors of incident heart failure in men and women free from manifest cardiovascular disease (from the Atherosclerosis Risk in Communities [ARIC] study)","volume":"112","author":"Rautaharju","year":"2013","journal-title":"Am J Cardiol"},{"key":"2024031800232920600_ztad081-B31","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1186\/1471-2261-10-28","article-title":"Accuracy of advanced versus strictly conventional 12-lead ECG for detection and screening of coronary artery disease, left ventricular hypertrophy and left ventricular systolic dysfunction","volume":"10","author":"Schlegel","year":"2010","journal-title":"BMC Cardiovasc Disord"},{"key":"2024031800232920600_ztad081-B32","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1093\/ehjdh\/ztad027","article-title":"An explainable artificial intelligence-enabled electrocardiogram analysis model for the classification of reduced left ventricular function","volume":"4","author":"Katsushika","year":"2023","journal-title":"Eur Heart J Digit Health"},{"key":"2024031800232920600_ztad081-B33","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1093\/ehjdh\/ztac038","article-title":"Improving explainability of deep neural network-based electrocardiogram interpretation using variational auto-encoders","volume":"3","author":"van de Leur","year":"2022","journal-title":"Eur Heart J Digit Health"},{"key":"2024031800232920600_ztad081-B34","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1093\/ehjdh\/ztac028","article-title":"Real-world performance, long-term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction","volume":"3","author":"Harmon","year":"2022","journal-title":"Eur Heart J Digit Health"},{"key":"2024031800232920600_ztad081-B35","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/j.ijcard.2020.10.074","article-title":"Left ventricular systolic dysfunction identification using artificial intelligence-augmented electrocardiogram in cardiac intensive care unit patients","volume":"326","author":"Jentzer","year":"2021","journal-title":"Int J Cardiol"},{"key":"2024031800232920600_ztad081-B36","doi-asserted-by":"crossref","first-page":"6767","DOI":"10.3390\/jcm11226767","article-title":"Physicians and machine-learning algorithm performance in predicting left-ventricular systolic dysfunction from a standard 12-lead-electrocardiogram","volume":"11","author":"Golany","year":"2022","journal-title":"J Clin Med"},{"key":"2024031800232920600_ztad081-B37","doi-asserted-by":"crossref","first-page":"1070641","DOI":"10.3389\/fcvm.2023.1070641","article-title":"Artificial intelligence-enabled electrocardiographic screening for left ventricular systolic dysfunction and mortality risk prediction","volume":"10","author":"Huang","year":"2023","journal-title":"Front Cardiovasc Med"}],"container-title":["European Heart Journal - Digital Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/ehjdh\/advance-article-pdf\/doi\/10.1093\/ehjdh\/ztad081\/54930095\/ztad081.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ehjdh\/article-pdf\/5\/2\/144\/56990495\/ztad081.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ehjdh\/article-pdf\/5\/2\/144\/56990495\/ztad081.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,18]],"date-time":"2024-03-18T00:23:49Z","timestamp":1710721429000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/ehjdh\/article\/5\/2\/144\/7484643"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,20]]},"references-count":37,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,12,20]]},"published-print":{"date-parts":[[2024,3,18]]}},"URL":"https:\/\/doi.org\/10.1093\/ehjdh\/ztad081","relation":{},"ISSN":["2634-3916"],"issn-type":[{"value":"2634-3916","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,3]]},"published":{"date-parts":[[2023,12,20]]}}}