{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,2]],"date-time":"2026-11-02T20:08:29Z","timestamp":1793650109914,"version":"4.5.1"},"reference-count":26,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,3,24]],"date-time":"2022-03-24T00:00:00Z","timestamp":1648080000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,3,24]],"date-time":"2022-03-24T00:00:00Z","timestamp":1648080000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000050","name":"U.S. Department of Health & Human Services | NIH | National Heart, Lung, and Blood Institute","doi-asserted-by":"publisher","award":["K23HL153775"],"award-info":[{"award-number":["K23HL153775"]}],"id":[{"id":"10.13039\/100000050","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Commun"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The application of artificial intelligence (AI) for automated diagnosis of electrocardiograms (ECGs) can improve care in remote settings but is limited by the reliance on infrequently available signal-based data. We report the development of a multilabel automated diagnosis model for electrocardiographic images, more suitable for broader use. A total of 2,228,236 12-lead ECGs signals from 811 municipalities in Brazil are transformed to ECG images in varying lead conformations to train a convolutional neural network (CNN) identifying 6 physician-defined clinical labels spanning rhythm and conduction disorders, and a hidden label for gender. The image-based model performs well on a distinct test set validated by at least two cardiologists (average AUROC 0.99, AUPRC 0.86), an external validation set of 21,785 ECGs from Germany (average AUROC 0.97, AUPRC 0.73), and printed ECGs, with performance superior to signal-based models, and learning clinically relevant cues based on Grad-CAM. The model allows the application of AI to ECGs across broad settings.<\/jats:p>","DOI":"10.1038\/s41467-022-29153-3","type":"journal-article","created":{"date-parts":[[2022,3,25]],"date-time":"2022-03-25T07:36:15Z","timestamp":1648193775000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":123,"title":["Automated multilabel diagnosis on electrocardiographic images and signals"],"prefix":"10.1038","volume":"13","author":[{"given":"Veer","family":"Sangha","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2655-2095","authenticated-orcid":false,"given":"Bobak J.","family":"Mortazavi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4106-7055","authenticated-orcid":false,"given":"Adrian D.","family":"Haimovich","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ant\u00f4nio H.","family":"Ribeiro","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cynthia A.","family":"Brandt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel L.","family":"Jacoby","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2048-4028","authenticated-orcid":false,"given":"Wade L.","family":"Schulz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2046-127X","authenticated-orcid":false,"given":"Harlan M.","family":"Krumholz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2740-0042","authenticated-orcid":false,"given":"Antonio Luiz P.","family":"Ribeiro","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9467-6199","authenticated-orcid":false,"given":"Rohan","family":"Khera","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,3,24]]},"reference":[{"key":"29153_CR1","doi-asserted-by":"publisher","unstructured":"Hughes, J. W. et al. Performance of a convolutional neural network and explainability technique for 12-lead electrocardiogram interpretation. JAMA Cardiol. https:\/\/doi.org\/10.1001\/jamacardio.2021.2746 (2021).","DOI":"10.1001\/jamacardio.2021.2746"},{"key":"29153_CR2","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1038\/s41591-018-0268-3","volume":"25","author":"AY Hannun","year":"2019","unstructured":"Hannun, A. Y. et al. Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network. Nat. Med. 25, 65\u201369 (2019).","journal-title":"Nat. Med."},{"key":"29153_CR3","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-15432-4","volume":"11","author":"AH Ribeiro","year":"2020","unstructured":"Ribeiro, A. H. et al. Automatic diagnosis of the 12-lead ECG using a deep neural network. Nat. Commun. 11, 1760 (2020).","journal-title":"Nat. Commun."},{"key":"29153_CR4","doi-asserted-by":"publisher","first-page":"1287","DOI":"10.1161\/CIRCULATIONAHA.120.047829","volume":"143","author":"S Raghunath","year":"2021","unstructured":"Raghunath, S. et al. Deep neural networks can predict new-onset atrial fibrillation from the 12-lead ECG and help identify those at risk of atrial fibrillation-related stroke. Circulation 143, 1287\u20131298 (2021).","journal-title":"Circulation"},{"key":"29153_CR5","doi-asserted-by":"publisher","unstructured":"Biton, S. et al. Atrial fibrillation risk prediction from the 12-lead ECG using digital biomarkers and deep representation learning. Eur. Heart J.- Digital Health https:\/\/doi.org\/10.1093\/ehjdh\/ztab071 (2021).","DOI":"10.1093\/ehjdh\/ztab071"},{"key":"29153_CR6","doi-asserted-by":"publisher","first-page":"S75","DOI":"10.1016\/j.jelectrocard.2019.09.008","volume":"57S","author":"ALP Ribeiro","year":"2019","unstructured":"Ribeiro, A. L. P. et al. Tele-electrocardiography and bigdata: the CODE (clinical outcomes in digital electrocardiography) study. J. Electrocardiol. 57S, S75\u2013S78 (2019).","journal-title":"J. Electrocardiol."},{"key":"29153_CR7","doi-asserted-by":"publisher","first-page":"1306","DOI":"10.1161\/CIRCULATIONAHA.106.180200","volume":"115","author":"P Kligfield","year":"2007","unstructured":"Kligfield, P. et al. Recommendations for the standardization and interpretation of the electrocardiogram: part I: the electrocardiogram and its technology: a scientific statement from the American Heart Association Electrocardiography and Arrhythmias Committee, Council on Clinical Cardiology; the American College of Cardiology Foundation; and the Heart Rhythm Society: endorsed by the International Society for Computerized Electrocardiology. Circulation 115, 1306\u20131324 (2007).","journal-title":"Circulation"},{"key":"29153_CR8","unstructured":"WFDB Python Toolbox, accessed 22 September 2021, https:\/\/github.com\/MIT-LCP\/wfdb-python\/blob\/master\/wfdb\/processing\/qrs.py."},{"key":"29153_CR9","unstructured":"ECG Plot Python Library, accessed 22 September 2021, https:\/\/pypi.org\/project\/ecg-plot\/."},{"key":"29153_CR10","unstructured":"Tan, M. & Le, Q. V. EfficientNet: rethinking model scaling for convolutional neural networks. International Conference on Machine Learning (2019)."},{"key":"29153_CR11","doi-asserted-by":"crossref","unstructured":"Cui, Y., Jia, M., Lin, T.-Y., Song, Y. & Belongie, S. Class-balanced loss based on effective number of samples. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) pp. 9268\u20139277 (2019).","DOI":"10.1109\/CVPR.2019.00949"},{"key":"29153_CR12","unstructured":"Sangha, V. & Khera, R. Automatic multilabel diagnosis using artificial intelligence on electrocardiographic images - ECG DX\u00a9. https:\/\/www.cards-lab.org\/ecgdx (2022)."},{"key":"29153_CR13","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-020-0495-6","volume":"7","author":"P Wagner","year":"2020","unstructured":"Wagner, P. et al. PTB-XL, a large publicly available electrocardiography dataset. Sci. Data 7, 154 (2020).","journal-title":"Sci. Data"},{"key":"29153_CR14","doi-asserted-by":"publisher","unstructured":"Selvaraju, R. R. et al. Grad-CAM: visual explanations from deep networks via gradient-based localization. IEEE I Conf. Comp. Vis. https:\/\/doi.org\/10.1109\/Iccv.2017.74 (2017).","DOI":"10.1109\/Iccv.2017.74"},{"key":"29153_CR15","doi-asserted-by":"publisher","unstructured":"DeGrave, A. J., Janizek, J. D. & Lee, S. I. AI for radiographic COVID-19 detection selects shortcuts over signal. Nat. Mach. Intell. 3, 610\u2013619 (2021). https:\/\/doi.org\/10.1038\/s42256-021-00338-7.","DOI":"10.1038\/s42256-021-00338-7"},{"key":"29153_CR16","doi-asserted-by":"publisher","unstructured":"Attia, Z. I. et al. Age and sex estimation using artificial intelligence from standard 12-lead ECGs. https:\/\/doi.org\/10.1161\/CIRCEP.119.007284 (2019).","DOI":"10.1161\/CIRCEP.119.007284"},{"key":"29153_CR17","doi-asserted-by":"publisher","unstructured":"ZI, A. et al. An artificial intelligence-enabled ECG algorithm for the identification of patients with atrial fibrillation during sinus rhythm: a retrospective analysis of outcome prediction. Lancet https:\/\/doi.org\/10.1016\/S0140-6736(19)31721-0 (2019).","DOI":"10.1016\/S0140-6736(19)31721-0"},{"key":"29153_CR18","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-73060-w","volume":"10","author":"V Gliner","year":"2020","unstructured":"Gliner, V. et al. Automatic classification of healthy and disease conditions from images or digital standard 12-lead electrocardiograms. Sci. Rep. 10, 16331 (2020).","journal-title":"Sci. Rep."},{"key":"29153_CR19","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-019-1426-2","volume":"17","author":"CJ Kelly","year":"2019","unstructured":"Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G. & King, D. Key challenges for delivering clinical impact with artificial intelligence. BMC Med. 17, 195 (2019).","journal-title":"BMC Med."},{"key":"29153_CR20","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-65105-x","volume":"10","author":"H Makimoto","year":"2020","unstructured":"Makimoto, H. et al. Performance of a convolutional neural network derived from an ECG database in recognizing myocardial infarction. Sci. Rep. 10, 8445 (2020).","journal-title":"Sci. Rep."},{"key":"29153_CR21","doi-asserted-by":"publisher","unstructured":"Makowski, D. et al. NeuroKit2: a Python toolbox for neurophysiological signal processing. Behav. Res. Methods https:\/\/doi.org\/10.3758\/s13428-020-01516-y (2021).","DOI":"10.3758\/s13428-020-01516-y"},{"key":"29153_CR22","doi-asserted-by":"publisher","first-page":"570","DOI":"10.1109\/TBME.2003.821031","volume":"51","author":"JP Martinez","year":"2004","unstructured":"Martinez, J. P., Almeida, R., Olmos, S., Rocha, A. P. & Laguna, P. A wavelet-based ECG delineator: evaluation on standard databases. IEEE Trans. Biomed. Eng. 51, 570\u2013581 (2004).","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"29153_CR23","doi-asserted-by":"publisher","first-page":"e006556","DOI":"10.1161\/CIRCOUTCOMES.120.006556","volume":"13","author":"LM Stevens","year":"2020","unstructured":"Stevens, L. M., Mortazavi, B. J., Deo, R. C., Curtis, L. & Kao, D. P. Recommendations for reporting machine learning analyses in clinical research. Circ. Cardiovasc. Qual. Outcomes 13, e006556 (2020).","journal-title":"Circ. Cardiovasc. Qual. Outcomes"},{"key":"29153_CR24","doi-asserted-by":"publisher","first-page":"855","DOI":"10.1016\/j.jclinepi.2015.02.010","volume":"68","author":"B Ozenne","year":"2015","unstructured":"Ozenne, B., Subtil, F. & Maucort-Boulch, D. The precision\u2013recall curve overcame the optimism of the receiver operating characteristic curve in rare diseases. J. Clin. Epidemiol. 68, 855\u2013859 (2015).","journal-title":"J. Clin. Epidemiol."},{"key":"29153_CR25","doi-asserted-by":"publisher","first-page":"418","DOI":"10.1097\/CCM.0000000000002943","volume":"46","author":"DE Leisman","year":"2018","unstructured":"Leisman, D. E. Rare events in the ICU: an emerging challenge in classification and prediction. Crit. Care Med. 46, 418\u2013424 (2018).","journal-title":"Crit. Care Med."},{"key":"29153_CR26","doi-asserted-by":"publisher","first-page":"837","DOI":"10.2307\/2531595","volume":"44","author":"ER DeLong","year":"1988","unstructured":"DeLong, E. R., DeLong, D. M. & Clarke-Pearson, D. L. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44, 837\u2013845 (1988).","journal-title":"Biometrics"}],"container-title":["Nature Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41467-022-29153-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41467-022-29153-3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41467-022-29153-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,24]],"date-time":"2022-11-24T11:54:58Z","timestamp":1669290898000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41467-022-29153-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,24]]},"references-count":26,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["29153"],"URL":"https:\/\/doi.org\/10.1038\/s41467-022-29153-3","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.09.22.21263926","asserted-by":"object"}],"has-review":[{"id-type":"doi","id":"10.32388\/4FBS04","asserted-by":"object"}]},"ISSN":["2041-1723"],"issn-type":[{"value":"2041-1723","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,24]]},"assertion":[{"value":"26 September 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 February 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 March 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"B.J.M. reported receiving grants from the National Institute of Biomedical Imaging and Bioengineering, National Heart, Lung, and Blood Institute, US Food and Drug Administration, and the US Department of Defense Advanced Research Projects Agency outside the submitted work; in addition, B.J.M. has a pending patent on predictive models using electronic health records (US20180315507A1). A.H.R. is funded by <i>Kjell och M\u00e4rta Beijer Foundation<\/i>. D.L.J. has received personal fees from MyoKardia and has received a grant through the SHaRe Cardiomyopathy Registry, which is funded by MyoKardia. W.L.S. was an investigator for a research agreement, through Yale University, from the Shenzhen Center for Health Information for work to advance intelligent disease prevention and health promotion; collaborates with the National Center for Cardiovascular Diseases in Beijing; is a technical consultant to Hugo Health, a personal health information platform, and co-founder of Refactor Health, an AI-augmented data management platform for healthcare; is a consultant for Interpace Diagnostics Group, a molecular diagnostics company. H.M.K. works under contract with the Centers for Medicare & Medicaid Services to support quality measurement programs, was a recipient of a research grant from Johnson & Johnson, through Yale University, to support clinical trial data sharing; was a recipient of a research agreement, through Yale University, from the Shenzhen Center for Health Information for work to advance intelligent disease prevention and health promotion; collaborates with the National Center for Cardiovascular Diseases in Beijing; receives payment from the Arnold & Porter Law Firm for work related to the Sanofi clopidogrel litigation, from the Martin Baughman Law Firm for work related to the Cook Celect IVC filter litigation, and from the Siegfried and Jensen Law Firm for work related to Vioxx litigation; chairs a Cardiac Scientific Advisory Board for UnitedHealth; was a member of the IBM Watson Health Life Sciences Board; is a member of the Advisory Board for Element Science, the Advisory Board for Facebook, and the Physician Advisory Board for Aetna; and is the co-founder of Hugo Health, a personal health information platform, and co-founder of Refactor Health, a healthcare AI-augmented data management company. A.H.R. is supported in part by CNPq (310679\/2016-8 and 465518\/2014-1) and by FAPEMIG (PPM-00428-17 and RED-00081-16). R.K. is the coinventor of U.S. Provisional Patent Application No. 63\/177,117, \u201cMethods for neighborhood phenomapping for clinical trials\u201d and a co-founder of Evidence2Health, a precision health platform to improve evidence-based care. The other authors have no relevant competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"1583"}}