{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T22:07:34Z","timestamp":1790633254103,"version":"4.1.0"},"reference-count":29,"publisher":"BMJ","issue":"17","content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["Heart"],"accepted":{"date-parts":[[2024,5,2]]},"published-print":{"date-parts":[[2024,9]]},"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Researchers have developed machine learning-based ECG diagnostic algorithms that match or even surpass cardiologist level of performance. However, most of them cannot be used in real-world, as older generation ECG machines do not permit installation of new algorithms.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To develop a smartphone application that automatically extract ECG waveforms from photos and to convert them to voltage-time series for downstream analysis by a variety of diagnostic algorithms built by researchers.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>A novel approach of using objective detection and image segmentation models to automatically extract ECG waveforms from photos taken by clinicians was devised. Modular machine learning models were developed to sequentially perform waveform identification, gridline removal, and scale calibration. The extracted data were then analysed using a machine learning-based cardiac rhythm classifier.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Waveforms from 40\u2009516 scanned and 444 photographed ECGs were automatically extracted. 12\u2009828 of 13\u2009258 (96.8%) scanned and 5399 of 5743 (94.0%) photographed waveforms were correctly cropped and labelled. 11\u2009604 of 12\u2009735 (91.1%) scanned and 5062 of 5752 (88.0%) photographed waveforms achieved successful voltage-time signal extraction after automatic gridline and background noise removal. In a proof-of-concept demonstration, an atrial fibrillation diagnostic algorithm achieved 91.3% sensitivity, 94.2% specificity, 95.6% positive predictive value, 88.6% negative predictive value and 93.4% F1 score, using photos of ECGs as input.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Object detection and image segmentation models allow automatic extraction of ECG signals from photos for downstream diagnostics. This novel pipeline circumvents the need for costly ECG hardware upgrades, thereby paving the way for large-scale implementation of machine learning-based diagnostic algorithms.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1136\/heartjnl-2023-323822","type":"journal-article","created":{"date-parts":[[2024,5,20]],"date-time":"2024-05-20T13:15:38Z","timestamp":1716210938000},"page":"1074-1082","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":7,"title":["Automatic detection of cardiac conditions from photos of electrocardiogram captured by smartphones"],"prefix":"10.1136","volume":"110","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5205-9440","authenticated-orcid":false,"given":"Chun-Ka","family":"Wong","sequence":"first","affiliation":[{"name":"Cardiology Division, Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong SAR, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuk Ming","family":"Lau","sequence":"additional","affiliation":[{"name":"Cardiology Division, Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong SAR, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hin Wai","family":"Lui","sequence":"additional","affiliation":[{"name":"Cardiology Division, Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong SAR, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wai Fung","family":"Chan","sequence":"additional","affiliation":[{"name":"Cardiology Division, Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong SAR, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wing Chun","family":"San","sequence":"additional","affiliation":[{"name":"Cardiology Division, Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong SAR, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mi","family":"Zhou","sequence":"additional","affiliation":[{"name":"Cardiology Division, Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong SAR, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yangyang","family":"Cheng","sequence":"additional","affiliation":[{"name":"Cardiology Division, Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong SAR, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Duo","family":"Huang","sequence":"additional","affiliation":[{"name":"Cardiology Division, Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong SAR, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wing Hon","family":"Lai","sequence":"additional","affiliation":[{"name":"Cardiology Division, Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong SAR, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yee Man","family":"Lau","sequence":"additional","affiliation":[{"name":"Cardiology Division, Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong SAR, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chung Wah","family":"Siu","sequence":"additional","affiliation":[{"name":"Cardiology Division, Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong SAR, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2024,5,20]]},"reference":[{"key":"2025091923233162000_110.17.1074.1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacc.2020.11.030"},{"key":"2025091923233162000_110.17.1074.2","doi-asserted-by":"publisher","DOI":"10.1136\/heartjnl-2018-313147"},{"key":"2025091923233162000_110.17.1074.3","doi-asserted-by":"crossref","DOI":"10.1038\/s41598-021-82771-7","article-title":"Observational study on wearable biosensors and machine learning-based remote monitoring of COVID-19 patients","volume":"11","author":"Un","year":"2021","journal-title":"Sci Rep"},{"key":"2025091923233162000_110.17.1074.4","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-018-0268-3"},{"key":"2025091923233162000_110.17.1074.5","doi-asserted-by":"crossref","first-page":"227","DOI":"10.21037\/cdt.2019.12.10","article-title":"Automated detection of cardiovascular disease by electrocardiogram signal analysis: a deep learning system","volume":"10","author":"Zhang","year":"2020","journal-title":"Cardiovasc Diagn Ther"},{"key":"2025091923233162000_110.17.1074.6","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1001\/jamacardio.2020.7422","article-title":"Use of artificial intelligence and deep neural networks in evaluation of patients with electrocardiographically concealed long QT syndrome from the surface 12-lead electrocardiogram","volume":"6","author":"Bos","year":"2021","journal-title":"JAMA Cardiol"},{"key":"2025091923233162000_110.17.1074.7","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.imu.2018.08.002","article-title":"Multiclass classification of myocardial infarction with convolutional and recurrent neural networks for portable ECG devices","volume":"13","author":"Lui","year":"2018","journal-title":"Informatics in Medicine Unlocked"},{"key":"2025091923233162000_110.17.1074.8","doi-asserted-by":"crossref","DOI":"10.1038\/s41467-020-17804-2","article-title":"Machine learning-based prediction of acute coronary syndrome using only the pre-hospital 12-lead electrocardiogram","volume":"11","author":"Al-Zaiti","year":"2020","journal-title":"Nat Commun"},{"key":"2025091923233162000_110.17.1074.9","doi-asserted-by":"crossref","DOI":"10.1161\/JAHA.119.014717","article-title":"Deep learning-based algorithm for detecting aortic stenosis using electrocardiography","volume":"9","author":"Kwon","year":"2020","journal-title":"J Am Heart Assoc"},{"key":"2025091923233162000_110.17.1074.10","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.jelectrocard.2020.02.008","article-title":"Artificial intelligence for detecting mitral regurgitation using electrocardiography","volume":"59","author":"Kwon","year":"2020","journal-title":"J Electrocardiol"},{"key":"2025091923233162000_110.17.1074.11","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacc.2022.05.029"},{"key":"2025091923233162000_110.17.1074.12","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacc.2019.12.030"},{"key":"2025091923233162000_110.17.1074.13","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1093\/europace\/euz324","article-title":"Comparing the performance of artificial intelligence and conventional diagnosis criteria for detecting left ventricular hypertrophy using electrocardiography","volume":"22","author":"Kwon","year":"2020","journal-title":"Europace"},{"key":"2025091923233162000_110.17.1074.14","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1097\/MAT.0000000000001218","article-title":"Artificial intelligence algorithm for screening heart failure with reduced ejection fraction using electrocardiography","volume":"67","author":"Cho","year":"2021","journal-title":"ASAIO J"},{"key":"2025091923233162000_110.17.1074.15","doi-asserted-by":"crossref","DOI":"10.2196\/15931","article-title":"A deep-learning algorithm (Ecg12Net) for detecting hypokalemia and hyperkalemia by electrocardiography: algorithm development","volume":"8","author":"Lin","year":"2020","journal-title":"JMIR Med Inform"},{"key":"2025091923233162000_110.17.1074.16","doi-asserted-by":"crossref","DOI":"10.1038\/s41598-021-87631-y","article-title":"Accessory pathway analysis using a multimodal deep learning model","volume":"11","author":"Nishimori","year":"2021","journal-title":"Sci Rep"},{"key":"2025091923233162000_110.17.1074.17","doi-asserted-by":"crossref","first-page":"886","DOI":"10.1038\/s41591-020-0870-z","article-title":"Prediction of mortality from 12-lead electrocardiogram voltage data using a deep neural network","volume":"26","author":"Raghunath","year":"2020","journal-title":"Nat Med"},{"key":"2025091923233162000_110.17.1074.18","doi-asserted-by":"crossref","unstructured":"Baydoun M , Safatly L , Abou Hassan OK , et al . High precision digitization of paper-based ECG records: a step toward machine learning. IEEE J Transl Eng Health Med 2019;7. doi:10.1109\/JTEHM.2019.2949784","DOI":"10.1109\/JTEHM.2019.2949784"},{"key":"2025091923233162000_110.17.1074.19","doi-asserted-by":"crossref","first-page":"707","DOI":"10.1016\/j.jelectrocard.2018.05.003","article-title":"Image Digitization of discontinuous and degraded electrocardiogram paper records using an entropy-based bit plane slicing algorithm","volume":"51","author":"Patil","year":"2018","journal-title":"J Electrocardiol"},{"key":"2025091923233162000_110.17.1074.20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/JTEHM.2013.2262024","article-title":"Novel tool for complete digitization of paper electrocardiography data","volume":"1","author":"Ravichandran","year":"2013","journal-title":"IEEE J Transl Eng Health Med"},{"key":"2025091923233162000_110.17.1074.21","first-page":"1588","article-title":"Digitization and synchronization method for electrocardiogram printouts","volume":"2005","author":"Morales","year":"2005","journal-title":"Conf Proc IEEE Eng Med Biol Soc"},{"key":"2025091923233162000_110.17.1074.22","doi-asserted-by":"publisher","DOI":"10.1016\/j.jelectrocard.2005.04.003"},{"key":"2025091923233162000_110.17.1074.23","unstructured":"Yakubovskiy P . Segmentation models. GitHub repository; 2019."},{"key":"2025091923233162000_110.17.1074.24","doi-asserted-by":"crossref","first-page":"20963","DOI":"10.1038\/s41598-022-25284-1","article-title":"A fully-automated paper ECG digitisation algorithm using deep learning","volume":"12","author":"Wu","year":"2022","journal-title":"Sci Rep"},{"key":"2025091923233162000_110.17.1074.25","doi-asserted-by":"crossref","DOI":"10.1038\/s41467-022-29153-3","article-title":"Automated multilabel diagnosis on electrocardiographic images and signals","volume":"13","author":"Sangha","year":"2022","journal-title":"Nat Commun"},{"key":"2025091923233162000_110.17.1074.26","doi-asserted-by":"crossref","DOI":"10.1161\/JAHA.123.032100","article-title":"Robust artificial intelligence tool for atrial fibrillation diagnosis: novel development approach incorporating both atrial electrograms and surface ECG and evaluation by head-to-head comparison with hospital-based physician ECG readers","volume":"13","author":"Zhang","year":"2024","journal-title":"J Am Heart Assoc"},{"key":"2025091923233162000_110.17.1074.27","doi-asserted-by":"crossref","first-page":"105325","DOI":"10.1016\/j.compbiomed.2022.105325","article-title":"A transformer-based deep neural network for arrhythmia detection using continuous ECG signals","volume":"144","author":"Hu","year":"2022","journal-title":"Comput Biol Med"},{"key":"2025091923233162000_110.17.1074.28","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0226671","article-title":"Lead-I ECG for detecting atrial fibrillation in patients attending primary care with an irregular pulse using single-time point testing: a systematic review and economic evaluation","volume":"14","author":"Duarte","year":"2019","journal-title":"PLoS One"},{"key":"2025091923233162000_110.17.1074.29","doi-asserted-by":"crossref","first-page":"e358","DOI":"10.1016\/S2589-7500(20)30108-4","article-title":"A deep learning algorithm to detect anaemia with ECGs: a retrospective, multicentre study","volume":"2","author":"Kwon","year":"2020","journal-title":"Lancet Digit Health"}],"container-title":["Heart"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/heartjnl-2023-323822","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,20]],"date-time":"2025-09-20T06:24:19Z","timestamp":1758349459000},"score":1,"resource":{"primary":{"URL":"https:\/\/heart.bmj.com\/lookup\/doi\/10.1136\/heartjnl-2023-323822"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,20]]},"references-count":29,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2024,8,14]]},"published-print":{"date-parts":[[2024,9]]}},"alternative-id":["10.1136\/heartjnl-2023-323822"],"URL":"https:\/\/doi.org\/10.1136\/heartjnl-2023-323822","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2023.11.01.23297947","asserted-by":"object"}]},"ISSN":["1355-6037","1468-201X"],"issn-type":[{"value":"1355-6037","type":"print"},{"value":"1468-201X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,20]]}}}