{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,3]],"date-time":"2026-11-03T06:32:19Z","timestamp":1793687539439,"version":"4.5.1"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,1,2]],"date-time":"2023-01-02T00:00:00Z","timestamp":1672617600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,1,2]],"date-time":"2023-01-02T00:00:00Z","timestamp":1672617600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Echocardiography is the first-line diagnostic technique for heart diseases. Although artificial intelligence techniques have made great improvements in the analysis of echocardiography, the major limitations remain to be the built neural networks are normally adapted to a few diseases and specific equipment. Here, we present an end-to-end deep learning framework named AIEchoDx that differentiates four common cardiovascular diseases (Atrial Septal Defect, Dilated Cardiomyopathy, Hypertrophic Cardiomyopathy, prior Myocardial Infarction) from normal subjects with performance comparable to that of consensus of three senior cardiologists in AUCs (99.50% vs 99.26%, 98.75% vs 92.75%, 99.57% vs 97.21%, 98.52% vs 84.20%, and 98.70% vs 89.41%), respectively. Meanwhile, AIEchoDx accurately recognizes critical lesion regions of interest along with each disease by visualizing the decision-making process. Furthermore, our analysis indicates that heterogeneous diseases, like dilated cardiomyopathy, could be classified into two phenogroups with distinct clinical characteristics. Finally, AIEchoDx performs efficiently as an anomaly detection tool when applying handheld device-produced videos. Together, AIEchoDx provides a potential diagnostic assistant tool in either cart-based echocardiography equipment or handheld echocardiography device for primary and point-of-care medical personnel with high diagnostic performance, and the application of lesion region identification and heterogeneous disease phenogrouping, which may broaden the application of artificial intelligence in echocardiography.<\/jats:p>","DOI":"10.1038\/s41598-022-27211-w","type":"journal-article","created":{"date-parts":[[2023,1,2]],"date-time":"2023-01-02T06:16:50Z","timestamp":1672640210000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":68,"title":["A deep learning framework assisted echocardiography with diagnosis, lesion localization, phenogrouping heterogeneous disease, and anomaly detection"],"prefix":"10.1038","volume":"13","author":[{"given":"Bohan","family":"Liu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Chang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dong","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Feifei","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qiushuang","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yujiao","family":"Deng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lijun","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenqing","family":"Lv","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bo","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liheng","family":"Yu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Burkhoff","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kunlun","family":"He","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,1,2]]},"reference":[{"key":"27211_CR1","doi-asserted-by":"publisher","first-page":"1736","DOI":"10.1016\/s0140-6736(18)32203-7","volume":"392","author":"GA Roth","year":"2018","unstructured":"Roth, G. A. et al. Global, regional, and national age-sex-specific mortality for 282 causes of death in 195 countries and territories, 1980\u20132017: A systematic analysis for the global burden of disease study 2017. The Lancet 392, 1736\u20131788. https:\/\/doi.org\/10.1016\/s0140-6736(18)32203-7 (2018).","journal-title":"The Lancet"},{"key":"27211_CR2","doi-asserted-by":"publisher","first-page":"2178","DOI":"10.1161\/CIRCULATIONAHA.117.026622","volume":"136","author":"MA Chamsi-Pasha","year":"2017","unstructured":"Chamsi-Pasha, M. A., Sengupta, P. P. & Zoghbi, W. A. Handheld echocardiography: Current state and future perspectives. Circulation 136, 2178\u20132188. https:\/\/doi.org\/10.1161\/CIRCULATIONAHA.117.026622 (2017).","journal-title":"Circulation"},{"key":"27211_CR3","doi-asserted-by":"publisher","first-page":"1818","DOI":"10.1001\/jamainternmed.2017.5048","volume":"177","author":"RB Liu","year":"2017","unstructured":"Liu, R. B., Donroe, J. H., McNamara, R. L., Forman, H. P. & Moore, C. L. The practice and implications of finding fluid during point-of-care ultrasonography: A review. JAMA Intern. Med 177, 1818\u20131825. https:\/\/doi.org\/10.1001\/jamainternmed.2017.5048 (2017).","journal-title":"JAMA Intern. Med"},{"key":"27211_CR4","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-018-0107-6","author":"J De Fauw","year":"2018","unstructured":"De Fauw, J. et al. Clinically applicable deep learning for diagnosis and referral in retinal disease. Nat. Med. https:\/\/doi.org\/10.1038\/s41591-018-0107-6 (2018).","journal-title":"Nat. Med."},{"key":"27211_CR5","doi-asserted-by":"publisher","unstructured":"Kermany, D. S. et al. Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172, 1122\u20131131. https:\/\/doi.org\/10.1016\/j.cell.2018.02.010 (2018).","DOI":"10.1016\/j.cell.2018.02.010"},{"key":"27211_CR6","doi-asserted-by":"publisher","first-page":"469","DOI":"10.1038\/nature26000","volume":"555","author":"D Capper","year":"2018","unstructured":"Capper, D. et al. DNA methylation-based classification of central nervous system tumours. Nature 555, 469\u2013474. https:\/\/doi.org\/10.1038\/nature26000 (2018).","journal-title":"Nature"},{"key":"27211_CR7","doi-asserted-by":"publisher","first-page":"1394","DOI":"10.1161\/STROKEAHA.117.019740","volume":"49","author":"A Nielsen","year":"2018","unstructured":"Nielsen, A., Hansen, M. B., Tietze, A. & Mouridsen, K. Prediction of tissue outcome and assessment of treatment effect in acute ischemic stroke using deep learning. Stroke 49, 1394\u20131401. https:\/\/doi.org\/10.1161\/STROKEAHA.117.019740 (2018).","journal-title":"Stroke"},{"key":"27211_CR8","doi-asserted-by":"publisher","unstructured":"Ehteshami Bejnordi, B. et al. Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer. JAMA 318, 2199\u20132210. https:\/\/doi.org\/10.1001\/jama.2017.14585 (2017).","DOI":"10.1001\/jama.2017.14585"},{"key":"27211_CR9","doi-asserted-by":"publisher","first-page":"252","DOI":"10.1038\/s41586-020-2145-8","volume":"580","author":"D Ouyang","year":"2020","unstructured":"Ouyang, D. et al. Video-based AI for beat-to-beat assessment of cardiac function. Nature 580, 252\u2013256. https:\/\/doi.org\/10.1038\/s41586-020-2145-8 (2020).","journal-title":"Nature"},{"key":"27211_CR10","doi-asserted-by":"crossref","unstructured":"Zhou, B., Khosla, A., Lapedriza, A., Oliva, A. & Torralba, A. Learning deep features for discriminative localization. arXiv e-prints (2015). arXiv:151204150Z.","DOI":"10.1109\/CVPR.2016.319"},{"key":"27211_CR11","doi-asserted-by":"publisher","first-page":"2280","DOI":"10.1007\/s00259-017-3834-x","volume":"44","author":"K Nakajima","year":"2017","unstructured":"Nakajima, K. et al. Diagnostic accuracy of an artificial neural network compared with statistical quantitation of myocardial perfusion images: A Japanese multicenter study. Eur. J. Nucl. Med. Mol. Imaging 44, 2280\u20132289. https:\/\/doi.org\/10.1007\/s00259-017-3834-x (2017).","journal-title":"Eur. J. Nucl. Med. Mol. Imaging"},{"key":"27211_CR12","doi-asserted-by":"publisher","unstructured":"Rajpurkar, P. et al. Deep learning for chest radiograph diagnosis: A retrospective comparison of the CheXNeXt algorithm to practicing radiologists. PLoS Med 15, e1002686. https:\/\/doi.org\/10.1371\/journal.pmed.1002686 (2018).","DOI":"10.1371\/journal.pmed.1002686"},{"key":"27211_CR13","doi-asserted-by":"publisher","unstructured":"Saria, S. et al. Deep-learning-assisted diagnosis for knee magnetic resonance imaging: Development and retrospective validation of MRNet. PLOS Medicine 15, doi:https:\/\/doi.org\/10.1371\/journal.pmed.1002699 (2018).","DOI":"10.1371\/journal.pmed.1002699"},{"key":"27211_CR14","doi-asserted-by":"publisher","first-page":"270","DOI":"10.1093\/eurheartj\/ehm342","volume":"29","author":"P Elliott","year":"2008","unstructured":"Elliott, P. et al. Classification of the cardiomyopathies: A position statement from the European Society Of Cardiology Working Group on Myocardial and Pericardial Diseases. Eur. Heart J. 29, 270\u2013276. https:\/\/doi.org\/10.1093\/eurheartj\/ehm342 (2008).","journal-title":"Eur. Heart J."},{"key":"27211_CR15","doi-asserted-by":"publisher","first-page":"1850","DOI":"10.1093\/eurheartj\/ehv727","volume":"37","author":"YM Pinto","year":"2016","unstructured":"Pinto, Y. M. et al. Proposal for a revised definition of dilated cardiomyopathy, hypokinetic non-dilated cardiomyopathy, and its implications for clinical practice: A position statement of the ESC working group on myocardial and pericardial diseases. Eur. Heart J. 37, 1850\u20131858. https:\/\/doi.org\/10.1093\/eurheartj\/ehv727 (2016).","journal-title":"Eur. Heart J."},{"key":"27211_CR16","doi-asserted-by":"publisher","unstructured":"Moon, K. R. et al. Visualizing transitions and structure for biological data exploration. bioRxiv, 120378. https:\/\/doi.org\/10.1101\/120378 (2018).","DOI":"10.1101\/120378"},{"key":"27211_CR17","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1002\/ejhf.608","volume":"19","author":"M Gigli","year":"2017","unstructured":"Gigli, M. et al. Insights into mildly dilated cardiomyopathy: Temporal evolution and long-term prognosis. Eur. J. Heart Fail. 19, 531\u2013539. https:\/\/doi.org\/10.1002\/ejhf.608 (2017).","journal-title":"Eur. J. Heart Fail."},{"key":"27211_CR18","doi-asserted-by":"publisher","first-page":"302","DOI":"10.1161\/01.CIR.72.2.302","volume":"72","author":"A Keren","year":"1985","unstructured":"Keren, A., Billingham, M. E., Weintraub, D., Stinson, E. B. & Popp, R. L. Mildly dilated congestive cardiomyopathy. Circulation 72, 302\u2013309 (1985).","journal-title":"Circulation"},{"key":"27211_CR19","doi-asserted-by":"publisher","first-page":"1623","DOI":"10.1161\/circulationaha.118.034338","volume":"138","author":"J Zhang","year":"2018","unstructured":"Zhang, J. et al. Fully automated echocardiogram interpretation in clinical practice. Circulation 138, 1623\u20131635. https:\/\/doi.org\/10.1161\/circulationaha.118.034338 (2018).","journal-title":"Circulation"},{"key":"27211_CR20","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1007\/s10916-016-0432-6","volume":"40","author":"GB Berikol","year":"2016","unstructured":"Berikol, G. B., Yildiz, O. & Ozcan, I. T. Diagnosis of acute coronary syndrome with a support vector machine. J. Med. Syst. 40, 84. https:\/\/doi.org\/10.1007\/s10916-016-0432-6 (2016).","journal-title":"J. Med. Syst."},{"key":"27211_CR21","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1109\/titb.2009.2038906","volume":"14","author":"MA Karaolis","year":"2010","unstructured":"Karaolis, M. A., Moutiris, J. A., Hadjipanayi, D. & Pattichis, C. S. Assessment of the risk factors of coronary heart events based on data mining with decision trees. IEEE Trans. Inf. Technol. Biomed. 14, 559\u2013566. https:\/\/doi.org\/10.1109\/titb.2009.2038906 (2010).","journal-title":"IEEE Trans. Inf. Technol. Biomed."},{"key":"27211_CR22","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1007\/s12265-016-9727-8","volume":"10","author":"Y Luo","year":"2017","unstructured":"Luo, Y., Ahmad, F. S. & Shah, S. J. Tensor factorization for precision medicine in heart failure with preserved ejection fraction. J. Cardiovasc. Transl. Res. 10, 305\u2013312 (2017).","journal-title":"J. Cardiovasc. Transl. Res."},{"key":"27211_CR23","doi-asserted-by":"publisher","DOI":"10.1016\/j.ultrasmedbio.2018.07.024","author":"A Ostvik","year":"2018","unstructured":"Ostvik, A., Smistad, E., Aase, S. A., Haugen, B. O. & Lovstakken, L. Real-time standard view classification in transthoracic echocardiography using convolutional neural networks. Ultrasound Med. Biol. https:\/\/doi.org\/10.1016\/j.ultrasmedbio.2018.07.024 (2018).","journal-title":"Ultrasound Med. Biol."},{"key":"27211_CR24","doi-asserted-by":"publisher","DOI":"10.1109\/tcyb.2017.2778799","author":"F Liao","year":"2017","unstructured":"Liao, F., Chen, X., Hu, X. & Song, S. Estimation of the volume of the left ventricle from MRI images using deep neural networks. IEEE Trans. Cybern. https:\/\/doi.org\/10.1109\/tcyb.2017.2778799 (2017).","journal-title":"IEEE Trans. Cybern."},{"key":"27211_CR25","doi-asserted-by":"publisher","unstructured":"Madani, A., Ong, J. R., Tibrewal, A. & Mofrad, M. R. K. Deep echocardiography: data-efficient supervised and semi-supervised deep learning towards automated diagnosis of cardiac disease. NPJ Digit. Med. 1, 1. https:\/\/doi.org\/10.1038\/s41746-018-0065-x (2018).","DOI":"10.1038\/s41746-018-0065-x"},{"key":"27211_CR26","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/j.media.2016.10.007","volume":"36","author":"H Khamis","year":"2017","unstructured":"Khamis, H. et al. Automatic apical view classification of echocardiograms using a discriminative learning dictionary. Med. Image Anal. 36, 15\u201321. https:\/\/doi.org\/10.1016\/j.media.2016.10.007 (2017).","journal-title":"Med. Image Anal."},{"key":"27211_CR27","doi-asserted-by":"publisher","unstructured":"Narula, S., Shameer, K., Salem Omar, A. M., Dudley, J. T. & Sengupta, P. P. Machine-learning algorithms to automate morphological and functional assessments in 2D echocardiography. J. Am. College Cardiol. 68, 2287\u20132295. https:\/\/doi.org\/10.1016\/j.jacc.2016.08.062 (2016).","DOI":"10.1016\/j.jacc.2016.08.062"},{"key":"27211_CR28","doi-asserted-by":"publisher","unstructured":"Lang, R. M. et al. Recommendations for cardiac chamber quantification by echocardiography in adults: An update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. J. Am. Soc. Echocardiogr. 28, 1\u201339 e14. https:\/\/doi.org\/10.1016\/j.echo.2014.10.003 (2015).","DOI":"10.1016\/j.echo.2014.10.003"},{"key":"27211_CR29","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J. & Wojna, Z. Rethinking the inception architecture for computer vision. arXiv e-prints (2015). arXiv:151200567S.","DOI":"10.1109\/CVPR.2016.308"},{"key":"27211_CR30","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A. & Chen, L.-C. MobileNetV2: Inverted residuals and linear bottlenecks. arXiv e-prints (2018). arXiv:180104381S.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"27211_CR31","unstructured":"Minka, T. P. in Advances in Neural Information Processing Systems 13 (eds T. K. Leen, T. G. Dietterich, & V. Tresp) 598\u2013604 (MIT Press, 2001)."},{"key":"27211_CR32","doi-asserted-by":"publisher","unstructured":"Moon, K. R. et al. PHATE: A dimensionality reduction method for visualizing trajectory structures in high-dimensional biological data. https:\/\/doi.org\/10.1101\/120378 (2018).","DOI":"10.1101\/120378"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-27211-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-27211-w","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-27211-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,2]],"date-time":"2023-01-02T06:18:23Z","timestamp":1672640303000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-27211-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,2]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["27211"],"URL":"https:\/\/doi.org\/10.1038\/s41598-022-27211-w","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,2]]},"assertion":[{"value":"13 June 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 December 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 January 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"3"}}