{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T10:31:47Z","timestamp":1776940307723,"version":"3.51.4"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T00:00:00Z","timestamp":1698451200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T00:00:00Z","timestamp":1698451200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Focused cardiac ultrasound (FoCUS) is becoming standard practice in a wide spectrum of clinical settings. There is limited data evaluating the real-world use of FoCUS with artificial intelligence (AI). Our objective was to determine the accuracy of FoCUS AI-assisted left ventricular ejection fraction (LVEF) assessment and compare its accuracy between novice and experienced users. In this prospective, multicentre study, participants requiring a transthoracic echocardiogram (TTE) were recruited to have a FoCUS done by a novice or experienced user. The AI-assisted device calculated LVEF at the bedside, which was subsequently compared to TTE. 449 participants were enrolled with 424 studies included in the final analysis. The overall intraclass coefficient was 0.904, and 0.921 in the novice (<jats:italic>n<\/jats:italic>\u2009=\u2009208) and 0.845 in the experienced (<jats:italic>n<\/jats:italic>\u2009=\u2009216) cohorts. There was a significant bias of 0.73% towards TTE (<jats:italic>p<\/jats:italic>\u2009=\u20090.005) with a level of agreement of 11.2%. Categorical grading of LVEF severity had excellent agreement to TTE (weighted kappa = 0.83). The area under the curve (AUC) was 0.98 for identifying an abnormal LVEF (&lt;50%) with a sensitivity of 92.8%, specificity of 92.3%, negative predictive value (NPV) of 0.97 and a positive predictive value (PPV) of 0.83. In identifying severe dysfunction (&lt;30%) the AUC was 0.99 with a sensitivity of 78.1%, specificity of 98.0%, NPV of 0.98 and PPV of 0.76. Here we report that FoCUS AI-assisted LVEF assessments provide highly reproducible LVEF estimations in comparison to formal TTE. This finding was consistent among senior and novice echocardiographers suggesting applicability in a variety of clinical settings.<\/jats:p>","DOI":"10.1038\/s41746-023-00945-1","type":"journal-article","created":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T08:02:34Z","timestamp":1698480154000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Diagnostic accuracy of point-of-care ultrasound with artificial intelligence-assisted assessment of left ventricular ejection fraction"],"prefix":"10.1038","volume":"6","author":[{"given":"Pouya","family":"Motazedian","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0479-6785","authenticated-orcid":false,"given":"Jeffrey A.","family":"Marbach","sequence":"additional","affiliation":[]},{"given":"Graeme","family":"Prosperi-Porta","sequence":"additional","affiliation":[]},{"given":"Simon","family":"Parlow","sequence":"additional","affiliation":[]},{"given":"Pietro","family":"Di Santo","sequence":"additional","affiliation":[]},{"given":"Omar","family":"Abdel-Razek","sequence":"additional","affiliation":[]},{"given":"Richard","family":"Jung","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4752-2677","authenticated-orcid":false,"given":"William B.","family":"Bradford","sequence":"additional","affiliation":[]},{"given":"Miranda","family":"Tsang","sequence":"additional","affiliation":[]},{"given":"Michael","family":"Hyon","sequence":"additional","affiliation":[]},{"given":"Stefano","family":"Pacifici","sequence":"additional","affiliation":[]},{"given":"Sharanya","family":"Mohanty","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4350-1652","authenticated-orcid":false,"given":"F. Daniel","family":"Ramirez","sequence":"additional","affiliation":[]},{"given":"Gordon S.","family":"Huggins","sequence":"additional","affiliation":[]},{"given":"Trevor","family":"Simard","sequence":"additional","affiliation":[]},{"given":"Stephanie","family":"Hon","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0906-1363","authenticated-orcid":false,"given":"Benjamin","family":"Hibbert","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,10,28]]},"reference":[{"key":"945_CR1","doi-asserted-by":"publisher","first-page":"2982","DOI":"10.1016\/j.jacc.2020.11.010","volume":"76","author":"GA Roth","year":"2020","unstructured":"Roth, G. A. et al. Global Burden of Cardiovascular Diseases and Risk Factors, 1990-2019: Update From the GBD 2019 Study. J. Am. Coll. Cardiol. 76, 2982\u20133021 (2020).","journal-title":"J. Am. Coll. Cardiol."},{"key":"945_CR2","doi-asserted-by":"publisher","first-page":"R15","DOI":"10.1530\/ERP-16-0043","volume":"4","author":"MR Cowie","year":"2017","unstructured":"Cowie, M. R. The heart failure epidemic: a UK perspective. Echo Res Pr. 4, R15\u2013r20 (2017).","journal-title":"Echo Res Pr."},{"key":"945_CR3","unstructured":"Commission, M. P. A. & Book, A. D. Healthcare spending and the Medicare program. Washington, DC: MedPAC (2012)."},{"key":"945_CR4","doi-asserted-by":"publisher","first-page":"1097","DOI":"10.1016\/j.jacc.2019.01.027","volume":"73","author":"A Almufleh","year":"2019","unstructured":"Almufleh, A., Di Santo, P. & Marbach, J. A. Training Cardiology Fellows in Focused Cardiac Ultrasound. J. Am. Coll. Cardiol. 73, 1097\u20131100 (2019).","journal-title":"J. Am. Coll. Cardiol."},{"key":"945_CR5","doi-asserted-by":"publisher","first-page":"e037664","DOI":"10.1136\/bmjopen-2020-037664","volume":"10","author":"CA Andersen","year":"2020","unstructured":"Andersen, C. A., Brodersen, J., Davidsen, A. S., Graumann, O. & Jensen, M. B. B. Use and impact of point-of-care ultrasonography in general practice: a prospective observational study. BMJ open 10, e037664 (2020).","journal-title":"BMJ open"},{"key":"945_CR6","doi-asserted-by":"publisher","first-page":"264","DOI":"10.7326\/M19-1337","volume":"171","author":"JA Marbach","year":"2019","unstructured":"Marbach, J. A. et al. Comparative Accuracy of Focused Cardiac Ultrasonography and Clinical Examination for Left Ventricular Dysfunction and Valvular Heart Disease: A Systematic Review and Meta-analysis. Ann. Intern Med 171, 264\u2013272 (2019).","journal-title":"Ann. Intern Med"},{"key":"945_CR7","doi-asserted-by":"publisher","first-page":"2107","DOI":"10.1016\/j.chest.2020.07.021","volume":"158","author":"JA Marbach","year":"2020","unstructured":"Marbach, J. A. et al. A Shifting Paradigm: The Role of Focused Cardiac Ultrasound in Bedside Patient Assessment. Chest 158, 2107\u20132118 (2020).","journal-title":"Chest"},{"key":"945_CR8","doi-asserted-by":"publisher","first-page":"e5","DOI":"10.1016\/j.chest.2016.05.040","volume":"151","author":"P Motazedian","year":"2017","unstructured":"Motazedian, P., Le May, M. R., Glover, C. & Hibbert, B. A Woman in Her 80s With Anterior ST-Elevation Myocardial Infarction and Shock. Chest 151, e5\u2013e8 (2017).","journal-title":"Chest"},{"key":"945_CR9","doi-asserted-by":"publisher","first-page":"406","DOI":"10.1002\/ejhf.2047","volume":"23","author":"S Stewart","year":"2021","unstructured":"Stewart, S. et al. Ejection fraction and mortality: a nationwide register-based cohort study of 499\u2009153 women and men. Eur. J. Heart Fail 23, 406\u2013416 (2021).","journal-title":"Eur. J. Heart Fail"},{"key":"945_CR10","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1016\/j.amjcard.2020.06.062","volume":"132","author":"GS Huang","year":"2020","unstructured":"Huang, G. S., Alviar, C. L., Wiley, B. M. & Kwon, Y. The Era of Point-of-Care Ultrasound Has Arrived: Are Cardiologists Ready? Am. J. Cardiol. 132, 173\u2013175 (2020).","journal-title":"Am. J. Cardiol."},{"key":"945_CR11","doi-asserted-by":"publisher","first-page":"324","DOI":"10.1067\/mhj.2001.116475","volume":"142","author":"BJ Kimura","year":"2001","unstructured":"Kimura, B. J., Bocchicchio, M., Willis, C. L. & DeMaria, A. N. Screening cardiac ultrasonographic examination in patients with suspected cardiac disease in the emergency department. Am. heart J. 142, 324\u2013330 (2001).","journal-title":"Am. heart J."},{"key":"945_CR12","doi-asserted-by":"publisher","first-page":"409","DOI":"10.1016\/j.echo.2020.01.008","volume":"33","author":"JN Kirkpatrick","year":"2020","unstructured":"Kirkpatrick, J. N. et al. Recommendations for Echocardiography Laboratories Participating in Cardiac Point of Care Cardiac Ultrasound (POCUS) and Critical Care Echocardiography Training: Report from the American Society of Echocardiography. J. Am. Soc. Echocardiogr. 33, 409\u2013422.e404 (2020).","journal-title":"J. Am. Soc. Echocardiogr."},{"key":"945_CR13","doi-asserted-by":"publisher","first-page":"m689","DOI":"10.1136\/bmj.m689","volume":"368","author":"M Nagendran","year":"2020","unstructured":"Nagendran, M. et al. Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies. Bmj 368, m689 (2020).","journal-title":"Bmj"},{"key":"945_CR14","doi-asserted-by":"publisher","first-page":"810","DOI":"10.1126\/science.aaw0029","volume":"363","author":"RB Parikh","year":"2019","unstructured":"Parikh, R. B., Obermeyer, Z. & Navathe, A. S. Regulation of predictive analytics in medicine. Science 363, 810\u2013812 (2019).","journal-title":"Science"},{"key":"945_CR15","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","volume":"25","author":"EJ Topol","year":"2019","unstructured":"Topol, E. J. High-performance medicine: the convergence of human and artificial intelligence. Nat. Med. 25, 44\u201356 (2019).","journal-title":"Nat. Med."},{"key":"945_CR16","doi-asserted-by":"publisher","first-page":"R115","DOI":"10.1530\/ERP-18-0056","volume":"5","author":"M Alsharqi","year":"2018","unstructured":"Alsharqi, M. et al. Artificial intelligence and echocardiography. Echo Res. Pr. 5, R115\u2013r125 (2018).","journal-title":"Echo Res. Pr."},{"key":"945_CR17","doi-asserted-by":"publisher","DOI":"10.1186\/s12947-021-00261-2","volume":"19","author":"J Zhou","year":"2021","unstructured":"Zhou, J., Du, M., Chang, S. & Chen, Z. Artificial intelligence in echocardiography: detection, functional evaluation, and disease diagnosis. Cardiovasc. Ultrasound 19, 29 (2021).","journal-title":"Cardiovasc. Ultrasound"},{"key":"945_CR18","doi-asserted-by":"publisher","DOI":"10.1186\/cc11198","volume":"16","author":"J-B Amiel","year":"2012","unstructured":"Amiel, J.-B. et al. Assessment of left ventricular ejection fraction using an ultrasonic stethoscope in critically ill patients. Crit. Care 16, R29 (2012).","journal-title":"Crit. Care"},{"key":"945_CR19","doi-asserted-by":"publisher","first-page":"1069","DOI":"10.1016\/S0300-8932(03)77017-1","volume":"56","author":"A Mart\u00edn-Pe\u00f1ato","year":"2003","unstructured":"Mart\u00edn-Pe\u00f1ato, A. et al. Hand-held echocardiographic devices: what do they add to the initial cardiovascular evaluation? Rev. Espanola de. Cardiologia 56, 1069\u20131076 (2003).","journal-title":"Rev. Espanola de. Cardiologia"},{"key":"945_CR20","first-page":"983","volume":"7","author":"M Mehta","year":"2014","unstructured":"Mehta, M. et al. Handheld ultrasound versus physical examination in patients referred for transthoracic echocardiography for a suspected cardiac condition. JACC: Cardiovas. Imaging 7, 983\u2013990 (2014).","journal-title":"JACC: Cardiovas. Imaging"},{"key":"945_CR21","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.amjmed.2008.07.022","volume":"122","author":"LD Martin","year":"2009","unstructured":"Martin, L. D. et al. Hand-carried Ultrasound Performed by Hospitalists: Does It Improve the Cardiac Physical Examination? Am. J. Med. 122, 35\u201341 (2009).","journal-title":"Am. J. Med."},{"key":"945_CR22","doi-asserted-by":"publisher","first-page":"1002","DOI":"10.1016\/j.amjcard.2005.05.060","volume":"96","author":"SL Kobal","year":"2005","unstructured":"Kobal, S. L. et al. Comparison of Effectiveness of Hand-Carried Ultrasound to Bedside Cardiovascular Physical Examination. Am. J. Cardiol. 96, 1002\u20131006 (2005).","journal-title":"Am. J. Cardiol."},{"key":"945_CR23","doi-asserted-by":"publisher","first-page":"1061","DOI":"10.1016\/j.echo.2020.04.025","volume":"33","author":"A Davis","year":"2020","unstructured":"Davis, A. et al. Artificial Intelligence and Echocardiography: A Primer for Cardiac Sonographers. J. Am. Soc. Echocardiogr. 33, 1061\u20131066 (2020).","journal-title":"J. Am. Soc. Echocardiogr."},{"key":"945_CR24","doi-asserted-by":"publisher","first-page":"1623","DOI":"10.1161\/CIRCULATIONAHA.118.034338","volume":"138","author":"J Zhang","year":"2018","unstructured":"Zhang, J. et al. Fully Automated Echocardiogram Interpretation in Clinical Practice. Circulation 138, 1623\u20131635 (2018).","journal-title":"Circulation"},{"key":"945_CR25","doi-asserted-by":"publisher","first-page":"e46","DOI":"10.1016\/S2589-7500(21)00235-1","volume":"4","author":"J Tromp","year":"2022","unstructured":"Tromp, J. et al. Automated interpretation of systolic and diastolic function on the echocardiogram: a multicohort study. Lancet Digit. Health 4, e46\u2013e54 (2022).","journal-title":"Lancet Digit. Health"},{"key":"945_CR26","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1093\/ehjdh\/ztac001","volume":"3","author":"S-L Papadopoulou","year":"2022","unstructured":"Papadopoulou, S.-L., Sachpekidis, V., Kantartzi, V., Styliadis, I. & Nihoyannopoulos, P. Clinical validation of an artificial intelligence-assisted algorithm for automated quantification of left ventricular ejection fraction in real time by a novel handheld ultrasound device. Eur. Heart J.-Digital Health 3, 29\u201337 (2022).","journal-title":"Eur. Heart J.-Digital Health"},{"key":"945_CR27","doi-asserted-by":"publisher","unstructured":"He, B. et al. Ai-Enabled Assessment Of Cardiac Function And Video Quality In Emergency Department Point-Of-Care Echocardiograms. J. Emerg. Med. https:\/\/doi.org\/10.1016\/j.jemermed.2023.02.005 (2023).","DOI":"10.1016\/j.jemermed.2023.02.005"},{"key":"945_CR28","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1016\/j.accpm.2017.02.008","volume":"36","author":"X Bobbia","year":"2017","unstructured":"Bobbia, X. et al. The clinical impact and prevalence of emergency point-of-care ultrasound: A prospective multicenter study. Anaesth. Crit. Care Pain. Med 36, 383\u2013389 (2017).","journal-title":"Anaesth. Crit. Care Pain. Med"},{"key":"945_CR29","doi-asserted-by":"publisher","first-page":"S68","DOI":"10.1016\/j.ultrasmedbio.2019.07.639","volume":"45","author":"P Pouryahya","year":"2019","unstructured":"Pouryahya, P. The utility of Point-Of-Care Ultrasound (POCUS) in emergency department; an observational study. Ultrasound Med. Biol. 45, S68 (2019).","journal-title":"Ultrasound Med. Biol."},{"key":"945_CR30","doi-asserted-by":"publisher","first-page":"605","DOI":"10.2147\/JMDH.S359084","volume":"15","author":"L Shaddock","year":"2022","unstructured":"Shaddock, L. & Smith, T. Potential for Use of Portable Ultrasound Devices in Rural and Remote Settings in Australia and Other Developed Countries: A Systematic Review. J. Multidiscip. Health. 15, 605\u2013625 (2022).","journal-title":"J. Multidiscip. Health."},{"key":"945_CR31","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1016\/j.afjem.2017.04.011","volume":"7","author":"M Stachura","year":"2017","unstructured":"Stachura, M. et al. Evaluation of a point-of-care ultrasound scan list in a resource-limited emergency centre in Addis Ababa Ethiopia. Afr. J. Emerg. Med. 7, 118\u2013123 (2017).","journal-title":"Afr. J. Emerg. Med."},{"key":"945_CR32","doi-asserted-by":"publisher","first-page":"2145","DOI":"10.1111\/echo.14546","volume":"36","author":"OM Aldaas","year":"2019","unstructured":"Aldaas, O. M., Igata, S., Raisinghani, A., Kraushaar, M. & DeMaria, A. N. Accuracy of left ventricular ejection fraction determined by automated analysis of handheld echocardiograms: A comparison of experienced and novice examiners. Echocardiography 36, 2145\u20132151 (2019).","journal-title":"Echocardiography"},{"key":"945_CR33","doi-asserted-by":"publisher","first-page":"520","DOI":"10.1038\/s41586-023-05947-3","volume":"616","author":"B He","year":"2023","unstructured":"He, B. et al. Blinded, randomized trial of sonographer versus AI cardiac function assessment. Nature 616, 520\u2013524 (2023).","journal-title":"Nature"},{"key":"945_CR34","doi-asserted-by":"publisher","first-page":"698","DOI":"10.1016\/j.jacr.2010.03.004","volume":"7","author":"EA Krupinski","year":"2010","unstructured":"Krupinski, E. A., Berbaum, K. S., Caldwell, R. T., Schartz, K. M. & Kim, J. Long Radiology Workdays Reduce Detection and Accommodation Accuracy. J. Am. Coll. Radiol. 7, 698\u2013704 (2010).","journal-title":"J. Am. Coll. Radiol."},{"key":"945_CR35","doi-asserted-by":"publisher","first-page":"624","DOI":"10.1001\/jamacardio.2021.0185","volume":"6","author":"A Narang","year":"2021","unstructured":"Narang, A. et al. Utility of a Deep-Learning Algorithm to Guide Novices to Acquire Echocardiograms for Limited Diagnostic Use. JAMA Cardiol. 6, 624\u2013632 (2021).","journal-title":"JAMA Cardiol."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00945-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00945-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00945-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T08:03:39Z","timestamp":1698480219000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00945-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,28]]},"references-count":35,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["945"],"URL":"https:\/\/doi.org\/10.1038\/s41746-023-00945-1","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,28]]},"assertion":[{"value":"15 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 October 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"201"}}