{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T16:22:49Z","timestamp":1785860569365,"version":"3.56.0"},"reference-count":17,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2022,5,16]],"date-time":"2022-05-16T00:00:00Z","timestamp":1652659200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"name":"GIGA FOR HEALTH: 5G-Medizincampus"},{"name":"State of North Rhine-Westphalia"},{"name":"Ministry for Economic Affairs, Innovation, Digitalization and Energy","award":["005-2008-0055"],"award-info":[{"award-number":["005-2008-0055"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,7,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Aims<\/jats:title>\n                  <jats:p>The medical need for screening of aortic valve stenosis (AS), which leads to timely and appropriate medical intervention, is rapidly increasing because of the high prevalence of AS in elderly population. This study aimed to establish a screening method using understandable artificial intelligence (AI) to detect severe AS based on heart sounds and to package the built AI into a smartphone application.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods and results<\/jats:title>\n                  <jats:p>In this diagnostic accuracy study, we developed multiple convolutional neural networks (CNNs) using a modified stratified five-fold cross-validation to detect severe AS in electronic heart sound data recorded at three auscultation locations. Clinical validation was performed with the developed smartphone application in an independent cohort (model establishment: n\u2009=\u2009556, clinical validation: n\u2009=\u2009132). Our ensemble technique integrating the heart sounds from multiple auscultation locations increased the detection accuracy of CNN model by compensating detection errors. The established smartphone application achieved a sensitivity, specificity, accuracy, and F1 value of 97.6% (41\/42), 94.4% (85\/90), 95.7% (126\/132), and 0.93, respectively, which were higher compared with the consensus of cardiologists (81.0%, 93.3%, 89.4%, and 0.829, respectively), implying a good utility for severe AS screening. The Gradient-based Class Activation Map demonstrated that the built AIs could focus on specific heart sounds to differentiate the severity of AS.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>Our CNN model combining multiple auscultation locations and exported on smartphone application could efficiently identify severe AS based on heart sounds. The visual explanation of AI decisions for heart sounds was interpretable. These technologies may support medical training and remote consultations.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/ehjdh\/ztac029","type":"journal-article","created":{"date-parts":[[2022,5,16]],"date-time":"2022-05-16T19:58:00Z","timestamp":1652731080000},"page":"141-152","source":"Crossref","is-referenced-by-count":20,"title":["Efficient screening for severe aortic valve stenosis using understandable artificial intelligence: a prospective diagnostic accuracy study"],"prefix":"10.1093","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5302-2874","authenticated-orcid":false,"given":"Hisaki","family":"Makimoto","sequence":"first","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf , D\u00fcsseldorf , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Takeru","family":"Shiraga","sequence":"additional","affiliation":[{"name":"Mitsubishi Electric Inc. , Kamakura , Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benita","family":"Kohlmann","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf , D\u00fcsseldorf , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christofori Eleni","family":"Magnisali","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf , D\u00fcsseldorf , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shqipe","family":"Gerguri","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf , D\u00fcsseldorf , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nobuaki","family":"Motoyama","sequence":"additional","affiliation":[{"name":"Mitsubishi Electric Inc. , Kamakura , Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lukas","family":"Clasen","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf , D\u00fcsseldorf , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandru","family":"Bejinariu","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf , D\u00fcsseldorf , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kathrin","family":"Klein","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf , D\u00fcsseldorf , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Asuka","family":"Makimoto","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf , D\u00fcsseldorf , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Jung","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf , D\u00fcsseldorf , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ralf","family":"Westenfeld","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf , D\u00fcsseldorf , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4517-0068","authenticated-orcid":false,"given":"Tobias","family":"Zeus","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf , D\u00fcsseldorf , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0060-1052","authenticated-orcid":false,"given":"Malte","family":"Kelm","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf , D\u00fcsseldorf , Germany"},{"name":"CARID - Cardiovascular Research Institute D\u00fcsseldorf , D\u00fcsseldorf , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2022,5,16]]},"reference":[{"key":"2022121509085235000_ztac029-B1","first-page":"ehab395","article-title":"2021 ESC\/EACTS guidelines for the management of valvular heart disease","author":"Vahanian","year":"2021","journal-title":"Eur Heart J"},{"key":"2022121509085235000_ztac029-B2","doi-asserted-by":"crossref","first-page":"3515","DOI":"10.1093\/eurheartj\/ehw229","article-title":"Large-scale community echocardiographic screening reveals a major burden of undiagnosed valvular heart disease in older people: the OxVALVE population cohort study","volume":"37","author":"d'Arcy","year":"2016","journal-title":"Eur Heart J"},{"key":"2022121509085235000_ztac029-B3","doi-asserted-by":"crossref","first-page":"1162","DOI":"10.1161\/01.CIR.71.6.1162","article-title":"Continuous-wave Doppler echocardiographic assessment of severity of calcific aortic stenosis: a simultaneous Doppler-catheter correlative study in 100 adult patients","volume":"71","author":"Currie","year":"1985","journal-title":"Circulation"},{"key":"2022121509085235000_ztac029-B4","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1016\/0002-9149(86)90295-X","article-title":"Correlation of aortic cuspal and aortic root disease with aortic systolic ejection murmurs and with mitral anular calcium in persons older than 62 years in a long-term health care facility","volume":"58","author":"Aronow","year":"1986","journal-title":"Am J Cardiol"},{"key":"2022121509085235000_ztac029-B5","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1016\/0002-9149(71)90412-7","article-title":"Severe valvular aortic stenosis in patients over 65 years of age. A clinicopathologic study","volume":"27","author":"Roberts","year":"1971","journal-title":"Am J Cardiol"},{"key":"2022121509085235000_ztac029-B6","volume-title":"CARDIAC CLASSICS: a collection of classic works on the heart and circulation with comprehensive biographic accounts of the authors.","author":"Willus","year":"1941"},{"key":"2022121509085235000_ztac029-B7","doi-asserted-by":"crossref","first-page":"1832","DOI":"10.1136\/heartjnl-2018-313082","article-title":"Cardiac auscultation poorly predicts the presence of valvular heart disease in asymptomatic primary care patients","volume":"104","author":"Gardezi","year":"2018","journal-title":"Heart"},{"key":"2022121509085235000_ztac029-B8","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1136\/thoraxjnl-2020-214556","article-title":"Applications of artificial intelligence and machine learning in respiratory medicine","volume":"75","author":"Gonem","year":"2020","journal-title":"Thorax"},{"key":"2022121509085235000_ztac029-B9","doi-asserted-by":"crossref","first-page":"8445","DOI":"10.1038\/s41598-020-65105-x","article-title":"Performance of a convolutional neural network derived from an ECG database in recognizing myocardial infarction","volume":"10","author":"Makimoto","year":"2020","journal-title":"Sci Rep"},{"key":"2022121509085235000_ztac029-B10","doi-asserted-by":"crossref","first-page":"e019905","DOI":"10.1161\/JAHA.120.019905","article-title":"Deep learning algorithm for automated cardiac murmur detection via a digital stethoscope platform","volume":"10","author":"Chorba","year":"2021","journal-title":"J Am Heart Assoc"},{"key":"2022121509085235000_ztac029-B11","first-page":"e72","article-title":"2020 ACC\/AHA guideline for the management of patients with valvular heart disease: a report of the American College of Cardiology\/American Heart Association joint committee on clinical practice guidelines","volume":"143","author":"Otto","year":"2021","journal-title":"Circulation"},{"key":"2022121509085235000_ztac029-B12","article-title":"Grad-CAM++: improved visual explanations for deep convolutional networks","author":"Chattopadhyay","journal-title":"arXiv"},{"key":"2022121509085235000_ztac029-B13","doi-asserted-by":"crossref","first-page":"913","DOI":"10.1016\/j.amjmed.2010.04.027","article-title":"Etiology and diagnosis of systolic murmurs in adults","volume":"123","author":"McGee","year":"2010","journal-title":"Am J Med"},{"key":"2022121509085235000_ztac029-B14","doi-asserted-by":"crossref","first-page":"1671","DOI":"10.1088\/1361-6579\/aa7841","article-title":"Recognition of normal\u2013abnormal phonocardiographic signals using deep convolutional neural networks and mel-frequency spectral coefficients","volume":"38","author":"Maknickas","year":"2017","journal-title":"Physiol Meas"},{"key":"2022121509085235000_ztac029-B15","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.asoc.2019.01.019","article-title":"Applying an ensemble convolutional neural network with Savitzky\u2013Golay filter to construct a phonocardiogram prediction model","volume":"78","author":"Wu","year":"2019","journal-title":"Appl Soft Comput"},{"key":"2022121509085235000_ztac029-B16","doi-asserted-by":"crossref","first-page":"e014717","DOI":"10.1161\/JAHA.119.014717","article-title":"Deep learning-based algorithm for detecting aortic stenosis using electrocardiography","volume":"9","author":"Kwon","year":"2020","journal-title":"J Am Heart Assoc"},{"key":"2022121509085235000_ztac029-B17","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1001\/jamainternmed.2021.6594","article-title":"Clinically undetectable heart sounds in hospitalized patients undergoing echocardiography","volume":"182","author":"Jariwala","year":"2022","journal-title":"JAMA Internal Med"}],"container-title":["European Heart Journal - Digital Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/ehjdh\/advance-article-pdf\/doi\/10.1093\/ehjdh\/ztac029\/43989972\/ztac029.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ehjdh\/article-pdf\/3\/2\/141\/47906786\/ztac029.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ehjdh\/article-pdf\/3\/2\/141\/47906786\/ztac029.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,15]],"date-time":"2022-12-15T21:51:22Z","timestamp":1671141082000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/ehjdh\/article\/3\/2\/141\/6586518"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,16]]},"references-count":17,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,5,16]]},"published-print":{"date-parts":[[2022,7,6]]}},"URL":"https:\/\/doi.org\/10.1093\/ehjdh\/ztac029","relation":{},"ISSN":["2634-3916"],"issn-type":[{"value":"2634-3916","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,6,22]]},"published":{"date-parts":[[2022,5,16]]}}}