{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T03:17:41Z","timestamp":1782962261039,"version":"3.54.5"},"reference-count":18,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2023,12,14]],"date-time":"2023-12-14T00:00:00Z","timestamp":1702512000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"State of North Rhine-Westphalia by the Ministry for Economic Affairs, Innovation, Digitalization and Energy","award":["005-2008-0055"],"award-info":[{"award-number":["005-2008-0055"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Simple sensor-based procedures, including auscultation and electrocardiography (ECG), can facilitate early diagnosis of valvular diseases, resulting in timely treatment. This study assessed the impact of combining these sensor-based procedures with machine learning on diagnosing valvular abnormalities and ventricular dysfunction. Data from auscultation at three distinct locations and 12-lead ECGs were collected from 1052 patients undergoing echocardiography. An independent cohort of 103 patients was used for clinical validation. These patients were screened for severe aortic stenosis (AS), severe mitral regurgitation (MR), and left ventricular dysfunction (LVD) with ejection fractions \u2264 40%. Optimal neural networks were identified by a fourfold cross-validation training process using heart sounds and various ECG leads, and their outputs were combined using a stacking technique. This composite sensor model had high diagnostic efficiency (area under the receiver operating characteristic curve (AUC) values: AS, 0.93; MR, 0.80; LVD, 0.75). Notably, the contribution of individual sensors to disease detection was found to be disease-specific, underscoring the synergistic potential of the sensor fusion approach. Thus, machine learning models that integrate auscultation and ECG can efficiently detect conditions typically diagnosed via imaging. Moreover, this study highlights the potential of multimodal artificial intelligence applications.<\/jats:p>","DOI":"10.3390\/s23249834","type":"journal-article","created":{"date-parts":[[2023,12,18]],"date-time":"2023-12-18T11:28:07Z","timestamp":1702898887000},"page":"9834","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Improving Valvular Pathologies and Ventricular Dysfunction Diagnostic Efficiency Using Combined Auscultation and Electrocardiography Data: A Multimodal AI Approach"],"prefix":"10.3390","volume":"23","author":[{"given":"Takeru","family":"Shiraga","sequence":"first","affiliation":[{"name":"Mitsubishi Electric Inc., Kamakura 247-0056, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hisaki","family":"Makimoto","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf, 40225 D\u00fcsseldorf, Germany"},{"name":"Data Science Center\/Cardiovascular Center, Jichi Medical University, Shimotsuke-City 329-0498, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benita","family":"Kohlmann","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf, 40225 D\u00fcsseldorf, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christofori-Eleni","family":"Magnisali","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf, 40225 D\u00fcsseldorf, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yoshie","family":"Imai","sequence":"additional","affiliation":[{"name":"Mitsubishi Electric Inc., Kamakura 247-0056, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yusuke","family":"Itani","sequence":"additional","affiliation":[{"name":"Mitsubishi Electric Inc., Kamakura 247-0056, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Asuka","family":"Makimoto","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf, 40225 D\u00fcsseldorf, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fabian","family":"Sch\u00f6lzel","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf, 40225 D\u00fcsseldorf, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4820-3304","authenticated-orcid":false,"given":"Alexandru","family":"Bejinariu","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf, 40225 D\u00fcsseldorf, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Malte","family":"Kelm","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf, 40225 D\u00fcsseldorf, Germany"},{"name":"CARID\u2014Cardiovascular Research Institute D\u00fcsseldorf, 40225 D\u00fcsseldorf, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Obaida","family":"Rana","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Pulmonology and Vascular Medicine, Medical Faculty, Heinrich-Heine-University D\u00fcsseldorf, 40225 D\u00fcsseldorf, Germany"},{"name":"CARID\u2014Cardiovascular Research Institute D\u00fcsseldorf, 40225 D\u00fcsseldorf, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,12,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"4901","DOI":"10.1093\/eurheartj\/ehab670","article-title":"Corrigendum to: 2021 ESC Guidelines for the diagnosis and treatment of acute and chronic heart failure: Developed by the Task Force for the diagnosis and treatment of acute and chronic heart failure of the European Society of Cardiology (ESC) With the special contribution of the Heart Failure Association (HFA) of the ESC","volume":"42","author":"McDonagh","year":"2021","journal-title":"Eur. Heart J."},{"key":"ref_2","first-page":"e895","article-title":"2022 AHA\/ACC\/HFSA Guideline for the Management of Heart Failure: A Report of the American College of Cardiology\/American Heart Association Joint Committee on Clinical Practice Guidelines","volume":"145","author":"Heidenreich","year":"2022","journal-title":"Circulation"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1093\/jbi\/wbz079","article-title":"Reducing Barriers to Breast Imaging in Patients with Mobility Limitations","volume":"2","author":"Bouhmam","year":"2020","journal-title":"J. Breast Imaging"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1024","DOI":"10.1001\/jama.2018.1150","article-title":"Health Care Spending in the United States and Other High-Income Countries","volume":"319","author":"Papanicolas","year":"2018","journal-title":"JAMA"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"e068121","DOI":"10.1136\/bmjopen-2022-068121","article-title":"Diagnostic accuracy of heart auscultation for detecting valve disease: A systematic review","volume":"13","author":"Davidsen","year":"2023","journal-title":"BMJ Open"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1038\/s41569-020-00503-2","article-title":"Artificial intelligence-enhanced electrocardiography in cardiovascular disease management","volume":"18","author":"Siontis","year":"2021","journal-title":"Nat. Rev. Cardiol."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Makimoto, H., and Kohro, T. (Hypertens. Res., 2023). Adopting artificial intelligence in cardiovascular medicine: A scoping review, Hypertens. Res., Online ahead of print.","DOI":"10.1038\/s41440-023-01469-7"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Pavlyshenko, B. (2018, January 21\u201325). Using Stacking Approaches for Machine Learning Models. Proceedings of the 2018 IEEE Second International Conference on Data Stream Mining & Processing (DSMP), Lviv, Ukraine.","DOI":"10.1109\/DSMP.2018.8478522"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1093\/ehjdh\/ztac029","article-title":"Efficient screening for severe aortic valve stenosis using understandable artificial intelligence: A prospective diagnostic accuracy study","volume":"3","author":"Makimoto","year":"2022","journal-title":"Eur. Heart J. Digit. Health"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1093\/eurheartj\/ehab395","article-title":"2021 ESC\/EACTS Guidelines for the management of valvular heart disease","volume":"43","author":"Vahanian","year":"2022","journal-title":"Eur. Heart J."},{"key":"ref_11","first-page":"e72","article-title":"2020 ACC\/AHA Guideline for the management of patients with valvular heart disease: A report of the American College of Cardiology\/American Heart Association Joint Committee on Clinical Practice Guidelines","volume":"143","author":"Otto","year":"2021","journal-title":"Circulation"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"8445","DOI":"10.1038\/s41598-020-65105-x","article-title":"Performance of a convolutional neural network derived from an ECG database in recognizing myocardial infarction","volume":"10","author":"Makimoto","year":"2020","journal-title":"Sci. Rep."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2885","DOI":"10.1093\/eurheartj\/ehab153","article-title":"Electrocardiogram screening for aortic valve stenosis using artificial intelligence","volume":"42","author":"Attia","year":"2021","journal-title":"Eur. Heart J."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"e019905","DOI":"10.1161\/JAHA.120.019905","article-title":"Deep Learning Algorithm for Automated Cardiac Murmur Detection via a Digital Stethoscope Platform","volume":"10","author":"Chorba","year":"2021","journal-title":"J. Am. Heart Assoc."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1016\/j.jacc.2022.05.029","article-title":"Deep learning electrocardiographic analysis for detection of left-sided valvular heart disease","volume":"80","author":"Elias","year":"2022","journal-title":"J. Am. Coll. Cardiol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1093\/ehjdh\/ztac030","article-title":"Automated detection of low ejection fraction from a one-lead electrocardiogram: Application of an AI algorithm to an electrocardiogram-enabled Digital Stethoscope","volume":"3","author":"Attia","year":"2022","journal-title":"Eur. Heart J. Digit. Health"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"e117","DOI":"10.1016\/S2589-7500(21)00256-9","article-title":"Point-of-care screening for heart failure with reduced ejection fraction using artificial intelligence during ECG-enabled stethoscope examination in London, UK: A prospective, observational, multicentre study","volume":"4","author":"Bachtiger","year":"2022","journal-title":"Lancet Digit. Health"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Linardatos, P., Papastefanopoulos, V., and Kotsiantis, S. (2020). Explainable AI: A review of machine learning interpretability methods. Entropy, 23.","DOI":"10.3390\/e23010018"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/24\/9834\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:39:02Z","timestamp":1760132342000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/24\/9834"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,14]]},"references-count":18,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["s23249834"],"URL":"https:\/\/doi.org\/10.3390\/s23249834","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,14]]}}}