{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T15:27:41Z","timestamp":1788449261182,"version":"build-2803163510"},"reference-count":55,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,3,10]],"date-time":"2022-03-10T00:00:00Z","timestamp":1646870400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Cardiovasc. Med."],"abstract":"<jats:p>The quality and acceptance of machine learning (ML) approaches in cardiovascular data interpretation depends strongly on model design and training and the interaction with the clinical experts. We hypothesize that a software infrastructure for the training and application of ML models can support the improvement of the model training and provide relevant information for understanding the classification-relevant data features. The presented solution supports an iterative training, evaluation, and exploration of machine-learning-based multimodal data interpretation methods considering cardiac MRI data. Correction, annotation, and exploration of clinical data and interpretation of results are supported through dedicated interactive visual analytics tools. We test the presented concept with two use cases from the ACDC and EMIDEC cardiac MRI image analysis challenges. In both applications, pre-trained 2D U-Nets are used for segmentation, and classifiers are trained for diagnostic tasks using radiomics features of the segmented anatomical structures. The solution was successfully used to identify outliers in automatic segmentation and image acquisition. The targeted curation and addition of expert annotations improved the performance of the machine learning models. Clinical experts were supported in understanding specific anatomical and functional characteristics of the assigned disease classes.<\/jats:p>","DOI":"10.3389\/fcvm.2022.829512","type":"journal-article","created":{"date-parts":[[2022,3,10]],"date-time":"2022-03-10T09:30:53Z","timestamp":1646904653000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["A Collaborative Approach for the Development and Application of Machine Learning Solutions for CMR-Based Cardiac Disease Classification"],"prefix":"10.3389","volume":"9","author":[{"given":"Markus","family":"Huellebrand","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthias","family":"Ivantsits","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lennart","family":"Tautz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastian","family":"Kelle","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anja","family":"Hennemuth","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,3,10]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"e012791","DOI":"10.1161\/JAHA.119.012791","article-title":"Role of big data in cardiovascular research","volume":"8","author":"Weintraub","year":"2019","journal-title":"J Am Heart Assoc."},{"key":"B2","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1172\/JCI129203","article-title":"The application of big data to cardiovascular disease: paths to precision medicine","volume":"130","author":"Leopold","year":"2020","journal-title":"J Clin Invest."},{"key":"B3","doi-asserted-by":"publisher","first-page":"4972346","DOI":"10.1155\/2020\/4972346","article-title":"Artificial intelligence (AI) and cardiovascular diseases: an unexpected alliance","volume":"2020","author":"Romiti","year":"2020","journal-title":"Cardiol Res Pract."},{"key":"B4","doi-asserted-by":"publisher","first-page":"1015","DOI":"10.1016\/j.mayocp.2020.01.038","article-title":"Artificial intelligence in cardiology: present and future","volume":"95","author":"Lopez-Jimenez","year":"2020","journal-title":"Mayo Clin Proc."},{"key":"B5","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1038\/s41569-021-00527-2","article-title":"Applications of artificial intelligence in cardiovascular imaging","volume":"18","author":"Sermesant","year":"2021","journal-title":"Nat Rev Cardiol."},{"key":"B6","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1093\/eurheartj\/ehw188","article-title":"Machine learning for prediction of all-cause mortality in patients with suspected coronary artery disease: a 5-year multicentre prospective registry analysis","volume":"38","author":"Motwani","year":"2016","journal-title":"Eur Heart J."},{"key":"B7","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1186\/s12916-021-01940-7","article-title":"Machine learning for subtype definition and risk prediction in heart failure, acute coronary syndromes and atrial fibrillation: systematic review of validity and clinical utility","volume":"19","author":"Banerjee","year":"2021","journal-title":"BMC Med."},{"key":"B8","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1148\/radiol.2015151169","article-title":"Radiomics: Images are more than pictures, they are data","volume":"278","author":"Gillies","year":"2016","journal-title":"Radiology."},{"key":"B9","first-page":"82","volume-title":"A Radiomics Approach to Computer-Aided Diagnosis with Cardiac Cine-MRI.","author":"Cetin","year":"2018"},{"key":"B10","first-page":"101","volume-title":"Automatic Segmentation and Disease Classification Using Cardiac Cine MR Images.","author":"Wolterink","year":"2018"},{"key":"B11","first-page":"140","volume-title":"Densely Connected Fully Convolutional Network for Short-Axis Cardiac Cine MR Image Segmentation and Heart Diagnosis Using Random Forest.","author":"Khened","year":"2018"},{"key":"B12","first-page":"120","volume-title":"Automatic Cardiac Disease Assessment on cine-MRI via Time-Series Segmentation and Domain Specific Features.","author":"Isensee","year":"2018"},{"key":"B13","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1148\/radiol.2018180411","article-title":"Cardiac MRI texture analysis of T1 and T2 maps in patients with infarctlike acute myocarditis","volume":"289","author":"Baessler","year":"2018","journal-title":"Radiology."},{"key":"B14","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1016\/j.ejrad.2017.04.024","article-title":"Differentiation between acute and chronic myocardial infarction by means of texture analysis of late gadolinium enhancement and cine cardiac magnetic resonance imaging","volume":"92","author":"Larroza","year":"2017","journal-title":"Eur J Radiol."},{"key":"B15","doi-asserted-by":"publisher","first-page":"e104","DOI":"10.1158\/0008-5472.CAN-17-0339","article-title":"Computational radiomics system to decode the radiographic phenotype","volume":"77","author":"van Griethuysen","year":"2017","journal-title":"Cancer Res."},{"key":"B16","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1186\/s12968-015-0179-0","article-title":"Fractal frontiers in cardiovascular magnetic resonance: towards clinical implementation","volume":"17","author":"Captur","year":"2015","journal-title":"J Cardiovasc Magn Reson."},{"key":"B17","first-page":"20200008","article-title":"Cardiac radiomics: an interactive approach for 4D data exploration","volume-title":"Curr Direct Biomed Eng.","author":"Tautz","year":"2020"},{"key":"B18","article-title":"Exploration of interventricular septum motion in multi-cycle cardiac MRI","volume-title":"Eurographics Workshop on Visual Computing for Biology and Medicine.","author":"Tautz","year":"2017"},{"key":"B19","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1186\/s12968-020-00610-6","article-title":"Standardized image interpretation and post-processing in cardiovascular magnetic resonance - 2020 update","volume":"22","author":"Schulz-Menger","year":"2020","journal-title":"J Cardiovasc Magn Reson."},{"key":"B20","doi-asserted-by":"publisher","first-page":"25","DOI":"10.3389\/fcvm.2020.00025","article-title":"Deep learning for cardiac image segmentation: a review","volume":"7","author":"Chen","year":"2020","journal-title":"Front Cardiovasc Med."},{"key":"B21","doi-asserted-by":"publisher","first-page":"180095","DOI":"10.1148\/ryai.2019180095","article-title":"A user interface for optimizing radiologist engagement in image data curation for artificial intelligence","volume":"1","author":"Demirer","year":"2019","journal-title":"Radiol Artif Intell."},{"key":"B22","doi-asserted-by":"publisher","first-page":"1323","DOI":"10.1016\/j.mri.2012.05.001","article-title":"3D Slicer as an image computing platform for the quantitative imaging network","volume":"30","author":"Fedorov","year":"2012","journal-title":"Magn Reson Imaging."},{"key":"B23","doi-asserted-by":"crossref","DOI":"10.1117\/12.535112","article-title":"The medical imaging interaction toolkit (MITK): a toolkit facilitating the creation of interactive software by extending VTK and ITK","volume-title":"Proceedings of SPIE - The International Society for Optical Engineering","author":"Wolf","year":"2004"},{"key":"B24","article-title":"Segmentation of 3D objects using live wire","volume-title":"Proc. SPIE","author":"Falcao","year":"1997"},{"key":"B25","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1109\/38.135915","article-title":"Shape-based interpolation","volume":"12","author":"Herman","year":"1992","journal-title":"IEEE Comput Graph Appl."},{"key":"B26","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1016\/j.ejmp.2021.02.007","article-title":"Data preparation for artificial intelligence in medical imaging: a comprehensive guide to open-access platforms and tools","volume":"83","author":"Diaz","year":"2021","journal-title":"Phys Med."},{"key":"B27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2342-10-1","article-title":"Design and validation of Segment - freely available software for cardiovascular image analysis","volume":"10","author":"Heiberg","year":"2010","journal-title":"BMC Med Imaging."},{"key":"B28","doi-asserted-by":"publisher","first-page":"105277","DOI":"10.1016\/j.cmpb.2019.105277","article-title":"An extensible software platform for interdisciplinary cardiovascular imaging research","volume":"184","author":"Huellebrand","year":"2020","journal-title":"Comput Methods Prog Biomed."},{"key":"B29","doi-asserted-by":"publisher","first-page":"276","DOI":"10.1055\/a-1244-2775","article-title":"The international radiomics platform - an initiative of the german and austrian radiological societies - first application examples","volume":"193","author":"Overhoff","year":"2021","journal-title":"RoFo Fortsch Gebiet Rontgenstr Bildgebenden Verfahren."},{"key":"B30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fcvm.2020.00001","article-title":"Image-based cardiac diagnosis with machine learning: a review","volume":"7","author":"Martin-Isla","year":"2020","journal-title":"Front Cardiovasc Med."},{"key":"B31","doi-asserted-by":"publisher","first-page":"96","DOI":"10.33969\/AIS.2019.11006","article-title":"Deep learning methods for cardiovascular image","volume":"1","author":"Cao","year":"2019","journal-title":"J Artif Intell Syst."},{"key":"B32","doi-asserted-by":"publisher","first-page":"52","DOI":"10.3390\/jimaging6060052","article-title":"Explainable deep learning models in medical image analysis","volume":"6","author":"Singh","year":"2020","journal-title":"J Imaging."},{"key":"B33","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1038\/s41746-019-0216-8","article-title":"Deep learning interpretation of echocardiograms","volume":"3","author":"Ghorbani","year":"2020","journal-title":"NPJ Digit Med."},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1117\/12.2582227","article-title":"Interpretability of a deep learning model in the application of cardiac MRI segmentation with an ACDC challenge dataset","author":"Janik","year":"2021","journal-title":"Proceedings of SPIE - The International Society for Optical Engineering"},{"key":"B35","doi-asserted-by":"publisher","first-page":"232","DOI":"10.3389\/fcvm.2020.591368","article-title":"Radiomics signatures of cardiovascular risk factors in cardiac MRI: results from the UK biobank","volume":"7","author":"Cetin","year":"2020","journal-title":"Front Cardiovasc Med."},{"key":"B36","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/978-3-030-64452-9_6","article-title":"Towards customizable chart visualizations of tabular data using knowledge graphs","volume-title":"Digital Libraries at Times of Massive Societal Transition.","author":"Wiens","year":"2020"},{"key":"B37","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1007\/s12265-017-9756-y","article-title":"Precision medicine for heart failure with preserved ejection fraction: an overview","volume":"10","author":"Shah","year":"2017","journal-title":"J Cardiovasc Transl Res."},{"key":"B38","doi-asserted-by":"publisher","first-page":"1027","DOI":"10.1200\/CCI.20.00045","article-title":"Joint imaging platform for federated clinical data analytics","volume":"4","author":"Scherer","year":"2020","journal-title":"JCO Clin Cancer Inform."},{"key":"B39","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1117\/12.2549582","article-title":"QuantMed: component-based deep learning platform for translational research","volume-title":"Medical Imaging 2020: Imaging Informatics for Healthcare, Research, and Applications.","author":"Klein","year":"2020"},{"key":"B40","volume-title":"Proposed Regulatory Framework for Modifications to Artificial Intelligence\/Machine Learning (AI\/ML)-Based Software as a Medical Device (SaMD) - Discussion Paper and Request for Feedback.","year":"2020"},{"key":"B41","doi-asserted-by":"publisher","first-page":"2514","DOI":"10.1109\/TMI.2018.2837502","article-title":"Deep learning techniques for automatic MRI cardiac multi-structures segmentation and diagnosis: is the problem solved?","volume":"37","author":"Bernard","year":"2018","journal-title":"IEEE Trans Med Imaging."},{"key":"B42","volume-title":"Digital Imaging and Communications in Medicine (DICOM) Standard. Supplement 97: CT\/MR Cardiovascular Analysis Report.","author":"NEMA","year":"2015"},{"key":"B43","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1109\/MPUL.2011.942929","article-title":"Medical image analysis","volume":"2","author":"Ritter","year":"2011","journal-title":"IEEE Pulse."},{"key":"B44","first-page":"319","article-title":"Comparison of a hybrid mixture model and a cnn for the segmentation of myocardial pathologies in delayed enhancement MRI","volume-title":"Statistical Atlases and Computational Models of the Heart. M&Ms and EMIDEC Challenges - 11th International Workshop, STACOM 2020, Held in Conjunction With MICCAI 2020.","author":"H\u00fcllebrand","year":"2020"},{"key":"B45","unstructured":"IvantsitsM\n            HuellebrandM\n            KelleS\n            SchonbergSO\n            KuehneT\n            HennemuthA\n          Deep-Learning-Based Myocardial Pathology Detection.2021"},{"key":"B46","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach Learn."},{"key":"B47","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1109\/VISUAL.1995.485139","article-title":"High dimensional brushing for interactive exploration of multivariate data. In:","author":"Martin","year":"1995","journal-title":"Proceedings of the IEEE Visualization Conference"},{"key":"B48","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1007\/978-3-642-28326-0_8","article-title":"Motion analysis with quadrature filter based registration of tagged MRI sequences","volume-title":"Statistical Atlases and Computational Models of the Heart. Imaging and Modelling Challenges.","author":"Tautz","year":"2012"},{"key":"B49","doi-asserted-by":"publisher","first-page":"89","DOI":"10.3390\/data5040089","article-title":"Emidec: a database usable for the automatic evaluation of myocardial infarction from delayed-enhancement cardiac MRI","volume":"5","author":"Lalande","year":"2020","journal-title":"Data."},{"key":"B50","doi-asserted-by":"publisher","first-page":"795","DOI":"10.1148\/rg.263055047","article-title":"Delayed enhancement MR imaging: utility in myocardial assessment","volume":"26","author":"Vogel-Claussen","year":"2006","journal-title":"RadioGraphics."},{"key":"B51","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1117\/1.JMI.7.1.016502","article-title":"Integrating AI into radiology workflow: levels of research, production, and feedback maturity","volume":"7","author":"Dikici","year":"2020","journal-title":"J Med Imaging."},{"key":"B52","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1109\/VAHC.2017.8387545","article-title":"Visual analytics for radiomics: combining medical imaging with patient data for clinical research","author":"Bannach","year":"2017","journal-title":"2017 IEEE Workshop on Visual Analytics in Healthcare (VAHC)"},{"key":"B53","doi-asserted-by":"publisher","first-page":"36","DOI":"10.3389\/fninf.2016.00036","article-title":"A multi-facetted visual analytics tool for exploratory analysis of human brain and function datasets","volume":"10","author":"Angulo","year":"2016","journal-title":"Front Neuroinformatics."},{"key":"B54","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TVCG.2021.3134083","article-title":"GUCCI - guided cardiac cohort investigation of blood flow data","author":"Meuschke","year":"2021","journal-title":"IEEE Trans Visual Comput Graph."},{"key":"B55","article-title":"Dropout as a Bayesian approximation: representing model uncertainty in deep learning","volume-title":"Proceedings of the 33rd International Conference on Machine Learning.","author":"Gal","year":"2016"}],"container-title":["Frontiers in Cardiovascular Medicine"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcvm.2022.829512\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,3,10]],"date-time":"2022-03-10T09:31:14Z","timestamp":1646904674000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcvm.2022.829512\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,10]]},"references-count":55,"alternative-id":["10.3389\/fcvm.2022.829512"],"URL":"https:\/\/doi.org\/10.3389\/fcvm.2022.829512","relation":{},"ISSN":["2297-055X"],"issn-type":[{"value":"2297-055X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,10]]},"article-number":"829512"}}