{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T03:29:43Z","timestamp":1776396583639,"version":"3.51.2"},"reference-count":43,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2022,5,23]],"date-time":"2022-05-23T00:00:00Z","timestamp":1653264000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Paul and Ruby Tsai Family Hypertrophic Cardiomyopathy Research Fund","award":["K01HL124045"],"award-info":[{"award-number":["K01HL124045"]}]},{"name":"the National Heart, Lung, and Blood Institute of National Institutes of Health","award":["K01HL124045"],"award-info":[{"award-number":["K01HL124045"]}]},{"name":"Mayo Clinic K2R award","award":["K01HL124045"],"award-info":[{"award-number":["K01HL124045"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>The analysis and interpretation of cardiac magnetic resonance (CMR) images are often time-consuming. The automated segmentation of cardiac structures can reduce the time required for image analysis. Spatial similarities between different CMR image types were leveraged to jointly segment multiple sequences using a segmentation model termed a multi-image type UNet (MI-UNet). This model was developed from 72 exams (46% female, mean age 63 \u00b1 11 years) performed on patients with hypertrophic cardiomyopathy. The MI-UNet for steady-state free precession (SSFP) images achieved a superior Dice similarity coefficient (DSC) of 0.92 \u00b1 0.06 compared to 0.87 \u00b1 0.08 for a single-image type UNet (p &lt; 0.001). The MI-UNet for late gadolinium enhancement (LGE) images also had a superior DSC of 0.86 \u00b1 0.11 compared to 0.78 \u00b1 0.11 for a single-image type UNet (p = 0.001). The difference across image types was most evident for the left ventricular myocardium in SSFP images and for both the left ventricular cavity and the left ventricular myocardium in LGE images. For the right ventricle, there were no differences in DCS when comparing the MI-UNet with single-image type UNets. The joint segmentation of multiple image types increases segmentation accuracy for CMR images of the left ventricle compared to single-image models. In clinical practice, the MI-UNet model may expedite the analysis and interpretation of CMR images of multiple types.<\/jats:p>","DOI":"10.3390\/jimaging8050149","type":"journal-article","created":{"date-parts":[[2022,5,23]],"date-time":"2022-05-23T22:57:22Z","timestamp":1653346642000},"page":"149","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Deep Neural Network for Cardiac Magnetic Resonance Image Segmentation"],"prefix":"10.3390","volume":"8","author":[{"given":"David","family":"Chen","sequence":"first","affiliation":[{"name":"Department of Cardiovascular Surgery, Cleveland Clinic, Cleveland, OH 44195, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4289-7288","authenticated-orcid":false,"given":"Huzefa","family":"Bhopalwala","sequence":"additional","affiliation":[{"name":"Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN 55902, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1637-3146","authenticated-orcid":false,"given":"Nakeya","family":"Dewaswala","sequence":"additional","affiliation":[{"name":"Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN 55902, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3251-5415","authenticated-orcid":false,"given":"Shivaram P.","family":"Arunachalam","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, Mayo Clinic, Rochester, MN 55902, USA"},{"name":"Department of Radiology, Mayo Clinic, Rochester, MN 55902, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7391-774X","authenticated-orcid":false,"given":"Moein","family":"Enayati","sequence":"additional","affiliation":[{"name":"Center for the Science of Health Care Delivery, Mayo Clinic, Rochester, MN 55902, USA"}]},{"given":"Nasibeh Zanjirani","family":"Farahani","sequence":"additional","affiliation":[{"name":"Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN 55902, USA"}]},{"given":"Kalyan","family":"Pasupathy","sequence":"additional","affiliation":[{"name":"Biomedical and Health Information Sciences Department, University of Illinois, Chicago, IL 60612, USA"}]},{"given":"Sravani","family":"Lokineni","sequence":"additional","affiliation":[{"name":"Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN 55902, USA"}]},{"given":"J. Martijn","family":"Bos","sequence":"additional","affiliation":[{"name":"Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN 55902, USA"}]},{"given":"Peter A.","family":"Noseworthy","sequence":"additional","affiliation":[{"name":"Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN 55902, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7081-4286","authenticated-orcid":false,"given":"Reza","family":"Arsanjani","sequence":"additional","affiliation":[{"name":"Department of Cardiovascular Medicine, Mayo Clinic, Phoenix, AZ 85054, USA"}]},{"given":"Bradley J.","family":"Erickson","sequence":"additional","affiliation":[{"name":"Department of Radiology, Mayo Clinic, Rochester, MN 55902, USA"}]},{"given":"Jeffrey B.","family":"Geske","sequence":"additional","affiliation":[{"name":"Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN 55902, USA"}]},{"given":"Michael J.","family":"Ackerman","sequence":"additional","affiliation":[{"name":"Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN 55902, USA"},{"name":"Department of Pediatric and Adolescent Medicine, Mayo Clinic, Rochester, MN 55902, USA"},{"name":"Department of Molecular Pharmacology & Experimental Therapeutics, Mayo Clinic, Rochester, MN 55902, USA"}]},{"given":"Philip A.","family":"Araoz","sequence":"additional","affiliation":[{"name":"Department of Radiology, Mayo Clinic, Rochester, MN 55902, USA"}]},{"given":"Adelaide M.","family":"Arruda-Olson","sequence":"additional","affiliation":[{"name":"Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN 55902, USA"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1429","DOI":"10.1136\/heartjnl-2015-309077","article-title":"Cardiac MRI evaluation of myocardial disease","volume":"102","author":"Captur","year":"2016","journal-title":"Heart"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Bogaert, J.D.S., Taylor, A.M., and Muthurangu, V. (2012). Clinical Cardiac MRI, Springer.","DOI":"10.1007\/978-3-642-23035-6"},{"key":"ref_3","first-page":"22","article-title":"Cardiac magnetic resonance imaging in the evaluation of patients with hypertrophic cardiomyopathy","volume":"2018","author":"Brenes","year":"2018","journal-title":"Glob. Cardiol. Sci. Pract."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"723","DOI":"10.1016\/j.acra.2012.02.011","article-title":"Automatic left ventricle segmentation in cardiac MRI using topological stable-state thresholding and region restricted dynamic programming","volume":"19","author":"Liu","year":"2012","journal-title":"Acad. Radiol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1109\/TMI.2002.808355","article-title":"A shape-based approach to the segmentation of medical imagery using level sets","volume":"22","author":"Tsai","year":"2003","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1027","DOI":"10.1016\/j.cviu.2013.01.014","article-title":"Graph cut segmentation with a statistical shape model in cardiac MRI","volume":"117","author":"Grosgeorge","year":"2013","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_7","unstructured":"Zotti, C., Luo, Z., Lalande, A., Humbert, O., and Jodoin, P.-M. (2017). Novel Deep Convolution Neural Network Applied to MRI Cardiac Segmentation. arXiv."},{"key":"ref_8","unstructured":"Reinhardt, J.M., and Pluim, J. (2008, January 16\u201321). Robust registration between cardiac MRI images and atlas for segmentation propagation. Proceedings of the Medical Imaging 2008: Image Processing, San Diego, CA, USA."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1146\/annurev-bioeng-071516-044442","article-title":"Deep Learning in Medical Image Analysis","volume":"19","author":"Shen","year":"2017","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.media.2016.01.005","article-title":"A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI","volume":"30","author":"Avendi","year":"2016","journal-title":"Med. Image Anal."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2439","DOI":"10.1002\/mrm.26631","article-title":"Automatic segmentation of the right ventricle from cardiac MRI using a learning-based approach","volume":"78","author":"Avendi","year":"2017","journal-title":"Magn. Reson. Med."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1109\/TMI.2017.2743464","article-title":"Anatomically Constrained Neural Networks (ACNNs): Application to Cardiac Image Enhancement and Segmentation","volume":"37","author":"Oktay","year":"2018","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Liu, Y., Wang, W., Wang, K., Ye, C., and Luo, G. (2019). An Automatic Cardiac Segmentation Framework based on Multi-sequence MR Image. arXiv.","DOI":"10.1007\/978-3-030-39074-7_23"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"106323","DOI":"10.1016\/j.cmpb.2021.106323","article-title":"Automatic segmentation of cardiac magnetic resonance images based on multi-input fusion network","volume":"209","author":"Shi","year":"2021","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, C., Chen, M., Zhang, J., and Liu, H. (2021). Cardiac MRI segmentation with focal loss constrained deep residual networks. Phys. Med. Biol., 66.","DOI":"10.1088\/1361-6560\/ac0bd3"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"102029","DOI":"10.1016\/j.media.2021.102029","article-title":"Deep neural network ensemble for on-the-fly quality control-driven segmentation of cardiac MRI T1 mapping","volume":"71","author":"Hann","year":"2021","journal-title":"Med. Image Anal."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhang, H., Zhang, W., Shen, W., Li, N., Chen, Y., Li, S., Chen, B., Guo, S., and Wang, Y. (2021). Automatic segmentation of the cardiac MR images based on nested fully convolutional dense network with dilated convolution. Biomed. Signal Processing Control., 68.","DOI":"10.1016\/j.bspc.2021.102684"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"484","DOI":"10.1161\/CIRCULATIONAHA.113.007094","article-title":"Prognostic value of quantitative contrast-enhanced cardiovascular magnetic resonance for the evaluation of sudden death risk in patients with hypertrophic cardiomyopathy","volume":"130","author":"Chan","year":"2014","journal-title":"Circulation"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Maron, M.S., Rowin, E.J., Wessler, B.S., Mooney, P.J., Fatima, A., Patel, P., Koethe, B.C., Romashko, M., Link, M.S., and Maron, B.J. (2019). Enhanced American College of Cardiology\/American Heart Association Strategy for Prevention of Sudden Cardiac Death in High-Risk Patients With Hypertrophic Cardiomyopathy. JAMA Cardiol.","DOI":"10.1001\/jamacardio.2019.1391"},{"key":"ref_20","first-page":"e533","article-title":"AHA\/ACC Guideline for the Diagnosis and Treatment of Patients With Hypertrophic Cardiomyopathy: Executive Summary: A Report of the American College of Cardiology\/American Heart Association Joint Committee on Clinical Practice Guidelines","volume":"142","author":"Ommen","year":"2020","journal-title":"Circulation"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"571","DOI":"10.1007\/s10278-019-00232-0","article-title":"RIL-Contour: A Medical Imaging Dataset Annotation Tool for and with Deep Learning","volume":"32","author":"Philbrick","year":"2019","journal-title":"J. Digit. Imaging"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3493","DOI":"10.1118\/1.3611983","article-title":"SU-E-T-33: Pydicom: An Open Source DICOM Library","volume":"38","author":"Mason","year":"2011","journal-title":"Med. Phys."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_24","unstructured":"Sorensen, T.J. (1948). A Method of Establishing Groups of Equal Amplitude in Plant Sociology Based on Similarity of Species Content and Its Application to Analyses of the Vegetation on Danish Commons, I kommission hos E. Munksgaard."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/0167-2789(92)90242-F","article-title":"Nonlinear total variation based noise removal algorithms","volume":"60","author":"Rudin","year":"1992","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_26","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_27","unstructured":"Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., Devito, Z., Lin, Z., Desmaison, A., Antiga, L., and Lerer, A. (2017, January 4\u20139). Automatic differentiation in PyTorch. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1016\/S1076-6332(03)00671-8","article-title":"Statistical validation of image segmentation quality based on a spatial overlap index","volume":"11","author":"Zou","year":"2004","journal-title":"Acad. Radiol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"795","DOI":"10.1148\/rg.263055047","article-title":"Delayed enhancement MR imaging: Utility in myocardial assessment","volume":"26","author":"Rochitte","year":"2006","journal-title":"Radiographics"},{"key":"ref_30","unstructured":"Ruder, S. (2017). An overview of multi-task learning in deep neural networks. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1007\/s10554-008-9300-x","article-title":"Delayed enhancement cardiac magnetic resonance imaging reveals typical patterns of myocardial injury in patients with various forms of non-ischemic heart disease","volume":"24","author":"Bohl","year":"2008","journal-title":"Int. J. Cardiovasc. Imaging"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1758","DOI":"10.1016\/j.jcmg.2017.09.021","article-title":"Dark-blood delayed enhancement cardiac magnetic resonance of myocardial infarction","volume":"11","author":"Kim","year":"2018","journal-title":"JACC Cardiovasc. Imaging"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Chen, C., Qin, C., Qiu, H., Tarroni, G., Duan, J., Bai, W., and Rueckert, D. (2020). Deep Learning for Cardiac Image Segmentation: A Review. Front. Cardiovasc. Med., 7.","DOI":"10.3389\/fcvm.2020.00025"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Baumgartner, C., Koch, L., Pollefeys, M., and Konukoglu, E. (2017). An exploration of 2D and 3D deep learning techniques for cardiac MR image segmentation. arXiv e-prints. 2017. Cornell Univ. (arXiv), 1.","DOI":"10.1007\/978-3-319-75541-0_12"},{"key":"ref_35","first-page":"04253","article-title":"Motion-Attentive Transition for Zero-Shot Video Object Segmentation","volume":"2003","author":"Zhou","year":"2020","journal-title":"arXiv"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Wang, W., Zhou, T., Yu, F., Dai, J., Konukoglu, E., and Van Gool, L. (2021). Exploring Cross-Image Pixel Contrast for Semantic Segmentation. arXiv.","DOI":"10.1109\/ICCV48922.2021.00721"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1109\/TIP.2021.3132834","article-title":"Group-Wise Learning for Weakly Supervised Semantic Segmentation","volume":"31","author":"Zhou","year":"2022","journal-title":"IEEE Trans. Image Processing"},{"key":"ref_38","unstructured":"Badrinarayanan Vijay, K.A., and Cipolla, R. (2015). SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation. arXiv."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"6111","DOI":"10.1007\/s00521-019-04097-w","article-title":"A transfer convolutional neural network for fault diagnosis based on ResNet-50","volume":"32","author":"Long","year":"2020","journal-title":"Neural. Comput. Applic."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2333","DOI":"10.1016\/j.jacc.2019.08.1057","article-title":"Distinct subgroups in hypertrophic cardiomyopathy in the NHLBI HCM registry","volume":"74","author":"Neubauer","year":"2019","journal-title":"J. Am. Coll. Cardiol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"P351","DOI":"10.1186\/1532-429X-18-S1-P351","article-title":"Fully automatic segmentation of heart chambers in cardiac MRI using deep learning","volume":"18","author":"Avendi","year":"2016","journal-title":"J. Cardiovasc. Magn. Reson."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1136\/hrt.55.6.575","article-title":"Quantitative analysis of myocardial fibrosis in normals, hypertensive hearts, and hypertrophic cardiomyopathy","volume":"55","author":"Tanaka","year":"1986","journal-title":"Heart"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1186\/1532-429X-12-21","article-title":"Quantitative analysis of late gadolinium enhancement in hypertrophic cardiomyopathy","volume":"12","author":"Aquaro","year":"2010","journal-title":"J. Cardiovasc. Magn. Reson."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/8\/5\/149\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:16:54Z","timestamp":1760138214000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/8\/5\/149"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,23]]},"references-count":43,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,5]]}},"alternative-id":["jimaging8050149"],"URL":"https:\/\/doi.org\/10.3390\/jimaging8050149","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,23]]}}}