{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T17:40:18Z","timestamp":1767980418957,"version":"3.49.0"},"reference-count":50,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2024,2,7]],"date-time":"2024-02-07T00:00:00Z","timestamp":1707264000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"PRECISE"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The multimodal and multidomain registration of medical images have gained increasing recognition in clinical practice as a powerful tool for fusing and leveraging useful information from different imaging techniques and in different medical fields such as cardiology and orthopedics. Image registration could be a challenging process, and it strongly depends on the correct tuning of registration parameters. In this paper, the robustness and accuracy of a landmarks-based approach have been presented for five cardiac multimodal image datasets. The study is based on 3D Slicer software and it is focused on the registration of a computed tomography (CT) and 3D ultrasound time-series of post-operative mitral valve repair. The accuracy of the method, as a function of the number of landmarks used, was performed by analysing root mean square error (RMSE) and fiducial registration error (FRE) metrics. The validation of the number of landmarks resulted in an optimal number of 10 landmarks. The mean RMSE and FRE values were 5.26 \u00b1 3.17 and 2.98 \u00b1 1.68 mm, respectively, showing comparable performances with respect to the literature. The developed registration process was also tested on a CT orthopaedic dataset to assess the possibility of reconstructing the damaged jaw portion for a pre-operative planning setting. Overall, the proposed work shows how 3D Slicer and registration by landmarks can provide a useful environment for multimodal\/unimodal registration.<\/jats:p>","DOI":"10.3390\/s24041072","type":"journal-article","created":{"date-parts":[[2024,2,7]],"date-time":"2024-02-07T03:47:09Z","timestamp":1707277629000},"page":"1072","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Three-Dimensional Multi-Modality Registration for Orthopaedics and Cardiovascular Settings: State-of-the-Art and Clinical Applications"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-2874-0218","authenticated-orcid":false,"given":"Simone","family":"Garzia","sequence":"first","affiliation":[{"name":"BioCardioLab, Bioengineering Unit, Fondazione Toscana G. Monasterio, 54100 Massa, Italy"},{"name":"Department of Information Engineering, University of Pisa, 56122 Pisa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4938-9569","authenticated-orcid":false,"given":"Katia","family":"Capellini","sequence":"additional","affiliation":[{"name":"BioCardioLab, Bioengineering Unit, Fondazione Toscana G. Monasterio, 54100 Massa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0122-5175","authenticated-orcid":false,"given":"Emanuele","family":"Gasparotti","sequence":"additional","affiliation":[{"name":"BioCardioLab, Bioengineering Unit, Fondazione Toscana G. Monasterio, 54100 Massa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Domenico","family":"Pizzuto","sequence":"additional","affiliation":[{"name":"Department of Information Engineering, University of Pisa, 56122 Pisa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giuseppe","family":"Spinelli","sequence":"additional","affiliation":[{"name":"Maxillofacial Surgery Department, Azienda Ospedaliero-Universitaria Careggi, 50134 Firenze, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5244-0556","authenticated-orcid":false,"given":"Sergio","family":"Berti","sequence":"additional","affiliation":[{"name":"Diagnostic and Interventional Cardiology Department, Fondazione Toscana G. Monasterio, 54100 Massa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6955-9572","authenticated-orcid":false,"given":"Vincenzo","family":"Positano","sequence":"additional","affiliation":[{"name":"BioCardioLab, Bioengineering Unit, Fondazione Toscana G. Monasterio, 54100 Massa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7832-0122","authenticated-orcid":false,"given":"Simona","family":"Celi","sequence":"additional","affiliation":[{"name":"BioCardioLab, Bioengineering Unit, Fondazione Toscana G. Monasterio, 54100 Massa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,2,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3285","DOI":"10.2174\/1381612823666170704171702","article-title":"Multimodality imaging for interventional cardiology","volume":"23","author":"Celi","year":"2017","journal-title":"Curr. Pharm. Des."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1504\/IJBET.2012.046086","article-title":"Rigid and non-rigid medical image registration methods","volume":"8","author":"Dhawan","year":"2012","journal-title":"Int. J. Biomed. Eng. Technol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.jmir.2018.06.001","article-title":"Challenges and solutions in multimodal medical image subregion detection and registration","volume":"50","author":"Alam","year":"2019","journal-title":"J. Med. Imaging Radiat. Sci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"986","DOI":"10.1109\/TMI.2003.815867","article-title":"Mutual-information-based registration of medical images: A survey","volume":"22","author":"Pluim","year":"2003","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_5","first-page":"962","article-title":"Image similarity metrics in image registration","volume":"7623","author":"Melbourne","year":"2010","journal-title":"Proc. SPIE"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1011","DOI":"10.1109\/TMI.2002.804441","article-title":"A Review of Cardiac Image Registration Methods","volume":"21","author":"Clarysse","year":"2002","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"8279342","DOI":"10.1155\/2020\/8279342","article-title":"A review of multimodal medical image fusion techniques","volume":"2020","author":"Huang","year":"2020","journal-title":"Comput. Math. Methods Med."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Azam, M.A., Khan, K.B., Salahuddin, S., Rehman, E., Khan, S.A., Khan, M.A., Kadry, S., and Gandomi, A.H. (2022). A review on multimodal medical image fusion: Compendious analysis of medical modalities, multimodal databases, fusion techniques and quality metrics. Comput. Biol. Med., 144.","DOI":"10.1016\/j.compbiomed.2022.105253"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1007\/s00392-018-1284-5","article-title":"Current and future aspects of multimodal and fusion imaging in structural and coronary heart disease","volume":"107","author":"Veulemans","year":"2018","journal-title":"Clin. Res. Cardiol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1080\/24748706.2020.1853293","article-title":"The Revolution in Heart Valve Therapy: Focus on Novel Imaging Techniques in Intra-Procedural Guidance","volume":"5","author":"Hell","year":"2021","journal-title":"Struct. Heart"},{"key":"ref_11","first-page":"124","article-title":"Transcatheter aortic valve replacement: Role of multimodality imaging in common and complex clinical scenarios","volume":"13","author":"Bax","year":"2020","journal-title":"Cardiovasc. Imaging"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Khalil, A., Faisal, A., Ng, S.C., Liew, Y.M., and Lai, K.W. (2017, January 13\u201317). Mitral valve rigid registration using 2D echocardiography and cardiac computed tomography. Proceedings of the 2017 International Conference on Applied System Innovation (ICASI), Sapporo, Japan.","DOI":"10.1109\/ICASI.2017.7988504"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/s00259-010-1586-y","article-title":"Hybrid cardiac imaging: SPECT\/CT and PET\/CT. A joint position statement by the European Association of Nuclear Medicine (EANM), the European Society of Cardiac Radiology (ESCR) and the European Council of Nuclear Cardiology (ECNC)","volume":"38","author":"Flotats","year":"2011","journal-title":"Eur. J. Nucl. Med. Mol. Imaging"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1161\/CIRCIMAGING.109.885152","article-title":"Comparison of aortic root dimensions and geometries before and after transcatheter aortic valve implantation by 2-and 3-dimensional transesophageal echocardiography and multislice computed tomography","volume":"3","author":"Ng","year":"2010","journal-title":"Circ. Cardiovasc. Imaging"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"037001","DOI":"10.1117\/1.JMI.4.3.037001","article-title":"Multimodality registration of two-dimensional echocardiography and cardiac CT for mitral valve diagnosis and surgical planning","volume":"4","author":"Khalil","year":"2017","journal-title":"J. Med. Imaging"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2152","DOI":"10.1109\/TMI.2013.2275233","article-title":"Intra-operative 2-D ultrasound and dynamic 3-D aortic model registration for magnetic navigation of transcatheter aortic valve implantation","volume":"32","author":"Luo","year":"2013","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"106767","DOI":"10.1016\/j.compeleceng.2020.106767","article-title":"Medical image registration using deep neural networks: A comprehensive review","volume":"87","author":"Boveiri","year":"2020","journal-title":"Comput. Electr. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1047215","DOI":"10.3389\/fonc.2022.1047215","article-title":"A review of deep learning-based deformable medical image registration","volume":"12","author":"Zou","year":"2022","journal-title":"Front. Oncol."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Hering, A., Kuckertz, S., Heldmann, S., and Heinrich, M.P. (2019, January 17\u201319). Enhancing label-driven deep deformable image registration with local distance metrics for state-of-the-art cardiac motion tracking. Proceedings of the Bildverarbeitung f\u00fcr die Medizin 2019: Algorithmen\u2013Systeme\u2013Anwendungen. Proceedings des Workshops vom, L\u00fcbeck, Germany.","DOI":"10.1007\/978-3-658-25326-4_69"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Chen, X., Xia, Y., Ravikumar, N., and Frangi, A.F. (October, January 27). A deep discontinuity-preserving image registration network. Proceedings of the Medical Image Computing and Computer Assisted Intervention\u2013MICCAI 2021: 24th International Conference, Strasbourg, France. Proceedings, Part IV 24.","DOI":"10.1007\/978-3-030-87202-1_5"},{"key":"ref_21","unstructured":"Mahapatra, D., Sedai, S., and Garnavi, R. (2018). Elastic registration of medical images with gans. arXiv, 7."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"4942121","DOI":"10.1155\/2020\/4942121","article-title":"CT-TEE image registration for surgical navigation of congenital heart disease based on a cycle adversarial network","volume":"2020","author":"Lu","year":"2020","journal-title":"Comput. Math. Methods Med."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1007\/s11548-021-02323-2","article-title":"Multimodal 3D ultrasound and CT in image-guided spinal surgery: Public database and new registration algorithms","volume":"16","author":"Masoumi","year":"2021","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e2316","DOI":"10.1002\/rcs.2316","article-title":"Multimodality-based knee joint modelling method with bone and cartilage structures for total knee arthroplasty","volume":"17","author":"Chen","year":"2021","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1301.e1","DOI":"10.1016\/j.joms.2017.02.013","article-title":"Three-Dimensional Image Fusion of 18F-Fluorodeoxyglucose\u2013Positron Emission Tomography\/Computed Tomography and Contrast-Enhanced Computed Tomography for Computer-Assisted Planning of Maxillectomy of Recurrent Maxillary Squamous Cell Carcinoma and Defect Reconstruction","volume":"75","author":"Yu","year":"2017","journal-title":"J. Oral Maxillofac. Surg."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1016\/j.ajodo.2021.02.013","article-title":"Machine learning and orthodontics, current trends and the future opportunities: A scoping review","volume":"160","author":"Nadimi","year":"2021","journal-title":"Am. J. Orthod. Dentofac. Orthop."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"716007","DOI":"10.3389\/frobt.2021.716007","article-title":"The impact of machine learning on 2d\/3d registration for image-guided interventions: A systematic review and perspective","volume":"8","author":"Unberath","year":"2021","journal-title":"Front. Robot. AI"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1372","DOI":"10.1177\/00220345221106676","article-title":"Deep Learning\u2013Based Prediction of the 3D Postorthodontic Facial Changes","volume":"101","author":"Park","year":"2022","journal-title":"J. Dent. Res."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"881","DOI":"10.1016\/j.eng.2020.03.016","article-title":"Multi-view point-based registration for native knee kinematics measurement with feature transfer learning","volume":"7","author":"Wang","year":"2021","journal-title":"Engineering"},{"key":"ref_30","first-page":"540","article-title":"3D Slicer as an image computing platform for the Quantitative Imaging Network","volume":"34","author":"Fedorov","year":"2021","journal-title":"J. Digit. Imaging"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"114941","DOI":"10.1016\/j.cma.2022.114941","article-title":"Image-based modelling and numerical simulations of the Cardioband\u00ae procedure for mitral valve regurgitation repair","volume":"394","author":"Gasparotti","year":"2022","journal-title":"Comput. Methods Appl. Mech. Eng."},{"key":"ref_32","unstructured":"Van Rossum, G., and Drake, F.L. (1995). Python Reference Manual, Centrum voor Wiskunde en Informatica."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.1016\/j.amjcard.2018.06.036","article-title":"Comprehensive Assessment of Mitral Valve Geometry and Cardiac Remodeling With 3-Dimensional Echocardiography After Percutaneous Mitral Valve Repair","volume":"122","author":"Mantegazza","year":"2018","journal-title":"Am. J. Cardiol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1093\/ehjci\/jes293","article-title":"Immediate effect of the MitraClip\u00ae procedure on mitral ring geometry in primary and secondary mitral regurgitation","volume":"14","author":"Schmidt","year":"2013","journal-title":"Eur. Heart J. -Cardiovasc. Imaging"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"983","DOI":"10.1093\/ejcts\/ezz096","article-title":"Dynamic mitral valve geometry in patients with primary and secondary mitral regurgitation: Implications for mitral valve repair","volume":"56","author":"Noack","year":"2019","journal-title":"Eur. J. -Cardio-Thorac. Surg."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1954","DOI":"10.1016\/j.athoracsur.2021.07.043","article-title":"Mitral Valve Translocation: A Novel Operation for the Treatment of Secondary Mitral Regurgitation","volume":"112","author":"Pasrija","year":"2021","journal-title":"Ann. Thorac. Surg."},{"key":"ref_37","first-page":"269","article-title":"Mitral Annular Dimensions and Geometry in Patients With Functional Mitral Regurgitation and Mitral Valve Prolapse: Implications for Transcatheter Mitral Valve Implantation","volume":"9","author":"Naoum","year":"2016","journal-title":"Ann. Thorac. Surg."},{"key":"ref_38","unstructured":"(2024, January 24). MITO: Multimodal Imaging Toolbox. Available online: https:\/\/sourceforge.net\/projects\/mito\/."},{"key":"ref_39","unstructured":"(2024, January 24). FW4SPL: FrameWork for Software Production Line. Available online: https:\/\/fw4spl.readthedocs.io\/en\/11.0.4\/index.html."},{"key":"ref_40","unstructured":"(2024, January 24). MedPy: Medical Image Processing in Python. Available online: https:\/\/pypi.org\/project\/MedPy\/."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"925","DOI":"10.1007\/s12553-023-00785-9","article-title":"Trimodality image registration of ultrasound, cardiac computed tomography, and magnetic resonance imaging for transcatheter aortic valve implantation and replacement image guidance","volume":"13","author":"Rahimi","year":"2023","journal-title":"Health Technol."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Lang, P., Rajchl, M., Li, F., and Peters, T.M. (2011, January 14\u201317). Towards model-enhanced real-time ultrasound guided cardiac interventions. Proceedings of the 2011 International Conference on Intelligent Computation and Bio-Medical Instrumentation, Wuhan, China.","DOI":"10.1109\/ICBMI.2011.24"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1109\/TMI.2008.2011557","article-title":"Dynamic 2D ultrasound and 3D CT image registration of the beating heart","volume":"28","author":"Huang","year":"2009","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1317","DOI":"10.1007\/s11517-016-1594-6","article-title":"2D to 3D fusion of echocardiography and cardiac CT for TAVR and TAVI image guidance","volume":"55","author":"Khalil","year":"2017","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1016\/j.ijom.2017.08.012","article-title":"Comparison of the accuracy of maxillary position between conventional model surgery and virtual surgical planning","volume":"47","author":"Ritto","year":"2018","journal-title":"Int. J. Oral Maxillofac. Surg."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.ijom.2015.07.010","article-title":"Surgical accuracy of three-dimensional virtual planning: A pilot study of bimaxillary orthognathic procedures including maxillary segmentation","volume":"45","author":"Stokbro","year":"2016","journal-title":"Int. J. Oral Maxillofac. Surg."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/j.joms.2012.03.027","article-title":"Accuracy of a computer-aided surgical simulation protocol for orthognathic surgery: A prospective multicenter study","volume":"71","author":"Hsu","year":"2013","journal-title":"J. Oral Maxillofac. Surg."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2093","DOI":"10.1016\/j.joms.2009.04.057","article-title":"New clinical protocol to evaluate craniomaxillofacial deformity and plan surgical correction","volume":"67","author":"Xia","year":"2009","journal-title":"J. Oral Maxillofac. Surg."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1578","DOI":"10.1016\/j.jcms.2017.06.027","article-title":"Clinical accuracy of waferless maxillary positioning using customized surgical guides and patient specific osteosynthesis in bimaxillary orthognathic surgery","volume":"45","author":"Heufelder","year":"2017","journal-title":"J. -Cranio-Maxillofac. Surg."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"2412","DOI":"10.1016\/j.joms.2009.09.058","article-title":"Comparison of actual surgical outcomes and 3-dimensional surgical simulations","volume":"68","author":"Tucker","year":"2010","journal-title":"J. Oral Maxillofac. Surg."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/4\/1072\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:56:15Z","timestamp":1760104575000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/4\/1072"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,7]]},"references-count":50,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,2]]}},"alternative-id":["s24041072"],"URL":"https:\/\/doi.org\/10.3390\/s24041072","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,7]]}}}