{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,18]],"date-time":"2026-01-18T05:39:46Z","timestamp":1768714786005,"version":"3.49.0"},"reference-count":30,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,2,1]],"date-time":"2022-02-01T00:00:00Z","timestamp":1643673600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Deep learning based medical image registration remains very difficult and often fails to improve over its classical counterparts where comprehensive supervision is not available, in particular for large transformations\u2014including rigid alignment. The use of unsupervised, metric-based registration networks has become popular, but so far no universally applicable similarity metric is available for multimodal medical registration, requiring a trade-off between local contrast-invariant edge features or more global statistical metrics. In this work, we aim to improve over the use of handcrafted metric-based losses. We propose to use synthetic three-way (triangular) cycles that for each pair of images comprise two multimodal transformations to be estimated and one known synthetic monomodal transform. Additionally, we present a robust method for estimating large rigid transformations that is differentiable in end-to-end learning. By minimising the cycle discrepancy and adapting the synthetic transformation to be close to the real geometric difference of the image pairs during training, we successfully tackle intra-patient abdominal CT-MRI registration and reach performance on par with state-of-the-art metric-supervision and classic methods. Cyclic constraints enable the learning of cross-modality features that excel at accurate anatomical alignment of abdominal CT and MRI scans.<\/jats:p>","DOI":"10.3390\/s22031107","type":"journal-article","created":{"date-parts":[[2022,2,1]],"date-time":"2022-02-01T22:16:18Z","timestamp":1643753778000},"page":"1107","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Learning a Metric for Multimodal Medical Image Registration without Supervision Based on Cycle Constraints"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1651-6960","authenticated-orcid":false,"given":"Hanna","family":"Siebert","sequence":"first","affiliation":[{"name":"Institute of Medical Informatics, Universit\u00e4t zu L\u00fcbeck, 23538 L\u00fcbeck, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3963-7052","authenticated-orcid":false,"given":"Lasse","family":"Hansen","sequence":"additional","affiliation":[{"name":"Institute of Medical Informatics, Universit\u00e4t zu L\u00fcbeck, 23538 L\u00fcbeck, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7489-1972","authenticated-orcid":false,"given":"Mattias P.","family":"Heinrich","sequence":"additional","affiliation":[{"name":"Institute of Medical Informatics, Universit\u00e4t zu L\u00fcbeck, 23538 L\u00fcbeck, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,1]]},"reference":[{"key":"ref_1","unstructured":"Hering, A., Hansen, L., Mok, T.C.W., Chung, A.C.S., Siebert, H., H\u00e4ger, S., Lange, A., Kuckertz, S., Heldmann, S., and Shao, W. (2021). Learn2Reg: Comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learning. arXiv."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Balakrishnan, G., Zhao, A., Sabuncu, M.R., Guttag, J., and Dalca, A.V. (2018, January 18\u201323). An unsupervised learning model for deformable medical image registration. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00964"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Heinrich, M.P. (2019, January 13\u201317). Closing the gap between deep and conventional image registration using probabilistic dense displacement networks. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Shenzhen, China.","DOI":"10.1007\/978-3-030-32226-7_6"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Van Der Smagt, P., Cremers, D., and Brox, T. (2015, January 7\u201313). Flownet: Learning optical flow with convolutional networks. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.316"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1097","DOI":"10.1109\/TMI.2018.2878316","article-title":"Pulmonary CT registration through supervised learning with convolutional neural networks","volume":"38","author":"Eppenhof","year":"2018","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Eppenhof, K.A., Lafarge, M.W., Moeskops, P., Veta, M., and Pluim, J.P. (2018, January 10\u201315). Deformable image registration using convolutional neural networks. Proceedings of the Medical Imaging 2018: Image Processing, Houston, TX, USA.","DOI":"10.1117\/12.2292443"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Krebs, J., Mansi, T., Delingette, H., Zhang, L., Ghesu, F.C., Miao, S., Maier, A.K., Ayache, N., Liao, R., and Kamen, A. (2017, January 11\u201313). Robust non-rigid registration through agent-based action learning. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Quebec City, QC, Canada.","DOI":"10.1007\/978-3-319-66182-7_40"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.media.2018.07.002","article-title":"Weakly-supervised convolutional neural networks for multimodal image registration","volume":"49","author":"Hu","year":"2018","journal-title":"Med. Image Anal."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"101822","DOI":"10.1016\/j.media.2020.101822","article-title":"Weakly-supervised learning of multi-modal features for regularised iterative descent in 3D image registration","volume":"67","author":"Blendowski","year":"2021","journal-title":"Med. Image Anal."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Misra, I., and van der Maaten, L. (2020, January 13\u201319). Self-supervised learning of pretext-invariant representations. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00674"},{"key":"ref_11","unstructured":"Komodakis, N., and Gidaris, S. (May, January 30). Unsupervised representation learning by predicting image rotations. Proceedings of the International Conference on Learning Representations (ICLR), Vancouver, BC, Canada."},{"key":"ref_12","unstructured":"Wallach, H., Larochelle, H., Beygelzimer, A., d\u2019Alch\u00e9-Buc, F., Fox, E., and Garnett, R. (2019). PRNet: Self-Supervised Learning for Partial-to-Partial Registration. Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Li, H., and Fan, Y. (2018, January 4\u20137). Non-rigid image registration using self-supervised fully convolutional networks without training data. Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), Washington, DC, USA.","DOI":"10.1109\/ISBI.2018.8363757"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wang, X., Jabri, A., and Efros, A.A. (2019, January 16\u201320). Learning correspondence from the cycle-consistency of time. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00267"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"014005","DOI":"10.1117\/1.JMI.2.1.014005","article-title":"Consistency-based rectification of nonrigid registrations","volume":"2","author":"Gass","year":"2015","journal-title":"J. Med. Imaging"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"568","DOI":"10.1109\/42.932742","article-title":"Consistent image registration","volume":"20","author":"Christensen","year":"2001","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Datteri, R.D., and Dawant, B.M. (2012, January 7\u20138). Automatic detection of the magnitude and spatial location of error in non-rigid registration. Proceedings of the International Workshop on Biomedical Image Registration, Nashville, TN, USA.","DOI":"10.1007\/978-3-642-31340-0_3"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kim, B., Kim, J., Lee, J.G., Kim, D.H., Park, S.H., and Ye, J.C. (2019, January 13\u201317). Unsupervised deformable image registration using cycle-consistent cnn. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Shenzhen, China.","DOI":"10.1007\/978-3-030-32226-7_19"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/j.media.2018.11.010","article-title":"A deep learning framework for unsupervised affine and deformable image registration","volume":"52","author":"Berendsen","year":"2019","journal-title":"Med. Image Anal."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"777","DOI":"10.1109\/TMI.2019.2935060","article-title":"Evaluation of MRI to ultrasound registration methods for brain shift correction: The CuRIOUS2018 challenge","volume":"39","author":"Xiao","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Xu, Z., Luo, J., Yan, J., Pulya, R., Li, X., Wells, W., and Jagadeesan, J. (2020, January 4\u20138). Adversarial uni-and multi-modal stream networks for multimodal image registration. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Lima, Peru.","DOI":"10.1007\/978-3-030-59716-0_22"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Simonovsky, M., Guti\u00e9rrez-Becker, B., Mateus, D., Navab, N., and Komodakis, N. (2016, January 17\u201321). A deep metric for multimodal registration. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Athens, Greece.","DOI":"10.1007\/978-3-319-46726-9_2"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"024003","DOI":"10.1117\/1.JMI.1.2.024003","article-title":"Global image registration using a symmetric block-matching approach","volume":"1","author":"Modat","year":"2014","journal-title":"J. Med. Imaging"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1007\/s10278-013-9622-7","article-title":"The Cancer Imaging Archive (TCIA): Maintaining and operating a public information repository","volume":"26","author":"Clark","year":"2013","journal-title":"J. Digit. Imaging"},{"key":"ref_26","unstructured":"Akin, O., Elnajjar, P., Heller, M., Jarosz, R., Erickson, B., Kirk, S., and Filippini, J. (2016). Radiology data from the cancer genome atlas kidney renal clear cell carcinoma [TCGA-KIRC] collection. Cancer Imaging Arch."},{"key":"ref_27","unstructured":"Linehan, M., Gautam, R., Kirk, S., Lee, Y., Roche, C., Bonaccio, E., and Jarosz, R. (2016). Radiology data from the cancer genome atlas cervical kidney renal papillary cell carcinoma [KIRP] collection. Cancer Imaging Arch."},{"key":"ref_28","unstructured":"Erickson, B., Kirk, S., Lee, Y., Bathe, O., Kearns, M., Gerdes, C., and Lemmerman, J. (2016). Radiology Data from The Cancer Genome Atlas Liver Hepatocellular Carcinoma [TCGA-LIHC] collection. Cancer Imaging Arch."},{"key":"ref_29","unstructured":"Sandk\u00fchler, R., Jud, C., Andermatt, S., and Cattin, P.C. (2018). AirLab: Autograd image registration laboratory. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1788","DOI":"10.1109\/TMI.2019.2897538","article-title":"Voxelmorph: A learning framework for deformable medical image registration","volume":"38","author":"Balakrishnan","year":"2019","journal-title":"IEEE Trans. Med. Imaging"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/1107\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:12:19Z","timestamp":1760134339000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/1107"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,1]]},"references-count":30,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["s22031107"],"URL":"https:\/\/doi.org\/10.3390\/s22031107","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,1]]}}}