{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T20:09:52Z","timestamp":1789070992855,"version":"build-2803163510"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T00:00:00Z","timestamp":1788998400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T00:00:00Z","timestamp":1788998400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"funding program Photonics Research Germany","award":["13N15706"],"award-info":[{"award-number":["13N15706"]}]},{"name":"funding program Photonics Research Germany","award":["13N15710"],"award-info":[{"award-number":["13N15710"]}]},{"name":"funding program Photonics Research Germany","award":["13N15719"],"award-info":[{"award-number":["13N15719"]}]},{"DOI":"10.13039\/100019180","name":"HORIZON EUROPE European Research Council","doi-asserted-by":"publisher","award":["101088997"],"award-info":[{"award-number":["101088997"]}],"id":[{"id":"10.13039\/100019180","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100012957","name":"Friedrich-Schiller-Universit\u00e4t Jena","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100012957","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Digit Imaging. Inform. med."],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Multimodal digital pathology combines hematoxylin and eosin (H&amp;E) staining with advanced microscopy techniques to provide complementary structural and molecular information. However, accurate registration between H&amp;E and other modalities remains challenging, especially when images differ strongly in appearance or are acquired on nonidentical consecutive sections. We present a multistep multimodal registration workflow that combines a multiscale histogram of local main orientations (MS-HLMO), a multimodal feature-based rigid initialization, with B-spline nonrigid registration and thin-plate spline refinement. We evaluated this approach on two datasets: human intestinal inflammatory bowel disease sections imaged with nonlinear multimodal microscopy (nMM) and H&amp;E and head and neck cancer biopsies imaged with H&amp;E and coherent Raman scattering (CRS), including single-band stimulated Raman scattering (SRS) and multimodal CRS images on parallel frozen sections. Registration performance was quantified using landmark and boundary-based metrics. The workflow was compared with several registration approaches, including scale-invariant feature transform (SIFT), B-spline deformable registration, MS-HLMO, and VALIS. For H&amp;E\/SRS pairs, the workflow reduced the median landmark error from 0.01459 to 0.01204 and lowered the mask boundary error from 0.0482 to 0.0115 compared with MS-HLMO. For H&amp;E\/nMM pairs, it achieved the lowest boundary errors, while B-spline registration yielded the smallest landmark errors, indicating a trade-off between point accuracy and boundary alignment. Qualitative checkerboards showed that the proposed method produced more consistent multimodal alignments than SIFT and VALIS across the evaluated datasets. These results demonstrate that the proposed workflow provides robust multimodal registration for both same-section and consecutive-section histology and enables reliable transfer of annotations between H&amp;E and advanced microscopy modalities.<\/jats:p>","DOI":"10.1007\/s10278-026-02278-3","type":"journal-article","created":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T19:48:16Z","timestamp":1789069696000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Multistep Registration Framework for Multimodal Histology Across Same and Consecutive Sections"],"prefix":"10.1007","author":[{"given":"Fatemehzahra","family":"Darzi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rodrigo","family":"Escobar D\u00edaz Guerrero","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2778-6624","authenticated-orcid":false,"given":"Thomas","family":"Bocklitz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,9,10]]},"reference":[{"key":"2278_CR1","doi-asserted-by":"publisher","unstructured":"Ji M, Orringer DA, Freudiger CW, et al.: Rapid, label-free detection of brain tumors with stimulated Raman scattering microscopy. Sci Transl Med 5, https:\/\/doi.org\/10.1126\/scitranslmed.3005954, 2013","DOI":"10.1126\/scitranslmed.3005954"},{"key":"2278_CR2","doi-asserted-by":"publisher","unstructured":"Balluff B, Heeren RM, Race AM: An overview of image registration for aligning mass spectrometry imaging with clinically relevant imaging modalities. J Mass Spectrom Adv Clin Lab 23:26\u201338, https:\/\/doi.org\/10.1016\/j.jmsacl.2021.12.006, 2022","DOI":"10.1016\/j.jmsacl.2021.12.006"},{"key":"2278_CR3","doi-asserted-by":"publisher","unstructured":"Race AM, Sutton D, Hamm G, et al.: Deep learning-based annotation transfer between molecular imaging modalities: an automated workflow for multimodal data integration. Anal Chem 93:3061\u20133071, https:\/\/doi.org\/10.1021\/acs.analchem.0c02726, 2021","DOI":"10.1021\/acs.analchem.0c02726"},{"key":"2278_CR4","doi-asserted-by":"publisher","unstructured":"Darzi F, Bocklitz T: Multimodal integration enhances tissue image information content: a deep feature perspective. Bioengineering 12:894, https:\/\/doi.org\/10.3390\/bioengineering12080894, 2025","DOI":"10.3390\/bioengineering12080894"},{"key":"2278_CR5","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2024.108187","volume":"250","author":"Wodzinski M, Marini N, Atzori M, M\u00fcller H: RegWSI: whole slide image registration using combined deep feature- and intensity-based methods: winner of the ACROBAT","year":"2023","unstructured":"Wodzinski M, Marini N, Atzori M, M\u00fcller H: RegWSI: whole slide image registration using combined deep feature- and intensity-based methods: winner of the ACROBAT 2023 challenge. Comput Methods Programs Biomed 250:108187, https:\/\/doi.org\/10.1016\/j.cmpb.2024.108187, 2024","journal-title":"Comput Methods Programs Biomed"},{"key":"2278_CR6","doi-asserted-by":"publisher","unstructured":"Ye Y, Bruzzone L, Shan J, Bovolo F, Zhu Q: Fast and robust matching for multimodal remote sensing image registration. IEEE Trans Geosci Remote Sens 57:9059\u20139070, https:\/\/doi.org\/10.1109\/TGRS.2019.2924684, 2019","DOI":"10.1109\/TGRS.2019.2924684"},{"key":"2278_CR7","doi-asserted-by":"publisher","unstructured":"Zhong Y, Zhang S, Liu Z, et al.: Unsupervised fusion of misaligned PAT and MRI images via mutually reinforcing cross-modality image generation and registration. IEEE Trans Med Imaging 43:1702\u20131714, https:\/\/doi.org\/10.1109\/TMI.2023.3347511, 2023","DOI":"10.1109\/TMI.2023.3347511"},{"key":"2278_CR8","doi-asserted-by":"publisher","unstructured":"Venet L, Pati S, Feldman MD, Nasrallah MP, Yushkevich P, Bakas S: Accurate and robust alignment of differently stained histologic images based on greedy diffeomorphic registration. Appl Sci 11:1892, https:\/\/doi.org\/10.3390\/app11041892, 2021","DOI":"10.3390\/app11041892"},{"key":"2278_CR9","doi-asserted-by":"publisher","unstructured":"Zhang X, Leng C, Hong Y, Pei Z, Cheng I, Basu A: Multimodal remote sensing image registration methods and advancements: a survey. Remote Sens 13:5128, https:\/\/doi.org\/10.3390\/rs13245128, 2021","DOI":"10.3390\/rs13245128"},{"key":"2278_CR10","doi-asserted-by":"publisher","unstructured":"Liu C, Xu J, Wang F: A review of keypoints' detection and feature description in image registration. Sci Program 2021:1\u201325, https:\/\/doi.org\/10.1155\/2021\/8509164, 2021","DOI":"10.1155\/2021\/8509164"},{"key":"2278_CR11","doi-asserted-by":"publisher","unstructured":"Escobar D\u00edaz Guerrero R, Oliveira JL, Popp J, Bocklitz T: MMIR: an open-source software for the registration of multimodal histological images. BMC Med Inform Decis Mak 24:65, https:\/\/doi.org\/10.1186\/s12911-024-02424-3, 2024","DOI":"10.1186\/s12911-024-02424-3"},{"key":"2278_CR12","doi-asserted-by":"publisher","unstructured":"Sotiras A, Davatzikos C, Paragios N: Deformable medical image registration: a survey. IEEE Trans Med Imaging 32:1153\u20131190, https:\/\/doi.org\/10.1109\/TMI.2013.2265603, 2013","DOI":"10.1109\/TMI.2013.2265603"},{"key":"2278_CR13","doi-asserted-by":"publisher","unstructured":"Wu Z, Lan T, Wang J, Ding Y, Qin Z: Medical image registration using B-spline transform. Int J Simul Syst Sci Technol 17:1.1\u20131.6, https:\/\/doi.org\/10.5013\/IJSSST.a.17.48.01, 2016","DOI":"10.5013\/IJSSST.a.17.48.01"},{"key":"2278_CR14","doi-asserted-by":"publisher","unstructured":"Baum ZMC, Hu Y, Barratt DC: Real-time multimodal image registration with partial intraoperative point-set data. Med Image Anal 74:102231, https:\/\/doi.org\/10.1016\/j.media.2021.102231, 2021","DOI":"10.1016\/j.media.2021.102231"},{"key":"2278_CR15","doi-asserted-by":"publisher","unstructured":"Gao C, Li W, Tao R, Du Q: MS-HLMO: multiscale histogram of local main orientation for remote sensing image registration. IEEE Trans Geosci Remote Sens 60:5626714, https:\/\/doi.org\/10.1109\/TGRS.2022.3193109, 2022","DOI":"10.1109\/TGRS.2022.3193109"},{"key":"2278_CR16","doi-asserted-by":"publisher","unstructured":"Gao C, Li W, Li Y: A new invariant feature for multi-modal images matching. In: 2024 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), 8374\u20138378, https:\/\/doi.org\/10.1109\/IGARSS53475.2024.10641671, 2024","DOI":"10.1109\/IGARSS53475.2024.10641671"},{"key":"2278_CR17","doi-asserted-by":"publisher","unstructured":"Velesaca HO, Bastidas G, Rouhani M, Sappa AD: Multimodal image registration techniques: a comprehensive survey. Multimed Tools Appl 83:63919\u201363947, https:\/\/doi.org\/10.1007\/s11042-023-17991-2, 2024","DOI":"10.1007\/s11042-023-17991-2"},{"key":"2278_CR18","doi-asserted-by":"publisher","unstructured":"Wong YM, Lew WS, Lee JCL, Tan HQ: Performance evaluation of deformable image registration algorithms: target registration error and its correlation to Dice similarity coefficient. Z Med Phys, https:\/\/doi.org\/10.1016\/j.zemedi.2025.09.001, 2025","DOI":"10.1016\/j.zemedi.2025.09.001"},{"key":"2278_CR19","doi-asserted-by":"publisher","unstructured":"Shafique A, Babaie M, Sajadi M, Batten A, Skdar S, Tizhoosh HR: Automatic multi-stain registration of whole slide images in histopathology. In: 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 3622\u20133625, https:\/\/doi.org\/10.1109\/EMBC46164.2021.9629970, 2021","DOI":"10.1109\/EMBC46164.2021.9629970"},{"key":"2278_CR20","doi-asserted-by":"publisher","unstructured":"Gatenbee CD, Baker A-M, Prabhakaran S, et al.: Virtual alignment of pathology image series for multi-gigapixel whole slide images. Nat Commun 14:4502, https:\/\/doi.org\/10.1038\/s41467-023-40218-9, 2023","DOI":"10.1038\/s41467-023-40218-9"},{"key":"2278_CR21","doi-asserted-by":"publisher","unstructured":"Chen S, Rao BY, Herrlinger S, Losonczy A, Paninski L, Varol E: Multimodal microscopy image alignment using spatial and shape information and a branch-and-bound algorithm. In: ICASSP 2023\u20132023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 1\u20135, https:\/\/doi.org\/10.1109\/ICASSP49357.2023.10096185, 2023","DOI":"10.1109\/ICASSP49357.2023.10096185"},{"key":"2278_CR22","doi-asserted-by":"publisher","unstructured":"Goubran M, Leuze C, Hsueh B, et al.: Multimodal image registration and connectivity analysis for integration of connectomic data from microscopy to MRI. Nat Commun 10:5504, https:\/\/doi.org\/10.1038\/s41467-019-13374-0, 2019","DOI":"10.1038\/s41467-019-13374-0"},{"key":"2278_CR23","doi-asserted-by":"publisher","unstructured":"Alyami W, Kyme A, Bourne R: Histological validation of MRI: a review of challenges in registration of imaging and whole-mount histopathology. J Magn Reson Imaging 55:11\u201322, https:\/\/doi.org\/10.1002\/jmri.27409, 2022","DOI":"10.1002\/jmri.27409"},{"key":"2278_CR24","doi-asserted-by":"publisher","unstructured":"Lee BC, Lin MK, Fu Y, Hata J, Miller MI, Mitra PP: Multimodal cross-registration and quantification of metric distortions in marmoset whole brain histology using diffeomorphic mappings. J Comp Neurol 529:281\u2013295, https:\/\/doi.org\/10.1002\/cne.24946, 2021","DOI":"10.1002\/cne.24946"},{"key":"2278_CR25","doi-asserted-by":"publisher","unstructured":"Ge L, Wei X, Hao Y, Luo J, Xu Y: Unsupervised histological image registration using structural feature guided convolutional neural network. IEEE Trans Med Imaging 41:2414\u20132431, https:\/\/doi.org\/10.1109\/TMI.2022.3164088, 2022","DOI":"10.1109\/TMI.2022.3164088"},{"key":"2278_CR26","doi-asserted-by":"publisher","unstructured":"Chernavskaia O, Heuke S, Vieth M, et al.: Beyond endoscopic assessment in inflammatory bowel disease: real-time histology of disease activity by non-linear multimodal imaging. Sci Rep 6:29239, https:\/\/doi.org\/10.1038\/srep29239, 2016","DOI":"10.1038\/srep29239"},{"key":"2278_CR27","doi-asserted-by":"publisher","unstructured":"Messerschmidt C, Calvarese M, Vafaeinezhad M, et al.: Broadband coherent Raman microspectroscopy for the investigation of head and neck cancer advancing ultrafast spectral histopathology. Discov Imaging 2:13, https:\/\/doi.org\/10.1007\/s44352-025-00017-y, 2025","DOI":"10.1007\/s44352-025-00017-y"},{"key":"2278_CR28","doi-asserted-by":"publisher","unstructured":"Chang Q, Lu C, Li M: Cascading affine and B-spline registration method for large deformation registration of lung X-rays. J Digit Imaging 36:1262\u20131278, https:\/\/doi.org\/10.1007\/s10278-022-00763-z, 2023","DOI":"10.1007\/s10278-022-00763-z"},{"key":"2278_CR29","doi-asserted-by":"publisher","unstructured":"Klein S, Staring M, Murphy K, Viergever MA, Pluim JP: Elastix: a toolbox for intensity-based medical image registration. IEEE Trans Med Imaging 29:196\u2013205, https:\/\/doi.org\/10.1109\/TMI.2009.2035616, 2010","DOI":"10.1109\/TMI.2009.2035616"},{"key":"2278_CR30","doi-asserted-by":"publisher","unstructured":"Cai H, Li Y, Zhao Q, Lu Y: Automated multimodal image registration for prostate cancer using squeeze-and-excitation ResNet with thin plate spline transformation: a deep learning approach. Med Sci Monit 31:e949996, https:\/\/doi.org\/10.12659\/MSM.949996, 2025","DOI":"10.12659\/MSM.949996"},{"key":"2278_CR31","doi-asserted-by":"publisher","unstructured":"Borovec J, Kybic J, Arganda-Carreras I, et al.: ANHIR: automatic non-rigid histological image registration challenge. IEEE Trans Med Imaging 39:3042\u20133052, https:\/\/doi.org\/10.1109\/TMI.2020.2986331, 2020","DOI":"10.1109\/TMI.2020.2986331"},{"key":"2278_CR32","doi-asserted-by":"publisher","unstructured":"Patankar SS, Kadam SG, Jadhav A, Gore M: Image registration using Shi-Tomasi and SIFT. In: 2023 2nd International Conference for Innovation in Technology (INOCON), 1\u20134, https:\/\/doi.org\/10.1109\/INOCON57975.2023.10101131, 2023","DOI":"10.1109\/INOCON57975.2023.10101131"},{"key":"2278_CR33","doi-asserted-by":"publisher","unstructured":"Lotz J, Weiss N, van der Laak J, Heldmann S: Comparison of consecutive and restained sections for image registration in histopathology. J Med Imaging (Bellingham) 10:067501, https:\/\/doi.org\/10.1117\/1.JMI.10.6.067501, 2023","DOI":"10.1117\/1.JMI.10.6.067501"}],"container-title":["Journal of Imaging Informatics in Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-026-02278-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10278-026-02278-3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-026-02278-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T19:48:17Z","timestamp":1789069697000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10278-026-02278-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,10]]},"references-count":33,"alternative-id":["2278"],"URL":"https:\/\/doi.org\/10.1007\/s10278-026-02278-3","relation":{},"ISSN":["2948-2933"],"issn-type":[{"value":"2948-2933","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,10]]},"assertion":[{"value":"15 May 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 August 2026","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 August 2026","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 September 2026","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","label":"Conflict of interest","group":{"name":"EthicsHeading","label":"Declarations"}}]}}