{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,19]],"date-time":"2026-11-19T20:37:28Z","timestamp":1795120648260,"version":"4.10.3"},"reference-count":22,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,7,31]],"date-time":"2025-07-31T00:00:00Z","timestamp":1753920000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,31]],"date-time":"2025-07-31T00:00:00Z","timestamp":1753920000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100008678","name":"Universit\u00e4t Leipzig","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100008678","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Hyperspectral imaging (HSI) shows significant promise in the medical field for tissue detection and perfusion assessment. To extend its application to intraoperative diagnosis, laparoscopic cameras combining a high resolution color video and simultaneous HSI were developed. Spatial scanning in these cameras is performed through a push-broom motor driving a line-scan spectrograph. However, long acquisition times and the necessity of absolute immobility for patient and operator currently limit its usability in the operating room. To provide a hyperspectral acquisition alternative to the traditional push-broom motor approach, we have developed an HSI stitching pipeline that enables freehand line scanning. Our method utilizes the dual recording capability of the camera, which has both an RGB and an HSI sensor. It applies the transformations observed in the RGB video to the corresponding HSI data, then seamlessly merges this data to create a coherent panorama. This allows operators to visualize hyperspectral data as an incrementally expanding overlay on the color video by scanning the scene with the laparoscope. The pipeline evaluation confirms the generation of globally consistent and well-interpretable panoramas with a high level of detail. The registration error is not only comparable to the push-broom method but also corresponds to a real-world error of less than 0.4\u00a0mm in 95\u00a0% of the cases. Therefore, the proposed method enhances the practicability of intraoperative hyperspectral imaging by providing a dynamic, video-like experience of HSI visualizations.<\/jats:p>","DOI":"10.1038\/s41598-025-11687-3","type":"journal-article","created":{"date-parts":[[2025,7,31]],"date-time":"2025-07-31T19:33:36Z","timestamp":1753990416000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Image stitching for real-time laparoscopic hyperspectral imaging"],"prefix":"10.1038","volume":"15","author":[{"given":"Marie-Sophie","family":"von Braun","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Annekatrin","family":"Pfahl","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"Melzer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Claire","family":"Chalopin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hannes","family":"K\u00f6hler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,7,31]]},"reference":[{"key":"11687_CR1","doi-asserted-by":"publisher","unstructured":"Barberio, M. et al. Intraoperative guidance using hyperspectral imaging: A review for surgeons. Diagnostics 11. https:\/\/doi.org\/10.3390\/diagnostics11112066 (2021).","DOI":"10.3390\/diagnostics11112066"},{"key":"11687_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1117\/1.JBO.25.8.086004","volume":"25","author":"H K\u00f6hler","year":"2020","unstructured":"K\u00f6hler, H. et al. Laparoscopic system for simultaneous high-resolution video and rapid hyperspectral imaging in the visible and near-infrared spectral range. J. Biomed. Opt. 25, 1\u201313. https:\/\/doi.org\/10.1117\/1.JBO.25.8.086004 (2020).","journal-title":"J. Biomed. Opt."},{"key":"11687_CR3","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1515\/bmt-2017-0155","volume":"63","author":"A Holmer","year":"2018","unstructured":"Holmer, A., Marotz, J., Wahl, P., Dau, M. & K\u00e4mmerer, P. W. Hyperspectral imaging in perfusion and wound diagnostics\u2013methods and algorithms for the determination of tissue parameters. Biomed. Eng. Biomed. Tech. 63, 547\u2013556. https:\/\/doi.org\/10.1515\/bmt-2017-0155 (2018).","journal-title":"Biomed. Eng. Biomed. Tech."},{"key":"11687_CR4","doi-asserted-by":"publisher","unstructured":"K\u00f6hler, H. et al. Comparison of image registration methods for combining laparoscopic video and spectral image data. Sci. Rep. 12 (2022). https:\/\/doi.org\/10.1038\/s41598-022-20816-1.","DOI":"10.1038\/s41598-022-20816-1"},{"key":"11687_CR5","doi-asserted-by":"publisher","unstructured":"Yoon, J. et al. A clinically translatable hyperspectral endoscopy (HySE) system for imaging the gastrointestinal tract. Nat. Commun. 10 (2019). https:\/\/doi.org\/10.1038\/s41467-019-09484-4.","DOI":"10.1038\/s41467-019-09484-4"},{"key":"11687_CR6","doi-asserted-by":"publisher","unstructured":"Yoon, J. et al. First experience in clinical application of hyperspectral endoscopy for evaluation of colonic polyps. J. Biophoton. 14 (2021). https:\/\/doi.org\/10.1002\/jbio.202100078.","DOI":"10.1002\/jbio.202100078"},{"key":"11687_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/0600000009","volume":"2","author":"R Szeliski","year":"2006","unstructured":"Szeliski, R. Image alignment and stitching: A tutorial. Found. Trends. Comput. Graph. Vis. 2, 1\u2013104. https:\/\/doi.org\/10.1561\/0600000009 (2006).","journal-title":"Found. Trends. Comput. Graph. Vis."},{"key":"11687_CR8","doi-asserted-by":"publisher","unstructured":"Arth, C., Klopschitz, M., Reitmayr, G. & Schmalstieg, D. Real-time self-localization from panoramic images on mobile devices. In 2011 10th IEEE International Symposium on Mixed and Augmented Reality. 37\u201346 (2011). https:\/\/doi.org\/10.1109\/ISMAR.2011.6092368.","DOI":"10.1109\/ISMAR.2011.6092368"},{"key":"11687_CR9","doi-asserted-by":"publisher","first-page":"402","DOI":"10.1016\/j.media.2011.10.004","volume":"16","author":"RJ Schneider","year":"2012","unstructured":"Schneider, R. J. et al. Real-time image-based rigid registration of three-dimensional ultrasound. Med. Image Anal. 16, 402\u2013414. https:\/\/doi.org\/10.1016\/j.media.2011.10.004 (2012).","journal-title":"Med. Image Anal."},{"key":"11687_CR10","doi-asserted-by":"publisher","unstructured":"Lin, Y. & Medioni, G. Map-enhanced UAV image sequence registration and synchronization of multiple image sequences. In 2007 IEEE Conference on Computer Vision and Pattern Recognition. 1\u20137 (2007). https:\/\/doi.org\/10.1109\/CVPR.2007.383428.","DOI":"10.1109\/CVPR.2007.383428"},{"key":"11687_CR11","doi-asserted-by":"publisher","unstructured":"Bergen, T., Nowack, S., M\u00fcnzenmayer, C. & Wittenberg, T. A hybrid tracking approach for endoscopic real-time panorama imaging. In 17th Annual Conference of the International Society for Computer Aided Surgery, Heidelberg, Germany. Int. J. CARS   8(Suppl. 01), 352\u2013354 (Springer, 2013). https:\/\/doi.org\/10.1007\/s11548-013-0881-z.","DOI":"10.1007\/s11548-013-0881-z"},{"key":"11687_CR12","unstructured":"Bergen, T. Real-Time Endoscopic Image Stitching for Cystoscopy (Cuvillier Verlag G\u00f6ttingen, 2017)."},{"key":"11687_CR13","unstructured":"The Qt Company. Qt Documentation (2021). https:\/\/doc.qt.io\/qt-5. Accessed 24 Mar  2025."},{"key":"11687_CR14","first-page":"120","volume":"25","author":"G Bradski","year":"2000","unstructured":"Bradski, G. The OpenCV library - Feature matching. Dr. Dobb\u2019s J. Softw. Tools 25, 120\u2013125 (2000).","journal-title":"Dr. Dobb\u2019s J. Softw. Tools"},{"key":"11687_CR15","doi-asserted-by":"publisher","unstructured":"Zuiderveld, K.\u00a0J. Contrast limited adaptive histogram equalization. In Graphics Gems. 474\u2013485 (1994). https:\/\/doi.org\/10.1016\/B978-0-12-336156-1.50061-6.","DOI":"10.1016\/B978-0-12-336156-1.50061-6"},{"key":"11687_CR16","doi-asserted-by":"publisher","unstructured":"Rublee, E., Rabaud, V., Konolige, K. & Bradski, G. ORB: An efficient alternative to SIFT or SURF. In 2011 International Conference on Computer Vision. 2564\u20132571 (IEEE, 2011). https:\/\/doi.org\/10.1109\/ICCV.2011.6126544.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"11687_CR17","doi-asserted-by":"publisher","unstructured":"Hartley, R. & Zisserman, A. Multiple View Geometry in Computer Vision. 2 Ed.  (Cambridge University Press, 2004). https:\/\/doi.org\/10.1017\/CBO9780511811685.","DOI":"10.1017\/CBO9780511811685"},{"key":"11687_CR18","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1145\/358669.358692","volume":"24","author":"MA Fischler","year":"1981","unstructured":"Fischler, M. A. & Bolles, R. C. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381\u2013395. https:\/\/doi.org\/10.1145\/358669.358692 (1981).","journal-title":"Commun. ACM"},{"key":"11687_CR19","unstructured":"Baum, I. USAF-1951 test target (2013). https:\/\/commons.wikimedia.org\/wiki\/File:USAF-1951.svg. Accessed 24 Mar  2025."},{"key":"11687_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s00104-020-01139-1","volume":"91","author":"Y Moulla","year":"2020","unstructured":"Moulla, Y. et al. Hybrid\u00f6sophagektomie mit intraoperativem Hyperspektral-Imaging: Videobeitrag. Der Chirurg 91, 1\u201312. https:\/\/doi.org\/10.1007\/s00104-020-01139-1 (2020).","journal-title":"Der Chirurg"},{"key":"11687_CR21","unstructured":"Eberhardt, W. Kuka AG, Germany (2022). www.kuka.com\/en-de\/products\/robot-systems\/industrial-robots\/lbr-iiwa. Accessed 24 Mar 2025."},{"key":"11687_CR22","doi-asserted-by":"publisher","unstructured":"Szeliski, R. Computer Vision \u2013 Algorithms and Applications. Texts in Computer Science. 2 Ed.  (Springer Cham, 2022). https:\/\/doi.org\/10.1007\/978-3-030-34372-9.","DOI":"10.1007\/978-3-030-34372-9"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-11687-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-11687-3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-11687-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,4]],"date-time":"2025-08-04T23:02:54Z","timestamp":1754348574000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-11687-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,31]]},"references-count":22,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["11687"],"URL":"https:\/\/doi.org\/10.1038\/s41598-025-11687-3","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,31]]},"assertion":[{"value":"25 March 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 July 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 July 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"28010"}}