{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T17:17:09Z","timestamp":1786123029609,"version":"build-2736575974"},"reference-count":21,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T00:00:00Z","timestamp":1778630400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T00:00:00Z","timestamp":1778630400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Multilayered Urban Sustainability Action","award":["ECS00000037"],"award-info":[{"award-number":["ECS00000037"]}]},{"name":"ANTHEM","award":["B53C22006700001"],"award-info":[{"award-number":["B53C22006700001"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Purpose:<\/jats:title>\n                    <jats:p>Realistic online 3D reconstruction from endoscopic video is essential for intraoperative inspection and navigation. However, existing approaches often neglect realistic light modeling, rely on offline optimization, or depend on fragile photometric tracking, thereby limiting physically plausible rendering and stable tracking. This study addresses these limitations through an online framework enabling stable tracking and photorealistic endoscopic rendering.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>We propose LumenGSLAM, an online RGB-D Gaussian Splatting framework for highly texturized dense reconstruction of endoscopic scenes. The method leverages dense depth input to enable stable geometry estimation and photorealistic appearance modeling through per-Gaussian physically based rendering (PBR). Surface-aligned Gaussian initialization and per-parameter gradient scaling are introduced to enhance anatomical fidelity and geometric consistency. Robust camera pose estimation is achieved via a Gaussian-coupled feature-based tracking module using SuperPoint\/LightGlue and Perspective-n-Point (PnP), ensuring reliable localization under rapid motion and challenging illumination conditions.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>\n                      Evaluated on C3VD and SCARED datasets, LumenGSLAM achieves superior online reconstruction and tracking performance. It attains PSNR = 30.6, SSIM = 0.89, and LPIPS = 0.23 on C3VD, outperforming all online baselines and approaching state-of-the-art offline PR-ENDO quality. In tracking, it delivers the lowest Absolute Trajectory Error (ATE = 0.93 mm) and Rotational Error (ARE = 0.98\n                      <jats:inline-formula>\n                        <jats:alternatives>\n                          <jats:tex-math>$$^{\\circ }$$<\/jats:tex-math>\n                          <mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                            <mml:mmultiscripts>\n                              <mml:mrow\/>\n                              <mml:mrow\/>\n                              <mml:mo>\u2218<\/mml:mo>\n                            <\/mml:mmultiscripts>\n                          <\/mml:math>\n                        <\/jats:alternatives>\n                      <\/jats:inline-formula>\n                      ), demonstrating robustness even under large inter-frame motions.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion:<\/jats:title>\n                    <jats:p>\n                      LumenGSLAM establishes a new benchmark for online RGB-D endoscopic reconstruction, achieving photometrically consistent and anatomically accurate mapping through explicit light modeling and geometry-aware Gaussian optimization. Its robustness makes it a promising candidate for intraoperative navigation and future extensions toward dynamic tissue modeling. Project page:\n                      <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/github.com\/FrancescoLeni\/LumenGSLAM\" ext-link-type=\"uri\">https:\/\/github.com\/FrancescoLeni\/LumenGSLAM<\/jats:ext-link>\n                      .\n                    <\/jats:p>\n                  <\/jats:sec>","DOI":"10.1007\/s11548-026-03660-w","type":"journal-article","created":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T15:00:38Z","timestamp":1778684438000},"page":"1243-1252","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["LumenGSLAM: online physically based rendering with Gaussian Splatting for robust endoscopic reconstruction and tracking"],"prefix":"10.1007","volume":"21","author":[{"given":"Francesco","family":"Leni","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-0326-0342","authenticated-orcid":false,"given":"Chiara","family":"Lena","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhehua","family":"Mao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sierra","family":"Bonilla","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luca","family":"Carlini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Danail","family":"Stoyanov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elena","family":"De Momi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sophia","family":"Bano","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,5,13]]},"reference":[{"key":"3660_CR1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2024.108546","volume":"175","author":"Z Yang","year":"2024","unstructured":"Yang Z, Dai J, Pan J (2024) 3d reconstruction from endoscopy images: a survey. Comput Biol Med 175:108546","journal-title":"Comput Biol Med"},{"key":"3660_CR2","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1109\/TMI.2013.2282997","volume":"33","author":"OG Grasa","year":"2014","unstructured":"Grasa OG, Bernal E, Casado S, Gil I, Montiel JMM (2014) Visual slam for handheld monocular endoscope. IEEE Trans Med Imaging 33:135\u2013146","journal-title":"IEEE Trans Med Imaging"},{"key":"3660_CR3","doi-asserted-by":"crossref","unstructured":"Ma R, Wang R, Zhang Y, Pizer S, McGill SK, Rosenman J, Frahm JM (2021) Rnnslam: reconstructing the 3d colon to visualize missing regions during a colonoscopy. Med Image Anal 72","DOI":"10.1016\/j.media.2021.102100"},{"issue":"2","key":"3660_CR4","doi-asserted-by":"publisher","first-page":"703","DOI":"10.1111\/cgf.14507","volume":"41","author":"A Tewari","year":"2022","unstructured":"Tewari A, Thies J, Mildenhall B, Srinivasan P, Tretschk E, Yifan W, Lassner C, Sitzmann V, Martin-Brualla R, Lombardi S, Simon T, Theobalt C, Nie\u00dfner M, Barron JT, Wetzstein G, Zollh\u00f6fer M, Golyanik V (2022) Advances in neural rendering. Comput Graph Forum 41(2):703\u2013735","journal-title":"Comput Graph Forum"},{"issue":"1","key":"3660_CR5","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1145\/3503250","volume":"65","author":"B Mildenhall","year":"2021","unstructured":"Mildenhall B, Srinivasan PP, Tancik M, Barron JT, Ramamoorthi R, Ng R (2021) Nerf: Representing scenes as neural radiance fields for view synthesis. Commun ACM 65(1):99\u2013106","journal-title":"Commun ACM"},{"key":"3660_CR6","doi-asserted-by":"crossref","unstructured":"Wang Y, Long Y, Fan SH, Dou Q (2022) Neural rendering for stereo 3d reconstruction of deformable tissues in robotic surgery. In: International conference on medical image computing and computer-assisted intervention, pp 431\u2013441. Springer","DOI":"10.1007\/978-3-031-16449-1_41"},{"key":"3660_CR7","doi-asserted-by":"crossref","unstructured":"Psychogyios D, Vasconcelos F, Stoyanov D (2023) Realistic endoscopic illumination modeling for nerf-based data generation. In: International conference on medical image computing and computer-assisted intervention, pp 535\u2013544. Springer","DOI":"10.1007\/978-3-031-43996-4_51"},{"key":"3660_CR8","doi-asserted-by":"crossref","unstructured":"Kerbl B, Kopanas G, Leimk\u00fchler T, Drettakis G (2023) 3d gaussian splatting for real-time radiance field rendering. ACM Trans Graph 42(4)","DOI":"10.1145\/3592433"},{"key":"3660_CR9","doi-asserted-by":"crossref","unstructured":"Bonilla S, Zhang S, Psychogyios D, Stoyanov D, Vasconcelos F, Bano S (2024) Gaussian pancakes: geometrically-regularized 3d gaussian splatting for realistic endoscopic reconstruction. In: International conference on medical image computing and computer-assisted intervention, pp 274\u2013283. Springer","DOI":"10.1007\/978-3-031-72089-5_26"},{"key":"3660_CR10","doi-asserted-by":"crossref","unstructured":"Kaleta J, Smolak-Dy\u017cewska W, Malarz D, Dall\u2019Alba D, Korzeniowski P, Spurek P (2025) Pr-endo: Physically based relightable gaussian splatting for endoscopy. In: International conference on medical image computing and computer-assisted intervention, pp 391\u2013401. Springer","DOI":"10.1007\/978-3-032-05127-1_38"},{"key":"3660_CR11","doi-asserted-by":"crossref","unstructured":"Wang K, Yang C, Wang Y, Li S, Wang Y, Dou Q, Yang X, Shen W (2024) Endogslam: Real-time dense reconstruction and tracking in endoscopic surgeries using gaussian splatting. In: International conference on medical image computing and computer-assisted intervention, pp 219\u2013229. Springer","DOI":"10.1007\/978-3-031-72089-5_21"},{"issue":"1","key":"3660_CR12","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1145\/357290.357293","volume":"1","author":"RL Cook","year":"1982","unstructured":"Cook RL, Torrance KE (1982) A reflectance model for computer graphics. ACM Trans Graph 1(1):7\u201324","journal-title":"ACM Trans Graph"},{"key":"3660_CR13","doi-asserted-by":"crossref","unstructured":"Matsuki H, Murai R, Kelly PHJ, Davison AJ (2024) Gaussian Splatting SLAM. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","DOI":"10.1109\/CVPR52733.2024.01708"},{"key":"3660_CR14","unstructured":"Yugay V, Li Y, Gevers T, Oswald MR (2023) Gaussian-slam: Photo-realistic dense slam with gaussian splatting. arXiv preprint arXiv:2312.10070"},{"key":"3660_CR15","doi-asserted-by":"crossref","unstructured":"Sahili AR, Hassan S, Sakhrieh SM, Mounsef J, Maalouf N, Arain B, Taha T (2023) A survey of visual slam methods. IEEE Access 11","DOI":"10.1109\/ACCESS.2023.3341489"},{"key":"3660_CR16","doi-asserted-by":"crossref","unstructured":"DeTone D, Malisiewicz T, Rabinovich A (2018) Superpoint: Self-supervised interest point detection and description. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 224\u2013236","DOI":"10.1109\/CVPRW.2018.00060"},{"key":"3660_CR17","doi-asserted-by":"crossref","unstructured":"Lindenberger P, Sarlin P-E, Pollefeys M (2023) Lightglue: local feature matching at light speed. In: Proceedings of the IEEE\/CVF international conference on computer vision, pp 17627\u201317638","DOI":"10.1109\/ICCV51070.2023.01616"},{"key":"3660_CR18","doi-asserted-by":"crossref","unstructured":"Bobrow TL, Golhar M, Vijayan R, Akshintala VS, Garcia JR, Durr NJ (2023) Colonoscopy 3d video dataset with paired depth from 2d-3d registration. Med Image Anal 102956","DOI":"10.1016\/j.media.2023.102956"},{"key":"3660_CR19","unstructured":"Allan M, Mcleod J, Wang C, Rosenthal JC, Hu Z, Gard N, Eisert P, Fu KX, Zeffiro T, Xia W, Zhu Z, Luo H, Jia F, Zhang X, Li X, Sharan L, Kurmann T, Schmid S, Sznitman R, Psychogyios D, Azizian M, Stoyanov D, Maier-Hein L, Speidel S (2021) Stereo correspondence and reconstruction of endoscopic data challenge. arXiv preprint arXiv:2101.01133"},{"key":"3660_CR20","doi-asserted-by":"crossref","unstructured":"Hayoz M, Hahne C, Kurmann T, Allan M, Beldi G, Candinas D, Marquez-Neila P, Sznitman R (2024) Online 3d reconstruction and dense tracking in endoscopic videos. In: Medical image computing and computer assisted intervention","DOI":"10.1007\/978-3-031-72089-5_42"},{"issue":"6","key":"3660_CR21","doi-asserted-by":"publisher","first-page":"1874","DOI":"10.1109\/TRO.2021.3075644","volume":"37","author":"C Campos","year":"2021","unstructured":"Campos C, Elvira R, Rodr\u00edguez JJG, Montiel JMM, Tard\u00f3s D (2021) Orb-slam3: an accurate open-source library for visual, visual-inertial, and multimap slam. IEEE Trans Robot 37(6):1874\u20131890","journal-title":"IEEE Trans Robot"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-026-03660-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-026-03660-w","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-026-03660-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T13:20:07Z","timestamp":1786108807000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-026-03660-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,13]]},"references-count":21,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2026,6]]}},"alternative-id":["3660"],"URL":"https:\/\/doi.org\/10.1007\/s11548-026-03660-w","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,13]]},"assertion":[{"value":"23 February 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 April 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 May 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Authors declare they have no competing financial or non-financial interests directly or indirectly related to the work submitted for publication.","order":1,"name":"Ethics","label":"Conflict of interest","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This article does not contain any new studies with human participants or animals performed by any of the authors. All analyses were conducted on public datasets for which ethical approval was obtained by the original data providers.","order":2,"name":"Ethics","label":"Ethics Approval","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"No new data involving human participants were collected for this study.","order":3,"name":"Ethics","label":"Informed Consent","group":{"name":"EthicsHeading","label":"Declarations"}}]}}