{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T18:05:19Z","timestamp":1779300319724,"version":"3.51.4"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2025,5,13]],"date-time":"2025-05-13T00:00:00Z","timestamp":1747094400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,5,13]],"date-time":"2025-05-13T00:00:00Z","timestamp":1747094400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100020194","name":"Wellcome \/ EPSRC Centre for Interventional and Surgical Sciences","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100020194","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100008536","name":"Amazon Web Services","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100008536","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010664","name":"H2020 Future and Emerging Technologies","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100010664","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000287","name":"Royal Academy of Engineering","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000287","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Purpose<\/jats:title>\n            <jats:p>Visual 3D scene reconstruction can support colonoscopy navigation. It can help in recognising which portions of the colon have been visualised and characterising the size and shape of polyps. This is still a very challenging problem due to complex illumination variations, including abundant specular reflections. We investigate how to effectively decouple light and depth in this problem.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods<\/jats:title>\n            <jats:p>We introduce a self-supervised model that simultaneously characterises the shape and lighting of the visualised colonoscopy scene. Our model estimates shading, albedo, depth, and specularities (SHADeS) from single images. Unlike previous approaches (IID (Li et al. IEEE J Biomed Health Inform <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/doi.org\/10.1109\/JBHI.2024.3400804\" ext-link-type=\"uri\">https:\/\/doi.org\/10.1109\/JBHI.2024.3400804<\/jats:ext-link>, 2024)), we use a non-Lambertian model that treats specular reflections as a separate light component. The implementation of our method is available at <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/github.com\/RemaDaher\/SHADeS\" ext-link-type=\"uri\">https:\/\/github.com\/RemaDaher\/SHADeS<\/jats:ext-link>.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>We demonstrate on real colonoscopy images (Hyper Kvasir) that previous models for light decomposition (IID) and depth estimation (MonoViT, ModoDepth2) are negatively affected by specularities. In contrast, SHADeS can simultaneously produce light decomposition and depth maps that are robust to specular regions. We also perform a quantitative comparison on phantom data (C3VD) where we further demonstrate the robustness of our model.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>Modelling specular reflections improves depth estimation in colonoscopy. We propose an effective self-supervised approach that uses this insight to jointly estimate light decomposition and depth. Light decomposition has the potential to help with other problems, such as place recognition within the colon.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1007\/s11548-025-03371-8","type":"journal-article","created":{"date-parts":[[2025,5,13]],"date-time":"2025-05-13T10:50:47Z","timestamp":1747133447000},"page":"1255-1263","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["SHADeS: self-supervised monocular depth estimation through non-Lambertian image decomposition"],"prefix":"10.1007","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0740-7490","authenticated-orcid":false,"given":"Rema","family":"Daher","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Francisco","family":"Vasconcelos","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Danail","family":"Stoyanov","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,5,13]]},"reference":[{"key":"3371_CR1","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2024.3400804","author":"B Li","year":"2024","unstructured":"Li B, Liu B, Zhu M, Luo X, Zhou F (2024) Image intrinsic-based unsupervised monocular depth estimation in endoscopy. IEEE J Biomed Health Inform. https:\/\/doi.org\/10.1109\/JBHI.2024.3400804","journal-title":"IEEE J Biomed Health Inform"},{"key":"3371_CR2","unstructured":"World Cancer Research Fund International: Colorectal Cancer Statistics (2022). www.wcrf.org\/cancer-trends\/colorectal-cancer-statistics"},{"key":"3371_CR3","unstructured":"World Health Organization: Colorectal Cancer (2023). www.who.int\/news-room\/fact-sheets\/detail\/colorectal-cancer"},{"key":"3371_CR4","unstructured":"Society AC (2024) Can colorectal cancer be found early? www.cancer.org\/cancer\/types\/colon-rectal-cancer\/detection-diagnosis-staging\/detection.html"},{"key":"3371_CR5","doi-asserted-by":"crossref","unstructured":"Zhao C, Zhang Y, Poggi M, Tosi F, Guo X, Zhu Z, Huang G, Tang Y, Mattoccia S (2022)Monovit: self-supervised monocular depth estimation with a vision transformer. In: 2022 international conference on 3D vision (3DV). IEEE, pp 668\u2013678","DOI":"10.1109\/3DV57658.2022.00077"},{"key":"3371_CR6","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2023.107850","volume":"169","author":"S Liu","year":"2024","unstructured":"Liu S, Fan J, Yang Y, Xiao D, Ai D, Song H, Wang Y, Yang J (2024) Monocular endoscopy images depth estimation with multi-scale residual fusion. Comput Biol Med 169:107850","journal-title":"Comput Biol Med"},{"key":"3371_CR7","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2023.102994","volume":"90","author":"R Daher","year":"2023","unstructured":"Daher R, Vasconcelos F, Stoyanov D (2023) A temporal learning approach to inpainting endoscopic specularities and its effect on image correspondence. Med Image Anal 90:102994","journal-title":"Med Image Anal"},{"key":"3371_CR8","doi-asserted-by":"crossref","unstructured":"Daher R, Barbed OL, Murillo AC, Vasconcelos F, Stoyanov D (2023) Cyclesttn: a learning-based temporal model for specular augmentation in endoscopy. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 570\u2013580","DOI":"10.1007\/978-3-031-43999-5_54"},{"key":"3371_CR9","doi-asserted-by":"crossref","unstructured":"Zhou T, Brown M, Snavely N, Lowe DG (2017) Unsupervised learning of depth and ego-motion from video. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1851\u20131858","DOI":"10.1109\/CVPR.2017.700"},{"key":"3371_CR10","doi-asserted-by":"crossref","unstructured":"Godard C, Mac\u00a0Aodha O, Firman M, Brostow GJ (2019) Digging into self-supervised monocular depth estimation. In: Proceedings of the IEEE\/CVF international conference on computer vision, pp 3828\u20133838","DOI":"10.1109\/ICCV.2019.00393"},{"key":"3371_CR11","unstructured":"Bian J, Li Z, Wang N, Zhan H, Shen Cu, Cheng M-M, Reid I (2019) Unsupervised scale-consistent depth and ego-motion learning from monocular video. In Advances in neural information processing systems, vol 32"},{"key":"3371_CR12","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.102058","volume":"71","author":"KB Ozyoruk","year":"2021","unstructured":"Ozyoruk KB, Gokceler GI, Bobrow TL, Coskun G, Incetan K, Almalioglu Y, Mahmood F, Curto E, Perdigoto L, Oliveira M et al (2021) Endoslam dataset and an unsupervised monocular visual odometry and depth estimation approach for endoscopic videos. Med Image Anal 71:102058","journal-title":"Med Image Anal"},{"key":"3371_CR13","doi-asserted-by":"crossref","unstructured":"Rau A, Bhattarai B, Agapito L, Stoyanov D (2023) Task-guided domain gap reduction for monocular depth prediction in endoscopy. In: MICCAI workshop on data engineering in medical imaging. Springer, pp 111\u2013122","DOI":"10.1007\/978-3-031-44992-5_11"},{"key":"3371_CR14","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.102338","volume":"77","author":"S Shao","year":"2022","unstructured":"Shao S, Pei Z, Chen W, Zhu W, Wu X, Sun D, Zhang B (2022) Self-supervised monocular depth and ego-motion estimation in endoscopy: appearance flow to the rescue. Med Image Anal 77:102338","journal-title":"Med Image Anal"},{"key":"3371_CR15","doi-asserted-by":"crossref","unstructured":"Zhou L, Luo J, Wang H, Zhao S, Han Y, Li W (2023) Tackling challenges of low-texture and illumination variations for endoscopy self-supervised monocular depth estimation. In: 2023 IEEE international conference on bioinformatics and biomedicine (BIBM). IEEE, pp 2427\u20132432","DOI":"10.1109\/BIBM58861.2023.10385682"},{"key":"3371_CR16","doi-asserted-by":"crossref","unstructured":"Lou A, Noble J (2024) Ws-sfmlearner: self-supervised monocular depth and ego-motion estimation on surgical videos with unknown camera parameters. In: Medical imaging 2024: image-guided procedures, robotic interventions, and modeling, vol. 12928. SPIE, pp 119\u2013127","DOI":"10.1117\/12.3008390"},{"issue":"3","key":"3371_CR17","doi-asserted-by":"publisher","first-page":"247","DOI":"10.20517\/ais.2024.17","volume":"4","author":"X Shi","year":"2024","unstructured":"Shi X, Cui B, Clarkson MJ, Islam M (2024) Long-term reprojection loss for self-supervised monocular depth estimation in endoscopic surgery. Artif Intell Surg 4(3):247\u2013257","journal-title":"Artif Intell Surg"},{"key":"3371_CR18","doi-asserted-by":"crossref","unstructured":"Li Y (2023) Endodepthl: lightweight endoscopic monocular depth estimation with CNN-transformer. In: 2023 IEEE international conference on bioinformatics and biomedicine (BIBM). IEEE, pp 4344\u20134351","DOI":"10.1109\/BIBM58861.2023.10386008"},{"key":"3371_CR19","doi-asserted-by":"crossref","unstructured":"Yue H, Gu Y (2023) Tcl: triplet consistent learning for odometry estimation of monocular endoscope. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 144\u2013153","DOI":"10.1007\/978-3-031-43996-4_14"},{"key":"3371_CR20","unstructured":"Wu J, Gu Y (2023) Unleashing the power of depth and pose estimation neural networks by designing compatible endoscopic images. arXiv preprint arXiv:2309.07390"},{"key":"3371_CR21","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2024.105978","volume":"91","author":"C Liao","year":"2024","unstructured":"Liao C, Wang C, Wang P, Wu H, Wang H (2024) Self-supervised learning of monocular depth and ego-motion estimation for non-rigid scenes in wireless capsule endoscopy videos. Biomed Signal Process Control 91:105978","journal-title":"Biomed Signal Process Control"},{"key":"3371_CR22","doi-asserted-by":"crossref","unstructured":"Rodriguez-Puigvert J, Recasens D, Civera J, Martinez-Cantin R (2022) On the uncertain single-view depths in colonoscopies. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 130\u2013140","DOI":"10.1007\/978-3-031-16437-8_13"},{"key":"3371_CR23","doi-asserted-by":"crossref","unstructured":"Wang S, Zhang Y, McGill SK, Rosenman JG, Frahm J-M, Sengupta S, Pizer SM (2023) A surface-normal based neural framework for colonoscopy reconstruction. In: International conference on information processing in medical imaging. Springer, pp 797\u2013809","DOI":"10.1007\/978-3-031-34048-2_61"},{"key":"3371_CR24","doi-asserted-by":"crossref","unstructured":"Rodr\u00edguez-Puigvert J, Batlle VM, Montiel J, Martinez-Cantin R, Fua P, Tard\u00f3s JD, Civera J (2023) Lightdepth: single-view depth self-supervision from illumination decline. In: Proceedings of the IEEE\/CVF international conference on computer vision, pp 21273\u201321283","DOI":"10.1109\/ICCV51070.2023.01945"},{"key":"3371_CR25","doi-asserted-by":"crossref","unstructured":"Shi J, Dong Y, Su H, Yu SX (2017) Learning non-Lambertian object intrinsics across shapenet categories. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1685\u20131694","DOI":"10.1109\/CVPR.2017.619"},{"key":"3371_CR26","doi-asserted-by":"crossref","unstructured":"El Meslouhi O, Kardouchi M, Allali H, Gadi T, Benkaddour YA (2011) Automatic detection and inpainting of specular reflections for colposcopic images. Cent Eur J Comput Sci 1(3):341\u2013354","DOI":"10.2478\/s13537-011-0020-2"},{"key":"3371_CR27","doi-asserted-by":"crossref","unstructured":"Borgli H, Thambawita V, Smedsrud PH, Hicks S, Jha D, Eskeland SL, Randel KR, Pogorelov K, Lux M, Nguyen DTD et al (2020) Hyperkvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy. Sci Data 7(1):1\u201314","DOI":"10.1038\/s41597-020-00622-y"},{"key":"3371_CR28","doi-asserted-by":"crossref","unstructured":"Bobrow TL, Golhar M, Vijayan R, Akshintala VS, Garcia JR, Durr NJ (2023) Colonoscopy 3D video dataset with paired depth from 2D\u20133D registration. Med Image Anal 90:102956","DOI":"10.1016\/j.media.2023.102956"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-025-03371-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-025-03371-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-025-03371-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,14]],"date-time":"2025-06-14T11:34:46Z","timestamp":1749900886000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-025-03371-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,13]]},"references-count":28,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2025,6]]}},"alternative-id":["3371"],"URL":"https:\/\/doi.org\/10.1007\/s11548-025-03371-8","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,13]]},"assertion":[{"value":"18 February 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 March 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 May 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}