{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T18:48:25Z","timestamp":1760986105503,"version":"3.41.2"},"reference-count":50,"publisher":"World Scientific Pub Co Pte Ltd","issue":"02n03","funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1631146"],"award-info":[{"award-number":["1631146"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Department of Mechanical Engineering, University of Washington"},{"DOI":"10.13039\/100011248","name":"CoMotion, University of Washington","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100011248","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Med. Robot. Res."],"published-print":{"date-parts":[[2022,6]]},"abstract":"<jats:p> Telecystoscopy can lower the barrier to access critical urologic diagnostics for patients around the world. A major challenge for robotic control of flexible cystoscopes and intuitive teleoperation is the pose estimation of the scope tip. We propose a novel real-time camera localization method using video recordings from a prior cystoscopy and 3D bladder reconstruction to estimate cystoscope pose within the bladder during follow-up telecystoscopy. We map prior video frames into a low-dimensional space as a dictionary so that a new image can be likewise mapped to efficiently retrieve its nearest neighbor among the dictionary images. The cystoscope pose is then estimated by the correspondence among the new image, its nearest dictionary image, and the prior model from 3D reconstruction. We demonstrate performance of our methods using bladder phantoms with varying fidelity and a servo-controlled cystoscope to simulate the use case of bladder surveillance through telecystoscopy. The servo-controlled cystoscope with 3 degrees of freedom (angulation, roll, and insertion axes) was developed for collecting cystoscope videos from bladder phantoms. Cystoscope videos were acquired in a 2.5D bladder phantom (bladder-shape cross-section plus height) with a panorama of a urothelium attached to the inner surface. Scans of the 2.5D phantom were performed in separate arc trajectories each of which is generated by actuation on the angulation with a fixed roll and insertion length. We further included variance in moving speed, imaging distance and existence of bladder tumors. Cystoscope videos were also acquired in a water-filled 3D silicone bladder phantom with hand-painted vasculature. Scans of the 3D phantom were performed in separate circle trajectories each of which is generated by actuation on the roll axis under a fixed angulation and insertion length. These videos were used to create 3D reconstructions, dictionary sets, and test data sets for evaluating the computational efficiency and accuracy of our proposed method in comparison with a method based on global Scale-Invariant Feature Transform (SIFT) features, named SIFT-only. Our method can retrieve the nearest dictionary image for 94\u2013100% of test frames in under 55[Formula: see text]ms per image, whereas the SIFT-only method can only find the image match for 56\u2013100% of test frames in 6000\u201340000[Formula: see text]ms per image depending on size of the dictionary set and richness of SIFT features in the images. Our method, with a speed of around 20\u2009Hz for the retrieval stage, is a promising tool for real-time image-based scope localization in robotic cystoscopy when prior cystoscopy images are available. <\/jats:p>","DOI":"10.1142\/s2424905x22410021","type":"journal-article","created":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T16:53:04Z","timestamp":1651164784000},"source":"Crossref","is-referenced-by-count":1,"title":["Real-Time Camera Localization during Robot-Assisted Telecystoscopy for Bladder Cancer Surveillance"],"prefix":"10.1142","volume":"07","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4142-7380","authenticated-orcid":false,"given":"Chen","family":"Gong","sequence":"first","affiliation":[{"name":"Mechanical Engineering, University of Washington, 3900 E Stevens Way NE, Seattle, WA 98195, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yaxuan","family":"Zhou","sequence":"additional","affiliation":[{"name":"Electrical and Computer Engineering, University of Washington, 185 W Stevens Way NE, Seattle, WA 98195, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew","family":"Lewis","sequence":"additional","affiliation":[{"name":"Mechanical Engineering, University of Washington, 3900 E Stevens Way NE, Seattle, WA 98195, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pengcheng","family":"Chen","sequence":"additional","affiliation":[{"name":"Mechanical Engineering, University of Washington, 3900 E Stevens Way NE, Seattle, WA 98195, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jason R.","family":"Speich","sequence":"additional","affiliation":[{"name":"Center for Research and Education in Simulation Technologies (CREST), University of Washington, 1959 NE Pacific St., Seattle, WA 98195, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael P.","family":"Porter","sequence":"additional","affiliation":[{"name":"Department of Urology, University of Washington, 1959 NE Pacific St., Seattle, WA 98195, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Blake","family":"Hannaford","sequence":"additional","affiliation":[{"name":"Electrical and Computer Engineering, University of Washington, 185 W Stevens Way NE, Seattle, WA 98195, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eric J.","family":"Seibel","sequence":"additional","affiliation":[{"name":"Mechanical Engineering, University of Washington, 3900 E Stevens Way NE, Seattle, WA 98195, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2022,5,14]]},"reference":[{"key":"S2424905X22410021BIB002","doi-asserted-by":"publisher","DOI":"10.3322\/caac.21654"},{"key":"S2424905X22410021BIB003","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1097\/MOU.0000000000000078","volume":"24","author":"Mossanen M.","year":"2014","journal-title":"Curr. Opin. Urol."},{"issue":"17","key":"S2424905X22410021BIB004","doi-asserted-by":"crossref","first-page":"3219","DOI":"10.1002\/cncr.28147","volume":"119","author":"Chamie K.","year":"2014","journal-title":"Cancer"},{"key":"S2424905X22410021BIB006","doi-asserted-by":"crossref","first-page":"5235","DOI":"10.1002\/cncr.25310","volume":"116","author":"Hollenbeck B. K.","year":"2010","journal-title":"Cancer"},{"issue":"4","key":"S2424905X22410021BIB008","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1097\/00000658-200204000-00005","volume":"235","author":"Marescaux J.","year":"2006","journal-title":"Ann. Surg."},{"key":"S2424905X22410021BIB009","first-page":"3895","volume-title":"Int. Conf. Robotics and Automation (ICRA)","author":"Graetzel C. F.","year":"2019"},{"key":"S2424905X22410021BIB010","doi-asserted-by":"crossref","first-page":"694","DOI":"10.1016\/j.chest.2019.10.016","volume":"157","author":"Yarmus L.","year":"2020","journal-title":"Chest"},{"issue":"6","key":"S2424905X22410021BIB011","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1089\/end.2018.0119","volume":"32","author":"Sarli N.","year":"2018","journal-title":"J. Endourol."},{"issue":"4","key":"S2424905X22410021BIB012","doi-asserted-by":"crossref","first-page":"1452","DOI":"10.1109\/TMECH.2019.2918137","volume":"24","author":"Sarli N.","year":"2020","journal-title":"IEEE\/ASME Trans. Mechatron."},{"issue":"13","key":"S2424905X22410021BIB013","doi-asserted-by":"crossref","first-page":"1559","DOI":"10.1177\/0278364915585397","volume":"34","author":"Hendrick R. J.","year":"2015","journal-title":"Int. J. Robot. Res."},{"key":"S2424905X22410021BIB014","doi-asserted-by":"crossref","first-page":"e29","DOI":"10.22374\/jeleu.v4i1.120","volume":"4","author":"Wong A.","year":"2021","journal-title":"J. Endoluminal Endourol."},{"issue":"2","key":"S2424905X22410021BIB015","doi-asserted-by":"crossref","first-page":"530","DOI":"10.1016\/j.jvs.2016.01.045","volume":"65","author":"Schwein A.","year":"2017","journal-title":"J. Vasc. Surg."},{"key":"S2424905X22410021BIB016","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1002\/rcs.1496","volume":"9","author":"Rozeboom E. D.","year":"2013","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"S2424905X22410021BIB017","first-page":"3725","volume-title":"Proc. \u2014 IEEE Int. Conf. Robotics and Automation","author":"Bardou B.","year":"2012"},{"issue":"6","key":"S2424905X22410021BIB018","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1586\/17434440.2015.1080120","volume":"12","author":"Sliker L.","year":"2015","journal-title":"Expert Rev. Med. Devices"},{"key":"S2424905X22410021BIB019","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmmm.2017.12.085"},{"key":"S2424905X22410021BIB020","doi-asserted-by":"publisher","DOI":"10.1080\/17434440.2019.1608182"},{"key":"S2424905X22410021BIB021","first-page":"1086","volume-title":"2012 IEEE Int. Conf. Robotics and Biomimetics, ROBIO 2012 \u2014 Conf. Digest","author":"Fang C.","year":"2012"},{"key":"S2424905X22410021BIB022","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2016.2624754"},{"issue":"1","key":"S2424905X22410021BIB023","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1109\/TMI.2013.2282997","volume":"33","author":"Grasa O. G.","year":"2014","journal-title":"IEEE Trans. Med. Imaging"},{"issue":"1","key":"S2424905X22410021BIB024","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1109\/TMI.2018.2856109","volume":"38","author":"Mahmoud N.","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"issue":"9","key":"S2424905X22410021BIB025","doi-asserted-by":"crossref","first-page":"1314","DOI":"10.1016\/j.jiph.2019.06.028","volume":"13","author":"Xie C.","year":"2020","journal-title":"J. Infect. Publ. Health"},{"issue":"9","key":"S2424905X22410021BIB026","doi-asserted-by":"crossref","first-page":"1314","DOI":"10.1016\/j.jiph.2019.06.028","volume":"13","author":"Xie C.","year":"2020","journal-title":"J. Infect. Publ. Health"},{"issue":"6","key":"S2424905X22410021BIB027","doi-asserted-by":"crossref","first-page":"1670","DOI":"10.1109\/TBME.2012.2191783","volume":"59","author":"Soper T. D.","year":"2012","journal-title":"IEEE Trans. Biomed. Eng."},{"issue":"4","key":"S2424905X22410021BIB029","doi-asserted-by":"crossref","first-page":"2106","DOI":"10.1364\/BOE.8.002106","volume":"8","author":"Lurie K. L.","year":"2017","journal-title":"Biomed. Opt. Express"},{"issue":"4","key":"S2424905X22410021BIB030","doi-asserted-by":"crossref","DOI":"10.1515\/bmt-2016-0185","volume":"63","author":"Pentek Q.","year":"2018","journal-title":"Biomedizinische Technik. Biomed. Eng."},{"key":"S2424905X22410021BIB031","first-page":"18","volume-title":"Therapeutics and Diagnostics in Urology 2019","volume":"10852","author":"Falcon N. O.","year":"2019"},{"key":"S2424905X22410021BIB032","doi-asserted-by":"crossref","first-page":"1800711","DOI":"10.1109\/JTEHM.2021.3132193","volume":"9","author":"Zhou Y.","year":"2021","journal-title":"IEEE J. Transl. Eng. Health Med."},{"key":"S2424905X22410021BIB033","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"key":"S2424905X22410021BIB034","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2007.09.014"},{"key":"S2424905X22410021BIB035","first-page":"1","volume-title":"Living Imaging Workshop","author":"Vemuri A. S.","year":"2011"},{"key":"S2424905X22410021BIB036","first-page":"1","volume-title":"13th IEEE Int. Conf. BioInformatics and BioEngineering","author":"Iakovidis D. K.","year":"2013"},{"key":"S2424905X22410021BIB037","first-page":"397","volume-title":"Int. Conf. Medical Image Computing and Computer-Assisted Intervention","author":"Richa R.","year":"2012"},{"key":"S2424905X22410021BIB039","series-title":"Informatik aktuell","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1007\/3-540-32137-3_85","volume-title":"Bildverarbeitung in der Medizin","author":"Wengert C.","year":"2006"},{"key":"S2424905X22410021BIB041","volume-title":"Symp. Geom Process","volume":"7","author":"Kazhdan M.","year":"2006"},{"volume-title":"Proc. ECCV","year":"2014","author":"Waechter M.","key":"S2424905X22410021BIB042"},{"issue":"8","key":"S2424905X22410021BIB043","volume":"1","author":"Wu Y.","year":"2018","journal-title":"Vis. Comput. Ind. Biomed. Art"},{"issue":"8","key":"S2424905X22410021BIB044","doi-asserted-by":"crossref","first-page":"1993","DOI":"10.1109\/TMI.2019.2923466","volume":"38","author":"Gong C.","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"S2424905X22410021BIB045","doi-asserted-by":"publisher","DOI":"10.1007\/BFb0020217"},{"key":"S2424905X22410021BIB046","doi-asserted-by":"publisher","DOI":"10.1126\/science.290.5500.2319"},{"volume-title":"SPIE Medical Imaging","year":"2022","author":"Chen P.","key":"S2424905X22410021BIB047"},{"key":"S2424905X22410021BIB048","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1002\/rcs.1496","volume":"9","author":"Reilink R.","year":"2013","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"S2424905X22410021BIB049","first-page":"1013512","volume-title":"Proc. SPIE Int. Soc. Opt. Eng.","volume":"10135","author":"Talari H. F.","year":"2017"},{"key":"S2424905X22410021BIB050","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/B978-0-12-802439-3.00004-9","volume-title":"Endoscopic Diagnosis and Treatment in Urinary Bladder Pathology","author":"Geavlete P. A.","year":"2016"},{"key":"S2424905X22410021BIB051","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-006-0002-3"},{"issue":"5","key":"S2424905X22410021BIB052","doi-asserted-by":"crossref","first-page":"694","DOI":"10.1109\/42.736021","volume":"17","author":"Fitzpatrick J. M.","year":"1998","journal-title":"IEEE Trans. Med. Imaging"},{"key":"S2424905X22410021BIB054","doi-asserted-by":"publisher","DOI":"10.1145\/1970392.1970395"},{"issue":"8","key":"S2424905X22410021BIB055","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1109\/JPROC.2018.2853589","volume":"106","author":"Bouwmans T.","year":"2018","journal-title":"Proc. IEEE"},{"key":"S2424905X22410021BIB056","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2015.08.104"},{"key":"S2424905X22410021BIB057","first-page":"8463","volume-title":"Proc. IEEE\/CVF Conf. Computer Vision and Pattern Recognition","author":"Niethammer M.","year":"2019"}],"container-title":["Journal of Medical Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S2424905X22410021","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,30]],"date-time":"2022-09-30T14:21:33Z","timestamp":1664547693000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S2424905X22410021"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,14]]},"references-count":50,"journal-issue":{"issue":"02n03","published-print":{"date-parts":[[2022,6]]}},"alternative-id":["10.1142\/S2424905X22410021"],"URL":"https:\/\/doi.org\/10.1142\/s2424905x22410021","relation":{},"ISSN":["2424-905X","2424-9068"],"issn-type":[{"type":"print","value":"2424-905X"},{"type":"electronic","value":"2424-9068"}],"subject":[],"published":{"date-parts":[[2022,5,14]]},"article-number":"2241002"}}