{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T03:52:40Z","timestamp":1780631560674,"version":"3.54.1"},"reference-count":57,"publisher":"World Scientific Pub Co Pte Ltd","issue":"02n03","funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-2101107"],"award-info":[{"award-number":["IIS-2101107"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Med. Robot. Res."],"published-print":{"date-parts":[[2022,6]]},"abstract":"<jats:p> This paper presents a tool-pose-informed variable center morphological polar transform to enhance segmentation of endoscopic images. The representation, while not loss-less, transforms rigid tool shapes into morphologies consistently more rectangular that may be more amenable to image segmentation networks. The proposed method was evaluated using the U-Net convolutional neural network, and the input images from endoscopy were represented in one of the four different coordinate formats (1) the original rectangular image representation, (2) the morphological polar coordinate transform, (3) the proposed variable center transform about the tool-tip pixel and (4) the proposed variable center transform about the tool vanishing point pixel. Previous work relied on the observations that endoscopic images typically exhibit unused border regions with content in the shape of a circle (since the image sensor is designed to be larger than the image circle to maximize available visual information in the constrained environment) and that the region of interest (ROI) was most ideally near the endoscopic image center. That work sought an intelligent method for, given an input image, carefully selecting between methods (1) and (2) for best image segmentation prediction. In this extension, the image center reference constraint for polar transformation in method (2) is relaxed via the development of a variable center morphological transformation. Transform center selection leads to different spatial distributions of image loss, and the transform-center location can be informed by robot kinematic model and endoscopic image data. In particular, this work is examined using the tool-tip and tool vanishing point on the image plane as candidate centers. The experiments were conducted for each of the four image representations using a data set of 8360 endoscopic images from real sinus surgery. The segmentation performance was evaluated with standard metrics, and some insight about loss and tool location effects on performance are provided. Overall, the results are promising, showing that selecting a transform center based on tool shape features using the proposed method can improve segmentation performance. <\/jats:p>","DOI":"10.1142\/s2424905x22410033","type":"journal-article","created":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T16:53:04Z","timestamp":1651164784000},"source":"Crossref","is-referenced-by-count":10,"title":["Surgical Tool Segmentation with Pose-Informed Morphological Polar Transform of Endoscopic Images"],"prefix":"10.1142","volume":"07","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0300-9911","authenticated-orcid":false,"given":"Kevin","family":"Huang","sequence":"first","affiliation":[{"name":"Department of Engineering, Trinity College, 300 Summit St, Hartford, CT 06106, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Digesh","family":"Chitrakar","sequence":"additional","affiliation":[{"name":"Department of Engineering, Trinity College, 300 Summit St, Hartford, CT 06106, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenfan","family":"Jiang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Mount Holyoke College, 50 College St, South Hadley, MA 01075, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Isabella","family":"Yung","sequence":"additional","affiliation":[{"name":"Department of Engineering, Trinity College, 300 Summit St, Hartford, CT 06106, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yun-Hsuan","family":"Su","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Mount Holyoke College, 50 College St, South Hadley, MA 01075, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"219","published-online":{"date-parts":[[2022,6,9]]},"reference":[{"issue":"10","key":"S2424905X22410033BIB001","doi-asserted-by":"crossref","first-page":"2970","DOI":"10.1007\/s00464-014-4030-8","volume":"29","author":"Koehn J. K.","year":"2015","journal-title":"Surg. Endosc."},{"key":"S2424905X22410033BIB002","first-page":"4903","volume-title":"2020 42nd Annual Int. Conf. IEEE Engineering in Medicine & Biology Society (EMBC)","author":"Huang K.","year":"2020"},{"key":"S2424905X22410033BIB003","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1109\/ISMR48331.2020.9312951","volume-title":"2020 Int. Symp. Medical Robotics (ISMR)","author":"Su Y.-H.","year":"2020"},{"key":"S2424905X22410033BIB004","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2010.2098351"},{"key":"S2424905X22410033BIB005","first-page":"7911","volume-title":"2019 IEEE\/RSJ Int. Conf. Intelligent Robots and Systems (IROS)","author":"Su Y.-H.","year":"2019"},{"key":"S2424905X22410033BIB006","doi-asserted-by":"publisher","DOI":"10.1016\/j.sna.2012.12.015"},{"key":"S2424905X22410033BIB007","doi-asserted-by":"publisher","DOI":"10.1109\/ISMR.2019.8710190"},{"issue":"01","key":"S2424905X22410033BIB008","doi-asserted-by":"crossref","first-page":"2140003","DOI":"10.1142\/S2424905X21400031","volume":"6","author":"Su Y.-H.","year":"2021","journal-title":"J. Med. Robot. Res."},{"key":"S2424905X22410033BIB009","doi-asserted-by":"publisher","DOI":"10.1007\/s00464-016-5255-5"},{"key":"S2424905X22410033BIB010","series-title":"International Society for Optics and Photonics","doi-asserted-by":"crossref","first-page":"97020U","DOI":"10.1117\/12.2213385","volume-title":"Optical Fibers and Sensors for Medical Diagnostics and Treatment Applications XVI","volume":"9702","author":"Shahzada K. S.","year":"2016"},{"issue":"2","key":"S2424905X22410033BIB011","doi-asserted-by":"crossref","first-page":"2264","DOI":"10.1109\/LRA.2020.2970944","volume":"5","author":"Black D. G.","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"issue":"12","key":"S2424905X22410033BIB012","doi-asserted-by":"crossref","first-page":"2603","DOI":"10.1109\/TMI.2015.2450831","volume":"34","author":"Bouget D.","year":"2015","journal-title":"IEEE Trans. Med. Imaging"},{"key":"S2424905X22410033BIB013","doi-asserted-by":"publisher","DOI":"10.3390\/s21155163"},{"key":"S2424905X22410033BIB014","first-page":"1","volume-title":"2021 Int. Symp. Medical Robotics (ISMR)","author":"Huang K.","year":"2021"},{"key":"S2424905X22410033BIB015","first-page":"534","volume-title":"Proc. 26th IEEE Int. Symp. Computer-Based Medical Systems","author":"M\u00fcnzer B.","year":"2013"},{"key":"S2424905X22410033BIB016","doi-asserted-by":"publisher","DOI":"10.1109\/ISMR.2018.8333305"},{"key":"S2424905X22410033BIB017","first-page":"664","volume-title":"Int. Conf. Medical Image Computing and Computer-assisted Intervention","author":"Laina I.","year":"2017"},{"key":"S2424905X22410033BIB018","first-page":"4411","volume-title":"2018 IEEE\/RSJ Int. Conf. Intelligent Robots and Systems (IROS)","author":"Su Y.-H.","year":"2018"},{"key":"S2424905X22410033BIB019","doi-asserted-by":"crossref","first-page":"6617","DOI":"10.1109\/ICRA.2018.8460867","volume-title":"2018 IEEE Int. Conf. Robotics and Automation (ICRA)","author":"\u00d6zg\u00fcner O.","year":"2018"},{"issue":"5","key":"S2424905X22410033BIB020","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1007\/s11548-018-1735-5","volume":"13","author":"Zia A.","year":"2018","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"issue":"11","key":"S2424905X22410033BIB021","doi-asserted-by":"crossref","first-page":"3629","DOI":"10.1007\/s00464-018-06650-5","volume":"33","author":"Minhem M. A.","year":"2019","journal-title":"Surg. Endosc."},{"issue":"6","key":"S2424905X22410033BIB022","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1177\/000313480907500606","volume":"75","author":"Alaedeen D.","year":"2009","journal-title":"Am. Surgeon"},{"issue":"7","key":"S2424905X22410033BIB023","doi-asserted-by":"crossref","first-page":"1398","DOI":"10.1007\/s11695-015-1958-2","volume":"26","author":"Nimeri A.","year":"2016","journal-title":"Obesity Surgery"},{"key":"S2424905X22410033BIB024","series-title":"International Society for Optics and Photonics","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1117\/12.595794","volume-title":"Medical Imaging 2005: Visualization, Image-Guided Procedures, and Display","volume":"5744","author":"Nageotte F.","year":"2005"},{"issue":"10","key":"S2424905X22410033BIB025","doi-asserted-by":"crossref","first-page":"2340","DOI":"10.1109\/TIP.2009.2025010","volume":"18","author":"Matungka R.","year":"2009","journal-title":"IEEE Trans. Image Process."},{"key":"S2424905X22410033BIB026","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/ICRA.2013.6630582","volume-title":"2013 IEEE Int. Conf. Robotics and Automation","author":"Iyer S.","year":"2013"},{"key":"S2424905X22410033BIB027","first-page":"1658","volume-title":"2020 42nd Annual Int. Conf. IEEE Engineering in Medicine & Biology Society (EMBC)","author":"Kanakatte A.","year":"2020"},{"key":"S2424905X22410033BIB028","first-page":"230","volume-title":"Int. Conf. Medical Image Computing and Computer-assisted Intervention","author":"Lo B. P.","year":"2003"},{"key":"S2424905X22410033BIB029","first-page":"505","volume-title":"Int. Conf. Medical Image Computing and Computer-Assisted Intervention","author":"Kurmann T.","year":"2017"},{"key":"S2424905X22410033BIB030","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1007\/978-3-030-32692-0_65","volume-title":"Int. Workshop on Machine Learning in Medical Imaging","author":"Pakhomov D.","year":"2019"},{"key":"S2424905X22410033BIB031","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1109\/ISM46123.2019.00049","volume-title":"2019 IEEE Int. Symp. Multimedia (ISM)","author":"Jha D.","year":"2019"},{"key":"S2424905X22410033BIB032","first-page":"558","volume-title":"2020 IEEE 33rd Int. Symp. Computer-based Medical Systems (CBMS)","author":"Jha D.","year":"2020"},{"key":"S2424905X22410033BIB033","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1007\/978-3-030-67835-7_19","volume-title":"Int. Conf. Multimedia Modeling","author":"Jha D.","year":"2021"},{"issue":"1","key":"S2424905X22410033BIB034","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.cmpb.2010.11.009","volume":"102","author":"Naranjo V.","year":"2011","journal-title":"Comput. Methods Prog. Biomed."},{"key":"S2424905X22410033BIB035","series-title":"International Society for Optics and Photonics","doi-asserted-by":"crossref","first-page":"65680K","DOI":"10.1117\/12.731454","volume-title":"Algorithms for Synthetic Aperture Radar Imagery XIV","volume":"6568","author":"Gorham L. A.","year":"2007"},{"key":"S2424905X22410033BIB036","first-page":"493","volume-title":"Proc. 2000 Int. Conf. Image Processing (Cat. No.00CH37101)","volume":"1","author":"Wolberg G.","year":"2000"},{"key":"S2424905X22410033BIB037","first-page":"1","volume-title":"TENCON 2009 \u2014 2009 IEEE Region 10 Conf.","author":"Sarvaiya J. N.","year":"2009"},{"key":"S2424905X22410033BIB038","first-page":"139","volume-title":"Proc. II Workshop on Cybernetic Vision","author":"Araujo H.","year":"1996"},{"issue":"10","key":"S2424905X22410033BIB039","doi-asserted-by":"crossref","first-page":"2340","DOI":"10.1109\/TIP.2009.2025010","volume":"18","author":"Matungka R.","year":"2009","journal-title":"IEEE Trans. Image Process."},{"key":"S2424905X22410033BIB040","first-page":"1","volume":"10","author":"Sasikala D.","year":"2010","journal-title":"Int. J. Video Image Process. Netw. Secur."},{"key":"S2424905X22410033BIB041","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/j.procs.2010.11.042","volume":"2","author":"Sasikala D.","year":"2010","journal-title":"Procedia Comput. Sci."},{"issue":"2","key":"S2424905X22410033BIB042","doi-asserted-by":"crossref","first-page":"1650","DOI":"10.1109\/LRA.2020.2969941","volume":"5","author":"Moccia R.","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"S2424905X22410033BIB043","first-page":"1","volume-title":"Int. Conf. Information Processing in Computer-assisted Interventions","author":"Allan M.","year":"2014"},{"issue":"6","key":"S2424905X22410033BIB044","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1080\/13645700701702135","volume":"16","author":"Chmarra M. K.","year":"2007","journal-title":"Minim. Invasive Ther. Allied Technol."},{"key":"S2424905X22410033BIB045","doi-asserted-by":"crossref","first-page":"2711","DOI":"10.1109\/CAC.2017.8243236","volume-title":"2017 Chinese Automation Congress (CAC)","author":"Chen Z.","year":"2017"},{"key":"S2424905X22410033BIB046","first-page":"544","volume":"119","author":"Tonet O.","year":"2006","journal-title":"Studies in Health Technol. Informatics"},{"issue":"5","key":"S2424905X22410033BIB047","doi-asserted-by":"crossref","first-page":"842","DOI":"10.1109\/TRA.2003.817086","volume":"19","author":"Krupa A.","year":"2003","journal-title":"IEEE Trans. Robot. Autom."},{"issue":"4","key":"S2424905X22410033BIB048","doi-asserted-by":"crossref","first-page":"1050","DOI":"10.1109\/TBME.2012.2229278","volume":"60","author":"Allan M.","year":"2012","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"S2424905X22410033BIB049","doi-asserted-by":"crossref","first-page":"9821","DOI":"10.1109\/ICRA.2019.8794122","volume-title":"2019 Int. Conf. Robotics and Automation (ICRA)","author":"Qin F.","year":"2019"},{"issue":"2","key":"S2424905X22410033BIB050","doi-asserted-by":"crossref","first-page":"2188","DOI":"10.1109\/LRA.2019.2900854","volume":"4","author":"Islam M.","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"issue":"4","key":"S2424905X22410033BIB052","doi-asserted-by":"crossref","first-page":"6639","DOI":"10.1109\/LRA.2020.3009073","volume":"5","author":"Qin F.","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"issue":"8","key":"S2424905X22410033BIB053","doi-asserted-by":"crossref","first-page":"1946","DOI":"10.1109\/TIP.2007.899190","volume":"16","author":"Park W.","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"S2424905X22410033BIB054","doi-asserted-by":"publisher","DOI":"10.1145\/357994.358023"},{"issue":"11","key":"S2424905X22410033BIB055","doi-asserted-by":"crossref","first-page":"2159","DOI":"10.1109\/TPAMI.2014.25","volume":"36","author":"Schouten T. E.","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"S2424905X22410033BIB056","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1109\/SPIN.2015.7095391","volume-title":"2015 2nd Int. Conf. Signal Processing and Integrated Networks (SPIN)","author":"Anand A.","year":"2015"},{"key":"S2424905X22410033BIB057","doi-asserted-by":"publisher","DOI":"10.1007\/s40314-014-0198-8"},{"issue":"2","key":"S2424905X22410033BIB058","doi-asserted-by":"crossref","first-page":"110","DOI":"10.3390\/diagnostics10020110","volume":"10","author":"Gadosey P. K.","year":"2020","journal-title":"sDiagnostics"}],"container-title":["Journal of Medical Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S2424905X22410033","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,30]],"date-time":"2022-09-30T14:23:15Z","timestamp":1664547795000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S2424905X22410033"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6]]},"references-count":57,"journal-issue":{"issue":"02n03","published-print":{"date-parts":[[2022,6]]}},"alternative-id":["10.1142\/S2424905X22410033"],"URL":"https:\/\/doi.org\/10.1142\/s2424905x22410033","relation":{},"ISSN":["2424-905X","2424-9068"],"issn-type":[{"value":"2424-905X","type":"print"},{"value":"2424-9068","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6]]},"article-number":"2241003"}}