{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,17]],"date-time":"2026-08-17T23:10:02Z","timestamp":1787008202271,"version":"build-2736575974"},"reference-count":28,"publisher":"SAGE Publications","issue":"8","license":[{"start":{"date-parts":[[2024,8,1]],"date-time":"2024-08-01T00:00:00Z","timestamp":1722470400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Endourology"],"published-print":{"date-parts":[[2024,8]]},"abstract":"<jats:sec>\n                    <jats:title>Introduction:<\/jats:title>\n                    <jats:p>Endoscopic tumor ablation of upper tract urothelial carcinoma (UTUC) allows for tumor control with the benefit of renal preservation but is impacted by intraoperative visibility. We sought to develop a computer vision model for real-time, automated segmentation of UTUC tumors to augment visualization during treatment.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods:<\/jats:title>\n                    <jats:p>\n                      We collected 20 videos of endoscopic treatment of UTUC from two institutions. Frames from each video (\n                      <jats:italic toggle=\"yes\">N<\/jats:italic>\n                      \u2009=\u20093387) were extracted and manually annotated to identify tumors and areas of ablated tumor. Three established computer vision models (U-Net, U-Net++, and UNext) were trained using these annotated frames and compared. Eighty percent of the data was used to train the models while 10% was used for both validation and testing. We evaluated the highest performing model for tumor and ablated tissue segmentation using a pixel-based analysis. The model and a video overlay depicting tumor segmentation were further evaluated intraoperatively.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>All 20 videos (mean 36\u2009\u00b1\u200958 seconds) demonstrated tumor identification and 12 depicted areas of ablated tumor. The U-Net model demonstrated the best performance for segmentation of both tumors (area under the receiver operating curve [AUC-ROC] of 0.96) and areas of ablated tumor (AUC-ROC of 0.90). In addition, we implemented a working system to process real-time video feeds and overlay model predictions intraoperatively. The model was able to annotate new videos at 15 frames per second.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions:<\/jats:title>\n                    <jats:p>Computer vision models demonstrate excellent real-time performance for automated upper tract urothelial tumor segmentation during ureteroscopy.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1089\/end.2023.0686","type":"journal-article","created":{"date-parts":[[2024,4,25]],"date-time":"2024-04-25T09:43:23Z","timestamp":1714038203000},"page":"836-842","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":9,"title":["Automated Upper Tract Urothelial Carcinoma Tumor Segmentation During Ureteroscopy Using Computer Vision Techniques"],"prefix":"10.1177","volume":"38","author":[{"given":"Daiwei","family":"Lu","sequence":"first","affiliation":[{"name":"Department of Computer Science, Vanderbilt University School of Engineering, Nashville, Tennessee, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amy","family":"Reed","sequence":"additional","affiliation":[{"name":"Department of Urology, Vanderbilt University Medical Center, Nashville, Tennessee, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Natalie","family":"Pace","sequence":"additional","affiliation":[{"name":"Department of Urology, Vanderbilt University Medical Center, Nashville, Tennessee, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amy N.","family":"Luckenbaugh","sequence":"additional","affiliation":[{"name":"Department of Urology, Vanderbilt University Medical Center, Nashville, Tennessee, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maximilian","family":"Pallauf","sequence":"additional","affiliation":[{"name":"Department of Urology, Johns Hopkins University, Baltimore, Maryland, USA."},{"name":"Department of Urology, University Hospital Salzburg, Paracelsus Medical University Salzburg, Salzburg, Austria."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nirmish","family":"Singla","sequence":"additional","affiliation":[{"name":"Department of Urology, Johns Hopkins University, Baltimore, Maryland, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ipek","family":"Oguz","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Vanderbilt University School of Engineering, Nashville, Tennessee, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicholas","family":"Kavoussi","sequence":"additional","affiliation":[{"name":"Department of Urology, Vanderbilt University Medical Center, Nashville, Tennessee, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2024,8,1]]},"reference":[{"key":"e_1_3_5_2_2","doi-asserted-by":"publisher","DOI":"10.1097\/JU.0000000000003480"},{"key":"e_1_3_5_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11934-017-0675-x"},{"key":"e_1_3_5_4_2","doi-asserted-by":"publisher","DOI":"10.1097\/01.ju.0000158139.65771.0a"},{"key":"e_1_3_5_5_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1464-410x.1991.tb15064.x"},{"key":"e_1_3_5_6_2","doi-asserted-by":"publisher","DOI":"10.3390\/jcm11051307"},{"key":"e_1_3_5_7_2","doi-asserted-by":"publisher","DOI":"10.1093\/jnci\/djab179"},{"key":"e_1_3_5_8_2","doi-asserted-by":"publisher","DOI":"10.1089\/end.2020.0919"},{"key":"e_1_3_5_9_2","doi-asserted-by":"publisher","DOI":"10.1089\/end.2022.0511"},{"key":"e_1_3_5_10_2","unstructured":"Skalski P. Make sense. Git Code. 2019. Available from: https:\/\/github.com\/SkalskiP\/make-sense [Last accessed: April29 2024]."},{"key":"e_1_3_5_11_2","doi-asserted-by":"crossref","unstructured":"Ronneberger O Fischer P Brox T. U-net: Convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2015: 18th International Conference. Springer: Cham; 2015; pp. 234\u2013241.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"e_1_3_5_12_2","doi-asserted-by":"crossref","unstructured":"Zhou Z Rahman Siddiquee MM Tajbakhsh N et al. Unet++: A nested u-net architecture for medical image segmentation. In: Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop DLMIA 2018 and 8th International Workshop ML-CDS. Springer: Cham; 2018; pp. 3\u201311.","DOI":"10.1007\/978-3-030-00889-5_1"},{"key":"e_1_3_5_13_2","doi-asserted-by":"crossref","unstructured":"J\u00e9gou S Drozdzal M Vazquez D et al. The one hundred layers tiramisu: Fully convolutional densenets for semantic segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops. 2017; pp. 11\u201319.","DOI":"10.1109\/CVPRW.2017.156"},{"key":"e_1_3_5_14_2","unstructured":"Yakubovskiy P. Segmentation models pytorch. GitHub Repos. 2020: 57. Available from: https:\/\/github.com\/qubvel\/segmentation_models.pytorch [Last accessed: April29 2024]."},{"issue":"10","key":"e_1_3_5_15_2","first-page":"5393","article-title":"Binary cross entropy with deep learning technique for image classification","volume":"9","author":"Ruby U","year":"2020","unstructured":"Ruby U, , Yendapalli V. Binary cross entropy with deep learning technique for image classification. Int J Adv Trends Comput Sci Eng, 2020; 9(10):5393\u20135397.","journal-title":"Int J Adv Trends Comput Sci Eng"},{"key":"e_1_3_5_16_2","first-page":"851","article-title":"Rethinking dice loss for medical image segmentation. In: IEEE International Conference on Data Mining (ICDM)","author":"Zhao R","year":"2020","unstructured":"Zhao R, , Qian B, , Zhang X, et al. Rethinking dice loss for medical image segmentation. In: IEEE International Conference on Data Mining (ICDM). IEEE: Sorrento, Italy;, 2020; 851\u2013860.","journal-title":"IEEE: Sorrento, Italy;"},{"key":"e_1_3_5_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.euf.2021.07.004"},{"key":"e_1_3_5_18_2","doi-asserted-by":"crossref","unstructured":"Lu D Kavoussi N Oguz I. Automated UTUC carcinoma tumor segmentation during ureteroscopy using computer vision techniques. Git Code. 2024. Available from: https:\/\/lu-d.github.io\/utuc\/ [Last accessed: April29 2024].","DOI":"10.1089\/end.2023.0686"},{"key":"e_1_3_5_19_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00345-009-0494-x"},{"key":"e_1_3_5_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.urology.2018.05.042"},{"key":"e_1_3_5_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.juro.2017.07.088"},{"key":"e_1_3_5_22_2","doi-asserted-by":"publisher","DOI":"10.1097\/JU.0000000000001505"},{"key":"e_1_3_5_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11934-021-01065-7"},{"key":"e_1_3_5_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.juro.2012.12.006"},{"key":"e_1_3_5_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.juro.2010.02.005"},{"key":"e_1_3_5_26_2","first-page":"900","article-title":"Segmentation of kidney stones in endoscopic video feeds","author":"Stoebner ZA","year":"2022","unstructured":"Stoebner ZA, , Lu D, , Hong SH, et al. Segmentation of kidney stones in endoscopic video feeds. In: Medical Imaging 2022: Image Processing, Vol. 12032. SPIE Medical Imaging, San Diego, CA, USA; 2022; 900\u2013908.","journal-title":"SPIE Medical Imaging"},{"key":"e_1_3_5_27_2","doi-asserted-by":"publisher","DOI":"10.1097\/JU.0000000000003331.03"},{"key":"e_1_3_5_28_2","doi-asserted-by":"publisher","DOI":"10.1364\/BOE.8.002106"},{"key":"e_1_3_5_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eururo.2019.08.032"}],"container-title":["Journal of Endourology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1089\/end.2023.0686","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1089\/end.2023.0686","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1089\/end.2023.0686","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T20:16:04Z","timestamp":1777407364000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1089\/end.2023.0686"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8]]},"references-count":28,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2024,8]]}},"alternative-id":["10.1089\/end.2023.0686"],"URL":"https:\/\/doi.org\/10.1089\/end.2023.0686","relation":{},"ISSN":["0892-7790","1557-900X"],"issn-type":[{"value":"0892-7790","type":"print"},{"value":"1557-900X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8]]}}}