{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T05:16:48Z","timestamp":1773897408854,"version":"3.50.1"},"reference-count":37,"publisher":"World Scientific Pub Co Pte Ltd","issue":"01n02","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Med. Robot. Res."],"published-print":{"date-parts":[[2023,6]]},"abstract":"<jats:p>Endoscopic video recordings are widely used in minimally invasive robot-assisted surgery, but when the endoscope is outside the patient\u2019s body, it can capture irrelevant segments that may contain sensitive information. To address this, we propose a framework that accurately detects out-of-body frames in surgical videos by leveraging self-supervision with minimal data labels. We use a massive amount of unlabeled endoscopic images to learn meaningful representations in a self-supervised manner. Our approach, which involves pre-training on an auxiliary task and fine-tuning with limited supervision, outperforms previous methods for detecting out-of-body frames in surgical videos captured from da Vinci X and Xi surgical systems. The average F1 scores range from [Formula: see text] to [Formula: see text]. Remarkably, using only [Formula: see text] of the training labels, our approach still maintains an average F1 score performance above 97, outperforming fully-supervised methods with [Formula: see text] fewer labels. These results demonstrate the potential of our framework to facilitate the safe handling of surgical video recordings and enhance data privacy protection in minimally invasive surgery.<\/jats:p>","DOI":"10.1142\/s2424905x23500022","type":"journal-article","created":{"date-parts":[[2023,4,19]],"date-time":"2023-04-19T14:20:18Z","timestamp":1681914018000},"source":"Crossref","is-referenced-by-count":4,"title":["Automatic Detection of Out-of-Body Frames in Surgical Videos for Privacy Protection Using Self-Supervised Learning and Minimal Labels"],"prefix":"10.1142","volume":"08","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1099-3141","authenticated-orcid":false,"given":"Ziheng","family":"Wang","sequence":"first","affiliation":[{"name":"Intuitive Surgical, Inc., USA"}]},{"given":"Xi","family":"Liu","sequence":"additional","affiliation":[{"name":"Intuitive Surgical, Inc., USA"}]},{"given":"Conor","family":"Perreault","sequence":"additional","affiliation":[{"name":"Intuitive Surgical, Inc., USA"}]},{"given":"Anthony","family":"Jarc","sequence":"additional","affiliation":[{"name":"Intuitive Surgical, Inc., USA"}]}],"member":"219","published-online":{"date-parts":[[2023,5,4]]},"reference":[{"issue":"9","key":"S2424905X23500022BIB001","doi-asserted-by":"crossref","first-page":"691","DOI":"10.1038\/s41551-017-0132-7","volume":"1","author":"Maier-Hein L.","year":"2017","journal-title":"Nat. Biomed. Eng."},{"issue":"3","key":"S2424905X23500022BIB002","first-page":"109","volume":"2","author":"Vedula S. S.","year":"2017","journal-title":"Innov. Surg. Sci."},{"key":"S2424905X23500022BIB004","doi-asserted-by":"crossref","first-page":"48658","DOI":"10.1109\/ACCESS.2021.3068852","volume":"9","author":"Rivas-Blanco I.","year":"2021","journal-title":"IEEE Access"},{"issue":"2","key":"S2424905X23500022BIB005","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.media.2006.10.003","volume":"11","author":"Oh J.","year":"2007","journal-title":"Med. Image Anal."},{"issue":"2","key":"S2424905X23500022BIB006","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1007\/s10278-010-9290-9","volume":"24","author":"Akg\u00fcl C. B.","year":"2011","journal-title":"J. Dig. Imag."},{"issue":"2","key":"S2424905X23500022BIB007","doi-asserted-by":"crossref","first-page":"524","DOI":"10.1016\/j.cmpb.2011.04.003","volume":"108","author":"Stanek S. R.","year":"2012","journal-title":"Comput. Methods Programs Biomed."},{"key":"S2424905X23500022BIB008","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1109\/ISM.2013.22","volume-title":"2013 IEEE Int. Symp. Multimedia","author":"M\u00fcnzer B.","year":"2013"},{"issue":"3","key":"S2424905X23500022BIB009","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1109\/TMI.2011.2174252","volume":"31","author":"Atasoy S.","year":"2011","journal-title":"IEEE Trans. Med. Imag."},{"issue":"7553","key":"S2424905X23500022BIB010","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"LeCun Y.","year":"2015","journal-title":"Nature"},{"key":"S2424905X23500022BIB011","volume-title":"Deep Learning","author":"Goodfellow I.","year":"2016"},{"issue":"7","key":"S2424905X23500022BIB012","doi-asserted-by":"crossref","first-page":"1217","DOI":"10.1007\/s11548-019-01995-1","volume":"14","author":"Funke I.","year":"2019","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"S2424905X23500022BIB013","doi-asserted-by":"crossref","first-page":"1959","DOI":"10.1007\/s11548-018-1860-1","volume":"13","author":"Wang Z.","year":"2018","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"issue":"1","key":"S2424905X23500022BIB014","doi-asserted-by":"crossref","first-page":"2141001","DOI":"10.1142\/S2424905X21410014","volume":"7","author":"Yoshida K.","year":"2022","journal-title":"J. Med. Robot. Res."},{"issue":"12","key":"S2424905X23500022BIB015","doi-asserted-by":"crossref","first-page":"9215","DOI":"10.1007\/s00464-022-09405-5","volume":"36","author":"Golany T.","year":"2022","journal-title":"Surg. Endosc."},{"issue":"2","key":"S2424905X23500022BIB016","doi-asserted-by":"crossref","first-page":"2241003","DOI":"10.1142\/S2424905X22410033","volume":"7","author":"Huang K.","year":"2022","journal-title":"J. Med. Robot. Res."},{"key":"S2424905X23500022BIB018","doi-asserted-by":"crossref","first-page":"78193","DOI":"10.1109\/ACCESS.2020.2989807","volume":"8","author":"Liu Y.","year":"2020","journal-title":"IEEE Access"},{"issue":"3","key":"S2424905X23500022BIB019","doi-asserted-by":"crossref","first-page":"1942005","DOI":"10.1142\/S2424905X19420054","volume":"4","author":"Mei Q.","year":"2019","journal-title":"J. Med. Robot. Res."},{"issue":"3","key":"S2424905X23500022BIB020","doi-asserted-by":"crossref","first-page":"542","DOI":"10.1109\/TNN.2009.2015974","volume":"20","author":"Chapelle O.","year":"2009","journal-title":"IEEE Trans. Neural Netw."},{"key":"S2424905X23500022BIB021","first-page":"923","volume-title":"Medical Imaging with Deep Learning, Proc. Third Conf. Medical Imaging with Deep Learning (PMLR, 2020)","author":"Zohar M."},{"issue":"6","key":"S2424905X23500022BIB022","doi-asserted-by":"crossref","first-page":"1049","DOI":"10.1007\/s11548-019-01944-y","volume":"14","author":"Issenhuth T.","year":"2019","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"S2424905X23500022BIB023","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1007\/978-3-030-01201-4_4","volume-title":"OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis","author":"Flouty E.","year":"2018"},{"key":"S2424905X23500022BIB024","author":"Jing L.","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"S2424905X23500022BIB025","first-page":"1920","volume-title":"Proc. IEEE\/CVF Conf. Computer Vision and Pattern Recognition","author":"Kolesnikov A.","year":"2019"},{"key":"S2424905X23500022BIB026","first-page":"132","volume-title":"Proc. European Conf. Computer Vision (ECCV)","author":"Caron M.","year":"2018"},{"key":"S2424905X23500022BIB027","first-page":"699","volume-title":"Proc. IEEE\/CVF Conf. Computer Vision and Pattern Recognition","author":"Chen T.","year":"2020"},{"key":"S2424905X23500022BIB029","first-page":"5714","volume-title":"Int. Conf. Machine Learning (PMLR, 2020)","author":"Lee H."},{"key":"S2424905X23500022BIB030","first-page":"567","volume-title":"Proc. IEEE Int. Conf. Computer Vision","author":"Deshpande A.","year":"2015"},{"key":"S2424905X23500022BIB031","first-page":"6391","volume-title":"Proc. IEEE\/CVF Int. Conf. Computer Vision","author":"Goyal P.","year":"2019"},{"key":"S2424905X23500022BIB032","first-page":"6707","volume-title":"Proc. IEEE\/CVF Conf. Computer Vision and Pattern Recognition","author":"Misra I.","year":"2020"},{"key":"S2424905X23500022BIB033","first-page":"3637","volume-title":"Proc. IEEE Conf. Computer Vision and Pattern Recognition","author":"Novotny D.","year":"2018"},{"key":"S2424905X23500022BIB034","first-page":"2536","volume-title":"Proc. IEEE Conf. Computer Vision and Pattern Recognition","author":"Pathak D.","year":"2016"},{"key":"S2424905X23500022BIB035","first-page":"770","volume-title":"Proc. IEEE Conf. Computer Vision and Pattern Recognition","author":"He K.","year":"2016"},{"key":"S2424905X23500022BIB036","first-page":"1597","volume-title":"Int. Conf. Machine Learning (PMLR, 2020)","author":"Chen T."},{"key":"S2424905X23500022BIB037","first-page":"273","volume-title":"Int. Conf. Medical Image Computing and Computer-Assisted Intervention","author":"Zia A.","year":"2018"},{"issue":"4","key":"S2424905X23500022BIB040","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1016\/j.ipm.2009.03.002","volume":"45","author":"Sokolova M.","year":"2009","journal-title":"Inf. Process. Manage."},{"issue":"1","key":"S2424905X23500022BIB041","doi-asserted-by":"crossref","first-page":"1323","DOI":"10.1007\/s11042-016-4219-z","volume":"77","author":"M\u00fcnzer B.","year":"2018","journal-title":"Multimedia Tools Appl."},{"key":"S2424905X23500022BIB042","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/JTEHM.2017.2756034","volume":"6","author":"Ghosh T.","year":"2018","journal-title":"IEEE J. Transl. Eng. Health Med."}],"container-title":["Journal of Medical Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S2424905X23500022","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,11]],"date-time":"2023-12-11T00:13:53Z","timestamp":1702253633000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S2424905X23500022"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,4]]},"references-count":37,"journal-issue":{"issue":"01n02","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["10.1142\/S2424905X23500022"],"URL":"https:\/\/doi.org\/10.1142\/s2424905x23500022","relation":{},"ISSN":["2424-905X","2424-9068"],"issn-type":[{"value":"2424-905X","type":"print"},{"value":"2424-9068","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,4]]},"article-number":"2350002"}}