{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T12:43:19Z","timestamp":1768567399671,"version":"3.49.0"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643685540","type":"electronic"}],"license":[{"start":{"date-parts":[[2024,11,22]],"date-time":"2024-11-22T00:00:00Z","timestamp":1732233600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,11,22]]},"abstract":"<jats:p>The ability to recognize anatomical landmarks, microsurgical instruments, and complex scenes and events in a surgical wound using computer vision presents new opportunities for studying microsurgery effectiveness. In this study, we aimed to develop an artificial intelligence-based solution for detecting, segmenting, and tracking microinstruments using a neurosurgical microscope. We have developed a technique to process videos from microscope camera, which involves creating a segmentation mask for the instrument and subsequently tracking it. We compared two segmentation approaches: (1) semantic segmentation using Visual Transformers (pre-trained domain-specific EndoViT model), enhanced with tracking as described by Cheng Y. et al. (our proposed approach), and (2) instance segmentation with tracking based on the YOLOv8l-seg architecture. We conducted experiments using the CholecSeg8k dataset and our proprietary set of neurosurgical videos (PSNV) from microscope. Our approach with tracking outperformed YOLOv8l-seg-based solutions and EndoViT model with no tracking on both CholecSeg8k (mean IoT = 0.8158, mean Dice = 0.8657) and PSNV (mean IoT = 0.7196, mean Dice = 0.8202) datasets. Our experiments with identifying neurosurgical instruments in a microscope\u2019s field of view showcase the high quality of these technologies and their potential for valuable applications.<\/jats:p>","DOI":"10.3233\/shti241089","type":"book-chapter","created":{"date-parts":[[2024,11,22]],"date-time":"2024-11-22T11:37:47Z","timestamp":1732275467000},"source":"Crossref","is-referenced-by-count":1,"title":["A Neurosurgical Instrument Segmentation Approach to Assess Microsurgical Movements"],"prefix":"10.3233","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1442-5993","authenticated-orcid":false,"given":"Gleb","family":"Danilov","sequence":"first","affiliation":[{"name":"Laboratory of Biomedical Informatics and Artificial Intelligence, cDepartment of Neurosurgery, National Medical Research Center for Neurosurgery named after N.N. Burdenko, Moscow, Russian Federation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Oleg","family":"Pilipenko","sequence":"additional","affiliation":[{"name":"Laboratory of Biomedical Informatics and Artificial Intelligence, cDepartment of Neurosurgery, National Medical Research Center for Neurosurgery named after N.N. Burdenko, Moscow, Russian Federation"},{"name":"Faculty of Computational Mathematics and Cybernetics, Lomonosov Moscow State University, Moscow, Russian Federation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0582-4909","authenticated-orcid":false,"given":"Vasiliy","family":"Kostyumov","sequence":"additional","affiliation":[{"name":"Faculty of Computational Mathematics and Cybernetics, Lomonosov Moscow State University, Moscow, Russian Federation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sergey","family":"Trubetskoy","sequence":"additional","affiliation":[{"name":"Faculty of Computational Mathematics and Cybernetics, Lomonosov Moscow State University, Moscow, Russian Federation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9408-023X","authenticated-orcid":false,"given":"Narek","family":"Maloyan","sequence":"additional","affiliation":[{"name":"Faculty of Computational Mathematics and Cybernetics, Lomonosov Moscow State University, Moscow, Russian Federation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9906-1505","authenticated-orcid":false,"given":"Bulat","family":"Nutfullin","sequence":"additional","affiliation":[{"name":"Faculty of Computational Mathematics and Cybernetics, Lomonosov Moscow State University, Moscow, Russian Federation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9891-8658","authenticated-orcid":false,"given":"Eugeniy","family":"Ilyushin","sequence":"additional","affiliation":[{"name":"Faculty of Computational Mathematics and Cybernetics, Lomonosov Moscow State University, Moscow, Russian Federation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0374-7970","authenticated-orcid":false,"given":"David","family":"Pitskhelauri","sequence":"additional","affiliation":[{"name":"Laboratory of Biomedical Informatics and Artificial Intelligence, cDepartment of Neurosurgery, National Medical Research Center for Neurosurgery named after N.N. Burdenko, Moscow, Russian Federation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexandra","family":"Zelenova","sequence":"additional","affiliation":[{"name":"N.I. Pirogov Russian National Research Medical University, Moscow, Russian Federation"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0588-4779","authenticated-orcid":false,"given":"Andrey","family":"Bykanov","sequence":"additional","affiliation":[{"name":"Laboratory of Biomedical Informatics and Artificial Intelligence, cDepartment of Neurosurgery, National Medical Research Center for Neurosurgery named after N.N. Burdenko, Moscow, Russian Federation"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"7437","container-title":["Studies in Health Technology and Informatics","Collaboration across Disciplines for the Health of People, Animals and Ecosystems"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/SHTI241089","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,22]],"date-time":"2024-11-22T11:37:48Z","timestamp":1732275468000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/SHTI241089"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,22]]},"ISBN":["9781643685540"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/shti241089","relation":{},"ISSN":["0926-9630","1879-8365"],"issn-type":[{"value":"0926-9630","type":"print"},{"value":"1879-8365","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,22]]}}}