{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T13:16:30Z","timestamp":1785417390214,"version":"3.56.0"},"reference-count":22,"publisher":"Optica Publishing Group","issue":"2","license":[{"start":{"date-parts":[[2025,1,14]],"date-time":"2025-01-14T00:00:00Z","timestamp":1736812800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/doi.org\/10.1364\/OA_License_v2#VOR-OA"},{"start":{"date-parts":[[2025,1,14]],"date-time":"2025-01-14T00:00:00Z","timestamp":1736812800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/opg.optica.org\/policies\/opg-tdm-policy.json"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62075033"],"award-info":[{"award-number":["62075033"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62135002"],"award-info":[{"award-number":["62135002"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100012542","name":"Sichuan Province Science and Technology Support Program","doi-asserted-by":"publisher","award":["2024YFHZ0174"],"award-info":[{"award-number":["2024YFHZ0174"]}],"id":[{"id":"10.13039\/100012542","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100012542","name":"Sichuan Province Science and Technology Support Program","doi-asserted-by":"publisher","award":["2023YFS0022"],"award-info":[{"award-number":["2023YFS0022"]}],"id":[{"id":"10.13039\/100012542","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Open Research Funds Province Key Laboratory of Ophthalmology","award":["202104010910013"],"award-info":[{"award-number":["202104010910013"]}]},{"name":"Medico-Engineering Cooperation Funds from University of Electronic Science and Technology of China","award":["ZYGX2021YGCX004"],"award-info":[{"award-number":["ZYGX2021YGCX004"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["ZYGX2021J009"],"award-info":[{"award-number":["ZYGX2021J009"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["opg.optica.org"],"crossmark-restriction":false},"short-container-title":["Biomed. Opt. Express"],"published-print":{"date-parts":[[2025,2,1]]},"abstract":"<jats:p>Phacoemulsification with intraocular lens (IOL) implantation is a widely used effective treatment for cataracts. However, the surgical outcome relies heavily on precise operations with marked eye location and orientation, which ideally require a high-precision navigation system for complete guidance of surgical procedure. However, both research and current commercial surgical microscopes still face substantial challenges in handling various complex clinical scenarios. Here we propose a neural network-powered surgical microscopic system that can benefit from big data to address the unmet clinical need. In this system, we designed an end-to-end navigation network for real-time positioning and alignment of IOL and then built a computer-assisted surgical microscope with a complete imaging and display platform integrating the control software and algorithms for surgical planning and navigation. The network used an attention-based encoder-decoder architecture with an edge padding mechanism and an MLP layer for eye center localization, and combined siamese network, correlation filter, and spatial transformation network to track eye rotation. Using computer-aided annotation, we collected and labeled 100 clinical surgery videos from 100 patients, and proposed a data augmentation method to enhance the diversity of training. We further evaluated the navigation performance of the microscopic system on a human eye model.<\/jats:p>","DOI":"10.1364\/boe.542436","type":"journal-article","created":{"date-parts":[[2024,12,18]],"date-time":"2024-12-18T03:00:31Z","timestamp":1734490831000},"page":"535","update-policy":"https:\/\/doi.org\/10.1364\/crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Neural network powered microscopic system for cataract surgery"],"prefix":"10.1364","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2476-3577","authenticated-orcid":true,"given":"Yuxuan","family":"Zhai","sequence":"first","affiliation":[{"id":[{"id":"https:\/\/ror.org\/04qr3zq92","id-type":"ROR","asserted-by":"publisher"}]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chunsheng","family":"Ji","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/04qr3zq92","id-type":"ROR","asserted-by":"publisher"}]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yaqi","family":"Wang","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/04qr3zq92","id-type":"ROR","asserted-by":"publisher"}]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chao","family":"Qu","sequence":"additional","affiliation":[{"name":"University of Electronic Science and Technology of China"},{"name":"Sichuan Provincial People\u2019s Hospital"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chong","family":"He","sequence":"additional","affiliation":[{"name":"University of Electronic Science and Technology of China"},{"name":"Sichuan Provincial People\u2019s Hospital"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fang","family":"Lu","sequence":"additional","affiliation":[{"name":"University of Electronic Science and Technology of China"},{"name":"Sichuan Provincial People\u2019s Hospital"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lin","family":"Huang","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/04qr3zq92","id-type":"ROR","asserted-by":"publisher"}]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junhong","family":"Li","sequence":"additional","affiliation":[{"name":"Shanxi Eye Hospital Affiliated to Shanxi Medical University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zaowen","family":"Wang","sequence":"additional","affiliation":[{"name":"Chinese Academy of Medical Sciences"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Chinese Academy of Medical Sciences"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xufeng","family":"Zhao","sequence":"additional","affiliation":[{"name":"Chinese Academy of Medical Sciences"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weihong","family":"Yu","sequence":"additional","affiliation":[{"name":"Chinese Academy of Medical Sciences"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaogang","family":"Wang","sequence":"additional","affiliation":[{"name":"Shanxi Eye Hospital Affiliated to Shanxi Medical University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3628-5699","authenticated-orcid":true,"given":"Zhao","family":"Wang","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/04qr3zq92","id-type":"ROR","asserted-by":"publisher"}]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"285","published-online":{"date-parts":[[2025,1,14]]},"reference":[{"key":"boe-16-2-535-R1","doi-asserted-by":"publisher","first-page":"100008","DOI":"10.1016\/j.aopr.2021.100008","volume":"1","author":"Chen","year":"2021","journal-title":"Adv. Ophthalmol. Pract. Res."},{"key":"boe-16-2-535-R2","doi-asserted-by":"publisher","first-page":"1895","DOI":"10.1016\/j.jcrs.2011.04.036","volume":"37","author":"Felipe","year":"2011","journal-title":"J. Cataract Refract. Surg."},{"key":"boe-16-2-535-R3","doi-asserted-by":"publisher","first-page":"3921","DOI":"10.1109\/JBHI.2021.3072246","volume":"25","author":"Zhai","year":"2021","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"boe-16-2-535-R6","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1001\/jamaophthalmol.2021.5742","volume":"140","author":"Nespolo","year":"2022","journal-title":"JAMA ophthalmol."},{"key":"boe-16-2-535-R7","doi-asserted-by":"publisher","first-page":"102604","DOI":"10.1016\/j.inffus.2024.102604","volume":"113","author":"Tu","year":"2025","journal-title":"Inform. Fusion."},{"key":"boe-16-2-535-R9","doi-asserted-by":"publisher","author":"Oktay","year":"2018","DOI":"10.48550\/arXiv.1804.03999"},{"key":"boe-16-2-535-R10","doi-asserted-by":"publisher","author":"Dosovitskiy","year":"2020","DOI":"10.48550\/arXiv.2010.11929"},{"key":"boe-16-2-535-R11","doi-asserted-by":"publisher","author":"Chen","year":"2021","DOI":"10.48550\/arXiv.2102.04306"},{"key":"boe-16-2-535-R12","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1109\/TPAMI.2014.2345390","volume":"37","author":"Henriques","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"boe-16-2-535-R15","doi-asserted-by":"publisher","author":"Wang","year":"2017","DOI":"10.48550\/arXiv.1704.04057"},{"key":"boe-16-2-535-R18","doi-asserted-by":"publisher","author":"Grammatikopoulou","year":"2019","DOI":"10.48550\/arXiv.1906.11586"},{"key":"boe-16-2-535-R19","doi-asserted-by":"publisher","author":"Esteves","year":"2017","DOI":"10.48550\/arXiv.1709.01889"},{"key":"boe-16-2-535-R20","first-page":"24261","volume":"34","author":"Tolstikhin","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"boe-16-2-535-R21","first-page":"2017","volume":"28","author":"Jaderberg","year":"2015","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"boe-16-2-535-R26","doi-asserted-by":"publisher","first-page":"1788","DOI":"10.1109\/TMI.2019.2897538","volume":"38","author":"Balakrishnan","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"boe-16-2-535-R27","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1080\/24699322.2022.2047787","volume":"27","author":"Su","year":"2022","journal-title":"Comput. Assist. Surg."},{"key":"boe-16-2-535-R28","doi-asserted-by":"publisher","first-page":"667","DOI":"10.18240\/ijo.2020.04.21","volume":"13","author":"Emerah","year":"2020","journal-title":"Int. J. Ophthalmol., Engl. Ed."},{"key":"boe-16-2-535-R29","doi-asserted-by":"publisher","first-page":"6","DOI":"10.21037\/aes-20-127","volume":"6","author":"Kozak","year":"2021","journal-title":"Ann. Eye Sci."},{"key":"boe-16-2-535-R30","doi-asserted-by":"publisher","first-page":"1876","DOI":"10.18240\/ijo.2021.12.10","volume":"14","author":"Gencer","year":"2021","journal-title":"Int. J. Ophthalmol."},{"key":"boe-16-2-535-R31","doi-asserted-by":"publisher","first-page":"415","DOI":"10.2147\/OPTH.S177219","volume":"13","author":"Lin","year":"2019","journal-title":"Clin. Ophthalmol."},{"key":"boe-16-2-535-R32","doi-asserted-by":"publisher","first-page":"12783","DOI":"10.1109\/TPAMI.2022.3213073","volume":"45","author":"Zhu","year":"2023","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"boe-16-2-535-R33","doi-asserted-by":"publisher","first-page":"1453","DOI":"10.1038\/s41591-019-0539-7","volume":"25","author":"Chen","year":"2019","journal-title":"Nat. Med."}],"container-title":["Biomedical Optics Express"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/opg.optica.org\/viewmedia.cfm?URI=boe-16-2-535&seq=0","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,14]],"date-time":"2025-01-14T12:31:27Z","timestamp":1736857887000},"score":1,"resource":{"primary":{"URL":"https:\/\/opg.optica.org\/abstract.cfm?URI=boe-16-2-535"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,14]]},"references-count":22,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025]]},"published-print":{"date-parts":[[2025]]}},"URL":"https:\/\/doi.org\/10.1364\/boe.542436","relation":{},"ISSN":["2156-7085","2156-7085"],"issn-type":[{"value":"2156-7085","type":"print"},{"value":"2156-7085","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,14]]},"assertion":[{"value":"Optica Publishing Group","name":"publisher","label":"This article is maintained by"},{"value":"https:\/\/doi.org\/10.1364\/BOE.542436","name":"articlelink","label":"Crossref DOI link to publisher maintained version"},{"value":"research-article","name":"content_type","label":"Article type"},{"value":"Screened by Similarity Check","name":"cross_check","label":"Similarity check"},{"value":"Yes","order":0,"name":"peer_reviewed","label":"Peer reviewed","group":{"name":"peer_review","label":"Peer review"}},{"value":"Single blind","order":1,"name":"review_process","label":"Review process","group":{"name":"peer_review","label":"Peer review"}},{"value":"30 September 2024","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"17 December 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"14 January 2025","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}},{"value":"\u00a9 2025 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement","name":"copyright","label":"Copyright"}]}}