{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,30]],"date-time":"2025-10-30T06:54:43Z","timestamp":1761807283827,"version":"build-2065373602"},"reference-count":14,"publisher":"Springer Science and Business Media LLC","issue":"11","license":[{"start":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:00:00Z","timestamp":1750291200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:00:00Z","timestamp":1750291200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100019180","name":"HORIZON EUROPE European Research Council","doi-asserted-by":"publisher","award":["803880","803880","803880"],"award-info":[{"award-number":["803880","803880","803880"]}],"id":[{"id":"10.13039\/100019180","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100018693","name":"HORIZON EUROPE Framework Programme","doi-asserted-by":"publisher","award":["101095387"],"award-info":[{"award-number":["101095387"]}],"id":[{"id":"10.13039\/100018693","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>Epilepsy surgery is a potential curative treatment for people with focal epilepsy. Intraoperative electrocorticogram (ioECoG) recordings from the brain guide neurosurgeons during resection. Accurate localization of epileptic activity and thus the ioECoG grids is critical for successful outcomes. We aim to develop and evaluate the feasibility of a novel method for localizing small, deformable objects using augmented reality (AR) head-mounted displays (HMDs) and artificial intelligence (AI). AR HMDs combine cameras and patient overlay visualization in a compact design.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We developed an image processing method for the HoloLens 2 to localize a 64-electrode ioECoG grid even when individual electrodes are indistinguishable due to low resolution. The method combines object detection, super-resolution, and pose estimation AI models with stereo triangulation. A synthetic dataset of 90,000 images trained the super-resolution and pose estimation models. The system was tested in a controlled environment against an optical tracker as ground truth. Accuracy was evaluated at distances between 40 and 90\u00a0cm.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The system achieved sub-5\u00a0mm accuracy in localizing the ioECoG grid at distances shorter than 60\u00a0cm. At 40\u00a0cm, the accuracy remained below 2\u00a0mm, with an average standard deviation of less than 0.5 mm. At 60\u00a0cm the method processed on average 24 stereo frames per second.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>This study demonstrates the feasibility of localizing small, deformable objects like ioECoG grids using AR HMDs. While results indicate clinically acceptable accuracy, further research is needed to validate the method in clinical environments and assess its impact on surgical precision and outcomes.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1007\/s11548-025-03401-5","type":"journal-article","created":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T02:42:49Z","timestamp":1750300969000},"page":"2319-2327","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Super-resolution for localizing electrode grids as small, deformable objects during epilepsy surgery using augmented reality headsets"],"prefix":"10.1007","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-4685-9741","authenticated-orcid":false,"given":"Hizirwan S.","family":"Salim","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0505-2198","authenticated-orcid":false,"given":"Abdullah","family":"Thabit","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4455-6700","authenticated-orcid":false,"given":"Sem","family":"Hoogteijling","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6594-8965","authenticated-orcid":false,"given":"Maryse A.","family":"van \u2019t Klooster","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8257-7759","authenticated-orcid":false,"given":"Theo","family":"van Walsum","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1258-5678","authenticated-orcid":false,"given":"Maeike","family":"Zijlmans","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1830-2480","authenticated-orcid":false,"given":"Mohamed","family":"Benmahdjoub","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,6,19]]},"reference":[{"issue":"8","key":"3401_CR1","doi-asserted-by":"publisher","first-page":"1173","DOI":"10.1007\/s00270-022-03195-y","volume":"45","author":"V Van den Bosch","year":"2022","unstructured":"Van den Bosch V, Salim HS, Chen NZ et al (2022) Augmented reality-assisted ct-guided puncture: a phantom study. Cardiovasc Intervent Radiol 45(8):1173\u20131177. https:\/\/doi.org\/10.1007\/s00270-022-03195-y","journal-title":"Cardiovasc Intervent Radiol"},{"key":"3401_CR2","doi-asserted-by":"crossref","unstructured":"Branco MP, Leibbrand M, Vansteensel MJ et al (2018) Gridloc: An automatic and unsupervised localization method for high-density ecog grids. NeuroImage 179:225\u2013234","DOI":"10.1016\/j.neuroimage.2018.06.050"},{"key":"3401_CR3","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.jocn.2021.06.032","volume":"91","author":"S Chidambaram","year":"2021","unstructured":"Chidambaram S, Stifano V, Demetres M et al (2021) Applications of augmented reality in the neurosurgical operating room: a systematic review of the literature. J Clin Neurosci 91:43\u201361. https:\/\/doi.org\/10.1016\/j.jocn.2021.06.032","journal-title":"J Clin Neurosci"},{"key":"3401_CR4","unstructured":"Dibene JC, Dunn E (2022) Hololens 2 sensor streaming. arXiv preprint arXiv:2211.02648"},{"key":"3401_CR5","unstructured":"FDA (2025) Augmented Reality and Virtual Reality in Medical Devices \u2014 fda.gov. https:\/\/www.fda.gov\/medical-devices\/digital-health-center-excellence\/augmented-reality-and-virtual-reality-medical-devices, [Accessed 09-01-2025]"},{"key":"3401_CR6","doi-asserted-by":"publisher","unstructured":"Guo J, Wang Z, van\u00a0\u2019t Klooster MA, et\u00a0al (2024) Seizure outcome after intraoperative electrocorticography-tailored epilepsy surgery: A systematic review and meta-analysis. Neurology 102(11). https:\/\/doi.org\/10.1212\/wnl.0000000000209430","DOI":"10.1212\/wnl.0000000000209430"},{"key":"3401_CR7","doi-asserted-by":"publisher","unstructured":"Iqbal H, Rodriguez\u00a0y Baena F (2022) Semi-automatic infrared calibration for augmented reality systems in surgery. In: 2022 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), vol abs 2008 1. IEEE, p 4957-4964, https:\/\/doi.org\/10.1109\/iros47612.2022.9982215","DOI":"10.1109\/iros47612.2022.9982215"},{"issue":"2","key":"3401_CR8","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1177\/15357597221150055","volume":"23","author":"L Jehi","year":"2023","unstructured":"Jehi L (2023) Machine learning for precision epilepsy surgery. Epilepsy Currents 23(2):78\u201383. https:\/\/doi.org\/10.1177\/15357597221150055","journal-title":"Epilepsy Currents"},{"key":"3401_CR9","unstructured":"Jocher G, Qiu J, Chaurasia A (2023) Ultralytics YOLO. https:\/\/github.com\/ultralytics\/ultralytics"},{"issue":"5","key":"3401_CR10","doi-asserted-by":"publisher","first-page":"1086","DOI":"10.3171\/2013.2.jns121450","volume":"118","author":"TA Pieters","year":"2013","unstructured":"Pieters TA, Conner CR, Tandon N (2013) Recursive grid partitioning on a cortical surface model: an optimized technique for the localization of implanted subdural electrodes: Clinical article. J Neurosurg 118(5):1086\u20131097. https:\/\/doi.org\/10.3171\/2013.2.jns121450","journal-title":"J Neurosurg"},{"key":"3401_CR11","doi-asserted-by":"publisher","unstructured":"Trotta MS, Cocjin J, Whitehead E et al (2017) Surface based electrode localization and standardized regions of interest for intracranial eeg. Hum Brain Mapp 39(2):709\u2013721. https:\/\/doi.org\/10.1002\/hbm.23876","DOI":"10.1002\/hbm.23876"},{"key":"3401_CR12","unstructured":"Ung H (2016) Mining biomarkers of epilepsy from large-scale intracranial electroencephalography. Penn Libraries"},{"key":"3401_CR13","doi-asserted-by":"publisher","unstructured":"Wang X, Xie L, Dong C, et\u00a0al (2021) Real-esrgan: Training real-world blind super-resolution with pure synthetic data. https:\/\/doi.org\/10.48550\/ARXIV.2107.10833","DOI":"10.48550\/ARXIV.2107.10833"},{"key":"3401_CR14","doi-asserted-by":"crossref","unstructured":"Zijlmans M, Zweiphenning W, van Klink N (2019) Changing concepts in presurgical assessment for epilepsy surgery. Nat Rev Neurol 15(10):594\u2013606","DOI":"10.1038\/s41582-019-0224-y"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-025-03401-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-025-03401-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-025-03401-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,30]],"date-time":"2025-10-30T06:47:41Z","timestamp":1761806861000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-025-03401-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,19]]},"references-count":14,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["3401"],"URL":"https:\/\/doi.org\/10.1007\/s11548-025-03401-5","relation":{},"ISSN":["1861-6429"],"issn-type":[{"type":"electronic","value":"1861-6429"}],"subject":[],"published":{"date-parts":[[2025,6,19]]},"assertion":[{"value":"3 March 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 April 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 June 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no conflict of interest to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}