{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T07:09:20Z","timestamp":1775027360341,"version":"3.50.1"},"reference-count":54,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2022,12,7]],"date-time":"2022-12-07T00:00:00Z","timestamp":1670371200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Philipps-Universit\u00e4t Marburg with support of the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation)"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This study aims to report on the capability of microscope-based augmented reality (AR) to evaluate registration and navigation accuracy with extracranial and intracranial landmarks and to elaborate on its opportunities and obstacles in compensation for navigation inaccuracies. In a consecutive single surgeon series of 293 patients, automatic intraoperative computed tomography-based registration was performed delivering a high initial registration accuracy with a mean target registration error of 0.84 \u00b1 0.36 mm. Navigation accuracy is evaluated by overlaying a maximum intensity projection or pre-segmented object outlines within the recent focal plane onto the in situ patient anatomy and compensated for by translational and\/or rotational in-plane transformations. Using bony landmarks (85 cases), there was two cases where a mismatch was seen. Cortical vascular structures (242 cases) showed a mismatch in 43 cases and cortex representations (40 cases) revealed two inaccurate cases. In all cases, with detected misalignment, a successful spatial compensation was performed (mean correction: bone (6.27 \u00b1 7.31 mm), vascular (3.00 \u00b1 1.93 mm, 0.38\u00b0 \u00b1 1.06\u00b0), and cortex (5.31 \u00b1 1.57 mm, 1.75\u00b0 \u00b1 2.47\u00b0)) increasing navigation accuracy. AR support allows for intermediate and straightforward monitoring of accuracy, enables compensation of spatial misalignments, and thereby provides additional safety by increasing overall accuracy.<\/jats:p>","DOI":"10.3390\/s22249591","type":"journal-article","created":{"date-parts":[[2022,12,8]],"date-time":"2022-12-08T03:35:53Z","timestamp":1670470553000},"page":"9591","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Augmented Reality to Compensate for Navigation Inaccuracies"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1574-7572","authenticated-orcid":false,"given":"Miriam H. A.","family":"Bopp","sequence":"first","affiliation":[{"name":"Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany"},{"name":"Center for Mind, Brain and Behavior (CMBB), 35043 Marburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Felix","family":"Corr","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany"},{"name":"EDU Institute of Higher Education, Villa Bighi, Chaplain\u2019s House, KKR 1320 Kalkara, Malta"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2855-3443","authenticated-orcid":false,"given":"Benjamin","family":"Sa\u00df","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mirza","family":"Pojskic","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andr\u00e9","family":"Kemmling","sequence":"additional","affiliation":[{"name":"Department of Neuroradiology, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8216-9410","authenticated-orcid":false,"given":"Christopher","family":"Nimsky","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany"},{"name":"Center for Mind, Brain and Behavior (CMBB), 35043 Marburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"E11","DOI":"10.3171\/2019.8.FOCUS19621","article-title":"Reliable navigation registration in cranial and spine surgery based on intraoperative computed tomography","volume":"47","author":"Carl","year":"2019","journal-title":"Neurosurg. Focus"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1007\/s12194-009-0053-6","article-title":"Evaluation of errors influencing accuracy in image-guided neurosurgery","volume":"2","author":"Watanabe","year":"2009","journal-title":"Radiol. Phys. Technol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1227\/NEU.0b013e318287072d","article-title":"The silent loss of neuronavigation accuracy: A systematic retrospective analysis of factors influencing the mismatch of frameless stereotactic systems in cranial neurosurgery","volume":"72","author":"Stieglitz","year":"2013","journal-title":"Neurosurgery"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1227\/NEU.0000000000000921","article-title":"Video-Assisted Navigation for Adjustment of Image-Guidance Accuracy to Slight Brain Shift","volume":"11","author":"Kantelhardt","year":"2015","journal-title":"Oper. Neurosurg."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1159\/000048404","article-title":"Factors influencing the application accuracy of neuronavigation systems","volume":"75","author":"Steinmeier","year":"2000","journal-title":"Stereotact. Funct. Neurosurg."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1007\/s10143-001-0201-x","article-title":"Anatomical landmarks for image registration in frameless stereotactic neuronavigation","volume":"25","author":"Wolfsberger","year":"2002","journal-title":"Neurosurg. Rev."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2199","DOI":"10.1088\/0031-9155\/48\/14\/311","article-title":"Neuronavigation accuracy dependence on CT and MR imaging parameters: A phantom-based study","volume":"48","author":"Poggi","year":"2003","journal-title":"Phys. Med. Biol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"S123","DOI":"10.4103\/2152-7806.110660","article-title":"Image fusion pitfalls for cranial radiosurgery","volume":"4","author":"Jonker","year":"2013","journal-title":"Surg. Neurol. Int."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1186\/2193-1801-2-90","article-title":"Technical accuracy of optical and the electromagnetic tracking systems","volume":"2","author":"Koivukangas","year":"2013","journal-title":"SpringerPlus"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"E11","DOI":"10.3171\/2009.6.FOCUS09109","article-title":"Neuronavigation: Geneology, reality, and prospects","volume":"27","author":"Enchev","year":"2009","journal-title":"Neurosurg. Focus"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"11","DOI":"10.3109\/10929080209146013","article-title":"Semiautomated registration using new markers for assessing the accuracy of a navigation system","volume":"7","author":"Kozak","year":"2002","journal-title":"Comput. Aided Surg. Off. J. Int. Soc. Comput. Aided Surg."},{"key":"ref_12","unstructured":"Brainlab, A.G. (2022). Cranial Navigation Version 4.1 Revision 1.0. User Guide, Brainlab AG."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"865","DOI":"10.1007\/s00701-019-03867-8","article-title":"Current accuracy of surface matching compared to adhesive markers in patient-to-image registration","volume":"161","author":"Mongen","year":"2019","journal-title":"Acta Neurochir."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1681","DOI":"10.1007\/s00701-018-3641-6","article-title":"Intraoperative computed tomography as reliable navigation registration device in 200 cranial procedures","volume":"160","author":"Carl","year":"2018","journal-title":"Acta Neurochir."},{"key":"ref_15","first-page":"201","article-title":"Fiducial versus nonfiducial neuronavigation registration assessment and considerations of accuracy","volume":"62","author":"Pfisterer","year":"2008","journal-title":"Neurosurgery"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"e307","DOI":"10.1016\/j.wneu.2020.06.219","article-title":"Indocyanine Green Angiography Visualized by Augmented Reality in Aneurysm Surgery","volume":"142","author":"Carl","year":"2020","journal-title":"World Neurosurg."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Bopp, M.H.A., Sass, B., Pojskic, M., Corr, F., Grimm, D., Kemmling, A., and Nimsky, C. (2022). Use of Neuronavigation and Augmented Reality in Transsphenoidal Pituitary Adenoma Surgery. J. Clin. Med., 11.","DOI":"10.3390\/jcm11195590"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"522","DOI":"10.2176\/nmc.44.522","article-title":"Frameless stereotactic surgery using intraoperative high-field magnetic resonance imaging","volume":"44","author":"Nimsky","year":"2004","journal-title":"Neurol. Med.-Chir."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1159\/000094462","article-title":"Application accuracy of automatic registration in frameless stereotaxy","volume":"84","author":"Rachinger","year":"2006","journal-title":"Stereotact. Funct. Neurosurg."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1070","DOI":"10.1097\/00006123-200011000-00008","article-title":"Quantification of, visualization of, and compensation for brain shift using intraoperative magnetic resonance imaging","volume":"47","author":"Nimsky","year":"2000","journal-title":"Neurosurgery"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sa\u00df, B., Carl, B., Pojskic, M., Nimsky, C., and Bopp, M. (2020). Navigated 3D Ultrasound in Brain Metastasis Surgery: Analyzing the Differences in Object Appearances in Ultrasound and Magnetic Resonance Imaging. Appl. Sci., 10.","DOI":"10.3390\/app10217798"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"580","DOI":"10.1016\/j.wneu.2015.03.025","article-title":"Simple Accuracy Enhancing Techniques in Neuronavigation","volume":"84","author":"Stieglitz","year":"2015","journal-title":"World Neurosurg."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1109\/TBME.2004.840186","article-title":"Brain shift estimation in image-guided neurosurgery using 3-D ultrasound","volume":"52","author":"Letteboer","year":"2005","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1301","DOI":"10.1007\/s00701-014-2052-6","article-title":"Intra-operative correction of brain-shift","volume":"156","author":"Reinertsen","year":"2014","journal-title":"Acta Neurochir."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"656020","DOI":"10.3389\/fonc.2021.656020","article-title":"Utilizing Intraoperative Navigated 3D Color Doppler Ultrasound in Glioma Surgery","volume":"11","author":"Sass","year":"2021","journal-title":"Front. Oncol."},{"key":"ref_26","first-page":"252","article-title":"Augmented reality in the surgery of cerebral aneurysms: A technical report","volume":"10","author":"Cabrilo","year":"2014","journal-title":"Neurosurgery"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1007\/s10143-016-0732-9","article-title":"Augmented reality in neurosurgery: A systematic review","volume":"40","author":"Meola","year":"2017","journal-title":"Neurosurg. Rev."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"864792","DOI":"10.3389\/fsurg.2022.864792","article-title":"Augmented Reality in Neurosurgery, State of Art and Future Projections. A Systematic Review","volume":"9","author":"Cannizzaro","year":"2022","journal-title":"Front. Surg."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1016\/j.wneu.2016.07.107","article-title":"Impact of Virtual and Augmented Reality Based on Intraoperative Magnetic Resonance Imaging and Functional Neuronavigation in Glioma Surgery Involving Eloquent Areas","volume":"96","author":"Sun","year":"2016","journal-title":"World Neurosurg."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s00701-021-05045-1","article-title":"Augmented reality visualization in brain lesions: A prospective randomized controlled evaluation of its potential and current limitations in navigated microneurosurgery","volume":"164","author":"Roethe","year":"2022","journal-title":"Acta Neurochir."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1049\/htl.2017.0062","article-title":"Quantifying attention shifts in augmented reality image-guided neurosurgery","volume":"4","author":"Leger","year":"2017","journal-title":"Healthc. Technol. Lett."},{"key":"ref_32","unstructured":"Kosaka, A., Saito, A., Furuhashi, Y., and Shibasaki, T. (2000, January 15). Augmented reality system for surgical navigation using robust target vision. Proceedings of the Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662), Hilton Head, SC, USA."},{"key":"ref_33","unstructured":"Aschke, M., Wirtz, C.R., Raczkowsky, J., Worn, H., and Kunze, S. (2003, January 20\u201322). Augmented reality in operating microscopes for neurosurgical interventions. Proceedings of the First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings, Capri, Italy."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/17434440.2021.1865795","article-title":"Device profile of the XVision-spine (XVS) augmented-reality surgical navigation system: Overview of its safety and efficacy","volume":"18","author":"Dibble","year":"2021","journal-title":"Expert Rev. Med. Devices"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Pojskic, M., Bopp, M.H.A., Sabeta, B., Carl, B., and Nimsky, C. (2022). Microscope-Based Augmented Reality with Intraoperative Computed Tomography-Based Navigation for Resection of Skull Base Meningiomas in Consecutive Series of 39 Patients. Cancers, 14.","DOI":"10.3390\/cancers14092302"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"197","DOI":"10.3171\/jns.1995.83.2.0197","article-title":"Clinical use of a frameless stereotactic arm: Results of 325 cases","volume":"83","author":"Golfinos","year":"1995","journal-title":"J. Neurosurg."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1007\/s10143-010-0302-5","article-title":"Comparative study of application accuracy of two frameless neuronavigation systems: Experimental error assessment quantifying registration methods and clinically influencing factors","volume":"34","author":"Paraskevopoulos","year":"2010","journal-title":"Neurosurg. Rev."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/j.wneu.2020.11.029","article-title":"Current Accuracy of Augmented Reality Neuronavigation Systems: Systematic Review and Meta-Analysis","volume":"146","author":"Fick","year":"2021","journal-title":"World Neurosurg."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/s12194-010-0103-0","article-title":"Skin shift and its effect on navigation accuracy in image-guided neurosurgery","volume":"4","author":"Mitsui","year":"2011","journal-title":"Radiol. Phys. Technol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1002\/rcs.299","article-title":"Guidelines for the placement of fiducial points in image-guided neurosurgery","volume":"6","author":"Wang","year":"2010","journal-title":"Int. J. Med. Robot."},{"key":"ref_41","first-page":"143","article-title":"Distribution templates of the fiducial points in image-guided neurosurgery","volume":"66","author":"Wang","year":"2010","journal-title":"Neurosurgery"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1055\/s-2005-836606","article-title":"Visualization of the pyramidal tract in glioma surgery by integrating diffusion tensor imaging in functional neuronavigation","volume":"66","author":"Nimsky","year":"2005","journal-title":"Zent. Neurochir."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1093\/ons\/opw001","article-title":"Assessment of the Accuracy and Errors of Head-Up Display by an Optical Neuronavigation System in Brain Tumor Surgery","volume":"13","author":"Asano","year":"2017","journal-title":"Oper. Neurosurg."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1016\/j.media.2016.08.007","article-title":"Brain shift in neuronavigation of brain tumors: A review","volume":"35","author":"Gerard","year":"2017","journal-title":"Med. Image Anal."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1016\/j.media.2004.02.001","article-title":"Strategies for brain shift evaluation","volume":"8","author":"Hastreiter","year":"2004","journal-title":"Med. Image Anal."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1016\/S0090-3019(01)00628-0","article-title":"Intraoperative compensation for brain shift","volume":"56","author":"Nimsky","year":"2001","journal-title":"Surg. Neurol."},{"key":"ref_47","first-page":"787","article-title":"Serial intraoperative magnetic resonance imaging of brain shift","volume":"48","author":"Nabavi","year":"2001","journal-title":"Neurosurgery"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"e223","DOI":"10.1016\/j.wneu.2020.06.166","article-title":"Elastic Fusion Enables Fusion of Intraoperative Magnetic Resonance Imaging Data with Preoperative Neuronavigation Data","volume":"142","author":"Negwer","year":"2020","journal-title":"World Neurosurg."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"123","DOI":"10.3109\/10929080500079248","article-title":"Automatic non-linear MRI-ultrasound registration for the correction of intra-operative brain deformations","volume":"9","author":"Arbel","year":"2004","journal-title":"Comput. Aided Surg. Off. J. Int. Soc. Comput. Aided Surg."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1118\/1.598942","article-title":"Intraoperative ultrasound for guidance and tissue shift correction in image-guided neurosurgery","volume":"27","author":"Comeau","year":"2000","journal-title":"Med. Phys."},{"key":"ref_51","first-page":"735","article-title":"Deformation Aware Augmented Reality for Craniotomy using 3D\/2D Non-rigid Registration of Cortical Vessels","volume":"Volume 12264","author":"Haouchine","year":"2020","journal-title":"International Conference on Medical Image Computing and Computer-Assisted Intervention"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1016\/j.media.2008.01.003","article-title":"Automatic segmentation of human brain sulci","volume":"12","author":"Yang","year":"2008","journal-title":"Med. Image Anal."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1002\/(SICI)1522-712X(1995)1:2<109::AID-IGS6>3.0.CO;2-E","article-title":"Adaptation of personal projection television to a head-mounted display for intra-operative viewing of neuroimaging","volume":"1","author":"Barnett","year":"1995","journal-title":"J. Image Guided Surg."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Doughty, M., Ghugre, N.R., and Wright, G.A. (2022). Augmenting Performance: A Systematic Review of Optical See-Through Head-Mounted Displays in Surgery. J. Imaging, 8.","DOI":"10.3390\/jimaging8070203"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/24\/9591\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:35:50Z","timestamp":1760146550000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/24\/9591"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,7]]},"references-count":54,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["s22249591"],"URL":"https:\/\/doi.org\/10.3390\/s22249591","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,7]]}}}