{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T14:58:45Z","timestamp":1782313125000,"version":"3.54.5"},"reference-count":115,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,7,20]],"date-time":"2022-07-20T00:00:00Z","timestamp":1658275200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Natural Sciences and Engineering Research Council of Canada (NSERC) Discovery program","award":["RGPIN-2019-06367"],"award-info":[{"award-number":["RGPIN-2019-06367"]}]},{"name":"Natural Sciences and Engineering Research Council of Canada (NSERC) Discovery program","award":["NFRFE-2019-00333"],"award-info":[{"award-number":["NFRFE-2019-00333"]}]},{"name":"New Frontiers in Research Fund-Exploration","award":["RGPIN-2019-06367"],"award-info":[{"award-number":["RGPIN-2019-06367"]}]},{"name":"New Frontiers in Research Fund-Exploration","award":["NFRFE-2019-00333"],"award-info":[{"award-number":["NFRFE-2019-00333"]}]},{"name":"Heart and Stroke Foundation of Canada (HSFC)","award":["RGPIN-2019-06367"],"award-info":[{"award-number":["RGPIN-2019-06367"]}]},{"name":"Heart and Stroke Foundation of Canada (HSFC)","award":["NFRFE-2019-00333"],"award-info":[{"award-number":["NFRFE-2019-00333"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>We conducted a systematic review of recent literature to understand the current challenges in the use of optical see-through head-mounted displays (OST-HMDs) for augmented reality (AR) assisted surgery. Using Google Scholar, 57 relevant articles from 1 January 2021 through 18 March 2022 were identified. Selected articles were then categorized based on a taxonomy that described the required components of an effective AR-based navigation system: data, processing, overlay, view, and validation. Our findings indicated a focus on orthopedic (n=20) and maxillofacial surgeries (n=8). For preoperative input data, computed tomography (CT) (n=34), and surface rendered models (n=39) were most commonly used to represent image information. Virtual content was commonly directly superimposed with the target site (n=47); this was achieved by surface tracking of fiducials (n=30), external tracking (n=16), or manual placement (n=11). Microsoft HoloLens devices (n=24 in 2021, n=7 in 2022) were the most frequently used OST-HMDs; gestures and\/or voice (n=32) served as the preferred interaction paradigm. Though promising system accuracy in the order of 2\u20135 mm has been demonstrated in phantom models, several human factors and technical challenges\u2014perception, ease of use, context, interaction, and occlusion\u2014remain to be addressed prior to widespread adoption of OST-HMD led surgical navigation.<\/jats:p>","DOI":"10.3390\/jimaging8070203","type":"journal-article","created":{"date-parts":[[2022,7,20]],"date-time":"2022-07-20T11:22:24Z","timestamp":1658316144000},"page":"203","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":67,"title":["Augmenting Performance: A Systematic Review of Optical See-Through Head-Mounted Displays in Surgery"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7617-307X","authenticated-orcid":false,"given":"Mitchell","family":"Doughty","sequence":"first","affiliation":[{"name":"Department of Medical Biophysics, University of Toronto, Toronto, ON M5S 1A1, Canada"},{"name":"Schulich Heart Program, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M5, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nilesh R.","family":"Ghugre","sequence":"additional","affiliation":[{"name":"Department of Medical Biophysics, University of Toronto, Toronto, ON M5S 1A1, Canada"},{"name":"Schulich Heart Program, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M5, Canada"},{"name":"Physical Sciences Platform, Sunnybrook Research Institute, Toronto, ON M4N 3M5, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Graham A.","family":"Wright","sequence":"additional","affiliation":[{"name":"Department of Medical Biophysics, University of Toronto, Toronto, ON M5S 1A1, Canada"},{"name":"Schulich Heart Program, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M5, Canada"},{"name":"Physical Sciences Platform, Sunnybrook Research Institute, Toronto, ON M4N 3M5, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,20]]},"reference":[{"key":"ref_1","first-page":"1321","article-title":"A Taxonomy of Mixed Reality Visual Displays","volume":"77","author":"Kishino","year":"1994","journal-title":"Ieice Trans. Inf. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1227\/00006123-198203000-00005","article-title":"Computer-assisted stereotactic microsurgery for the treatment of intracranial neoplasms","volume":"10","author":"Kelly","year":"1982","journal-title":"Neurosurgery"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Peters, T.M., Linte, C.A., Yaniv, Z., and Williams, J. (2018). Mixed and Augmented Reality in Medicine, CRC Press.","DOI":"10.1201\/9781315157702"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1146\/annurev-bioeng-070909-105249","article-title":"Image-guided interventions: Technology review and clinical applications","volume":"12","author":"Cleary","year":"2010","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"e10967","DOI":"10.2196\/10967","article-title":"Augmented reality in medicine: Systematic and bibliographic review","volume":"7","author":"Eckert","year":"2019","journal-title":"JMIR mHealth uHealth"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"102361","DOI":"10.1016\/j.media.2022.102361","article-title":"Utility of Optical See-Through Head Mounted Displays in Augmented Reality-Assisted Surgery: A systematic review","volume":"77","author":"Birlo","year":"2022","journal-title":"Med. Image Anal."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.media.2017.01.007","article-title":"The status of augmented reality in laparoscopic surgery as of 2016","volume":"37","author":"Bernhardt","year":"2017","journal-title":"Med. Image Anal."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1109\/JDT.2008.2001575","article-title":"Advanced medical displays: A literature review of augmented reality","volume":"4","author":"Sielhorst","year":"2008","journal-title":"J. Disp. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1912","DOI":"10.1109\/TVCG.2015.2473855","article-title":"Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays","volume":"22","author":"Kramida","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1109\/TBME.2019.2914517","article-title":"Perceptual Limits of Optical See-Through Visors for Augmented Reality Guidance of Manual Tasks","volume":"67","author":"Condino","year":"2020","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1109\/MCG.2007.117","article-title":"Action-and workflow-driven augmented reality for computer-aided medical procedures","volume":"27","author":"Navab","year":"2007","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1007\/s11548-014-1005-0","article-title":"A system for context-aware intraoperative augmented reality in dental implant surgery","volume":"10","author":"Spengler","year":"2015","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_13","unstructured":"Qian, L., Azimi, E., Kazanzides, P., and Navab, N. (2017). Comprehensive Tracker Based Display Calibration for Holographic Optical See-Through Head-Mounted Display. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2550","DOI":"10.1109\/TVCG.2020.3037284","article-title":"AR-Loupe: Magnified Augmented Reality by Combining an Optical See-Through Head-Mounted Display and a Loupe","volume":"28","author":"Qian","year":"2011","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.20870\/IJVR.2010.9.2.2767","article-title":"A survey of augmented reality technologies, applications and limitations","volume":"9","author":"Poelman","year":"2010","journal-title":"Int. J. Virtual Real."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1162\/105474600566808","article-title":"Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization","volume":"9","author":"Rolland","year":"2000","journal-title":"Presence"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/MC.2012.72","article-title":"Anywhere Interfaces Using Handheld Augmented Reality","volume":"45","author":"Gervautz","year":"2012","journal-title":"Computer"},{"key":"ref_18","unstructured":"Peters, A.K. (2005). Spatial Augmented Reality: Merging Real and Virtual Worlds, CRC Press."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"H87","DOI":"10.1364\/AO.50.000H87","article-title":"Three-dimensional display technologies of recent interest: Principles, status, and issues [Invited]","volume":"50","author":"Hong","year":"2011","journal-title":"Appl. Opt."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Cutolo, F., Fontana, U., and Ferrari, V. (2018). Perspective preserving solution for quasi-orthoscopic video see-through HMDs. Technologies, 6.","DOI":"10.3390\/technologies6010009"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"159698","DOI":"10.1109\/ACCESS.2019.2950877","article-title":"Toed-in vs parallel displays in video see-through head-mounted displays for close-up view","volume":"7","author":"Cattari","year":"2019","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2649","DOI":"10.1109\/TVCG.2017.2754257","article-title":"A survey of calibration methods for optical see-through head-mounted displays","volume":"24","author":"Grubert","year":"2017","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1162\/pres.1995.4.1.24","article-title":"Towards Quantifying Depth and Size Perception in Virtual Environments","volume":"4","author":"Rolland","year":"1995","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1109\/JDT.2006.879846","article-title":"Head-Worn Displays: A Review","volume":"2","author":"Cakmakci","year":"2006","journal-title":"J. Disp. Technol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"101795","DOI":"10.1109\/ACCESS.2019.2930701","article-title":"An online calibration method for microsoft HoloLens","volume":"7","author":"Guo","year":"2019","journal-title":"IEEE Access"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Sutherland, I.E. (1968, January 9\u201311). A head-mounted three dimensional display. Proceedings of the 9\u201311 December 1968, Fall Joint Computer Conference, Part I, San Francisco, CA, USA.","DOI":"10.1145\/1476589.1476686"},{"key":"ref_27","unstructured":"Bention, S. (2001). Selected PapersonThree-Dimensional Displays, SPEOptical Engineeting Press."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1109\/TBC.2011.2130930","article-title":"Three-Dimensional Displays: A Review and Applications Analysis","volume":"57","author":"Holliman","year":"2011","journal-title":"IEEE Trans. Broadcast."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Szeliski, R. (2010). Computer Vision: Algorithms and Applications, Springer Science & Business Media.","DOI":"10.1007\/978-1-84882-935-0"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2280","DOI":"10.1016\/j.patcog.2014.01.005","article-title":"Automatic generation and detection of highly reliable fiducial markers under occlusion","volume":"47","year":"2014","journal-title":"Pattern Recognit."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Prince, S.J. (2012). Computer Vision: Models, Learning, and Inference, Cambridge University Press.","DOI":"10.1017\/CBO9780511996504"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Doughty, M., and Ghugre, N.R. (2022). Head-Mounted Display-Based Augmented Reality for Image-Guided Media Delivery to the Heart: A Preliminary Investigation of Perceptual Accuracy. J. Imaging, 8.","DOI":"10.3390\/jimaging8020033"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Viglialoro, R.M., Condino, S., Turini, G., Carbone, M., Ferrari, V., and Gesi, M. (2019). Review of the augmented reality systems for shoulder rehabilitation. Information, 10.","DOI":"10.3390\/info10050154"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1385","DOI":"10.1109\/TVCG.2018.2869729","article-title":"The Effect of Focal Distance, Age, and Brightness on Near-Field Augmented Reality Depth Matching","volume":"26","author":"Singh","year":"2020","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1109\/JPROC.2017.2648796","article-title":"Enabling Focus Cues in Head-Mounted Displays","volume":"105","author":"Hua","year":"2017","journal-title":"Proc. IEEE"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3072959.3073622","article-title":"Accommodation and comfort in head-mounted displays","volume":"36","author":"Koulieris","year":"2017","journal-title":"ACM Trans. Graph."},{"key":"ref_38","unstructured":"Epstein, W., and Rogers, S. (1995). Chapter 3\u2014Perceiving Layout and Knowing Distances: The Integration, Relative Potency, and Contextual Use of Different Information about Depth. Perception of Space and Motion, Academic Press."},{"key":"ref_39","unstructured":"Teittinen, M. (2022, March 23). Depth Cues in the Human Visual System. The Encyclopedia of Virtual Environments. Available online: http:\/\/www.hitl.washington.edu\/projects\/knowledge_base\/virtual-worlds\/EVE\/III.A.1.c.DepthCues.html."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1432","DOI":"10.1109\/TVCG.2016.2518138","article-title":"Effects of Configuration of Optical Combiner on Near-Field Depth Perception in Optical See-Through Head-Mounted Displays","volume":"22","author":"Lee","year":"2016","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Patterson, P.D., and Earl, R. (2015). Human Factors of Stereoscopic 3D Displays, Springer.","DOI":"10.1007\/978-1-4471-6651-1"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1002\/sdtp.11586","article-title":"11-1: Invited Paper: Towards the Ultimate Mixed Reality Experience: HoloLens Display Architecture Choices","volume":"48","author":"Kress","year":"2017","journal-title":"SID Symp. Dig. Tech. Pap."},{"key":"ref_43","unstructured":"Ungureanu, D., Bogo, F., Galliani, S., Sama, P., Duan, X., Meekhof, C., St\u00fchmer, J., Cashman, T.J., Tekin, B., and Sch\u00f6nberger, J.L. (2020). HoloLens 2 Research Mode as a Tool for Computer Vision Research. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1109\/TVCG.2011.50","article-title":"DVV: A Taxonomy for Mixed Reality Visualization in Image Guided Surgery","volume":"18","author":"Jannin","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Ackermann, J., Liebmann, F., Hoch, A., Snedeker, J.G., Farshad, M., Rahm, S., Zingg, P.O., and F\u00fcrnstahl, P. (2021). Augmented Reality Based Surgical Navigation of Complex Pelvic Osteotomies\u2014A Feasibility Study on Cadavers. Appl. Sci., 11.","DOI":"10.3390\/app11031228"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Dennler, C., Bauer, D.E., Scheibler, A.G., Spirig, J., G\u00f6tschi, T., F\u00fcrnstahl, P., and Farshad, M. (2021). Augmented reality in the operating room: A clinical feasibility study. BMC Musculoskelet. Disord., 22.","DOI":"10.1186\/s12891-021-04339-w"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"100065","DOI":"10.1016\/j.xnsj.2021.100065","article-title":"First in man in-situ augmented reality pedicle screw navigation","volume":"6","author":"Farshad","year":"2021","journal-title":"N. Am. Spine Soc. J. (NASSJ)"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1080\/21681163.2020.1835556","article-title":"Feasibility of image-based augmented reality guidance of total shoulder arthroplasty using microsoft HoloLens 1","volume":"9","author":"Gu","year":"2021","journal-title":"Comput. Methods Biomech. Biomed. Eng. Imaging Vis."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1007\/s11548-020-02302-z","article-title":"Mixed reality as a novel tool for diagnostic and surgical navigation in orthopaedics","volume":"16","author":"Teatini","year":"2021","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"3731","DOI":"10.1007\/s00586-021-06950-w","article-title":"Augmented reality-navigated pedicle screw placement: A cadaveric pilot study","volume":"30","author":"Spirig","year":"2021","journal-title":"Eur. Spine J."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Schlueter-Brust, K., Henckel, J., Katinakis, F., Buken, C., Opt-Eynde, J., Pofahl, T., Rodriguez y Baena, F., and Tatti, F. (2021). Augmented-Reality-Assisted K-Wire Placement for Glenoid Component Positioning in Reversed Shoulder Arthroplasty: A Proof-of-Concept Study. J. Pers. Med., 11.","DOI":"10.3390\/jpm11080777"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"715484","DOI":"10.3389\/fonc.2021.715484","article-title":"Accuracy of Mixed Reality Combined With Surgical Navigation Assisted Oral and Maxillofacial Tumor Resection","volume":"11","author":"Tang","year":"2021","journal-title":"Front. Oncol."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"719985","DOI":"10.3389\/fsurg.2021.719985","article-title":"Development and Application of Digital Maxillofacial Surgery System Based on Mixed Reality Technology","volume":"8","author":"Yang","year":"2022","journal-title":"Front. Surg."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1016\/j.bjoms.2021.03.011","article-title":"Use of augmented reality navigation to optimise the surgical management of craniofacial fibrous dysplasia","volume":"60","author":"Gao","year":"2022","journal-title":"Br. J. Oral Maxillofac. Surg."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"103841","DOI":"10.1016\/j.jbi.2021.103841","article-title":"Augmented reality in robotic assisted orthopaedic surgery: A pilot study","volume":"120","author":"Iqbal","year":"2021","journal-title":"J. Biomed. Informat."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Stewart, C.L., Fong, A., Payyavula, G., DiMaio, S., Lafaro, K., Tallmon, K., Wren, S., Sorger, J., and Fong, Y. (2021). Study on augmented reality for robotic surgery bedside assistants. J. Robot. Surg., 1\u20138.","DOI":"10.1007\/s11701-021-01335-z"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Lin, Z., Gao, A., Ai, X., Gao, H., Fu, Y., Chen, W., and Yang, G.Z. (2021). ARei: Augmented-Reality-Assisted Touchless Teleoperated Robot for Endoluminal Intervention. IEEE\/ASME Trans. Mechatronics, 1\u201311.","DOI":"10.1109\/TMECH.2021.3105536"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Gasques, D., Johnson, J.G., Sharkey, T., Feng, Y., Wang, R., Xu, Z.R., Zavala, E., Zhang, Y., Xie, W., and Zhang, X. (2021, January 8\u201313). ARTEMIS: A Collaborative Mixed-Reality System for Immersive Surgical Telementoring. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, CHI \u201921, Yokohama, Japan.","DOI":"10.1145\/3411764.3445576"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1109","DOI":"10.3174\/ajnr.A7066","article-title":"Teleproctoring for Neurovascular Procedures: Demonstration of Concept Using Optical See-Through Head-Mounted Display, Interactive Mixed Reality, and Virtual Space Sharing\u2014A Critical Need Highlighted by the COVID-19 Pandemic","volume":"42","author":"Rai","year":"2021","journal-title":"Am. J. Neuroradiol."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Gsaxner, C., Li, J., Pepe, A., Schmalstieg, D., and Egger, J. (2021, January 8\u201310). Inside-Out Instrument Tracking for Surgical Navigation in Augmented Reality. Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology. Association for Computing Machinery, VRST \u201921, Osaka, Japan.","DOI":"10.1145\/3489849.3489863"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1007\/s11548-021-02531-w","article-title":"Research on registration and navigation technology of augmented reality for ex-vivo hepatectomy","volume":"17","author":"Zhang","year":"2022","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"E3","DOI":"10.3171\/2021.5.FOCUS20735","article-title":"Augmented reality head-mounted display\u2013based incision planning in cranial neurosurgery: A prospective pilot study","volume":"51","author":"Ivan","year":"2021","journal-title":"Neurosurg. Focus"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1007\/s00701-021-04707-4","article-title":"Holographic patient tracking after bed movement for augmented reality neuronavigation using a head-mounted display","volume":"163","author":"Fick","year":"2021","journal-title":"Acta Neurochir."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"738","DOI":"10.1109\/TMRB.2021.3091184","article-title":"Autonomous Planning and Intraoperative Augmented Reality Navigation for Neurosurgery","volume":"3","author":"Kunz","year":"2021","journal-title":"IEEE Trans. Med. Robot. Bionics"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"E22","DOI":"10.3171\/2021.5.FOCUS21175","article-title":"Holographic mixed-reality neuronavigation with a head-mounted device: Technical feasibility and clinical application","volume":"51","author":"Qi","year":"2021","journal-title":"Neurosurg. Focus"},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"2590","DOI":"10.1007\/s10439-021-02834-8","article-title":"Evaluation of a Wearable AR Platform for Guiding Complex Craniotomies in Neurosurgery","volume":"49","author":"Condino","year":"2021","journal-title":"Ann. Biomed. Eng."},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Uhl, C., Hatzl, J., Meisenbacher, K., Zimmer, L., Hartmann, N., and B\u00f6ckler, D. (2022). Mixed-Reality-Assisted Puncture of the Common Femoral Artery in a Phantom Model. J. Imaging, 8.","DOI":"10.3390\/jimaging8020047"},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"101905","DOI":"10.1016\/j.compmedimag.2021.101905","article-title":"Towards quantitative and intuitive percutaneous tumor puncture via augmented virtual reality","volume":"90","author":"Li","year":"2021","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Liu, Y., Azimi, E., Dav\u00e9, N., Qiu, C., Yang, R., and Kazanzides, P. (2021, January 12\u201313). Augmented Reality Assisted Orbital Floor Reconstruction. Proceedings of the 2021 IEEE International Conference on Intelligent Reality (ICIR), Piscataway, NJ, USA.","DOI":"10.1109\/ICIR51845.2021.00013"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"2081","DOI":"10.21873\/invivo.12477","article-title":"Development and Accuracy Evaluation of Augmented Reality-based Patient Positioning System in Radiotherapy: A Phantom Study","volume":"35","author":"Tarutani","year":"2021","journal-title":"In Vivo"},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1002\/mp.15349","article-title":"Patient posture correction and alignment using mixed reality visualization and the HoloLens 2","volume":"49","author":"Johnson","year":"2022","journal-title":"Med. Phys."},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"1006","DOI":"10.1016\/j.surg.2021.10.004","article-title":"Intraoperative holography navigation using a mixed-reality wearable computer during laparoscopic cholecystectomy","volume":"171","author":"Kitagawa","year":"2021","journal-title":"Surgery"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/s11548-020-02272-2","article-title":"HoloPointer: A virtual augmented reality pointer for laparoscopic surgery training","volume":"16","author":"Heinrich","year":"2021","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Ivanov, V.M., Krivtsov, A.M., Strelkov, S.V., Kalakutskiy, N.V., Yaremenko, A.I., Petropavlovskaya, M.Y., Portnova, M.N., Lukina, O.V., and Litvinov, A.P. (2021). Intraoperative Use of Mixed Reality Technology in Median Neck and Branchial Cyst Excision. Future Internet, 13.","DOI":"10.3390\/fi13080214"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"105854","DOI":"10.1016\/j.cmpb.2020.105854","article-title":"Augmented Reality for Head and Neck Carcinoma Imaging: Description and Feasibility of an Instant Calibration, Markerless Approach","volume":"200","author":"Gsaxner","year":"2021","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"102365","DOI":"10.1016\/j.media.2022.102365","article-title":"Marker-free surgical navigation of rod bending using a stereo neural network and augmented reality in spinal fusion","volume":"77","author":"Liebmann","year":"2022","journal-title":"Med. Image Anal."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"910","DOI":"10.1109\/JBHI.2021.3088442","article-title":"Head-Mounted Augmented Reality Platform for Markerless Orthopaedic Navigation","volume":"26","author":"Hu","year":"2022","journal-title":"IEEE J. Biomed. Health Informat."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"e2290","DOI":"10.1002\/rcs.2290","article-title":"Evaluation of how users interface with holographic augmented reality surgical scenes: Interactive planning MR-Guided prostate biopsies","volume":"17","author":"Navkar","year":"2021","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1007\/s10334-019-00788-6","article-title":"Measuring geometric accuracy in magnetic resonance imaging with 3D-printed phantom and nonrigid image registration","volume":"33","author":"Nousiainen","year":"2020","journal-title":"Magn. Reson. Mater. Phys. Biol. Med."},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Lim, S., Ha, J., Yoon, S., Tae Sohn, Y., Seo, J., Chul Koh, J., and Lee, D. (2021, January 1\u20135). Augmented Reality Assisted Surgical Navigation System for Epidural Needle Intervention. Proceedings of the 2021 43rd Annual International Conference of the IEEE Engineering in Medicine Biology Society (EMBC), Mexico City, Mexico. ISSN 2694-0604.","DOI":"10.1109\/EMBC46164.2021.9629804"},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1177\/1553350620987978","article-title":"Visualization of Fluoroscopic Imaging in Orthopedic Surgery: Head-Mounted Display vs Conventional Monitor","volume":"29","author":"Johnson","year":"2021","journal-title":"Surg. Innov."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"104402","DOI":"10.1016\/j.compbiomed.2021.104402","article-title":"Augmented reality based navigation for distal interlocking of intramedullary nails utilizing Microsoft HoloLens 2","volume":"133","author":"Tu","year":"2021","journal-title":"Comput. Biol. Med."},{"key":"ref_83","doi-asserted-by":"crossref","unstructured":"Cattari, N., Condino, S., Cutolo, F., Ferrari, M., and Ferrari, V. (2021). In Situ Visualization for 3D Ultrasound-Guided Interventions with Augmented Reality Headset. Bioengineering, 8.","DOI":"10.3390\/bioengineering8100131"},{"key":"ref_84","doi-asserted-by":"crossref","unstructured":"Frisk, H., Lindqvist, E., Persson, O., Weinzierl, J., Bruetzel, L.K., Cewe, P., Burstr\u00f6m, G., Edstr\u00f6m, E., and Elmi-Terander, A. (2022). Feasibility and Accuracy of Thoracolumbar Pedicle Screw Placement Using an Augmented Reality Head Mounted Device. Sensors, 22.","DOI":"10.3390\/s22020522"},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"e34781","DOI":"10.2196\/34781","article-title":"Augmented Reality-Based Surgery on the Human Cadaver Using a New Generation of Optical Head-Mounted Displays: Development and Feasibility Study","volume":"10","author":"Puladi","year":"2022","journal-title":"JMIR Serious Games"},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Kimmel, S., Cobus, V., and Heuten, W. opticARe\u2014Augmented Reality Mobile Patient Monitoring in Intensive Care Units. Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology, Osaka, Japan, 8\u201310 December 2021.","DOI":"10.1145\/3489849.3489852"},{"key":"ref_87","unstructured":"Magnenat-Thalmann, N., Interrante, V., Thalmann, D., Papagiannakis, G., Sheng, B., Kim, J., and Gavrilova, M. (2021). A Preliminary Work: Mixed Reality-Integrated Computer-Aided Surgical Navigation System for Paranasal Sinus Surgery Using Microsoft HoloLens 2. Computer Graphics International Conference, Springer International Publishing."},{"key":"ref_88","doi-asserted-by":"crossref","unstructured":"Kriechling, P., Loucas, R., Loucas, M., Casari, F., F\u00fcrnstahl, P., and Wieser, K. (2021). Augmented reality through head-mounted display for navigation of baseplate component placement in reverse total shoulder arthroplasty: A cadaveric study. Arch. Orthop. Trauma Surg., 1\u20137.","DOI":"10.1007\/s00402-021-04025-5"},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"Fischer, M., Leuze, C., Perkins, S., Rosenberg, J., Daniel, B., and Martin-Gomez, A. (2020, January 9\u201313). Evaluation of Different Visualization Techniques for Perception-Based Alignment in Medical AR. Proceedings of the 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Recife, Brazil.","DOI":"10.1109\/ISMAR-Adjunct51615.2020.00027"},{"key":"ref_90","doi-asserted-by":"crossref","unstructured":"Carbone, M., Cutolo, F., Condino, S., Cercenelli, L., D\u2019Amato, R., Badiali, G., and Ferrari, V. (2022). Architecture of a Hybrid Video\/Optical See-through Head-Mounted Display-Based Augmented Reality Surgical Navigation Platform. Information, 13.","DOI":"10.3390\/info13020081"},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1109\/TMRB.2022.3155254","article-title":"Augmented Reality Assisted Autonomous View Adjustment of a 6-DOF Robotic Stereo Flexible Endoscope","volume":"4","author":"Ma","year":"2022","journal-title":"IEEE Trans. Med. Robot. Bionics"},{"key":"ref_92","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1007\/s11548-021-02526-7","article-title":"HoloUS: Augmented reality visualization of live ultrasound images using HoloLens for ultrasound-guided procedures","volume":"17","author":"Nguyen","year":"2022","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_93","doi-asserted-by":"crossref","unstructured":"Tu, P., Qin, C., Guo, Y., Li, D., Lungu, A.J., Wang, H., and Chen, X. (2022). Ultrasound image guided and mixed reality-based surgical system with real-time soft tissue deformation computing for robotic cervical pedicle screw placement. IEEE Trans. Biomed. Eng.","DOI":"10.1109\/TBME.2022.3150952"},{"key":"ref_94","doi-asserted-by":"crossref","unstructured":"Olson, E. (2011, January 9\u201313). AprilTag: A robust and flexible visual fiducial system. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5979561"},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"E11","DOI":"10.3171\/2021.5.FOCUS21209","article-title":"Real-time navigation guidance with intraoperative CT imaging for pedicle screw placement using an augmented reality head-mounted display: A proof-of-concept study","volume":"51","author":"Yanni","year":"2021","journal-title":"Neurosurg. Focus"},{"key":"ref_96","doi-asserted-by":"crossref","unstructured":"Condino, S., Cutolo, F., Cattari, N., Colangeli, S., Parchi, P.D., Piazza, R., Ruinato, A.D., Capanna, R., and Ferrari, V. (2021). Hybrid simulation and planning platform for cryosurgery with Microsoft Hololens. Sensors, 21.","DOI":"10.3390\/s21134450"},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"81","DOI":"10.37190\/ABB-01811-2021-02","article-title":"Augmented reality visualization for aiding biopsy procedure according to computed tomography based virtual plan","volume":"23","author":"Majak","year":"2021","journal-title":"Acta Bioeng. Biomech."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"975","DOI":"10.1007\/s10055-021-00503-8","article-title":"Surgical navigation system for brachytherapy based on mixed reality using a novel stereo registration method","volume":"25","author":"Zhou","year":"2021","journal-title":"Virtual Real."},{"key":"ref_99","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1080\/21681163.2021.2009378","article-title":"A calibration-free workflow for image-based mixed reality navigation of total shoulder arthroplasty","volume":"10","author":"Gu","year":"2021","journal-title":"Comput. Methods Biomech. Biomed. Eng. Imaging Vis."},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"161","DOI":"10.14444\/8021","article-title":"Augmented Reality Navigated Sacral-Alar-Iliac Screw Insertion","volume":"15","author":"Dennler","year":"2021","journal-title":"Int. J. Spine Surg."},{"key":"ref_101","doi-asserted-by":"crossref","first-page":"1447","DOI":"10.1007\/s00402-020-03542-z","article-title":"Augmented reality for base plate component placement in reverse total shoulder arthroplasty: A feasibility study","volume":"141","author":"Kriechling","year":"2021","journal-title":"Arch. Orthop. Trauma Surg."},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"10043","DOI":"10.1038\/s41598-021-88860-x","article-title":"Augmented reality navigation method for recontouring surgery of craniofacial fibrous dysplasia","volume":"11","author":"Liu","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_103","first-page":"e9717184","article-title":"Application of Mixed Reality Using Optical See-Through Head-Mounted Displays in Transforaminal Percutaneous Endoscopic Lumbar Discectomy","volume":"2021","author":"Liu","year":"2021","journal-title":"Biomed Res. Int."},{"key":"ref_104","first-page":"105760T","article-title":"Neurosurgical burr hole placement using the Microsoft HoloLens","volume":"10576","author":"Rae","year":"2018","journal-title":"Proceedings of the Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling, Houston, TX, USA, 10\u201315 February 2018"},{"key":"ref_105","unstructured":"Center for Devices and Radiological Health (2016). Applying Human Factors and Usability Engineering to Medical Devices, FDA."},{"key":"ref_106","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1243\/09544119JEIM589","article-title":"The role of registration in accurate surgical guidance","volume":"224","author":"Fitzpatrick","year":"2010","journal-title":"Proc. Inst. Mech. Eng. Part J. Eng. Med."},{"key":"ref_107","doi-asserted-by":"crossref","unstructured":"Sielhorst, T., Bichlmeier, C., Heining, S.M., and Navab, N. (2006). Depth perception\u2014A major issue in medical AR: Evaluation study by twenty surgeons. International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.","DOI":"10.1007\/11866565_45"},{"key":"ref_108","doi-asserted-by":"crossref","first-page":"792","DOI":"10.1016\/j.jsurg.2017.07.031","article-title":"Utility of 3D reconstruction of 2D liver computed tomography\/magnetic resonance images as a surgical planning tool for residents in liver resection surgery","volume":"75","author":"Yeo","year":"2018","journal-title":"J. Surg. Educ."},{"key":"ref_109","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1080\/13645706.2019.1616558","article-title":"Use of mixed reality for improved spatial understanding of liver anatomy","volume":"29","author":"Pelanis","year":"2020","journal-title":"Minim. Invasive Ther. Allied Technol."},{"key":"ref_110","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1167\/11.8.11","article-title":"The zone of comfort: Predicting visual discomfort with stereo displays","volume":"11","author":"Shibata","year":"2011","journal-title":"J. Vis."},{"key":"ref_111","doi-asserted-by":"crossref","unstructured":"Hasson, Y., Tekin, B., Bogo, F., Laptev, I., Pollefeys, M., and Schmid, C. (2020, January 14\u201319). Leveraging photometric consistency over time for sparsely supervised hand-object reconstruction. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00065"},{"key":"ref_112","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1007\/s11548-021-02369-2","article-title":"Towards markerless surgical tool and hand pose estimation","volume":"16","author":"Hein","year":"2021","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_113","doi-asserted-by":"crossref","unstructured":"Doughty, M., and Ghugre, N.R. (2022). HMD-EgoPose: Head-mounted display-based egocentric marker-less tool and hand pose estimation for augmented surgical guidance. Int. J. Comput. Assist. Radiol. Surg.","DOI":"10.1007\/s11548-022-02688-y"},{"key":"ref_114","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1109\/TMI.2016.2593957","article-title":"Endonet: A deep architecture for recognition tasks on laparoscopic videos","volume":"36","author":"Twinanda","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_115","doi-asserted-by":"crossref","unstructured":"Doughty, M., Singh, K., and Ghugre, N.R. SurgeonAssist-Net: Towards Context-Aware Head-Mounted Display-Based Augmented Reality for Surgical Guidance. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Strasbourg, France, 27 September\u20131 October 2021.","DOI":"10.1007\/978-3-030-87202-1_64"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/8\/7\/203\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:54:44Z","timestamp":1760140484000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/8\/7\/203"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,20]]},"references-count":115,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["jimaging8070203"],"URL":"https:\/\/doi.org\/10.3390\/jimaging8070203","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,20]]}}}