{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T20:56:13Z","timestamp":1778273773567,"version":"3.51.4"},"reference-count":213,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2023,5,9]],"date-time":"2023-05-09T00:00:00Z","timestamp":1683590400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Research Participation Program at the Center for Devices and Radiological Health (CDRH)"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>Augmented reality (AR) head-mounted displays (HMDs) are an increasingly popular technology. For surgical applications, the use of AR HMDs to display medical images or models may reduce invasiveness and improve task performance by enhancing understanding of the underlying anatomy. This technology may be particularly beneficial in open surgeries and interventional procedures for which the use of endoscopes, microscopes, or other visualization tools is insufficient or infeasible. While the capabilities of AR HMDs are promising, their usability for surgery is not well-defined. This review identifies current trends in the literature, including device types, surgical specialties, and reporting of user demographics, and provides a description of usability assessments of AR HMDs for open surgeries and interventional procedures. Assessments applied to other extended reality technologies are included to identify additional usability assessments for consideration when assessing AR HMDs. The PubMed, Web of Science, and EMBASE databases were searched through September 2022 for relevant articles that described user studies. User assessments most often addressed task performance. However, objective measurements of cognitive, visual, and physical loads, known to affect task performance and the occurrence of adverse events, were limited. There was also incomplete reporting of user demographics. This review reveals knowledge and methodology gaps for usability of AR HMDs and demonstrates the potential impact of future usability research.<\/jats:p>","DOI":"10.3390\/mti7050049","type":"journal-article","created":{"date-parts":[[2023,5,10]],"date-time":"2023-05-10T01:57:51Z","timestamp":1683683871000},"page":"49","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Usability Assessments for Augmented Reality Head-Mounted Displays in Open Surgery and Interventional Procedures: A Systematic Review"],"prefix":"10.3390","volume":"7","author":[{"given":"Ellenor J.","family":"Brown","sequence":"first","affiliation":[{"name":"US FDA Center for Devices and Radiological Health, Silver Spring, MD 20903, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kyoko","family":"Fujimoto","sequence":"additional","affiliation":[{"name":"GE HealthCare, Chicago, IL 60661, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bennett","family":"Blumenkopf","sequence":"additional","affiliation":[{"name":"US FDA Center for Devices and Radiological Health, Silver Spring, MD 20903, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8532-6960","authenticated-orcid":false,"given":"Andrea S.","family":"Kim","sequence":"additional","affiliation":[{"name":"US FDA Center for Devices and Radiological Health, Silver Spring, MD 20903, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4978-6011","authenticated-orcid":false,"given":"Kimberly L.","family":"Kontson","sequence":"additional","affiliation":[{"name":"US FDA Center for Devices and Radiological Health, Silver Spring, MD 20903, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6707-9695","authenticated-orcid":false,"given":"Heather L.","family":"Benz","sequence":"additional","affiliation":[{"name":"Johnson & Johnson MedTech, Cincinnati, OH 45242, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"37","DOI":"10.3389\/frobt.2018.00037","article-title":"A systematic review of 10 years of augmented reality usability studies: 2005 to 2014","volume":"5","author":"Dey","year":"2018","journal-title":"Front. Robot. AI"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.compmedimag.2012.12.002","article-title":"On mixed reality environments for minimally invasive therapy guidance: Systems architecture, successes and challenges in their implementation from laboratory to clinic","volume":"37","author":"Linte","year":"2013","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"608","DOI":"10.1109\/10.29455","article-title":"A frameless stereotaxic operating microscope for neurosurgery","volume":"36","author":"Friets","year":"1989","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1227\/00006123-198203000-00005","article-title":"Computer-assisted stereotactic laser microsurgery for the treatment of intracranial neoplasms","volume":"10","author":"Kelly","year":"1982","journal-title":"Neurosurgery"},{"key":"ref_5","unstructured":"Kress, B., and Starner, T. (May, January 29). A review of head-mounted displays (HMD) technologies and applications for consumer electronics. Proceedings of the Conference on SPIE Defense, Security, and Sensing, Baltimore, MD, USA."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"901","DOI":"10.1007\/s11548-017-1564-y","article-title":"Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display","volume":"12","author":"Qian","year":"2017","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"883","DOI":"10.1093\/ehjci\/jey184","article-title":"Mixed reality holograms for heart surgery planning: First user experience in congenital heart disease","volume":"20","author":"Brun","year":"2018","journal-title":"Eur. Heart J. Cardiovasc. Imaging"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"31493","DOI":"10.1109\/ACCESS.2018.2843378","article-title":"Mixed reality guided radiofrequency needle placement: A pilot study","volume":"6","author":"Si","year":"2018","journal-title":"IEEE Access"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1187","DOI":"10.1136\/neurintsurg-2017-013649","article-title":"Image guided percutaneous spine procedures using an optical see-through head mounted display: Proof of concept and rationale","volume":"10","author":"Deib","year":"2018","journal-title":"J. Neurointerv. Surg."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"e422","DOI":"10.1016\/j.wneu.2018.06.208","article-title":"Clinical feasibility of a wearable mixed-reality device in neurosurgery","volume":"118","author":"Incekara","year":"2018","journal-title":"World Neurosurg."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"943","DOI":"10.1007\/s00464-002-9067-4","article-title":"Use of head-mounted display in transanal endoscopic microsurgery","volume":"17","author":"Koesveld","year":"2003","journal-title":"Surg. Endosc."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1049\/htl.2018.5065","article-title":"ARssist: Augmented reality on a head-mounted display for the first assistant in robotic surgery","volume":"5","author":"Qian","year":"2018","journal-title":"Healthc. Technol. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1177\/1553350616630142","article-title":"Novel use of Google Glass for procedural wireless vital sign monitoring","volume":"23","author":"Liebert","year":"2016","journal-title":"Surg. Innov."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1032","DOI":"10.1213\/ANE.0b013e3181d3e647","article-title":"Monitoring with head-mounted displays in general anesthesia: A clinical evaluation in the operating room","volume":"110","author":"Liu","year":"2010","journal-title":"Anesth. Analg."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1109\/MDAT.2015.2465135","article-title":"Computer-vision-based decision support in surgical robotics","volume":"32","author":"Kumar","year":"2015","journal-title":"IEEE Des. Test"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1097\/SLA.0000000000001504","article-title":"The conflicting evidence of three-dimensional displays in laparoscopy: A review of systems old and new","volume":"263","author":"Sakata","year":"2016","journal-title":"Ann. Surg."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.media.2017.01.007","article-title":"The status of augmented reality in laparoscopic surgery as of 2016","volume":"37","author":"Bernhardt","year":"2017","journal-title":"Med. Image Anal."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1146\/annurev-bioeng-062117-120917","article-title":"Advanced Endoscopic Navigation: Surgical Big Data, Methodology, and Applications","volume":"20","author":"Luo","year":"2018","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1109\/TBME.2019.2914517","article-title":"Perceptual limits of optical see-through visors for augmented reality guidance of manual tasks","volume":"67","author":"Condino","year":"2019","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1409","DOI":"10.1007\/s10278-022-00622-x","article-title":"Evaluation Challenges for the Application of Extended Reality Devices in Medicine","volume":"35","author":"Beams","year":"2022","journal-title":"J. Digit. Imaging"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1001\/archsurg.139.2.170","article-title":"Augmented reality in surgery","volume":"139","author":"Shuhaiber","year":"2004","journal-title":"Arch. Surg."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1002\/rcs.1914","article-title":"Augmented reality for the surgeon: Systematic review","volume":"14","author":"Yoon","year":"2018","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1007\/s10143-016-0732-9","article-title":"Augmented reality in neurosurgery: A systematic review","volume":"40","author":"Meola","year":"2017","journal-title":"Neurosurg. Rev."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"A97","DOI":"10.1227\/NEU.0b013e31827393c9","article-title":"Virtual endoscopy in neurosurgery: A review","volume":"72","author":"Neubauer","year":"2013","journal-title":"Neurosurgery"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1049\/htl.2017.0077","article-title":"Editorial: Challenges for the usability of AR and VR for clinical neurosurgical procedures","volume":"4","author":"Eagleson","year":"2017","journal-title":"Healthc. Technol. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1017\/cjn.2016.443","article-title":"Augmented reality in neurosurgery: A review of current concepts and emerging applications","volume":"44","author":"Guha","year":"2017","journal-title":"Can. J. Neurol. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Jud, L., Fotouhi, J., Andronic, O., Aichmair, A., Osgood, G., Navab, N., and Farshad, M. (2020). Applicability of augmented reality in orthopedic surgery\u2014A systematic review. BMC Musculoskelet. Disord., 21.","DOI":"10.1186\/s12891-020-3110-2"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"179","DOI":"10.5999\/aps.2017.44.3.179","article-title":"Virtual reality and augmented reality in plastic surgery: A review","volume":"44","author":"Kim","year":"2017","journal-title":"Arch. Plast. Surg."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TMRB.2019.2957061","article-title":"A Review of Augmented Reality in Robotic-Assisted Surgery","volume":"2","author":"Qian","year":"2019","journal-title":"IEEE Trans. Med. Robot. Bionics"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"102361","DOI":"10.1016\/j.media.2022.102361","article-title":"Utility of optical see-through head mounted displays in augmented reality-assisted surgery: A systematic review","volume":"77","author":"Birlo","year":"2022","journal-title":"Med. Image Anal."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"D\u00fcnser, A., Grasset, R., and Billinghurst, M. (2008, January 11\u201315). A survey of evaluation techniques used in augmented reality studies. Proceedings of the International Conference on Computer Graphics and Interactive Techniques, Los Angeles, CA, USA.","DOI":"10.1145\/1508044.1508049"},{"key":"ref_32","unstructured":"Spencer, S.N. (2016, January 2\u20134). AR interaction paradigm for closed reduction of long-bone fractures via external fixation. Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology, Munich, Germany."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1049\/htl.2018.5061","article-title":"Augmented reality visualisation for orthopaedic surgical guidance with pre- and intra-operative multimodal image data fusion","volume":"5","author":"Pandey","year":"2018","journal-title":"Healthc. Technol. Lett."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"021205","DOI":"10.1117\/1.JMI.5.2.021205","article-title":"Plan in 2-D, execute in 3-D: An augmented reality solution for cup placement in total hip arthroplasty","volume":"5","author":"Fotouhi","year":"2018","journal-title":"J. Med. Imaging"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"139","DOI":"10.3171\/2018.12.SPINE181142","article-title":"Augmented reality-assisted pedicle screw insertion: A cadaveric proof-of-concept study","volume":"31","author":"Molina","year":"2019","journal-title":"J. Neurosurg. Spine"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1941","DOI":"10.1007\/s00264-015-3028-8","article-title":"Precision insertion of percutaneous sacroiliac screws using a novel augmented reality-based navigation system: A pilot study","volume":"40","author":"Wang","year":"2016","journal-title":"Int. Orthop."},{"key":"ref_37","unstructured":"Julier, S., Lindeman, R.W., and Sandor, C. (2014, January 10\u201312). Video see through AR head-mounted display for medical procedures. Proceedings of the 2014 IEEE International Symposium on Mixed and Augmented Reality, Munich, Germany."},{"key":"ref_38","first-page":"30","article-title":"Stereoscopic augmented reality navigation for trauma surgery: Cadaver experiment and usability study","volume":"1","author":"Traub","year":"2006","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_39","unstructured":"Kress, B.C., and Peroz, C. (2020, January 28\u201331). Augmented Reality and Human Factors Regarding the Neurosurgical Operating Room Workflow. Proceedings of the Conference on Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality, Virtual."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"E1622","DOI":"10.1097\/BRS.0000000000003669","article-title":"Augmented Reality-assisted Pedicle Instrumentation: Versatility Across Major Instrumentation Sets","volume":"45","author":"Urakov","year":"2020","journal-title":"Spine"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12891-020-03373-4","article-title":"Augmented reality guided osteotomy in hallux Valgus correction","volume":"21","author":"Viehofer","year":"2020","journal-title":"BMC Musculoskelet. Disord."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1498","DOI":"10.1109\/TMI.2009.2018622","article-title":"The virtual mirror: A new interaction paradigm for augmented reality environments","volume":"28","author":"Bichlmeier","year":"2009","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"921","DOI":"10.1007\/s11548-022-02602-6","article-title":"The impact of visualization paradigms on the detectability of spatial misalignment in mixed reality surgical guidance","volume":"17","author":"Gu","year":"2022","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"e1226","DOI":"10.1016\/j.wneu.2022.05.134","article-title":"The XVS System During Open Spinal Fixation Procedures in Patients Requiring Pedicle Screw Placement in the Lumbosacral Spine","volume":"164","author":"Harel","year":"2022","journal-title":"World Neurosurg."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"E11","DOI":"10.3171\/2021.5.FOCUS21209","article-title":"Real-time navigation guidance with intraoperative CT imaging for pedicle screw placement using an augmented reality head-mounted display: A proof-of-concept study","volume":"51","author":"Yanni","year":"2021","journal-title":"Neurosurg. Focus"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1016\/j.wneu.2020.03.073","article-title":"The Use of a Novel Heads-Up Display (HUD) to View Intra-Operative X-rays during a One-Level Cervical Arthroplasty","volume":"138","author":"Saylany","year":"2020","journal-title":"World Neurosurg."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"e1770","DOI":"10.1002\/rcs.1770","article-title":"Technical feasibility and safety of an intraoperative head-up display device during spine instrumentation","volume":"13","author":"Yoon","year":"2017","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1636","DOI":"10.1016\/j.arth.2020.01.025","article-title":"Augmented Reality for Acetabular Component Placement in Direct Anterior Total Hip Arthroplasty","volume":"35","author":"Alexander","year":"2020","journal-title":"J. Arthroplast."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1057","DOI":"10.1007\/s12541-017-0124-2","article-title":"Development of a surgical navigation system for corrective osteotomy based on augmented reality","volume":"18","author":"Bong","year":"2017","journal-title":"Int. J. Precis. Eng. Manuf."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1007","DOI":"10.1007\/s11548-016-1363-x","article-title":"Preclinical usability study of multiple augmented reality concepts for K-wire placement","volume":"11","author":"Fischer","year":"2016","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"2205","DOI":"10.1007\/s11548-017-1652-z","article-title":"Augmented reality surgical navigation with ultrasound-assisted registration for pedicle screw placement: A pilot study","volume":"12","author":"Ma","year":"2017","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1833","DOI":"10.1016\/j.arth.2018.01.067","article-title":"A pilot study of augmented reality technology applied to the acetabular cup placement during total hip arthroplasty","volume":"33","author":"Ogawa","year":"2018","journal-title":"J. Arthroplast."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Ponce, B.A., Brabston, E.W., Zu, S., Watson, S.L., Baker, D., Winn, D., Guthrie, B.L., and Shenai, M.B. (2016, January 16\u201320). Telemedicine with mobile devices and augmented reality for early postoperative care. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Orlando, FL, USA.","DOI":"10.1109\/EMBC.2016.7591705"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1186\/s40634-019-0212-6","article-title":"Augmented reality-based navigation system applied to tibial bone resection in total knee arthroplasty","volume":"6","author":"Tsukada","year":"2019","journal-title":"J. Exp. Orthop."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.compbiomed.2016.08.008","article-title":"Inverse visualization concept for RGB-D augmented C-arms","volume":"77","author":"Wang","year":"2016","journal-title":"Comput. Biol. Med."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"987","DOI":"10.1007\/s11548-014-0995-y","article-title":"Video-guided calibration of an augmented reality mobile C-arm","volume":"9","author":"Chen","year":"2014","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_57","unstructured":"Holmes, D.R., and Yaniv, Z.R. (2013, January 9\u201314). How a surgeon becomes Superman by visualization of intelligently fused multi-modalities. Proceedings of the Medical Imaging 2013: Image-Guided Procedures, Robotic Interventions, and Modeling, Orlando, FL, USA."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1007\/s11548-011-0660-7","article-title":"Evaluation of a portable image overlay projector for the visualisation of surgical navigation data: Phantom studies","volume":"7","author":"Gavaghan","year":"2012","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_59","first-page":"189","article-title":"Pedicle screw placement under video-augmented flouroscopic control: First clinical application in a cadaver study","volume":"1","author":"Heining","year":"2006","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_60","unstructured":"Abbey, C.K., and MelloThoms, C.R. (2013, January 28). Comparing the Microsoft (R) Kinect (TM) to a traditional mouse for adjusting the viewed tissue densities of three-dimensional anatomical structures. Proceedings of the Medical Imaging 2013: Image Perception, Observer Performance, and Technology Assessment, Lake Buena Vista, FL, USA."},{"key":"ref_61","first-page":"232","article-title":"Intraoperative 3D Imaging: Value and Consequences in 248 Cases","volume":"66","author":"Kendoff","year":"2009","journal-title":"J. Trauma Inj. Infect. Crit. Care"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"1395","DOI":"10.1007\/s11548-015-1169-2","article-title":"Intra-operative augmented reality in distal locking","volume":"10","author":"Londei","year":"2015","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1055\/s-0038-1634092","article-title":"Pre-operative dynamic interactive exploration of complex articular fractures using a novel 3D navigation tool","volume":"45","author":"Marschollek","year":"2006","journal-title":"Methods Inf. Med."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"e182.1","DOI":"10.2106\/JBJS.K.00996","article-title":"Virtual fracture carving improves understanding of a complex fracture: A randomized controlled study","volume":"94","author":"Pahuta","year":"2012","journal-title":"J. Bone Jt. Surg. Am. Vol."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1080\/14639230600886900","article-title":"Efficacy of stereoscopic visualization and six degrees of freedom interaction in preoperative planning of total hip replacement","volume":"31","author":"Testi","year":"2006","journal-title":"Med. Inform. Internet Med."},{"key":"ref_66","first-page":"sti33\/1040","article-title":"Performance on a virtual reality DHS simulator correlates with performance in the operating theatre","volume":"33","author":"Vaghela","year":"2018","journal-title":"Surg. Technol. Int."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1055\/s-0040-1719099","article-title":"Retrospective Comparison of Minimally Invasive and Open Monosegmental Lumbar Fusion, and Impact of Virtual Reality on Surgical Planning and Strategy","volume":"82","author":"Alsofy","year":"2021","journal-title":"J. Neurol. Surg. Part A Cent. Eur. Neurosurg."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Moreta-Martinez, R., Pose-D\u00edez-de-la-Lastra, A., Calvo-Haro, J.A., Mediavilla-Santos, L., P\u00e9rez-Ma\u00f1anes, R., and Pascau, J. (2021). Combining Augmented Reality and 3D Printing to Improve Surgical Workflows in Orthopedic Oncology: Smartphone Application and Clinical Evaluation. Sensors, 21.","DOI":"10.3390\/s21041370"},{"key":"ref_69","first-page":"677","article-title":"What are the optimal targeting visualizations for performing surgical navigation of iliosacral screws? A user study","volume":"143","author":"Pandey","year":"2021","journal-title":"Trauma Surg."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"819","DOI":"10.1007\/s11548-020-02165-4","article-title":"Multimodal mixed reality visualisation for intraoperative surgical guidance","volume":"15","author":"Cartucho","year":"2020","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1080\/24699322.2017.1358400","article-title":"A new head-mounted display-based augmented reality system in neurosurgical oncology: A study on phantom","volume":"22","author":"Cutolo","year":"2017","journal-title":"Comput. Assist. Surg."},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"26","DOI":"10.4103\/sni.sni_228_18","article-title":"Feasibility of using a low-cost head-mounted augmented reality device in the operating room","volume":"10","author":"Kubben","year":"2019","journal-title":"Surg. Neurol. Int."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1007\/s00701-021-04707-4","article-title":"Holographic patient tracking after bed movement for augmented reality neuronavigation using a head-mounted display","volume":"163","author":"Fick","year":"2021","journal-title":"Acta Neurochir."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"1637","DOI":"10.1007\/s10055-022-00653-3","article-title":"Multimodal markers for technology-independent integration of augmented reality devices and surgical navigation systems","volume":"26","author":"Benmahdjoub","year":"2022","journal-title":"Virtual Real."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"2590","DOI":"10.1007\/s10439-021-02834-8","article-title":"Evaluation of a Wearable AR Platform for Guiding Complex Craniotomies in Neurosurgery","volume":"49","author":"Condino","year":"2021","journal-title":"Ann. Biomed. Eng."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"1453","DOI":"10.1007\/s11548-022-02634-y","article-title":"Augmented reality navigation for minimally invasive craniosynostosis surgery: A phantom study","volume":"17","author":"Thabit","year":"2022","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"E19","DOI":"10.3171\/2019.12.FOCUS19854","article-title":"Augmented reality and physical hybrid model simulation for preoperative planning of metopic craniosynostosis surgery","volume":"48","author":"Coelho","year":"2020","journal-title":"Neurosurg. Focus"},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"021210","DOI":"10.1117\/1.JMI.5.2.021210","article-title":"Combining intraoperative ultrasound brain shift correction and augmented reality visualizations: A pilot study of eight cases","volume":"5","author":"Gerard","year":"2018","journal-title":"J. Med. Imaging"},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1049\/htl.2018.5063","article-title":"Gesture-based registration correction using a mobile augmented reality image-guided neurosurgery system","volume":"5","author":"Reyes","year":"2018","journal-title":"Healthc. Technol. Lett."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"1013","DOI":"10.1007\/s11548-020-02155-6","article-title":"MARIN: An open-source mobile augmented reality interactive neuronavigation system","volume":"15","author":"Reyes","year":"2020","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"E491","DOI":"10.1016\/j.wneu.2018.07.189","article-title":"Stereoscopic versus monoscopic viewing of aneurysms: Experience of a single institution with a novel stereoscopic viewing system","volume":"119","author":"Acker","year":"2018","journal-title":"World Neurosurg."},{"key":"ref_82","unstructured":"Galloway, R.L. (2004, January 15\u201317). User performance analysis of different image-based navigation systems for needle placement procedures. Proceedings of the Medical Imaging 2004: Visualization, Image-Guided Procedures, and Display, San Diego, CA, USA."},{"key":"ref_83","first-page":"630","article-title":"Evaluation of projection-based augmented reality technique in cerebral catheter procedures","volume":"11","year":"2020","journal-title":"Ann. Clin. Anal. Med."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1109\/TVCG.2013.240","article-title":"An Evaluation of Depth Enhancing Perceptual Cues for Vascular Volume Visualization in Neurosurgery","volume":"20","author":"Chen","year":"2014","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1016\/j.ejvs.2013.02.004","article-title":"A pilot study of video-motion analysis in endovascular surgery: Development of real-time discriminatory skill metrics","volume":"45","author":"Rolls","year":"2013","journal-title":"Eur. J. Vasc. Endovasc. Surg."},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"A63","DOI":"10.1227\/NEU.0b013e318270d310","article-title":"Mono-stereo-autostereo: The evolution of 3-dimensional neurosurgical planning","volume":"72","author":"Stadie","year":"2013","journal-title":"Neurosurgery"},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"206","DOI":"10.3171\/2014.9.JNS141001","article-title":"Augmented reality-guided neurosurgery: Accuracy and intraoperative application of an image projection technique","volume":"123","author":"Tabrizi","year":"2015","journal-title":"J. Neurosurg."},{"key":"ref_88","first-page":"542","article-title":"The Benefits of Limited Orbitotomy on the Supraorbital Approach: An Anatomic and Morphometric Study in Virtual Reality","volume":"18","author":"Tai","year":"2020","journal-title":"Neurosurgery"},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"1700","DOI":"10.1016\/j.jvs.2010.08.015","article-title":"Patient-specific simulation in carotid artery stenting","volume":"52","author":"Willaert","year":"2010","journal-title":"J. Vasc. Surg."},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"1184","DOI":"10.1097\/SLA.0b013e31824f9dbf","article-title":"Simulated procedure rehearsal is more effective than a preoperative generic warm-up for endovascular procedures","volume":"255","author":"Willaert","year":"2012","journal-title":"Ann. Surg."},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"1304","DOI":"10.1002\/bjs.8858","article-title":"Role of patient-specific virtual reality rehearsal in carotid artery stenting","volume":"99","author":"Willaert","year":"2012","journal-title":"Br. J. Surg."},{"key":"ref_92","doi-asserted-by":"crossref","first-page":"1865","DOI":"10.1097\/SCS.0000000000006525","article-title":"Evaluation of Surgical Approaches for Tumor Resection in the Deep Infratentorial Region and Impact of Virtual Reality Technique for the Surgical Planning and Strategy","volume":"31","author":"Sakellaropoulou","year":"2020","journal-title":"J. Craniofac. Surg."},{"key":"ref_93","doi-asserted-by":"crossref","first-page":"100102","DOI":"10.1016\/j.wnsx.2021.100102","article-title":"Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics","volume":"11","author":"Koike","year":"2021","journal-title":"World Neurosurg. X"},{"key":"ref_94","unstructured":"Fei, B., and Linte, C.A. (2019, January 16\u201321). Shared visualizations and guided procedure simulation in augmented reality with Microsoft HoloLens. Proceedings of the Medical Imaging 2019: Image-Guided Procedures, Robotic Interventions, and Modeling, San Diego, CA, USA."},{"key":"ref_95","doi-asserted-by":"crossref","unstructured":"Perkins, S.L., Lin, M.A., Srinivasan, S., Wheeler, A.J., Hargreaves, B.A., and Daniel, B.L. (2017, January 9\u201313). A mixed-reality system for breast surgical planning. Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), Nantes, France.","DOI":"10.1109\/ISMAR-Adjunct.2017.92"},{"key":"ref_96","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1049\/htl.2019.0091","article-title":"Augmented reality mastectomy surgical planning prototype using the HoloLens template for healthcare technology letters","volume":"6","author":"Amini","year":"2019","journal-title":"Healthc. Technol. Lett."},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"8851964","DOI":"10.1155\/2020\/8851964","article-title":"Experimental Setup Employed in the Operating Room Based on Virtual and Mixed Reality: Analysis of Pros and Cons in Open Abdomen Surgery","volume":"2020","author":"Galati","year":"2020","journal-title":"J. Health Eng."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1007\/s10353-004-0102-7","article-title":"Augmented-reality-based liver-surgical planning system","volume":"36","author":"Werkgartner","year":"2004","journal-title":"Eur. Surg."},{"key":"ref_99","doi-asserted-by":"crossref","unstructured":"Wacker, F.K., Vogt, S., Khamene, A., Sauer, F., Wendt, M., Duerk, J.L., Lewin, J.S., and Wolf, K.J. (2005, January 22\u201325). MR image-guided needle biopsies with a combination of augmented reality and MRI: A pilot study in phantoms and animals. Proceedings of the CARS 2005: Computer Assisted Radiology and Surgery, Berlin, Germany.","DOI":"10.1016\/j.ics.2005.03.300"},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"3568","DOI":"10.1109\/TVCG.2020.3023637","article-title":"Comparison of Augmented Reality Display Techniques to Support Medical Needle Insertion","volume":"26","author":"Heinrich","year":"2020","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_101","doi-asserted-by":"crossref","unstructured":"Cattari, N., Condino, S., Cutolo, F., Ferrari, M., and Ferrari, V. (2021). In Situ Visualization for 3D Ultrasound-Guided Interventions with Augmented Reality Headset. Bioengineering, 8.","DOI":"10.3390\/bioengineering8100131"},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"71","DOI":"10.3109\/10929080701253634","article-title":"A quantitative evaluation of human coordination interfaces for computer assisted surgery","volume":"12","author":"Cardin","year":"2007","journal-title":"Comput. Aided Surg."},{"key":"ref_103","doi-asserted-by":"crossref","unstructured":"Engemann, K.J., GilLafuente, A.M., and Merigo, J.M. (2012). Modeling and Simulation in Engineering, Economics, and Management, Springer.","DOI":"10.1007\/978-3-642-30433-0"},{"key":"ref_104","doi-asserted-by":"crossref","first-page":"5110","DOI":"10.1109\/IEMBS.2009.5332720","article-title":"Ultrasound guided robotic biopsy using augmented reality and human-robot cooperative control","volume":"Volume 1\u201320","author":"Freschi","year":"2009","journal-title":"Proceedings of the 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society"},{"key":"ref_105","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1007\/s11548-018-1730-x","article-title":"IMHOTEP: Virtual reality framework for surgical applications","volume":"13","author":"Pfeiffer","year":"2018","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_106","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1109\/MCG.2006.131","article-title":"Liver surgery planning using virtual reality","volume":"26","author":"Reitinger","year":"2006","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_107","doi-asserted-by":"crossref","first-page":"4607","DOI":"10.3748\/wjg.v21.i15.4607","article-title":"Three-dimensional morphometric analysis for hepatectomy of centrally located hepatocellular carcinoma: A pilot study","volume":"21","author":"Tian","year":"2015","journal-title":"World J. Gastroenterol."},{"key":"ref_108","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1002\/jso.23782","article-title":"Preoperative prediction of cosmetic results in breast conserving surgery","volume":"111","author":"Vos","year":"2014","journal-title":"J. Surg. Oncol."},{"key":"ref_109","doi-asserted-by":"crossref","first-page":"e192633","DOI":"10.1001\/jamanetworkopen.2019.2633","article-title":"Comparison of 3-Dimensional and Augmented Reality Kidney Models with Conventional Imaging Data in the Preoperative Assessment of Children with Wilms Tumors","volume":"2","author":"Wellens","year":"2019","journal-title":"JAMA Netw. Open"},{"key":"ref_110","doi-asserted-by":"crossref","first-page":"72","DOI":"10.3389\/frobt.2020.00072","article-title":"Augmented Reality Guided Needle Biopsy of Soft Tissue: A Pilot Study","volume":"7","author":"Carriere","year":"2020","journal-title":"Front. Robot. AI"},{"key":"ref_111","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1007\/s00464-019-06755-5","article-title":"Mixed reality navigation system for ultrasound-guided percutaneous punctures: A pre-clinical evaluation","volume":"34","author":"Davrieux","year":"2020","journal-title":"Surg. Endosc."},{"key":"ref_112","doi-asserted-by":"crossref","unstructured":"Gao, Y., Zhao, Y., Xie, L., and Zheng, G. (2021). A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery. Sensors, 21.","DOI":"10.3390\/s21092931"},{"key":"ref_113","doi-asserted-by":"crossref","first-page":"1074","DOI":"10.21037\/atm-21-512","article-title":"Virtual reality and 3D printing improve preoperative visualization of 3D liver reconstructions-results from a preclinical comparison of presentation modalities and user\u2019s preference","volume":"9","author":"Huettl","year":"2021","journal-title":"Ann. Transl. Med."},{"key":"ref_114","doi-asserted-by":"crossref","first-page":"100077","DOI":"10.1016\/j.yjbinx.2020.100077","article-title":"Use of mixed reality for surgery planning: Assessment and development workflow","volume":"112","author":"Kumar","year":"2020","journal-title":"J. Biomed. Inform."},{"key":"ref_115","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/JTEHM.2020.3007031","article-title":"Performance Evaluation of Mixed Reality Display for Guidance during Transcatheter Cardiac Mapping and Ablation","volume":"8","author":"Southworth","year":"2020","journal-title":"IEEE J. Transl. Eng. Health Med."},{"key":"ref_116","doi-asserted-by":"crossref","first-page":"237.e1","DOI":"10.1016\/j.crad.2020.10.017","article-title":"Mixed-reality hologram for diagnosis and surgical planning of double outlet of the right ventricle: A pilot study","volume":"76","author":"Ye","year":"2020","journal-title":"Clin. Radiol."},{"key":"ref_117","doi-asserted-by":"crossref","first-page":"732","DOI":"10.1053\/j.jvca.2018.08.013","article-title":"Validation of quantitative 3-dimensional transesophageal echocardiography mitral valve analysis using stereoscopic display","volume":"33","author":"Ballocca","year":"2018","journal-title":"J. Cardiothorac. Vasc. Anesth."},{"key":"ref_118","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1093\/ehjci\/jew087","article-title":"Computer-generated real-time digital holography: First time use in clinical medical imaging","volume":"17","author":"Bruckheimer","year":"2016","journal-title":"Eur. Hearth J. Cardiovasc. Imaging"},{"key":"ref_119","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1177\/155698451000500609","article-title":"Augmented reality image guidance during off-pump mitral valve replacement through the guiraudon universal cardiac introducer","volume":"5","author":"Guiraudon","year":"2010","journal-title":"Innov. Technol. Tech. Cardiothorac. Vasc. Surg."},{"key":"ref_120","doi-asserted-by":"crossref","first-page":"1297","DOI":"10.1016\/j.echo.2020.06.016","article-title":"Stereoscopic Display Is Superior to Conventional Display for Three-Dimensional Echocardiography of Congenital Heart Anatomy","volume":"33","author":"Harake","year":"2020","journal-title":"J. Am. Soc. Echocardiogr."},{"key":"ref_121","doi-asserted-by":"crossref","first-page":"e20633","DOI":"10.2196\/20633","article-title":"A Novel Virtual Reality Medical Image Display System for Group Discussions of Congenital Heart Disease: Development and Usability Testing","volume":"4","author":"Kim","year":"2020","journal-title":"JMIR Cardio"},{"key":"ref_122","doi-asserted-by":"crossref","unstructured":"Kozlowski, P., Urheim, S., and Samset, E. (2017, January 18\u201321). Evaluation of a multi-view autostereoscopic real-time 3D ultrasound system for minimally invasive cardiac surgery guidance. Proceedings of the 2017 IEEE 14th International Symposium on Biomedical Imaging, Melbourne, Australia.","DOI":"10.1109\/ISBI.2017.7950593"},{"key":"ref_123","first-page":"162","article-title":"Surgeon-controlled visualization techniques for virtual reality-guided cardiac surgery","volume":"142","author":"Lo","year":"2009","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_124","doi-asserted-by":"crossref","first-page":"e12008","DOI":"10.2196\/12008","article-title":"Advancing Cardiac Surgery Case Planning and Case Review Conferences Using Virtual Reality in Medical Libraries: Evaluation of the Usability of Two Virtual Reality Apps","volume":"6","author":"Napa","year":"2019","journal-title":"JMIR Hum. Factors"},{"key":"ref_125","first-page":"307","article-title":"Towards a mixed reality environment for preoperative planning of cardiac surgery","volume":"142","author":"Seitel","year":"2009","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_126","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.xjtc.2021.02.044","article-title":"Virtual reality three-dimensional echocardiographic imaging for planning surgical atrioventricular valve repair","volume":"7","author":"Pushparajah","year":"2021","journal-title":"JTCVS Tech."},{"key":"ref_127","doi-asserted-by":"crossref","first-page":"e35488","DOI":"10.2196\/35488","article-title":"Virtual Reality Cardiac Surgical Planning Software (CorFix) for Designing Patient-Specific Vascular Grafts: Development and Pilot Usability Study","volume":"6","author":"Kim","year":"2022","journal-title":"JMIR Cardio"},{"key":"ref_128","doi-asserted-by":"crossref","unstructured":"Pellegrino, G., Mangano, C., Mangano, R., Ferri, A., Taraschi, V., and Marchetti, C. (2019). Augmented reality for dental implantology: A pilot clinical report of two cases. BMC Oral Health, 19.","DOI":"10.1186\/s12903-019-0853-y"},{"key":"ref_129","doi-asserted-by":"crossref","first-page":"1008","DOI":"10.1007\/s10278-019-00272-6","article-title":"A Marker-Less Registration Approach for Mixed Reality-Aided Maxillofacial Surgery: A Pilot Evaluation","volume":"32","author":"Pepe","year":"2019","journal-title":"J. Digit. Imaging"},{"key":"ref_130","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1007\/s11548-014-1005-0","article-title":"A system for context-aware intraoperative augmented reality in dental implant surgery","volume":"10","author":"Katic","year":"2015","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_131","doi-asserted-by":"crossref","first-page":"1943.e1","DOI":"10.1016\/j.joms.2021.04.001","article-title":"Augmented Reality Visualization for Image-Guided Surgery: A Validation Study Using a Three-Dimensional Printed Phantom","volume":"79","author":"Glas","year":"2021","journal-title":"J. Oral Maxillofac. Surg."},{"key":"ref_132","doi-asserted-by":"crossref","first-page":"e5526","DOI":"10.1002\/cpe.5526","article-title":"Augmented reality for botulinum toxin injection","volume":"32","author":"Kim","year":"2019","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_133","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1111\/opo.12393","article-title":"Drilling into the functional significance of stereopsis: The impact of stereoscopic information on surgical performance","volume":"37","author":"Mushtaq","year":"2017","journal-title":"Ophthalmic Physiol. Opt."},{"key":"ref_134","doi-asserted-by":"crossref","first-page":"644","DOI":"10.1016\/j.bjoms.2019.02.014","article-title":"Virtual reality in preoperative imaging in maxillofacial surgery: Implementation of \u201cthe next level\u201d?","volume":"57","author":"Bartella","year":"2019","journal-title":"Br. J. Oral Maxillofac. Surg."},{"key":"ref_135","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/S0266-4356(97)90046-2","article-title":"Computed intraoperative navigation guidance\u2014A preliminary report on a new technique","volume":"35","author":"Enislidis","year":"1997","journal-title":"Br. J. Oral Maxillofac. Surg."},{"key":"ref_136","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1007\/s00056-002-0043-3","article-title":"Public domain computer-aided surgery (CAS) in orthodontic and maxillofacial surgery","volume":"63","author":"Stamm","year":"2002","journal-title":"J. Orofac. Orthop."},{"key":"ref_137","doi-asserted-by":"crossref","unstructured":"Suenaga, H., Tran, H.H., Liao, H., Masamune, K., Dohi, T., Hoshi, K., and Takato, T. (2015). Vision-based markerless registration using stereo vision and an augmented reality surgical navigation system: A pilot study. BMC Med. Imaging, 15.","DOI":"10.1186\/s12880-015-0089-5"},{"key":"ref_138","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1038\/ijos.2013.26","article-title":"Real-time in situ three-dimensional integral videography and surgical navigation using augmented reality: A pilot study","volume":"5","author":"Suenaga","year":"2013","journal-title":"Int. J. Oral Sci."},{"key":"ref_139","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1097\/SLA.0000000000002764","article-title":"Surgical Telementoring Without Encumbrance A Comparative Study of See-through Augmented Reality-based Approaches","volume":"270","author":"Cabrera","year":"2019","journal-title":"Ann. Surg."},{"key":"ref_140","unstructured":"Howard, A. (2019, January 20\u201324). Augmented Reality Assisted Instrument Insertion and Tool Manipulation for the First Assistant in Robotic Surgery. Proceedings of the 2019 International Conference on Robotics and Automation, Montreal, QC, Canada."},{"key":"ref_141","doi-asserted-by":"crossref","first-page":"694","DOI":"10.1111\/aor.13396","article-title":"Real world usability analysis of two augmented reality headsets in visceral surgery","volume":"43","author":"Moosburner","year":"2018","journal-title":"Artif. Organs"},{"key":"ref_142","doi-asserted-by":"crossref","unstructured":"Arpaia, P., De Benedetto, E., De Paolis, L., D\u2019Errico, G., Donato, N., and Duraccio, L. (2022). Performance and Usability Evaluation of an Extended Reality Platform to Monitor Patient\u2019s Health during Surgical Procedures. Sensors, 22.","DOI":"10.3390\/s22103908"},{"key":"ref_143","doi-asserted-by":"crossref","first-page":"310","DOI":"10.7205\/MILMED-D-16-00051","article-title":"An augmented reality-based approach for surgical telementoring in austere environments","volume":"182","author":"Andersen","year":"2017","journal-title":"Mil. Med."},{"key":"ref_144","doi-asserted-by":"crossref","first-page":"911","DOI":"10.1007\/s00423-021-02127-7","article-title":"Using virtual 3D-models in surgical planning: Workflow of an immersive virtual reality application in liver surgery","volume":"406","author":"Boedecker","year":"2021","journal-title":"Langenbeck\u2019s Arch. Surg."},{"key":"ref_145","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1007\/s11548-009-0365-3","article-title":"Illustrative visualization of 3D planning models for augmented reality in liver surgery","volume":"5","author":"Hansen","year":"2010","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_146","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1080\/13645706.2016.1275016","article-title":"Routine clinical application of virtual reality in abdominal surgery","volume":"26","author":"Sampogna","year":"2017","journal-title":"Minim. Invasive Ther. Allied Technol."},{"key":"ref_147","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1177\/1553350618822860","article-title":"A Virtual Reality Environment to Visualize Three-Dimensional Patient-Specific Models by a Mobile Head-Mounted Display","volume":"26","author":"Vertemati","year":"2019","journal-title":"Surg. Innov."},{"key":"ref_148","doi-asserted-by":"crossref","first-page":"105429","DOI":"10.1016\/j.compbiomed.2022.105429","article-title":"A comparison of input devices for precise interaction tasks in VR-based surgical planning and training","volume":"145","author":"Allgaier","year":"2022","journal-title":"Comput. Biol. Med."},{"key":"ref_149","doi-asserted-by":"crossref","unstructured":"Hombeck, J., Meuschke, M., Zyla, L., Heuser, A.J., Toader, J., Popp, F., Bruns, C.J., Hansen, C., Datta, R.R., and Lawonn, K. (2022, January 12\u201316). Evaluating Perceptional Tasks for Medicine: A Comparative User Study between a Virtual Reality and a Desktop Application. Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR), Christchurch, New Zealand.","DOI":"10.1109\/VR51125.2022.00071"},{"key":"ref_150","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1097\/XCS.0000000000000285","article-title":"Preliminary Exploration on the Efficacy of Augmented Reality-Guided Hepatectomy for Hepatolithiasis","volume":"235","author":"Wu","year":"2022","journal-title":"J. Am. Coll. Surg."},{"key":"ref_151","doi-asserted-by":"crossref","unstructured":"Sadri, S., Kohen, S.A., Elvezio, C., Sun, S.H., Grinshpoon, A., Loeb, G.J., Basu, N., and Feiner, S.K. (2019, January 10\u201318). Manipulating 3D Anatomic Models in Augmented Reality: Comparing a Hands-Free Approach and a Manual Approach. Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, Beijing, China.","DOI":"10.1109\/ISMAR.2019.00-21"},{"key":"ref_152","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1177\/1553350619893236","article-title":"A Novel Evaluation Model for a Mixed-Reality Surgical Navigation System: Where Microsoft HoloLens Meets the Operating Room","volume":"27","author":"Zuo","year":"2020","journal-title":"Surg. Innov."},{"key":"ref_153","unstructured":"Kerren, A., Hurter, C., and Braz, J. (2020, January 27\u201329). Assessing the Feasibility of using Augmented Reality to Visualize Interventional Radiology Imagery. Proceedings of the Ivapp: 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Valetta, Malta."},{"key":"ref_154","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1016\/j.ejvs.2013.03.006","article-title":"Patient-specific Rehearsal Prior to EVAR: A Pilot Study","volume":"45","author":"Desender","year":"2013","journal-title":"Eur. J. Vasc. Endovasc. Surg."},{"key":"ref_155","doi-asserted-by":"crossref","first-page":"E205","DOI":"10.1532\/HSF98.20091169","article-title":"Endoclamp Balloon Visualization and Automatic Placement System","volume":"13","author":"Furtado","year":"2010","journal-title":"Hearth Surg. Forum"},{"key":"ref_156","doi-asserted-by":"crossref","first-page":"e1946","DOI":"10.1002\/rcs.1946","article-title":"A tensor-mass method-based vascular model and its performance evaluation for interventional surgery virtual reality simulator","volume":"14","author":"Guo","year":"2018","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"ref_157","doi-asserted-by":"crossref","unstructured":"Wang, J., Fallavollita, P., Wang, L., Kreiser, M., and Navab, N. (2012, January 5\u20138). Augmented reality during angiography: Integration of a virtual mirror for improved 2D\/3D visualization. Proceedings of the 2012 IEEE International Symposium on Mixed and Augmented Reality, Atlanta, GA, USA.","DOI":"10.1109\/ISMAR.2012.6402565"},{"key":"ref_158","doi-asserted-by":"crossref","first-page":"2473","DOI":"10.1007\/s00405-020-06351-7","article-title":"Augmented reality with HoloLens in parotid surgery: How to assess and to improve accuracy","volume":"278","author":"Scherl","year":"2020","journal-title":"Eur. Arch. Oto-Rhino-Laryngol."},{"key":"ref_159","first-page":"439","article-title":"Augmented Reality with HoloLens (R) in Parotid Tumor Surgery: A Prospective Feasibility Study","volume":"10","author":"Scherl","year":"2021","journal-title":"Orl-J. Oto-Rhino-Laryngol. Head Neck Surg."},{"key":"ref_160","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.cmpb.2020.105854","article-title":"Augmented Reality for Head and Neck Carcinoma Imaging: Description and Feasibility of an Instant Calibration, Markerless Approach","volume":"200","author":"Gsaxner","year":"2021","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_161","doi-asserted-by":"crossref","first-page":"1855","DOI":"10.1002\/lary.29542","article-title":"Patient-specific Virtual Temporal Bone Simulation Based on Clinical Cone-beam Computed Tomography","volume":"131","author":"Andersen","year":"2021","journal-title":"Laryngoscope"},{"key":"ref_162","first-page":"1197","article-title":"Comparison of three-dimensional visualization techniques for depicting the scala vestibuli and scala tympani of the cochlea by using high-resolution MR imaging","volume":"20","author":"Hans","year":"1999","journal-title":"Am. J. Neuroradiol."},{"key":"ref_163","doi-asserted-by":"crossref","first-page":"2795","DOI":"10.1007\/s00405-020-06360-6","article-title":"Virtual reality improves the accuracy of simulated preoperative planning in temporal bones: A feasibility and validation study","volume":"278","author":"Timonen","year":"2020","journal-title":"Eur. Arch. Oto-Rhino-Laryngol."},{"key":"ref_164","doi-asserted-by":"crossref","first-page":"1012","DOI":"10.1177\/0194599819878699","article-title":"Optimal Head Position Following Intratympanic Injections of Steroids, As Determined by Virtual Reality","volume":"161","author":"Ungar","year":"2019","journal-title":"Otolaryngol. Neck Surg."},{"key":"ref_165","doi-asserted-by":"crossref","first-page":"1043","DOI":"10.1002\/lsm.23373","article-title":"Dermatologic Scar Assessment with Stereoscopic Imaging and Digital Three-Dimensional Models: A Validation Study","volume":"7","author":"Hendel","year":"2021","journal-title":"Lasers Surg. Med."},{"key":"ref_166","doi-asserted-by":"crossref","first-page":"211","DOI":"10.5582\/bst.2011.v5.5.211","article-title":"Evaluation of usefulness of 3D views for clinical photography","volume":"5","author":"Jinnin","year":"2011","journal-title":"Biosci. Trends"},{"key":"ref_167","doi-asserted-by":"crossref","first-page":"812","DOI":"10.1097\/MNM.0000000000000524","article-title":"A pilot study of SPECT\/CT-based mixed-reality navigation towards the sentinel node in patients with melanoma or Merkel cell carcinoma of a lower extremity","volume":"37","author":"Engelen","year":"2016","journal-title":"Nucl. Med. Commun."},{"key":"ref_168","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1038\/s41746-020-0284-9","article-title":"Evaluation of an augmented reality platform for austere surgical telementoring: A randomized controlled crossover study in cricothyroidotomies","volume":"3","author":"Lin","year":"2020","journal-title":"Npj Digit. Med."},{"key":"ref_169","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1093\/milmed\/usz234","article-title":"Telementoring in Leg Fasciotomies via Mixed-Reality: Clinical Evaluation of the STAR Platform","volume":"185","author":"Cabrera","year":"2020","journal-title":"Mil. Med."},{"key":"ref_170","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1097\/SIH.0000000000000334","article-title":"Augmented Reality Future Step Visualization for Robust Surgical Telementoring","volume":"14","author":"Andersen","year":"2019","journal-title":"Simul. Healthc. J. Soc. Simul. Healthc."},{"key":"ref_171","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1007\/BF01142442","article-title":"Clinical-evaluation of the head-up display of anesthesia data\u2014Preliminary communication","volume":"12","author":"Block","year":"1995","journal-title":"Int. J. Clin. Monit. Comput."},{"key":"ref_172","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1016\/j.jclinane.2014.02.010","article-title":"Evaluation of a simplified augmented reality device for ultrasound-guided vascular access in a vascular phantom","volume":"26","author":"Jeon","year":"2014","journal-title":"J. Clin. Anesth."},{"key":"ref_173","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1109\/MCG.2018.2881985","article-title":"Towards Placental Surface Vasculature Exploration in Virtual Reality","volume":"40","author":"Novotny","year":"2020","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_174","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1007\/s00595-012-0313-7","article-title":"Using the Objective Structured Assessment of Technical Skills (OSATS) global rating scale to evaluate the skills of surgical trainees in the operating room","volume":"43","author":"Niitsu","year":"2013","journal-title":"Surg. Today"},{"key":"ref_175","first-page":"273","article-title":"Objective structured assessment of technical skill (OSATS) for surgical residents","volume":"84","author":"Martin","year":"1997","journal-title":"Br. J. Surg."},{"key":"ref_176","first-page":"4","article-title":"SUS: A \u201cquick and dirty\u2019usability","volume":"189","author":"Brooke","year":"1996","journal-title":"Usability Eval. Ind."},{"key":"ref_177","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.amjsurg.2007.08.070","article-title":"Reliability of a revised NOTECHS scale for use in surgical teams","volume":"196","author":"Sevdalis","year":"2008","journal-title":"Am. J. Surg."},{"key":"ref_178","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1097\/SIH.0b013e31802b68ee","article-title":"The mayo high performance teamwork scale: Reliability and validity for evaluating key crew resource management skills","volume":"2","author":"Malec","year":"2007","journal-title":"Simul. Healthc."},{"key":"ref_179","doi-asserted-by":"crossref","first-page":"658","DOI":"10.1016\/j.surg.2007.07.034","article-title":"Disruptions in surgical flow and their relationship to surgical errors: An exploratory investigation","volume":"142","author":"Wiegmann","year":"2007","journal-title":"Surgery"},{"key":"ref_180","doi-asserted-by":"crossref","first-page":"904","DOI":"10.1177\/154193120605000909","article-title":"NASA-task load index (NASA-TLX); 20 years later","volume":"50","author":"Hart","year":"2006","journal-title":"Proc. Hum. Factors Ergon. Soc. Annu. Meet."},{"key":"ref_181","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/S0166-4115(08)62386-9","article-title":"Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research","volume":"Volume 52","author":"Hart","year":"1988","journal-title":"Advances in Psychology"},{"key":"ref_182","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1177\/1541931218621010","article-title":"A deeper look at the NASA TLX and where it falls short","volume":"62","author":"McKendrick","year":"2018","journal-title":"Proc. Hum. Factors Ergon. Soc. Annu. Meet"},{"key":"ref_183","unstructured":"Mital, A. (1989). Advances in Industrial Ergonomics and Safety, CRC Press."},{"key":"ref_184","first-page":"313","article-title":"Factors influencing mental workload indexes","volume":"19","author":"Miyake","year":"1997","journal-title":"J. Univ. Occup. Environ. Health"},{"key":"ref_185","doi-asserted-by":"crossref","first-page":"3184","DOI":"10.1007\/s00464-014-4051-3","article-title":"Inattention blindness in surgery","volume":"29","author":"Mayer","year":"2015","journal-title":"Surg. Endosc."},{"key":"ref_186","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1007\/s00464-012-2457-3","article-title":"Surgeons blinded by enhanced navigation: The effect of augmented reality on attention","volume":"27","author":"Dixon","year":"2013","journal-title":"Surg. Endosc."},{"key":"ref_187","doi-asserted-by":"crossref","first-page":"599","DOI":"10.2466\/pms.1978.47.2.599","article-title":"Mental Rotations, a Group Test of Three-Dimensional Spatial Visualization","volume":"47","author":"Vandenberg","year":"1978","journal-title":"Percept. Mot. Ski."},{"key":"ref_188","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1111\/j.1444-0938.2004.tb05057.x","article-title":"Clinical colour vision tests","volume":"87","author":"Dain","year":"2004","journal-title":"Clin. Exp. Optom."},{"key":"ref_189","doi-asserted-by":"crossref","unstructured":"Tsurutani, K., Naruse, K., Oshima, K., Uehara, S., Sato, Y., Inoguchi, K., Otsuka, K., Wakemoto, H., Kurashige, M., and Sato, O. (2017, January 21\u201326). 65-2: Optical attachment to measure both eye-box\/FOV characteristics for AR\/VR eyewear displays. Proceedings of the SID Symposium Digest of Technical Papers, Los Angeles, CA, USA.","DOI":"10.1002\/sdtp.11805"},{"key":"ref_190","doi-asserted-by":"crossref","unstructured":"Draper, R.S., Penczek, J., Varshneya, R., and Boynton, P.A. (2018, January 20\u201325). 72-2: Standardizing fundamental criteria for near eye display optical measurements: Determining eye point position. Proceedings of the SID Symposium Digest of Technical Papers, Los Angeles, CA, USA.","DOI":"10.1002\/sdtp.12209"},{"key":"ref_191","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/S0003-6870(02)00020-0","article-title":"Health and safety implications of virtual reality: A review of empirical evidence","volume":"33","author":"Nichols","year":"2002","journal-title":"Appl. Ergon."},{"key":"ref_192","first-page":"47","article-title":"A discussion of cybersickness in virtual environments","volume":"32","author":"LaViola","year":"2000","journal-title":"Spec. Interest Group Comput. Hum. Interact. Bull."},{"key":"ref_193","unstructured":"DiZio, P., and Lackner, J.R. (1997). Circumventing Side Effects of Immersive Virtual Environments, HCI International."},{"key":"ref_194","doi-asserted-by":"crossref","unstructured":"Sielhorst, T., Bichlmeier, C., Heining, S.M., and Navab, N. (2006, January 1\u20136). Depth perception\u2013a major issue in medical AR: Evaluation study by twenty surgeons. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Copenhagen, Denmark.","DOI":"10.1007\/11866565_45"},{"key":"ref_195","doi-asserted-by":"crossref","first-page":"1010","DOI":"10.1001\/jama.1912.04270090254042","article-title":"Normal values of the accommodation at all ages","volume":"59","author":"Duane","year":"1912","journal-title":"J. Am. Med. Assoc."},{"key":"ref_196","doi-asserted-by":"crossref","first-page":"2183","DOI":"10.1073\/pnas.1617251114","article-title":"Optimizing virtual reality for all users through gaze-contingent and adaptive focus displays","volume":"114","author":"Padmanaban","year":"2017","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_197","doi-asserted-by":"crossref","first-page":"5435097","DOI":"10.1155\/2018\/5435097","article-title":"How to Build a Patient-Specific Hybrid Simulator for Orthopaedic Open Surgery: Benefits and Limits of Mixed-Reality Using the Microsoft HoloLens","volume":"2018","author":"Condino","year":"2018","journal-title":"J. Health Eng."},{"key":"ref_198","doi-asserted-by":"crossref","first-page":"668","DOI":"10.1016\/j.jamcollsurg.2009.08.004","article-title":"Results from the cognitive changes and retirement among senior surgeons self-report survey","volume":"209","author":"Lee","year":"2009","journal-title":"J. Am. Coll. Surg."},{"key":"ref_199","doi-asserted-by":"crossref","first-page":"1551","DOI":"10.1177\/154193121005401941","article-title":"Gender differences in simulator sickness in fixed-versus rotating-base driving simulator","volume":"54","author":"Garcia","year":"2010","journal-title":"Proc. Hum. Factors Ergon. Soc. Annu. Meet."},{"key":"ref_200","doi-asserted-by":"crossref","first-page":"1896","DOI":"10.1177\/154193120104502709","article-title":"Comparison of simulator sickness using static and dynamic walking simulators","volume":"45","author":"Jaeger","year":"2001","journal-title":"Proc. Hum. Factors Ergon. Soc. Annu. Meet."},{"key":"ref_201","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1518\/hfes.45.3.504.27254","article-title":"What to expect from immersive virtual environment exposure: Influences of gender, body mass index, and past experience","volume":"45","author":"Stanney","year":"2003","journal-title":"Hum. Factors"},{"key":"ref_202","doi-asserted-by":"crossref","first-page":"1479","DOI":"10.2307\/1130467","article-title":"Emergence and characterization of sex differences in spatial ability: A meta-analysis","volume":"56","author":"Linn","year":"1985","journal-title":"Child Dev."},{"key":"ref_203","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.actpsy.2004.05.003","article-title":"Gender differences on the mental rotations test: A factor analysis","volume":"117","author":"Voyer","year":"2004","journal-title":"Acta Psychol."},{"key":"ref_204","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1037\/0033-2909.117.2.250","article-title":"Magnitude of sex differences in spatial abilities: A meta-analysis and consideration of critical variables","volume":"117","author":"Voyer","year":"1995","journal-title":"Psychol. Bull."},{"key":"ref_205","doi-asserted-by":"crossref","first-page":"297","DOI":"10.2466\/pms.1997.85.1.297","article-title":"On Mental Rotation in Three Dimensions","volume":"85","author":"McWilliams","year":"1997","journal-title":"Percept. Mot. Ski."},{"key":"ref_206","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1089\/cpb.1999.2.113","article-title":"Gender Issues in the Use of Virtual Environments","volume":"2","author":"Larson","year":"1999","journal-title":"CyberPsychol. Behav."},{"key":"ref_207","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1016\/j.neuropsychologia.2003.08.014","article-title":"Sex differences in mental rotation and spatial rotation in a virtual environment","volume":"42","author":"Parsons","year":"2004","journal-title":"Neuropsychologia"},{"key":"ref_208","first-page":"1050","article-title":"Experimental but Not Sex Differences of a Mental Rotation Training Program on Adolescents","volume":"7","author":"Contreras","year":"2016","journal-title":"Front. Psychol."},{"key":"ref_209","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1016\/j.intell.2010.06.001","article-title":"Two- vs. three-dimensional presentation of mental rotation tasks: Sex differences and effects of training on performance and brain activation","volume":"38","author":"Neubauer","year":"2010","journal-title":"Intelligence"},{"key":"ref_210","unstructured":"Soler, L., Nicolau, S., Schmid, J., Koehl, C., Marescaux, J., Pennec, X., and Ayache, N. (2004, January 5). Virtual reality and augmented reality in digestive surgery. Proceedings of the Third IEEE and ACM International Symposium on Mixed and Augmented Reality, Arlington, VA, USA."},{"key":"ref_211","doi-asserted-by":"crossref","first-page":"1976","DOI":"10.1007\/s00464-010-0890-8","article-title":"Live augmented reality: A new visualization method for laparoscopic surgery using continuous volumetric computed tomography","volume":"24","author":"Shekhar","year":"2010","journal-title":"Surg. Endosc."},{"key":"ref_212","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1016\/j.media.2009.02.003","article-title":"An augmented reality system for liver thermal ablation: Design and evaluation on clinical cases","volume":"13","author":"Nicolau","year":"2009","journal-title":"Med. Image Anal."},{"key":"ref_213","unstructured":"FDA (2016). Applying Human Factors and Usability Engineering to Medical Devices."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/7\/5\/49\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:32:12Z","timestamp":1760124732000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/7\/5\/49"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,9]]},"references-count":213,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,5]]}},"alternative-id":["mti7050049"],"URL":"https:\/\/doi.org\/10.3390\/mti7050049","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,9]]}}}