{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T00:45:12Z","timestamp":1785545112183,"version":"3.56.0"},"reference-count":57,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR XR Spatial Comput"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Effective crisis management in operating rooms (ORs) is crucial for patient safety. Despite their benefits, adherence to OR crisis checklists is often limited, highlighting the need for innovative solutions.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n The objective of this study was to evaluate the efficacy of augmented reality (AR)-enhanced checklists in improving protocol adherence, compared to traditional paper checklists and no checklist scenarios during simulated OR crises.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n This study was a randomized comparative efficacy study comparing the utility of AR checklists, paper checklists, and no checklist scenarios using 4 validated and simulated OR crises scenarios: asystolic cardiac arrest, air embolism, unexplained hypotension\/hypoxia, and malignant hyperthermia. The study took place in a simulated OR setting and had applicability to the standard procedures in ORs, critical care units, and urgent care scenarios in the emergency department. To form the 24 OR teams, 50 professionals including 24 anesthesiologists, 24 nurses, 1 surgeon, and 1 scrub nurse from two academic hospitals were included. The primary outcome measured was the failure to adhere (FTA) rate for critical actions during simulated OR crises. Adherence was determined using retrospective video analysis involving 595 key processes evaluated across 24 surgical teams. Interrater reliability was assessed using a Cohen \u03ba. Secondary outcomes included checklist usability and cognitive load, as measured by the low-frequency to high-frequency (LF\/HF) ratio of the heart rate variability.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n The AR checklist group showed a significantly lower FTA rate (mean 15.1%, SD 5.77%) compared to the paper checklist (mean 8.32%, SD 5.65%;\n t<\/jats:italic>\n 23<\/jats:sub>\n =\u22122.08;\n P<\/jats:italic>\n =.048) and the no checklist groups (mean 29.81%, SD 5.59%;\n t<\/jats:italic>\n 23<\/jats:sub>\n =\u22126.47;\n P<\/jats:italic>\n <.001). The AR checklist also resulted in a higher LF\/HF ratio for anesthesiologists (\n F<\/jats:italic>\n 2,46<\/jats:sub>\n =4.88;\n P<\/jats:italic>\n =.02), showing a potential increase in the level of cognitive load. Survey data indicated positive receptions for both AR and paper checklists.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n These results suggest that AR checklists could offer a viable method for enhancing adherence to critical care protocols. Although, further research is needed to fully assess their impact on clinical outcomes and to address any associated increase in cognitive load.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/60792","type":"journal-article","created":{"date-parts":[[2025,2,3]],"date-time":"2025-02-03T00:51:26Z","timestamp":1738543886000},"page":"e60792-e60792","source":"Crossref","is-referenced-by-count":4,"title":["Augmented Reality in Enhancing Operating Room Crisis Checklist Adherence: Randomized Comparative Efficacy Study"],"prefix":"10.2196","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-7494-0758","authenticated-orcid":false,"given":"Rayan","family":"Ebnali Harari","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6769-6415","authenticated-orcid":false,"given":"Abdullah","family":"Altaweel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-2635-3633","authenticated-orcid":false,"given":"Erik","family":"Anderson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Charles","family":"Pozner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rafael","family":"Grossmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Goldsmith","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hamid","family":"Shokoohi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,1,6]]},"reference":[{"issue":"8","key":"R1","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1016\/0952-8180(95)00146-8","article-title":"Anesthesia crisis resource management: real-life simulation training in operating room crises","volume":"7","author":"Holzman","journal-title":"J Clin Anesth"},{"issue":"2","key":"R2","doi-asserted-by":"publisher","first-page":"384","DOI":"10.1097\/ALN.0000000000001731","article-title":"Operating room crisis checklists and emergency manuals","volume":"127","author":"Hepner","journal-title":"Anesthesiology"},{"issue":"2","key":"R3","doi-asserted-by":"publisher","DOI":"10.2196\/19099","article-title":"Usability of mobile health apps for postoperative care: systematic review","volume":"3","author":"Patel","journal-title":"JMIR Perioper Med"},{"issue":"1","key":"R4","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1097\/01.sla.0000217618.30744.61","article-title":"Surgical crisis management skills training and assessment: a simulation[corrected]-based approach to enhancing operating room performance","volume":"244","author":"Moorthy","journal-title":"Ann Surg"},{"issue":"1","key":"R5","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1016\/j.aan.2015.07.011","article-title":"Perioperative checklists and handoffs","volume":"33","author":"Agarwala","journal-title":"Adv Anesth"},{"issue":"7","key":"R6","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2024.22520","article-title":"Deep learning analysis of surgical video recordings to assess nontechnical skills","volume":"7","author":"Harari","journal-title":"JAMA Netw Open"},{"key":"R7","volume":"16","author":"Dias","journal-title":"Hamlyn Symp Med Robot"},{"key":"R8","volume":"16","author":"Harari","journal-title":"Hamlyn Symp Med Robot"},{"issue":"4","key":"R9","doi-asserted-by":"publisher","DOI":"10.2196\/18094","article-title":"Real-time streaming of surgery performance and intraoperative imaging data in the hybrid operating room: development and usability study","volume":"8","author":"Lin","journal-title":"JMIR Med Inform"},{"issue":"9","key":"R10","doi-asserted-by":"publisher","DOI":"10.2196\/28018","article-title":"Virtual reality tour to reduce perioperative anxiety in an operating setting before anesthesia: randomized clinical trial","volume":"23","author":"Vogt","journal-title":"J Med Internet Res"},{"key":"R11","doi-asserted-by":"crossref","unstructured":"Harari RE Ahmadi N Pourfalatoun S Al-Taweel A Shokoohi H . Clinician-AI collaboration for decision support in telemedicine: a randomized controlled trial study. Presented at: Proceedings of Conference on Cognitive and Computational Aspects of Situation Management 2023; Oct 16-19, 2023:81-89; Philadelphia, PA. 2024.[doi: 10.29007\/9qxd]","DOI":"10.29007\/9qxd"},{"issue":"2","key":"R12","doi-asserted-by":"publisher","DOI":"10.2196\/25284","article-title":"Using flow disruptions to examine system safety in robotic-assisted surgery: protocol for a stepped wedge crossover design","volume":"10","author":"Alfred","journal-title":"JMIR Res Protoc"},{"issue":"5","key":"R13","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1056\/NEJMsa0810119","article-title":"A surgical safety checklist to reduce morbidity and mortality in a global population","volume":"360","author":"Haynes","journal-title":"N Engl J Med"},{"issue":"3","key":"R14","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1056\/NEJMsa1204720","article-title":"Simulation-based trial of surgical-crisis checklists","volume":"368","author":"Arriaga","journal-title":"N Engl J Med"},{"issue":"15","key":"R15","doi-asserted-by":"publisher","first-page":"1434","DOI":"10.1056\/NEJMsa1300625","article-title":"Surgical skill and complication rates after bariatric surgery","volume":"369","author":"Birkmeyer","journal-title":"N Engl J Med"},{"issue":"2","key":"R16","doi-asserted-by":"publisher","DOI":"10.1093\/intqhc\/mzab068","article-title":"Are operating room distractions, interruptions and disruptions associated with performance and patient safety? A systematic review and meta-analysis","volume":"33","author":"Mcmullan","journal-title":"Int J Qual Health Care"},{"issue":"2","key":"R17","doi-asserted-by":"publisher","DOI":"10.1016\/j.juro.2011.10.071","article-title":"Re: crisis checklists for the operating room: development and pilot testing","volume":"187","author":"Babayan","journal-title":"J Urol"},{"issue":"1","key":"R18","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1016\/j.accpm.2019.07.011","article-title":"Anaesthesia-specific checklists: a systematic review of impact","volume":"39","author":"Saxena","journal-title":"Anaesth Crit Care Pain Med"},{"issue":"6","key":"R19","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.4888","article-title":"Operating room emergency manuals improve patient safety: a systemic review","volume":"11","author":"Simmons","journal-title":"Cureus"},{"key":"R20","unstructured":"Gaba DM Fish KJ Howard SK Burden A . Crisis Management in Anesthesiology. Elsevier Health Sciences; 2014:434. ISBN: 9781455738090"},{"issue":"9","key":"R21","doi-asserted-by":"publisher","first-page":"697","DOI":"10.1136\/bmjqs-2020-012740","article-title":"Medical crisis checklists in the emergency department: a simulation-based multi-institutional randomised controlled trial","volume":"30","author":"Dryver","journal-title":"BMJ Qual Saf"},{"issue":"8","key":"R22","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1136\/bmjqs-2020-012600","article-title":"Time out! Rethinking surgical safety: more than just a checklist","volume":"30","author":"Weinger","journal-title":"BMJ Qual Saf"},{"issue":"3","key":"R23","doi-asserted-by":"publisher","DOI":"10.1097\/AS9.0000000000000075","article-title":"Surgical teams\u2019 attitudes about surgical safety and the surgical safety checklist at 10 years","volume":"2","author":"Urban","journal-title":"Ann Surg Open"},{"issue":"6","key":"R24","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1097\/PTS.0000000000000386","article-title":"\u201cAttention everyone, time out!\u201d: safety attitudes and checklist practices in anesthesiology in Germany. A cross-sectional study","volume":"17","author":"Neuhaus","journal-title":"J Patient Saf"},{"key":"R25","unstructured":"Ebnali M Fathi R Lamb R Pourfalatoun S Motamedi S . Using augmented holographic UIs to communicate automation reliability in partially automated driving. Presented at: Automation Experience across Domains at CHI 2020; Apr 26-27, 2020. 2020.URL: https:\/\/ceur-ws.org\/Vol-2700\/paper5.pdf [Accessed 27-11-2024]"},{"key":"R26","doi-asserted-by":"crossref","unstructured":"Harari R Al-Taweel A Ahram T Shokoohi H . Explainable AI and augmented reality in transesophageal echocardiography (TEE) imaging. Presented at: 2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR); Jan 17-19, 2024:306-309; Los Angeles, CA. [doi: 10.1109\/AIxVR59861.2024.00051]","DOI":"10.1109\/AIxVR59861.2024.00051"},{"issue":"10","key":"R27","doi-asserted-by":"publisher","first-page":"968","DOI":"10.1001\/jamasurg.2019.2546","article-title":"Highly accurate, patient-specific, 3-dimensional mixed-reality model creation for surgical training and decision-making","volume":"154","author":"Devoto","journal-title":"JAMA Surg"},{"key":"R28","doi-asserted-by":"publisher","DOI":"10.2196\/42709","article-title":"Mixed reality platforms in telehealth delivery: scoping review","volume":"8","author":"Worlikar","journal-title":"JMIR Biomed Eng"},{"key":"R29","doi-asserted-by":"publisher","DOI":"10.2147\/AMEP.S201640","article-title":"Augmented reality glasses improve adherence to evidence-based intubation practice","volume":"10","author":"Alismail","journal-title":"Adv Med Educ Pract"},{"issue":"5","key":"R30","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.7379","article-title":"Adherence to AHA guidelines when adapted for augmented reality glasses for assisted pediatric cardiopulmonary resuscitation: a randomized controlled trial","volume":"19","author":"Siebert","journal-title":"J Med Internet Res"},{"issue":"5","key":"R31","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1097\/SIH.0000000000000631","article-title":"Electronic decision support in the delivery room using augmented reality to improve newborn life support guideline adherence: a randomized controlled pilot study","volume":"17","author":"Tsang","journal-title":"Simul Healthc"},{"issue":"3","key":"R32","doi-asserted-by":"publisher","DOI":"10.2196\/34501","article-title":"Augmented reality in vascular and endovascular surgery: scoping review","volume":"10","author":"Eves","journal-title":"JMIR Serious Games"},{"issue":"2","key":"R33","doi-asserted-by":"publisher","DOI":"10.2196\/34781","article-title":"Augmented reality-based surgery on the human cadaver using a new generation of optical head-mounted displays: development and feasibility study","volume":"10","author":"Puladi","journal-title":"JMIR Serious Games"},{"issue":"1","key":"R34","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1186\/s41077-021-00158-0","article-title":"The use of virtual reality and augmented reality to enhance cardio-pulmonary resuscitation: a scoping review","volume":"6","author":"Kuyt","journal-title":"Adv Simul (Lond)"},{"issue":"5","key":"R35","doi-asserted-by":"publisher","first-page":"1624","DOI":"10.1016\/j.athoracsur.2020.10.037","article-title":"Augmented reality and 3-dimensional printing technologies for guiding complex thoracoscopic surgery","volume":"112","author":"Li","journal-title":"Ann Thorac Surg"},{"issue":"8","key":"R36","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2023.30338","article-title":"Effect of mixed reality on delivery of emergency medical care in a simulated environment: a pilot randomized crossover trial","volume":"6","author":"Lawson","journal-title":"JAMA Netw Open"},{"issue":"2","key":"R37","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1001\/jamasurg.2021.3604","article-title":"Telestration and augmented reality in minimally invasive surgery: an invaluable tool in the age of COVID-19 for remote proctoring and telementoring","volume":"157","author":"Nickel","journal-title":"JAMA Surg"},{"issue":"4","key":"R38","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2019.2633","article-title":"Comparison of 3-dimensional and augmented reality kidney models with conventional imaging data in the preoperative assessment of children with Wilms tumors","volume":"2","author":"Wellens","journal-title":"JAMA Netw Open"},{"issue":"1","key":"R39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/2327857923121000","article-title":"AI-powered human digital twins in virtual therapeutic sessions","volume":"12","author":"Ebnali","journal-title":"Proc Int Symp Hum Factors Ergon Health Care"},{"issue":"3","key":"R40","doi-asserted-by":"publisher","first-page":"122","DOI":"10.3357\/AMHP.6131.2023","article-title":"Extended reality applications for space health","volume":"94","author":"Ebnali","journal-title":"Aerosp Med Hum Perform"},{"key":"R41","doi-asserted-by":"publisher","DOI":"10.1016\/j.apergo.2022.103902","article-title":"Using extended reality (XR) for medical training and real-time clinical support during deep space missions","volume":"106","author":"Burian","journal-title":"Appl Ergon"},{"issue":"2","key":"R42","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1016\/j.jamcollsurg.2011.04.031","article-title":"Crisis checklists for the operating room: development and pilot testing","volume":"213","author":"Ziewacz","journal-title":"J Am Coll Surg"},{"key":"R43","doi-asserted-by":"publisher","DOI":"10.1186\/1744-9081-7-17","article-title":"Mental fatigue caused by prolonged cognitive load associated with sympathetic hyperactivity","volume":"7","author":"Mizuno","journal-title":"Behav Brain Funct"},{"key":"R44","unstructured":"Gabaude C Baracat B Jallais C Bonniaud M Fort A . Cognitive load measurement while driving. Presented at: Human Factors and Ergonomics Society Europe Chapter Annual Meeting; Oct 10-12, 2012:67-80; Toulouse, France. 2012.URL: https:\/\/hal.science\/hal-01027475 [Accessed 30-12-2024]"},{"key":"R45","doi-asserted-by":"publisher","DOI":"10.3389\/fphys.2017.00360","article-title":"Resolving ambiguities in the LF\/HF Ratio: LF-HF scatter plots for the categorization of mental and physical stress from HRV","volume":"8","author":"von Rosenberg","journal-title":"Front Physiol"},{"issue":"21","key":"R46","doi-asserted-by":"publisher","first-page":"13047","DOI":"10.1109\/JSEN.2020.3001635","article-title":"Wearable devices for the assessment of cognitive effort for human\u2013robot interaction","volume":"20","author":"Villani","journal-title":"IEEE Sens J"},{"issue":"4","key":"R47","doi-asserted-by":"publisher","first-page":"1689","DOI":"10.3758\/s13428-020-01516-y","article-title":"NeuroKit2: a Python toolbox for neurophysiological signal processing","volume":"53","author":"Makowski","journal-title":"Behav Res Methods"},{"key":"R48","doi-asserted-by":"publisher","DOI":"10.1016\/j.wneu.2023.02.068","article-title":"Virtual and augmented reality in spine surgery: a systematic review","volume":"173","author":"McCloskey","journal-title":"World Neurosurg"},{"issue":"8","key":"R49","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2023.29310","article-title":"Augmented reality for perioperative anxiety in patients undergoing surgery","volume":"6","author":"Rizzo","journal-title":"JAMA Netw Open"},{"issue":"4","key":"R50","doi-asserted-by":"publisher","first-page":"326","DOI":"10.1001\/jamaoto.2024.0025","article-title":"Navigating the nose-the future of endoscopic endonasal surgical navigation","volume":"150","author":"Rosvall","journal-title":"JAMA Otolaryngol Head Neck Surg"},{"key":"R51","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6963-11-211","article-title":"Systematic review of safety checklists for use by medical care teams in acute hospital settings--limited evidence of effectiveness","volume":"11","author":"Ko","journal-title":"BMC Health Serv Res"},{"issue":"7","key":"R52","doi-asserted-by":"publisher","first-page":"562","DOI":"10.1001\/jamasurg.2020.0989","article-title":"Clinical efficacy of combined surgical patient safety system and the World Health Organization\u2019s checklists in surgery: a nonrandomized clinical trial","volume":"155","author":"Storesund","journal-title":"JAMA Surg"},{"issue":"6","key":"R53","doi-asserted-by":"publisher","first-page":"925","DOI":"10.1097\/SLA.0b013e3182682f27","article-title":"A systematic review of the effectiveness, compliance, and critical factors for implementation of safety checklists in surgery","volume":"256","author":"Borchard","journal-title":"Ann Surg"},{"key":"R54","doi-asserted-by":"crossref","unstructured":"Aitamurto T Boin JB Chen K Cherif A Shridhar S . The impact of augmented reality on art engagement: liking, impression of learning, and distraction. Presented at: Virtual, Augmented and Mixed Reality: Applications in Health, Cultural Heritage, and Industry; Jul 15-20, 2018:153-171; Las Vegas, NV. [doi: 10.1007\/978-3-319-91584-5_13]","DOI":"10.1007\/978-3-319-91584-5_13"},{"issue":"2","key":"R55","doi-asserted-by":"publisher","first-page":"454","DOI":"10.1007\/s00464-012-2457-3","article-title":"Surgeons blinded by enhanced navigation: the effect of augmented reality on attention","volume":"27","author":"Dixon","journal-title":"Surg Endosc"},{"issue":"2","key":"R56","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1111\/j.1365-2044.2008.05743.x","article-title":"The impact of trained assistance on error rates in anaesthesia: a simulation-based randomised controlled trial","volume":"64","author":"Weller","journal-title":"Anaesthesia"},{"key":"R57","doi-asserted-by":"publisher","DOI":"10.1044\/2024_AJA-24-00056","article-title":"Applications of augmented and virtual reality in enhancing communication for individuals who are hard of hearing: a systematic review","author":"Borna","journal-title":"Am J Audiol"}],"container-title":["JMIR XR and Spatial Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/xr.jmir.org\/2025\/1\/e60792","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T22:31:40Z","timestamp":1785537100000},"score":1,"resource":{"primary":{"URL":"https:\/\/xr.jmir.org\/2025\/1\/e60792"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,6]]},"references-count":57,"URL":"https:\/\/doi.org\/10.2196\/60792","relation":{},"ISSN":["2818-3045"],"issn-type":[{"value":"2818-3045","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,6]]},"article-number":"v2i8e60792"}}