{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T09:26:48Z","timestamp":1792142808224,"version":"4.4.0"},"reference-count":42,"publisher":"American Medical Association (AMA)","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JAMA Surg"],"published-print":{"date-parts":[[2026,3,1]]},"abstract":"\n Importance<\/jats:title>\n Having significant gaps between the expectations and reality of artificial intelligence\u2013based programs can be a major barrier to successful implementation. This is the first multisite implementation assessment of gaps between surgeon expectations and real-world effects of the Operating Room Black Box, a novel intervention that leverages artificial intelligence to improve surgical outcomes.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n To identify barriers and facilitators to implementing artificial intelligence\u2013based interventions that improve intra- and postoperative care.<\/jats:p>\n <\/jats:sec>\n \n Design, Setting, and Participants<\/jats:title>\n This qualitative study was conducted at 3 large academic centers via semistructured interviews with surgeons and implementation leaders of the AI intervention to identify areas where expectations of the technology misaligned with their experiences. Thirty surgeons and 17 implementation leaders from 3 centers that implemented the AI intervention were interviewed. Data were collected and analyzed between 2021 and 2024.<\/jats:p>\n <\/jats:sec>\n \n Exposure<\/jats:title>\n Implementation of the AI intervention.<\/jats:p>\n <\/jats:sec>\n \n Main Outcomes and Measures<\/jats:title>\n The primary outcome was areas of misalignment between participant expectations of the AI intervention technology and actual program deliverables.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Of 30 surgeons and 17 implementation leaders interviewed, most surgeons (17 [57%]) were between the ages of 35 and 50 years, and implementation leaders were older, typically between 51 and 80 years old (6 [35%]). Eight surgeons (27%) and 4 implementation leaders (24%) were female. Most surgeons (17 [57%]) had neutral views of the technology, 11 (37%) expressed positive views, and 2 (7%) had negative views. Interviewees identified the following 4 major themes that highlighted misalignment between user expectations and the experience of using the technology: (1) the artificial intelligence model needed considerable additional training to be usable; (2) accessing data on surgical cases was difficult and time consuming; (3) the program showed limited ability to predict postoperative complications; and (4) the program generated few academic deliverables.<\/jats:p>\n <\/jats:sec>\n \n Conclusions and Relevance<\/jats:title>\n Per the results of this multisite qualitative study, successfully implementing interventions based on artificial intelligence may require deliberate efforts to minimize gaps between what surgeons expect from the interventions and what they can deliver. Our evaluation of this study\u2019s AI intervention offers lessons for addressing this critical barrier to implementation.<\/jats:p>\n <\/jats:sec>","DOI":"10.1001\/jamasurg.2025.6029","type":"journal-article","created":{"date-parts":[[2026,1,14]],"date-time":"2026-01-14T16:00:44Z","timestamp":1768406444000},"page":"234","source":"Crossref","is-referenced-by-count":7,"title":["Expectations vs Reality of an Intraoperative Artificial Intelligence Intervention"],"prefix":"10.1001","volume":"161","author":[{"given":"Melissa","family":"Thornton","sequence":"first","affiliation":[{"name":"Department of Surgery, University of Texas Southwestern Medical Center, Dallas"},{"name":"VA North Texas Health Care System, Dallas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin A. Y.","family":"Cher","sequence":"additional","affiliation":[{"name":"Wisconsin Surgical Outcomes Research, Madison"},{"name":"William S. Middleton Memorial VA Hospital, Madison, Wisconsin"},{"name":"Department of Surgery, University of Wisconsin\u2013Madison School of Medicine and Public Health, Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cameron","family":"Macdonald","sequence":"additional","affiliation":[{"name":"Qualitative Healthcare Research Consultants, Madison, Wisconsin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jocelyn G.","family":"Baker","sequence":"additional","affiliation":[{"name":"Qualitative Healthcare Research Consultants, Madison, Wisconsin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elisa L.","family":"Marten","sequence":"additional","affiliation":[{"name":"Wisconsin Surgical Outcomes Research, Madison"},{"name":"William S. Middleton Memorial VA Hospital, Madison, Wisconsin"},{"name":"Department of Surgery, University of Wisconsin\u2013Madison School of Medicine and Public Health, Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Don","family":"Mai","sequence":"additional","affiliation":[{"name":"William S. Middleton Memorial VA Hospital, Madison, Wisconsin"},{"name":"Department of Surgery, University of Wisconsin\u2013Madison School of Medicine and Public Health, Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ganesh","family":"Sankaranarayanan","sequence":"additional","affiliation":[{"name":"Department of Surgery, University of Texas Southwestern Medical Center, Dallas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Courtney J.","family":"Balentine","sequence":"additional","affiliation":[{"name":"Wisconsin Surgical Outcomes Research, Madison"},{"name":"William S. Middleton Memorial VA Hospital, Madison, Wisconsin"},{"name":"Department of Surgery, University of Wisconsin\u2013Madison School of Medicine and Public Health, Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10","reference":[{"issue":"4","key":"soi250090r1","doi-asserted-by":"publisher","first-page":"2823","DOI":"10.1097\/JS9.0000000000002309","article-title":"The AI-enhanced surgeon - integrating black-box artificial intelligence in the operating room.","volume":"111","author":"Cahill","year":"2025","journal-title":"Int J Surg"},{"issue":"6","key":"soi250090r2","doi-asserted-by":"publisher","first-page":"1105","DOI":"10.1007\/s11596-021-2474-3","article-title":"Application of artificial intelligence in medicine: an overview.","volume":"41","author":"Liu","year":"2021","journal-title":"Curr Med Sci"},{"issue":"6","key":"soi250090r3","doi-asserted-by":"publisher","first-page":"630","DOI":"10.1177\/15533506241289481","article-title":"AI in surgery: navigating trends and managerial implications through bibliometric and text mining odyssey.","volume":"31","author":"Le","year":"2024","journal-title":"Surg Innov"},{"issue":"2","key":"soi250090r4","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1007\/s12369-011-0122-y","article-title":"How does the difference between users\u2019 expectations and perceptions about a robotic agent affect their behavior?","volume":"4","author":"Komatsu","year":"2012","journal-title":"Int J Soc Robot"},{"issue":"7","key":"soi250090r6","doi-asserted-by":"publisher","first-page":"1039","DOI":"10.1080\/13504851.2023.2300973","article-title":"When customer meets AI failure: expectation discrepancy perspective.","volume":"32","author":"Boo","year":"2025","journal-title":"Appl Econ Lett"},{"issue":"1","key":"soi250090r7","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1186\/1748-5908-7-17","article-title":"The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research.","volume":"7","author":"Wiltsey Stirman","year":"2012","journal-title":"Implement Sci"},{"issue":"1","key":"soi250090r8","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1186\/s13012-024-01381-9","article-title":"Teamwork and implementation of innovations in healthcare and human service settings: a systematic review.","volume":"19","author":"McGuier","year":"2024","journal-title":"Implement Sci"},{"issue":"1","key":"soi250090r9","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1186\/s13012-021-01171-7","article-title":"Implementability of healthcare interventions: an overview of reviews and development of a conceptual framework.","volume":"17","author":"Klaic","year":"2022","journal-title":"Implement Sci"},{"issue":"10","key":"soi250090r11","doi-asserted-by":"publisher","first-page":"5613","DOI":"10.1007\/s00464-024-11064-7","article-title":"Impact of team performance on the surgical safety checklist on patient outcomes: an Operating Room Black Box analysis.","volume":"38","author":"Al Abbas","year":"2024","journal-title":"Surg Endosc"},{"key":"soi250090r12","doi-asserted-by":"publisher","DOI":"10.1097\/SLA.0000000000006438","article-title":"Using OR Black Box technology to determine quality improvement outcomes for in-situ timeout and debrief simulation.","author":"Campbell","year":"2024","journal-title":"Ann Surg"},{"key":"soi250090r13","doi-asserted-by":"publisher","first-page":"S85","DOI":"10.47391\/JPMA.AKU-9S-13","article-title":"Operating Room Black Box: gimmick or a patient safety tool?","volume":"74","author":"Virji","year":"2024","journal-title":"J Pak Med Assoc"},{"issue":"1","key":"soi250090r14","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1097\/SLA.0000000000002863","article-title":"First-year analysis of the Operating Room Black Box study.","volume":"271","author":"Jung","year":"2020","journal-title":"Ann Surg"},{"issue":"3","key":"soi250090r15","doi-asserted-by":"publisher","DOI":"10.2196\/15443","article-title":"Implementation of the Operating Room Black Box research program at the Ottawa Hospital through patient, clinical, and organizational engagement: case study.","volume":"23","author":"Boet","year":"2021","journal-title":"J Med Internet Res"},{"issue":"11","key":"soi250090r16","doi-asserted-by":"publisher","first-page":"3306","DOI":"10.1007\/s00268-021-06251-9","article-title":"Patient safety in the operating room during urologic surgery: the OR Black Box experience.","volume":"45","author":"Rai","year":"2021","journal-title":"World J Surg"},{"issue":"7","key":"soi250090r17","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.16218","article-title":"Utilizing the Operating Room Black Box to characterize intraoperative delays, distractions, and threats in the gynecology operating room: a pilot study.","volume":"13","author":"Nensi","year":"2021","journal-title":"Cureus"},{"issue":"9","key":"soi250090r18","doi-asserted-by":"publisher","first-page":"1245","DOI":"10.1097\/ACM.0000000000000388","article-title":"Standards for reporting qualitative research: a synthesis of recommendations.","volume":"89","author":"O\u2019Brien","year":"2014","journal-title":"Acad Med"},{"issue":"1","key":"soi250090r20","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1186\/1748-5908-4-50","article-title":"Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science.","volume":"4","author":"Damschroder","year":"2009","journal-title":"Implement Sci"},{"issue":"1","key":"soi250090r21","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1186\/s13012-022-01245-0","article-title":"The updated Consolidated Framework for Implementation Research based on user feedback.","volume":"17","author":"Damschroder","year":"2022","journal-title":"Implement Sci"},{"issue":"6","key":"soi250090r22","doi-asserted-by":"publisher","first-page":"e752","DOI":"10.1097\/SLA.0000000000004433","article-title":"An implementation assessment of the virtual acute care for elders program from the perspective of key stakeholders.","volume":"275","author":"Balentine","year":"2022","journal-title":"Ann Surg"},{"key":"soi250090r23","doi-asserted-by":"publisher","DOI":"10.2196\/66815","article-title":"Integrating a mobile app to enhance atrial fibrillation care: key insights from an implementation study guided by the Consolidated Framework for Implementation Research.","volume":"27","author":"Hewage","year":"2025","journal-title":"J Med Internet Res"},{"issue":"1","key":"soi250090r24","doi-asserted-by":"publisher","first-page":"390","DOI":"10.1186\/s12913-024-10847-x","article-title":"Using the consolidated Framework for Implementation Research to integrate innovation recipients\u2019 perspectives into the implementation of a digital version of the spinal cord injury health maintenance tool: a qualitative analysis.","volume":"24","author":"Bourke","year":"2024","journal-title":"BMC Health Serv Res"},{"issue":"1","key":"soi250090r25","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1186\/s12961-024-01259-8","article-title":"Implementation research logic model in the design and execution of ehealth innovations for maternal and newborn healthcare in Ethiopia.","volume":"23","author":"Nigatu","year":"2025","journal-title":"Health Res Policy Syst"},{"issue":"3","key":"soi250090r26","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1200\/OP.23.00462","article-title":"Using Implementation Science Frameworks to guide the use of electronic patient-reported outcome symptom monitoring in routine cancer care.","volume":"20","author":"Lai-Kwon","year":"2024","journal-title":"JCO Oncol Pract"},{"issue":"9","key":"soi250090r27","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2024-084398","article-title":"Barriers and facilitators to implementing imaging-based diagnostic artificial intelligence-assisted decision-making software in hospitals in China: a qualitative study using the updated Consolidated Framework for Implementation Research.","volume":"14","author":"Liao","year":"2024","journal-title":"BMJ Open"},{"issue":"6","key":"soi250090r31","doi-asserted-by":"publisher","first-page":"995","DOI":"10.1097\/SLA.0000000000005695","article-title":"The Operating Room Black Box: understanding adherence to surgical checklists.","volume":"276","author":"Al Abbas","year":"2022","journal-title":"Ann Surg"},{"issue":"4","key":"soi250090r32","doi-asserted-by":"publisher","first-page":"S253","DOI":"10.1016\/j.jamcollsurg.2019.08.556","article-title":"Use of the Operating Room Black Box for structured postoperative team debriefing: lessons learned from discussions around safety threats and resilience support events.","volume":"229","author":"van Dalen","year":"2019","journal-title":"J Am Coll Surg"},{"issue":"1","key":"soi250090r33","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1016\/j.jamcollsurg.2004.08.029","article-title":"Assessing team performance in the operating room: development and use of a \u201cblack-box\u201d recorder and other tools for the intraoperative environment.","volume":"200","author":"Guerlain","year":"2005","journal-title":"J Am Coll Surg"},{"issue":"1","key":"soi250090r34","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1177\/15533506221106258","article-title":"Implementation of an innovative technology called the OR Black Box: a feasibility study.","volume":"30","author":"M\u00f8ller","year":"2023","journal-title":"Surg Innov"},{"issue":"Summer","key":"soi250090r35","first-page":"1g","article-title":"Top 10 lessons learned from electronic medical record implementation in a large academic medical center.","volume":"12","author":"Rizer","year":"2015","journal-title":"Perspect Health Inf Manag"},{"issue":"1","key":"soi250090r36","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1186\/s13012-016-0437-z","article-title":"A systematic review of the use of the Consolidated Framework for Implementation Research.","volume":"11","author":"Kirk","year":"2016","journal-title":"Implement Sci"},{"issue":"1","key":"soi250090r37","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1186\/s41077-023-00263-2","article-title":"Interprofessional staff perspectives on the adoption of or black box technology and simulations to improve patient safety: a multi-methods survey.","volume":"8","author":"Campbell","year":"2023","journal-title":"Adv Simul (Lond)"},{"issue":"3","key":"soi250090r38","doi-asserted-by":"publisher","DOI":"10.1136\/bmjoq-2019-000686","article-title":"Exploring stakeholder perceptions around implementation of the Operating Room Black Box for patient safety research: a qualitative study using the theoretical domains framework.","volume":"8","author":"Etherington","year":"2019","journal-title":"BMJ Open Qual"},{"issue":"6","key":"soi250090r39","doi-asserted-by":"publisher","first-page":"3789","DOI":"10.1007\/s00464-021-08695-5","article-title":"Perceptions of safety culture and recording in the operating room: understanding barriers to video data capture.","volume":"36","author":"Gordon","year":"2022","journal-title":"Surg Endosc"},{"issue":"6","key":"soi250090r40","doi-asserted-by":"publisher","first-page":"e1057","DOI":"10.1097\/SLA.0000000000004759","article-title":"Patient perceptions of audio and video recording in the operating room.","volume":"276","author":"Gallant","year":"2022","journal-title":"Ann Surg"},{"issue":"1","key":"soi250090r41","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1186\/s40900-022-00367-5","article-title":"Bringing the patient voice into the operating room: engaging patients in surgical safety research with the Operating Room Black Box\u00ae.","volume":"8","author":"Etherington","year":"2022","journal-title":"Res Involv Engagem"},{"key":"soi250090r5","author":"Schramm"},{"key":"soi250090r10","unstructured":"The OR Black Box. Surgical Safety Technologies. Accessed August 25, 2025. https:\/\/info.surgicalsafety.com\/or-black-box-overview"},{"key":"soi250090r19","unstructured":"Product overview: the Black Box Platform\u2122. Surgical Safety Technologies. Accessed September 7, 2025. https:\/\/www.surgicalsafety.com\/resources\/black-box-platform"},{"key":"soi250090r28","unstructured":"Igelsb\u00f6ck? A. Failed promise or a case of unrealistic expectations? Forbes. Accessed June 21, 2025. https:\/\/www.forbes.com\/councils\/forbestechcouncil\/2021\/08\/09\/ai-failed-promise-or-a-case-of-unrealistic-expectations"},{"key":"soi250090r29","unstructured":"Ryseff? J, De Bruhl? BF, Newberry? SJ. The root causes of failure for artificial intelligence projects and how they can succeed. RAND National Security Research Division. Accessed June 22, 2025. https:\/\/www.rand.org\/pubs\/research_reports\/RRA2680-1.html"},{"key":"soi250090r30","unstructured":"AI underdelivers at work: 62% of employees say ai is significantly overhyped, but 86% admit they aren\u2019t using AI to its full potential according to new research from GoTo. GoTo. Accessed June 22, 2025. https:\/\/www.goto.com\/blog\/2025-pulse-of-work"},{"key":"soi250090r42","unstructured":"Challapaly? A, Pease? C, Raskar? R, Chari? P. The GenAI divide: state of AI in business 2025. MIT NANDA. Accessed September 7, 2025. https:\/\/mlq.ai\/media\/quarterly_decks\/v0.1_State_of_AI_in_Business_2025_Report.pdf"}],"container-title":["JAMA Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/jamanetwork.com\/journals\/jamasurgery\/articlepdf\/2843489\/jamasurgery_thornton_2026_oi_250090_1771982704.80815.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T15:00:55Z","timestamp":1773241255000},"score":1,"resource":{"primary":{"URL":"https:\/\/jamanetwork.com\/journals\/jamasurgery\/fullarticle\/2843489"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,1]]},"references-count":42,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,3,1]]}},"URL":"https:\/\/doi.org\/10.1001\/jamasurg.2025.6029","relation":{},"ISSN":["2168-6254"],"issn-type":[{"value":"2168-6254","type":"print"}],"subject":[],"published":{"date-parts":[[2026,3,1]]}}}