{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,18]],"date-time":"2026-02-18T07:29:59Z","timestamp":1771399799546,"version":"3.50.1"},"reference-count":32,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,2,18]],"date-time":"2026-02-18T00:00:00Z","timestamp":1771372800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Virtual Real."],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Effective collaboration among healthcare professionals is essential for delivering high-quality patient care, especially in emergencies. As healthcare education adopts new technologies, virtual reality (VR) is gaining traction for enhancing emergency response skills. To define key learning objectives and best practices for a newly developed VR-based emergency training program in surgical wards, an interprofessional modified Delphi study was conducted.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      A five-round modified Delphi method was conducted with 17 participants from medical and nursing backgrounds. Round 1 involved an interprofessional discussion to identify critical actions, common errors, and preliminary learning goals. In Round 2, participants interacted with the VR simulation and refined the objectives in a follow-up discussion. In Round 3, 157 statements were rated using a five-point Likert scale. Items lacking consensus (&amp;lt;80% agreement, IQR &amp;gt; 1, or median \u22644;\n                      <jats:italic>n<\/jats:italic>\n                      = 76) were discussed again in Round 4. Revised items were anonymously re-evaluated in Round 5.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The Delphi process resulted in consensus on 131 of 157 items (84%), defining a structured framework of core interprofessional competencies, including key learning objectives, essential clinical actions, teamwork principles, and time-critical decision points for VR-based emergency training. No consensus was reached for 26 items (16%). Between Rounds 3 and 5, eight items showed differing ratings between physicians and nurses, which were reduced to four after interprofessional discussion.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>This study resulted in a consensus-based framework of interprofessional learning objectives and key competencies for VR-based emergency training. It highlights the value of structured interprofessional collaboration in the systematic development of evaluation-oriented educational frameworks for ward-based surgical emergencies.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/frvir.2026.1737515","type":"journal-article","created":{"date-parts":[[2026,2,18]],"date-time":"2026-02-18T06:55:47Z","timestamp":1771397747000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Development of a standardized evaluation model for virtual reality-based emergency training: a Delphi study on competency criteria for interprofessional teams"],"prefix":"10.3389","volume":"7","author":[{"given":"Jana","family":"Adams","sequence":"first","affiliation":[{"name":"Department of Obstetrics & Department of Gynecology, University of Cologne, Medical Faculty and University Hospital Cologne","place":["Cologne, Germany"]},{"name":"Department of General-, Visceral-, Thoracic- and Transplant Surgery, University of Cologne, Medical Faculty and University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martina","family":"Weidler","sequence":"additional","affiliation":[{"name":"Department of Nursing and Generalist Nursing Education, University of Cologne, University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jorge Pereira","family":"Santos","sequence":"additional","affiliation":[{"name":"Department of Nursing and Generalist Nursing Education, University of Cologne, University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sarah","family":"Hermanns","sequence":"additional","affiliation":[{"name":"Department of Nursing and Generalist Nursing Education, University of Cologne, University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sven","family":"Dannemann","sequence":"additional","affiliation":[{"name":"Department of Nursing and Generalist Nursing Education, University of Cologne, University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jens","family":"M\u00f6llenbeck","sequence":"additional","affiliation":[{"name":"Department of Nursing and Generalist Nursing Education, University of Cologne, University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pascal","family":"Wegmann","sequence":"additional","affiliation":[{"name":"Department of Nursing and Generalist Nursing Education, University of Cologne, University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lukas","family":"Schatzl","sequence":"additional","affiliation":[{"name":"Department of Nursing and Generalist Nursing Education, University of Cologne, University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rebecca","family":"Schatzl","sequence":"additional","affiliation":[{"name":"Department of Nursing and Generalist Nursing Education, University of Cologne, University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Patrick","family":"Dehn","sequence":"additional","affiliation":[{"name":"Department of Nursing and Generalist Nursing Education, University of Cologne, University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Niels-Benjamin","family":"Adams","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology and Intensive Care Medicine, University of Cologne, Medical Faculty and University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hendrik","family":"Drinhaus","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology and Intensive Care Medicine, University of Cologne, Medical Faculty and University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Sander","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology and Intensive Care Medicine, University of Cologne, Medical Faculty and University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cornelia zur","family":"Nieden","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology and Intensive Care Medicine, University of Cologne, Medical Faculty and University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tobias","family":"Kammerer","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology and Intensive Care Medicine, University of Cologne, Medical Faculty and University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hannes","family":"Ecker","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology and Intensive Care Medicine, University of Cologne, Medical Faculty and University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Robert","family":"Schier","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology and Intensive Care Medicine, University of Marburg, Medical Faculty and University Hospital of Fulda","place":["Fulda, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Robert","family":"Kleinert","sequence":"additional","affiliation":[{"name":"Department of Surgery, University of Bielefeld, Medical Faculty and University Hospital of Bielefeld","place":["Bielefeld, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christiane","family":"Bruns","sequence":"additional","affiliation":[{"name":"Department of General-, Visceral-, Thoracic- and Transplant Surgery, University of Cologne, Medical Faculty and University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rabi","family":"Datta","sequence":"additional","affiliation":[{"name":"Department of General-, Visceral-, Thoracic- and Transplant Surgery, University of Cologne, Medical Faculty and University Hospital of Cologne","place":["Cologne, Germany"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2026,2,18]]},"reference":[{"key":"B1","first-page":"779","article-title":"Delphi application in medical science teaching","volume":"42","author":"Adamowski","year":"2008","journal-title":"Psychiatr. Pol."},{"key":"B2","doi-asserted-by":"publisher","first-page":"e0301517","DOI":"10.1371\/journal.pone.0301517","article-title":"Validation of key components in designing a social skills training content using virtual reality for high functioning autism youth\u2014A fuzzy Delphi method","volume":"19","author":"Ahmad","year":"2024","journal-title":"PLoS One"},{"key":"B3","doi-asserted-by":"publisher","first-page":"142","DOI":"10.1097\/NNA.0b013e318283dc23","article-title":"Nurse-physician teamwork in the emergency department: impact on perceptions of job environment, autonomy, and control over practice","volume":"43","author":"Ajeigbe","year":"2013","journal-title":"J. Nurs. Adm."},{"key":"B4","doi-asserted-by":"publisher","first-page":"e29080","DOI":"10.2196\/29080","article-title":"Augmented, mixed, and virtual reality-based head-mounted devices for medical education: systematic review","volume":"9","author":"Barteit","year":"2021","journal-title":"JMIR Serious Games"},{"key":"B5","doi-asserted-by":"publisher","first-page":"e20476","DOI":"10.1371\/journal.pone.0020476","article-title":"Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review","volume":"6","author":"Boulkedid","year":"2011","journal-title":"PLoS One"},{"key":"B6","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1097\/SIH.0000000000000347","article-title":"Virtual reality simulation in nontechnical skills training for healthcare professionals","volume":"14","author":"Bracq","year":"2019","journal-title":"Simul. Healthc."},{"key":"B7","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1007\/s10055-025-01185-2","article-title":"VRainSUD: content validation of a cognitive training program using the Delphi method","volume":"29","author":"Caetano","year":"2025","journal-title":"Virtual Real."},{"key":"B8","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1111\/anae.16015","article-title":"Design and validation of a virtual reality trainer for ultrasound\u2010guided regional anaesthesia","volume":"78","author":"Chuan","year":"2023","journal-title":"Anaesthesia"},{"key":"B9","doi-asserted-by":"publisher","first-page":"639","DOI":"10.1080\/13611260500069947","article-title":"The Delphi technique in health sciences education research","volume":"27","author":"de Villiers","year":"2005","journal-title":"Med. Teach."},{"key":"B10","doi-asserted-by":"publisher","first-page":"185","DOI":"10.5811\/westjem.2017.11.35275","article-title":"Interprofessional emergency training leads to changes in the workplace","volume":"19","author":"Eisenmann","year":"2018","journal-title":"West J. Emerg. Med."},{"key":"B11","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1111\/j.1547-5069.2012.01458.x","article-title":"Nurse-physician relationships in ambulatory oncology settings","volume":"44","author":"Friese","year":"2012","journal-title":"J. Nurs. Scholarsh."},{"key":"B12","first-page":"196","article-title":"A WHO report: framework for action on interprofessional education and collaborative practice","volume":"39","author":"Gilbert","year":"2010","journal-title":"J. Allied Health"},{"key":"B13","doi-asserted-by":"publisher","first-page":"3895","DOI":"10.3390\/ijerph20053895","article-title":"Effects of medical education program using virtual reality: a systematic review and meta-analysis","volume":"20","author":"Kim","year":"2023","journal-title":"Int. J. Environ. Res. Public Health"},{"key":"B14","doi-asserted-by":"publisher","first-page":"e0264850","DOI":"10.1371\/journal.pone.0264850","article-title":"Preliminary investigations for the development of a virtual reality-based English-language communication program: using the Delphi method","volume":"17","author":"Kim","year":"2022","journal-title":"PLoS One"},{"key":"B15","doi-asserted-by":"publisher","first-page":"2495","DOI":"10.1007\/s11701-023-01679-8","article-title":"Validation of a multidisciplinary virtual reality (VR) robotic surgical curriculum","volume":"17","author":"Kim","year":"2023","journal-title":"J. Robot. Surg."},{"key":"B16","doi-asserted-by":"publisher","first-page":"e0190580","DOI":"10.1371\/journal.pone.0190580","article-title":"Development of an objective assessment tool for total laparoscopic hysterectomy: a Delphi method among experts and evaluation on a virtual reality simulator","volume":"13","author":"Knight","year":"2018","journal-title":"PLoS One"},{"key":"B17","doi-asserted-by":"publisher","first-page":"e45210","DOI":"10.2196\/45210","article-title":"Using virtual reality head-mounted displays to assess skills in emergency medicine: validity study","volume":"25","author":"Knudsen","year":"2023","journal-title":"J. Med. Internet Res."},{"key":"B18","doi-asserted-by":"publisher","first-page":"e68705","DOI":"10.2196\/68705","article-title":"Training and assessing teamwork in interprofessional virtual reality\u2013based simulation using the TeamSTEPPS framework: protocol for randomized pre-post intervention study","volume":"14","author":"Lehmann","year":"2025","journal-title":"JMIR Res. Protoc."},{"key":"B19","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1016\/j.jss.2021.06.045","article-title":"Immersive virtual reality for surgical training: a systematic review","volume":"268","author":"Mao","year":"2021","journal-title":"J. Surg. Res."},{"key":"B20","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1186\/s12893-021-01441-7","article-title":"Validation of a novel virtual reality simulation system with the focus on training for surgical dissection during laparoscopic sigmoid colectomy","volume":"22","author":"Mori","year":"2022","journal-title":"BMC Surg."},{"key":"B21","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1097\/01.NCQ.0000356905.87452.62","article-title":"Nurses\u2019 role in communication and patient safety","volume":"24","author":"Nadzam","year":"2009","journal-title":"J. Nurs. Care Qual."},{"key":"B22","doi-asserted-by":"publisher","first-page":"e57117","DOI":"10.2196\/57117","article-title":"Interprofessional team training with virtual reality: acceptance, learning outcome, and feasibility evaluation study","volume":"12","author":"Neher","year":"2024","journal-title":"JMIR Serious Games"},{"key":"B23","doi-asserted-by":"publisher","first-page":"292","DOI":"10.1186\/s12909-025-06867-8","article-title":"Virtual reality for assessment in undergraduate nursing and medical education - a systematic review","volume":"25","author":"Neher","year":"2025","journal-title":"BMC Med. Educ."},{"key":"B24","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1016\/j.surg.2011.08.005","article-title":"Designing a proficiency-based, content validated virtual reality curriculum for laparoscopic colorectal surgery: a Delphi approach","volume":"151","author":"Palter","year":"2012","journal-title":"Surgery"},{"key":"B25","doi-asserted-by":"publisher","first-page":"103778","DOI":"10.1016\/j.compedu.2019.103778","article-title":"A systematic review of immersive virtual reality applications for higher education: design elements, lessons learned, and research agenda","volume":"147","author":"Radianti","year":"2020","journal-title":"Comput. Educ."},{"key":"B26","doi-asserted-by":"publisher","first-page":"CD000072","DOI":"10.1002\/14651858.CD000072.pub3","article-title":"Interprofessional collaboration to improve professional practice and healthcare outcomes","volume":"2018","author":"Reeves","year":"2017","journal-title":"Cochrane Database Syst. Rev."},{"key":"B27","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1097\/SIH.0b013e3181626276","article-title":"Measuring team performance in simulation-based training: adopting best practices for healthcare","volume":"3","author":"Rosen","year":"2008","journal-title":"Simul. Healthc."},{"key":"B28","doi-asserted-by":"publisher","first-page":"M106","DOI":"10.1093\/gerona\/56.2.m106","article-title":"The effects of a collaborative model of primary care on the mortality and hospital use of community-dwelling older adults","volume":"56","author":"Schraeder","year":"2001","journal-title":"J. Gerontol. A Biol. Sci. Med. Sci."},{"key":"B29","doi-asserted-by":"publisher","first-page":"e32829","DOI":"10.1097\/MD.0000000000032829","article-title":"Use of Delphi in health sciences research: a narrative review","volume":"102","author":"Shang","year":"2023","journal-title":"Medicine"},{"key":"B30","doi-asserted-by":"publisher","first-page":"i4512","DOI":"10.1136\/sbmj.i4512","article-title":"The ABCDE approach explained","volume":"355","author":"Soltan","year":"2016","journal-title":"BMJ"},{"key":"B31","doi-asserted-by":"publisher","first-page":"103079","DOI":"10.1016\/j.otsr.2021.103079","article-title":"Validation of virtual reality arthroscopy simulator relevance in characterising experienced surgeons","volume":"107","author":"Tronchot","year":"2021","journal-title":"Orthop. and Traumatology Surg. and Res."},{"key":"B32","doi-asserted-by":"publisher","first-page":"2302231","DOI":"10.1080\/10872981.2024.2302231","article-title":"Gamification in medical education: identifying and prioritizing key elements through Delphi method","volume":"29","author":"Wang","year":"2024","journal-title":"Med. Educ. Online"}],"container-title":["Frontiers in Virtual Reality"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frvir.2026.1737515\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,18]],"date-time":"2026-02-18T06:55:48Z","timestamp":1771397748000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frvir.2026.1737515\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,18]]},"references-count":32,"alternative-id":["10.3389\/frvir.2026.1737515"],"URL":"https:\/\/doi.org\/10.3389\/frvir.2026.1737515","relation":{},"ISSN":["2673-4192"],"issn-type":[{"value":"2673-4192","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,18]]},"article-number":"1737515"}}