{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T18:24:21Z","timestamp":1789151061232,"version":"build-2803163510"},"reference-count":59,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Serious Games"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Workplace violence (WPV) is a growing concern in health care, adversely impacting frontline providers, patients, and visitors. Traditional training programs have demonstrated limited long-term effectiveness in equipping health care professionals with de-escalation and crisis management skills. Virtual reality (VR) may offer an opportunity to create an innovative, immersive, and engaging platform for WPV training that could address the limitation of conventional methods.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n The aim of this pilot usability study was to assess the user experience of a prototype VR training course designed to prepare frontline health care staff for WPV scenarios. We evaluated the VR system\u2019s practicality, engagement, and perceived value and identified areas for improvement.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n A cross-sectional, mixed methods study was conducted with 13 frontline health care providers. Four pilot-training modules were developed and deployed in a VR environment on stand-alone headsets to address a variety of topics around WPV: Situational Awareness, Self-Awareness and Self-Regulation, Team Dynamics, and Evasive Maneuvers. Participants engaged with each module while providing qualitative feedback during the training. Qualitative feedback was analyzed using a rapid qualitative analysis technique. After completing the pilot training courses, participants completed surveys on usability (System Usability Scale) and user experience (mini Player Experience Inventory) and shared first impressions via Reaction Cards.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Participants found the pilot VR training to be engaging (mini Player Experience Inventory; mean 5.23, SD 1.34), with 89% of Reaction Card responses reflecting positive impressions such as \u201cvaluable,\u201d \u201ccreative,\u201d and \u201caccessible.\u201d However, the overall System Usability Scale score (mean 63.30, SD 9.53) indicated room for improvement in usability. Although participants identified the VR system as manageable and intuitive, first-time users experienced challenges navigating the virtual environment. We identified four themes from qualitative feedback: (1) Perceived Value, (2) Technical and Navigational Barriers, (3) User Preferences, and (4) Vision. Participants described the VR training modules as refreshing due to the immersion in complex environments and noted areas for improvements in the tone and emotional expressiveness of nonplayer characters.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Despite reported limitations, VR training has the potential to be a useful WPV training tool. It offers an immersive, hands-on, and safe environment for health care professionals to practice but may present challenges in engaging learners with the training objectives initially. While overall engagement and value in the training were high, refining dialogue realism and technical usability will support wider adoption. Future iterations of the pilot material may benefit from exploring role-specific content, multiplayer functionality, and integration of artificial intelligence\u2013driven interactions to enhance responsiveness. Further research should compare VR WPV trainings with traditional trainings to evaluate differences in short- and long-term training effectiveness.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/70817","type":"journal-article","created":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T15:35:06Z","timestamp":1753889706000},"page":"e70817-e70817","source":"Crossref","is-referenced-by-count":8,"title":["Virtual Reality for Workplace Violence Training of Health Care Workers: Pilot Mixed Methods Usability Study"],"prefix":"10.2196","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-4751-1063","authenticated-orcid":false,"given":"Daniel Isaiah","family":"Jackson","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6719-5090","authenticated-orcid":false,"given":"Thipkanok","family":"Wongphothiphan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6404-8770","authenticated-orcid":false,"given":"John","family":"Luna","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6104-8401","authenticated-orcid":false,"given":"Tensing","family":"Maa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3189-2166","authenticated-orcid":false,"given":"Mary A","family":"Fristad","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3265-9902","authenticated-orcid":false,"given":"Yungui","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-7118-1083","authenticated-orcid":false,"given":"Brittany","family":"Schaffner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4948-7203","authenticated-orcid":false,"given":"Jennifer","family":"Reese","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-7746-9399","authenticated-orcid":false,"given":"Jason","family":"Wheeler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-8983-0432","authenticated-orcid":false,"given":"Brandon","family":"Abbott","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8798-9605","authenticated-orcid":false,"given":"Emre","family":"Sezgin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,9,15]]},"reference":[{"key":"R1","unstructured":"National Institute for Occupational Safety and Health. Workplace violence prevention strategies and research needs: report from the conference partnering in workplace violence prevention: translating research to practice. Centers for Disease Control and Prevention; Nov 17, 2004. 11418. URL: https:\/\/stacks.cdc.gov\/view\/cdc\/11418\/cdc_11418_DS1.pdf [Accessed 28-08-2025]"},{"key":"R2","unstructured":"Workplace violence SBREFA. Occupational Safety and Health Administration. URL: https:\/\/www.osha.gov\/workplace-violence\/sbrefa [Accessed 19-09-2024]"},{"key":"R3","unstructured":"American Hospital Association. Fact sheet: health care workplace violence and intimidation, and the need for a federal legislative response; URL: https:\/\/www.aha.org\/fact-sheets\/2022-06-07-fact-sheet-workplace-violence-and-intimidation-and-need-federal-legislative [Accessed 19-09-2024]"},{"key":"R4","unstructured":"Merchant JA Lundell JA . Workplace violence: a report to the nation. University of Iowa Injury Prevention Research Center; 2001. URL: https:\/\/iprc.public-health.uiowa.edu\/wp-content\/uploads\/2015\/09\/workplace-violence-report-1.pdf [Accessed 28-08-2025]"},{"issue":"4","key":"R5","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1016\/j.jcjq.2022.02.001","article-title":"The Joint Commission\u2019s new and revised workplace violence prevention standards for hospitals: a major step forward toward improved quality and safety","volume":"48","author":"Arnetz","journal-title":"Jt Comm J Qual Patient Saf"},{"issue":"1","key":"R6","doi-asserted-by":"publisher","DOI":"10.1186\/s12960-023-00868-8","article-title":"Contemporary evidence of workplace violence against the primary healthcare workforce worldwide: a systematic review","volume":"21","author":"Yusoff","journal-title":"Hum Resour Health"},{"key":"R7","unstructured":"Kingston MB Apolinar A Ardabell T et al. Building a safe workplace and community. American Hospital Association. 2022. URL: https:\/\/www.aha.org\/system\/files\/media\/file\/2023\/04\/Building-a-Safe-Workplace-and-Community-Mitigating-the-Risk-of-Violence.pdf [Accessed 28-08-2025]"},{"key":"R8","unstructured":"Healthcare\u2014workplace violence. Occupational Safety and Health Administration. URL: https:\/\/www.osha.gov\/healthcare\/workplace-violence [Accessed 19-09-2024]"},{"key":"R9","unstructured":"Centers for Disease Control and Prevention. Prioritizing our healthcare workers: the importance of addressing the intersection of workplace violence and mental health and wellbeing. 2024. URL: https:\/\/blogs.cdc.gov\/niosh-science-blog\/2024\/05\/29\/hcw_violence_mh\/ [Accessed 19-09-2024]"},{"issue":"9","key":"R10","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.CD011860.pub2","article-title":"Education and training for preventing and minimizing workplace aggression directed toward healthcare workers","volume":"9","author":"Geoffrion","journal-title":"Cochrane Database Syst Rev"},{"issue":"3","key":"R11","doi-asserted-by":"publisher","DOI":"10.2196\/38669","article-title":"Designing virtual reality-based conversational agents to train clinicians in verbal de-escalation skills: exploratory usability study","volume":"10","author":"Moore","journal-title":"JMIR Serious Games"},{"issue":"4","key":"R12","doi-asserted-by":"publisher","DOI":"10.2196\/17279","article-title":"Nurse-physician communication team training in virtual reality versus live simulations: randomized controlled trial on team communication and teamwork attitudes","volume":"22","author":"Liaw","journal-title":"J Med Internet Res"},{"issue":"1","key":"R13","doi-asserted-by":"publisher","DOI":"10.2196\/12959","article-title":"Virtual reality for health professions education: systematic review and meta-analysis by the digital health education collaboration","volume":"21","author":"Kyaw","journal-title":"J Med Internet Res"},{"issue":"1","key":"R14","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1080\/01612840.2024.2429712","article-title":"Virtual reality training to reduce workplace violence in healthcare","volume":"46","author":"Clay","journal-title":"Issues Ment Health Nurs"},{"issue":"3","key":"R15","doi-asserted-by":"publisher","DOI":"10.2196\/17823","article-title":"Biosensor real-time affective analytics in virtual and mixed reality medical education serious games: cohort study","volume":"8","author":"Antoniou","journal-title":"JMIR Serious Games"},{"issue":"3","key":"R16","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1080\/01608061.2023.2240767","article-title":"The effectiveness of virtual reality training: a systematic review","volume":"44","author":"Chang","journal-title":"J Organ Behav Manage"},{"issue":"4","key":"R17","doi-asserted-by":"publisher","first-page":"919","DOI":"10.1007\/s10055-020-00498-8","article-title":"A review of the evidence for training effectiveness with virtual reality technology","volume":"25","author":"Abich","journal-title":"Virtual Real"},{"issue":"1","key":"R18","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-023-04662-x","article-title":"Effectiveness of virtual reality in nursing education: a systematic review and meta-analysis","volume":"23","author":"Liu","journal-title":"BMC Med Educ"},{"key":"R19","doi-asserted-by":"crossref","unstructured":"Accinni T Papadogiannis G Orso L . De-escalation techniques in various settings empathy, normalization and de-escalation. In: Biondi M Pasquini M Tarsitani L , editors. Empathy, Normalization and de-Escalation: Management of the Agitated Patient in Emergency and Critical Situations. Cham: Springer International Publishing; 2021:65-91. [doi: 10.1007\/978-3-030-65106-0_5] ISBN: 9783030651053","DOI":"10.1007\/978-3-030-65106-0_5"},{"issue":"1","key":"R20","doi-asserted-by":"publisher","DOI":"10.15761\/PD.1000138","article-title":"Using de-escalation techniques to prevent violent behavior in pediatric psychiatric emergencies: it is possible","volume":"2","author":"D. Croce","journal-title":"Pediatr Dimensions"},{"issue":"12","key":"R21","doi-asserted-by":"publisher","first-page":"543","DOI":"10.1016\/j.paed.2019.09.005","article-title":"Initial assessment and management of agitation and aggression in the paediatric setting","volume":"29","author":"Ponnuthurai","journal-title":"Paediatr Child Health (Oxford)"},{"issue":"1","key":"R22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.5811\/westjem.2011.9.6865","article-title":"Overview of Project BETA: best practices in evaluation and treatment of agitation","volume":"13","author":"Holloman","journal-title":"West J Emerg Med"},{"issue":"1","key":"R23","doi-asserted-by":"publisher","first-page":"17","DOI":"10.5811\/westjem.2011.9.6864","article-title":"Verbal DE-escalation of the agitated patient: consensus statement of the American Association for Emergency Psychiatry Project BETA DE-escalation Workgroup","volume":"13","author":"Richmond","journal-title":"West J Emerg Med"},{"issue":"5","key":"R24","doi-asserted-by":"publisher","first-page":"898","DOI":"10.1002\/emp2.12138","article-title":"Improving the management of acutely agitated patients in the emergency department through implementation of Project BETA (Best Practices in the Evaluation and Treatment of Agitation)","volume":"1","author":"Roppolo","journal-title":"J Am Coll Emerg Physicians Open"},{"issue":"1","key":"R25","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1111\/j.1365-2648.2007.04308.x","article-title":"STAMP: components of observable behaviour that indicate potential for patient violence in emergency departments","volume":"59","author":"Luck","journal-title":"J Adv Nurs"},{"issue":"2","key":"R26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.25677\/10968\/4333","article-title":"Using the behavioral activity rating scale as a vital sign in the psychiatric emergency service","volume":"2","author":"Simpson","journal-title":"Colo J Psychiatry Psychol"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.1080\/15555240.2025.2474055","article-title":"Challenges and opportunities in healthcare workplace violence training: a qualitative study of staff experiences","author":"Jackson","journal-title":"J Workplace Behav Health"},{"issue":"3","key":"R28","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1016\/j.shaw.2021.04.004","article-title":"A systematic review: effectiveness of interventions to de-escalate workplace violence against nurses in healthcare settings","volume":"12","author":"Somani","journal-title":"Saf Health Work"},{"issue":"13-14","key":"R29","doi-asserted-by":"publisher","first-page":"1937","DOI":"10.1111\/jocn.12473","article-title":"Workplace physical violence among hospital nurses and physicians in underserved areas in Jordan","volume":"23","author":"AbuAlRub","journal-title":"J Clin Nurs"},{"key":"R30","unstructured":"Virtual real. PICO Immersive Pte ltd. PICO Global; 2023. URL: https:\/\/www.picoxr.com\/global [Accessed 19-12-2024]"},{"key":"R31","unstructured":"Unity. Unity Technologies. 2023. URL: https:\/\/unity.com\/releases\/editor\/whats-new\/2021.3.28 [Accessed 21-01-2025]"},{"key":"R32","unstructured":"Character creator. Reallusion Inc. 2023. URL: https:\/\/www.reallusion.com\/character-creator\/download.html [Accessed 21-01-2025]"},{"key":"R33","unstructured":"Index of \/release\/. Blender Foundation. 2023. URL: https:\/\/download.blender.org\/release\/ [Accessed 21-01-2025]"},{"key":"R34","unstructured":"Photoshop. Adobe. 2023. URL: https:\/\/www.adobe.com\/products\/photoshop.html [Accessed 21-01-2025]"},{"key":"R35","unstructured":"Substance 3D painter. Adobe. 2023. URL: https:\/\/www.adobe.com\/products\/substance3d\/apps\/painter.html [Accessed 21-01-2025]"},{"key":"R36","unstructured":"Premiere Pro. Adobe. 2023. URL: https:\/\/www.adobe.com\/products\/premiere.html [Accessed 21-01-2025]"},{"key":"R37","unstructured":"Visual Studio 2019. Microsoft. 2023. URL: https:\/\/visualstudio.microsoft.com\/vs\/older-downloads\/ [Accessed 21-01-2025]"},{"key":"R38","unstructured":"Kolb DA . Experiential Learning: Experience as the Source of Learning and Development. Financial Times Prentice Hall; 1983. ISBN: 9780132952613"},{"issue":"CHI PLAY","key":"R39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3549507","article-title":"miniPXI: development and validation of an eleven-item measure of the Player Experience Inventory","volume":"6","author":"Haider","journal-title":"Proc ACM Hum-Comput Interact"},{"issue":"12","key":"R40","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2022.48784","article-title":"Assessment of mental health services available through smartphone apps","volume":"5","author":"Camacho","journal-title":"JAMA Netw Open"},{"key":"R41","doi-asserted-by":"crossref","unstructured":"Brooke J . SUS: a \u201cquick and dirty\u201d usability scale. In: Usability Evaluation in Industry. 1st ed. CRC Press; 1996:207-212. [doi: 10.1201\/9781498710411-35] ISBN: 9780429157011","DOI":"10.1201\/9781498710411-35"},{"key":"R42","unstructured":"Barnum C . Product reaction words. UXFirm. 2022. URL: https:\/\/www.uxfirm.com\/microsofts-product-reaction-cards-unlock-user-satisfaction-part-1 [Accessed 06-09-2024]"},{"issue":"10","key":"R43","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2017-019993","article-title":"Can rapid approaches to qualitative analysis deliver timely, valid findings to clinical leaders? A mixed methods study comparing rapid and thematic analysis","volume":"8","author":"Taylor","journal-title":"BMJ Open"},{"issue":"114523","key":"R44","doi-asserted-by":"publisher","DOI":"10.1016\/j.socscimed.2021.114523","article-title":"Sample sizes for saturation in qualitative research: a systematic review of empirical tests","volume":"292","author":"Hennink","journal-title":"Soc Sci Med"},{"issue":"1","key":"R45","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A coefficient of agreement for nominal scales","volume":"20","author":"Cohen","journal-title":"Educ Psychol Meas"},{"key":"R46","unstructured":"RStudio releases. Posit Software. 2023. URL: https:\/\/dailies.rstudio.com\/release\/ [Accessed 29-10-2024]"},{"key":"R47","unstructured":"R Foundation. Index of \/src\/base\/R-4. 2023. URL: https:\/\/cran.r-project.org\/src\/base\/R-4\/ [Accessed 29-10-2024]"},{"key":"R48","unstructured":"Lang C . Wordcloud2 introduction. 2018. URL: https:\/\/cran.r-project.org\/web\/packages\/wordcloud2\/vignettes\/wordcloud.html [Accessed 25-11-2024]"},{"key":"R49","unstructured":"Sauro J . Measuring usability with the system usability scale (SUS). Measuring U. 2011. URL: https:\/\/measuringu.com\/sus\/ [Accessed 25-11-2025]"},{"issue":"3","key":"R50","first-page":"114","volume":"4","author":"Bangor","journal-title":"J Usability Stud"},{"issue":"1","key":"R51","doi-asserted-by":"publisher","DOI":"10.1186\/s12245-023-00545-6","article-title":"Development and usability testing of a fully immersive VR simulation for REBOA training","volume":"16","author":"Birrenbach","journal-title":"Int J Emerg Med"},{"key":"R52","doi-asserted-by":"publisher","DOI":"10.2196\/43416","article-title":"TACTICS VR stroke telehealth virtual reality training for health care professionals involved in stroke management at telestroke spoke hospitals: module design and implementation study","volume":"11","author":"Maltby","journal-title":"JMIR Serious Games"},{"issue":"22","key":"R53","doi-asserted-by":"publisher","DOI":"10.3352\/jeehp.2021.18.22","article-title":"No difference in learning outcomes and usability between using controllers and hand tracking during a virtual reality endotracheal intubation training for medical students in Thailand","volume":"18","author":"Khundam","journal-title":"J Educ Eval Health Prof"},{"issue":"4","key":"R54","doi-asserted-by":"publisher","DOI":"10.3390\/s22041342","article-title":"Usability testing of virtual reality applications\u2014the pilot study","volume":"22","author":"Kami\u0144ska","journal-title":"Sensors (Basel)"},{"issue":"1","key":"R55","doi-asserted-by":"publisher","DOI":"10.2196\/23708","article-title":"Using virtual reality to improve health care providers\u2019 cultural self-efficacy and diabetes attitudes: pilot questionnaire study","volume":"6","author":"Beverly","journal-title":"JMIR Diabetes"},{"issue":"1743","key":"R56","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2020.01743","article-title":"The use of virtual reality alone does not promote training performance (but sense of presence does)","volume":"11","author":"Grassini","journal-title":"Front Psychol"},{"issue":"12","key":"R57","doi-asserted-by":"publisher","first-page":"1585","DOI":"10.1302\/0301-620X.101B12.BJJ-2019-0643.R1","article-title":"Virtual reality training improves trainee performance in total hip arthroplasty: a randomized controlled trial","volume":"101-B","author":"Logishetty","journal-title":"Bone Joint J"},{"key":"R58","doi-asserted-by":"crossref","unstructured":"Dubois E Gray P Nigay L , editors. The Engineering of Mixed Reality Systems. Springer London; 2010. [doi: 10.1007\/978-1-84882-733-2] ISBN: 9781848827325","DOI":"10.1007\/978-1-84882-733-2"},{"issue":"2","key":"R59","doi-asserted-by":"publisher","first-page":"0","DOI":"10.1111\/j.1083-6101.1997.tb00072.x","article-title":"At the heart of it all: the concept of presence","volume":"3","author":"Lombard","journal-title":"J Comput Mediat Commun"}],"container-title":["JMIR Serious Games"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/games.jmir.org\/2025\/1\/e70817","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:59:45Z","timestamp":1782842385000},"score":1,"resource":{"primary":{"URL":"https:\/\/games.jmir.org\/2025\/1\/e70817"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,15]]},"references-count":59,"URL":"https:\/\/doi.org\/10.2196\/70817","relation":{},"ISSN":["2291-9279"],"issn-type":[{"value":"2291-9279","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,15]]},"article-number":"v13i4e70817"}}