{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T21:03:58Z","timestamp":1790802238102,"version":"4.1.0"},"reference-count":52,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Hum Factors"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Hepato-pancreato-biliary (HPB) oncology involves complex surgical planning and multidisciplinary decision-making that present significant cognitive, spatial, and communicative challenges. While augmented reality (AR) technologies are emerging as valuable tools in surgical planning, most existing systems are developed in a technologically deterministic manner, often without consideration of patients\u2019 lived experiences or the collaborative needs of multidisciplinary clinical teams. This limits their integration into complex workflows and their potential for meaningful clinical impact.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to co-design and evaluate a human-centered AR system that supports spatial understanding, emotional sensitivity, and collaborative decision-making in HPB surgical oncology.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n This mixed methods human-centered design study was conducted between February 2024 and September 2025 and comprised 2 phases. In Phase 1, convenience sampling was used to recruit 14 oncology health care professionals (surgeons, oncologists, and psycho-oncology specialists) and 10 patients with cancer from multidisciplinary oncology care settings to participate in co-design workshops and semistructured interviews exploring the cognitive, communicative, emotional, and workflow requirements for an AR system supporting HPB surgical oncology. Qualitative data were analyzed using reflexive thematic analysis and informed iterative prototype development. In Phase 2, the resulting AR prototype was evaluated through usability testing with 10 hepatobiliary clinicians using simulated multidisciplinary tumor board planning scenarios. Usability was assessed using the System Usability Scale (SUS), supplemented by observational data and qualitative feedback.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n The co-design process identified intersecting spatial, cognitive, emotional, and communicative challenges in HPB surgical oncology. These findings informed the iterative development of an AR prototype that functioned as a shared cognitive and communicative workspace. The system enabled collaborative manipulation of 3D anatomical models, emotionally calibrated visualizations, and seamless integration with existing planning workflows. The prototype achieved a mean SUS score of 67.25 (SD 7.95), indicating acceptable usability. In simulated multidisciplinary tumor board scenarios, clinicians reported improved spatial understanding, reduced cognitive load, and enhanced interdisciplinary communication. Patients with cancer participating in the co-design phase valued the ability to engage with their own anatomy in an emotionally manageable way and reported that interactive visualization improved their understanding and sense of agency. Overall, the findings suggest that AR systems designed with human-centered methods can function not only as visualization tools but also as boundary objects that support communication and distributed cognition in complex cancer care settings.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n A human-centered co-design process can guide the development of AR systems that extend beyond technical novelty to become emotionally attuned, cognitively supportive, and workflow-compatible tools in surgical oncology. By foregrounding the needs of both patients and professionals, AR can function as a boundary object that facilitates collaborative decision-making, empathetic communication, and multidisciplinary coordination in complex oncology care. This study provides actionable design recommendations for developing AR technologies that are meaningfully integrated into complex clinical contexts.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/86725","type":"journal-article","created":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T20:14:43Z","timestamp":1790799283000},"page":"e86725-e86725","source":"Crossref","is-referenced-by-count":0,"title":["From Prototype to Practice: Mixed Methods Study of Human-Centered Design and Usability Evaluation of Augmented Reality for Complex Oncology Surgical Workflows"],"prefix":"10.2196","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3804-5565","authenticated-orcid":false,"given":"Maria","family":"Matsangidou","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5628-4880","authenticated-orcid":false,"given":"Mikolaj R","family":"Kowal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5551-2574","authenticated-orcid":false,"given":"Jakob","family":"Yianni","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8122-963X","authenticated-orcid":false,"given":"Maria","family":"Krini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0535-1470","authenticated-orcid":false,"given":"Samir","family":"Pathak","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1483-0657","authenticated-orcid":false,"given":"Katie","family":"Gordon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-6974-0209","authenticated-orcid":false,"given":"Malcolm A","family":"Luker","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8031-1738","authenticated-orcid":false,"given":"Deborah D","family":"Stocken","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8725-3283","authenticated-orcid":false,"given":"David","family":"Jayne","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1271-8151","authenticated-orcid":false,"given":"Constantinos S","family":"Pattichis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,9,30]]},"reference":[{"issue":"10","key":"R1","doi-asserted-by":"publisher","first-page":"4174","DOI":"10.1007\/s00464-016-4800-6","article-title":"Systematic review on the effectiveness of augmented reality applications in medical training","volume":"30","author":"Barsom","journal-title":"Surg Endosc"},{"issue":"12","key":"R2","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1109\/MC.2009.380","article-title":"Augmented reality: no longer a novelty?","volume":"42","author":"Vaughan-Nichols","journal-title":"Computer (Long Beach Calif)"},{"issue":"1","key":"R3","doi-asserted-by":"publisher","DOI":"10.1186\/s12891-020-3110-2","article-title":"Applicability of augmented reality in orthopedic surgery - a systematic review","volume":"21","author":"Jud","journal-title":"BMC Musculoskelet Disord"},{"key":"R4","doi-asserted-by":"publisher","DOI":"10.3389\/fmed.2026.1688748","article-title":"Precision surgery in the era of 3D visualization, AR\/VR, and 3D printing: current applications and future directions","volume":"13","author":"Ren","journal-title":"Front Med"},{"key":"R5","doi-asserted-by":"crossref","unstructured":"Dwyer T Marriott K Isenberg T et al. Immersive analytics: an introduction. In: In Immersive Analytics. Springer International Publishing; 2018:1-23. [doi: 10.1007\/978-3-030-01388-2_1] ISBN: 978-3-030-01388-2","DOI":"10.1007\/978-3-030-01388-2_1"},{"issue":"1","key":"R6","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-026-44543-z","article-title":"3D imaging contribution in pediatric surgical oncology: a multi-stakeholder assessment study","volume":"16","author":"Pio","journal-title":"Sci Rep"},{"issue":"2","key":"R7","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1016\/j.hbpd.2018.02.002","article-title":"Augmented reality technology for preoperative planning and intraoperative navigation during hepatobiliary surgery: a review of current methods","volume":"17","author":"Tang","journal-title":"Hepatobiliary Pancreat Dis Int"},{"key":"R8","doi-asserted-by":"crossref","unstructured":"Hegarty M Keehner M Cohen C Montello DR Lippa Y . The role of spatial cognition in medicine: applications for selecting and training professionals. In: In Applied Spatial Cognition. Psychology Press; 2007:285-316. [doi: 10.4324\/9781003064350-11] ISBN: 9781138004139","DOI":"10.4324\/9781003064350-11"},{"issue":"1","key":"R9","doi-asserted-by":"publisher","DOI":"10.1515\/ohe-2025-0059","article-title":"Navigating challenges and maximizing potential: handling complications and constraints in minimally invasive surgery","volume":"6","author":"Qadrie","journal-title":"Open Health"},{"issue":"1","key":"R10","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-23403-5","article-title":"Positive surgical margins in the 10 most common solid cancers","volume":"8","author":"Orosco","journal-title":"Sci Rep"},{"key":"R11","doi-asserted-by":"publisher","DOI":"10.1016\/j.oraloncology.2022.105850","article-title":"Positive margins matter regardless of subsequent resection findings","volume":"128","author":"Coutu","journal-title":"Oral Oncol"},{"issue":"10-11","key":"R12","doi-asserted-by":"publisher","first-page":"1335","DOI":"10.1080\/00365521.2018.1501604","article-title":"The impact of post-hepatectomy liver failure on mortality: a population-based study","volume":"53","author":"Gilg","journal-title":"Scand J Gastroenterol"},{"issue":"24","key":"R13","doi-asserted-by":"publisher","DOI":"10.3390\/cancers13246268","article-title":"Augmented reality and image-guided robotic liver surgery","volume":"13","author":"Giannone","journal-title":"Cancers (Basel)"},{"key":"R14","doi-asserted-by":"publisher","DOI":"10.1016\/j.oraloncology.2022.105775","article-title":"Projected cutting guides using an augmented reality system to improve surgical margins in maxillectomies: a preclinical study","volume":"127","author":"Chan","journal-title":"Oral Oncol"},{"issue":"15","key":"R15","doi-asserted-by":"publisher","DOI":"10.3390\/jcm14155385","article-title":"Technological advances in pre-operative planning","volume":"14","author":"Kowal","journal-title":"J Clin Med"},{"issue":"3","key":"R16","doi-asserted-by":"publisher","first-page":"1629","DOI":"10.3390\/app13031629","article-title":"Augmented reality in surgical navigation: a review of evaluation and validation metrics","volume":"13","author":"Malhotra","journal-title":"Appl Sci"},{"issue":"2","key":"R17","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1007\/s00268-015-3229-8","article-title":"Augmented reality guidance for the resection of missing colorectal liver metastases: an initial experience","volume":"40","author":"Ntourakis","journal-title":"World J Surg"},{"issue":"5","key":"R18","doi-asserted-by":"publisher","first-page":"e55","DOI":"10.1016\/j.jamcollsurg.2014.12.053","article-title":"Trans-thoracic minimally invasive liver resection guided by augmented reality","volume":"220","author":"Hallet","journal-title":"J Am Coll Surg"},{"issue":"4","key":"R19","doi-asserted-by":"publisher","first-page":"29","DOI":"10.3390\/mti1040029","article-title":"Augmented reality: advances in diagnostic imaging","volume":"1","author":"Douglas","journal-title":"Multimodal Technol Interact"},{"issue":"1","key":"R20","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/j.apergo.2013.04.023","article-title":"Human factors systems approach to healthcare quality and patient safety","volume":"45","author":"Carayon","journal-title":"Appl Ergon"},{"issue":"11","key":"R21","doi-asserted-by":"publisher","DOI":"10.2196\/23623","article-title":"The associations of electronic health record usability and user age with stress and cognitive failures among Finnish registered nurses: cross-sectional study","volume":"8","author":"Kaihlanen","journal-title":"JMIR Med Inform"},{"key":"R22","doi-asserted-by":"crossref","unstructured":"B\u00f8dker S . When second wave HCI meets third wave challenges. Presented at: NordiCHI \u201906: 4th Nordic conference on Human-computer interaction: changing roles; Oct 14-18, 2006:1-8; Oslo, Norway. URL: https:\/\/dl.acm.org\/doi\/proceedings\/10.1145\/1182475 [Accessed 16-09-2026] [doi: 10.1145\/1182475.1182476]","DOI":"10.1145\/1182475.1182476"},{"key":"R23","doi-asserted-by":"publisher","DOI":"10.2196\/50178","article-title":"Examining challenges to co-design digital health interventions with end users: systematic review","volume":"27","author":"Duffy","journal-title":"J Med Internet Res"},{"key":"R24","doi-asserted-by":"crossref","unstructured":"Matsangidou M P. Kassianos A Papaioannou D et al. Virtual painkillers: designing accessible virtual reality experiences for helping cancer patients manage pain at home. Presented at: CHI \u201922: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems; Apr 29 to May 5, 2022:1-9; New Orleans, LA, USA. URL: https:\/\/dl.acm.org\/doi\/proceedings\/10.1145\/3491101 [Accessed 16-09-2026] [doi: 10.1145\/3491101.3503562]","DOI":"10.1145\/3491101.3503562"},{"issue":"4","key":"R25","doi-asserted-by":"publisher","DOI":"10.2196\/41481","article-title":"From testers to cocreators-the value of and approaches to successful patient engagement in the development of eHealth solutions: qualitative expert interview study","volume":"9","author":"Jacob","journal-title":"JMIR Hum Factors"},{"key":"R26","doi-asserted-by":"crossref","unstructured":"Endsley TC Sprehn KA Brill RM Ryan KJ Vincent EC Martin JM . Augmented Reality Design Heuristics: Designing for Dynamic Interaction. Sage Publications; 2017. [doi: 10.1177\/1541931213602007]","DOI":"10.1177\/1541931213602007"},{"key":"R27","doi-asserted-by":"crossref","unstructured":"Harders M Bianchi G Knoerlein B . Multimodal augmented reality in medicine. In: Universal Access in Human-Computer Interaction. Springer; 2007:652-658. [doi: 10.1007\/978-3-540-73281-5_70]","DOI":"10.1007\/978-3-540-73281-5_70"},{"key":"R28","unstructured":"Norman D Donald A . The Design of Everyday Things. Basic Books; 2002. ISBN: 9780465050659"},{"issue":"Suppl 3","key":"R29","doi-asserted-by":"publisher","first-page":"i68","DOI":"10.1136\/qshc.2010.042085","article-title":"A new sociotechnical model for studying health information technology in complex adaptive healthcare systems","volume":"19 Suppl 3","author":"Sittig","journal-title":"Qual Saf Health Care"},{"key":"R30","doi-asserted-by":"publisher","DOI":"10.1016\/j.apergo.2019.103033","article-title":"SEIPS 3.0: Human-centered design of the patient journey for patient safety","volume":"84","author":"Carayon","journal-title":"Appl Ergon"},{"key":"R31","doi-asserted-by":"publisher","DOI":"10.5888\/pcd15.180128","article-title":"Design thinking in health care","volume":"15","author":"Altman","journal-title":"Prev Chronic Dis"},{"issue":"2","key":"R32","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1191\/1478088706qp063oa","article-title":"Using thematic analysis in psychology","volume":"3","author":"Braun","journal-title":"Qual Res Psychol"},{"issue":"4","key":"R33","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1037\/h0061470","article-title":"The critical incident technique","volume":"51","author":"Flanagan","journal-title":"Psychol Bull"},{"key":"R34","unstructured":"Brooke J . System Usability Scale (SUS): A Quick-and-Dirty Method of System Evaluation User Information. Vol 43. Digital Equipment Co Ltd; 1986:1-7. URL: https:\/\/hell.meiert.org\/core\/pdf\/sus.pdf [Accessed 24-09-2026]"},{"issue":"2","key":"R35","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1080\/10447318.2012.681221","article-title":"Usability ratings for everyday products measured with the System Usability Scale","volume":"29","author":"Kortum","journal-title":"Int J Hum Comput Interact"},{"issue":"9","key":"R36","doi-asserted-by":"publisher","first-page":"1724","DOI":"10.1016\/j.pec.2020.03.018","article-title":"Patients\u2019 understanding of oncology clinical endpoints: a literature review","volume":"103","author":"Boudewyns","journal-title":"Patient Educ Couns"},{"issue":"8","key":"R37","doi-asserted-by":"publisher","first-page":"509","DOI":"10.6061\/clinics\/2014(08)02","article-title":"Treatment priorities in oncology: do we want to live longer or better?","volume":"69","author":"Marta","journal-title":"Clinics (Sao Paulo)"},{"issue":"1","key":"R38","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1002\/pon.921","article-title":"Does it hurt to know the worst?--psychological morbidity, information preferences and understanding of prognosis in patients with advanced cancer","volume":"15","author":"Barnett","journal-title":"Psychooncology"},{"issue":"9","key":"R39","doi-asserted-by":"publisher","first-page":"4081","DOI":"10.1002\/cam4.2331","article-title":"Advanced cancer patients\u2019 understanding of prognostic information: applying insights from psychological research","volume":"8","author":"Derry","journal-title":"Cancer Med"},{"key":"R40","doi-asserted-by":"publisher","DOI":"10.31661\/gmj.v13i.3327","article-title":"The impact of cancer on mental health and the importance of supportive services","volume":"13","author":"Fereidouni","journal-title":"Galen Med J"},{"key":"R41","doi-asserted-by":"crossref","unstructured":"Zacharia M Karekla M . The role of psychologists and psychological approaches in cancer care. In: Kassianos AP , editor. In Handbook of Quality of Life in Cancer. Springer International Publishing; 2022:311-337. [doi: 10.1007\/978-3-030-84702-9_19]","DOI":"10.1007\/978-3-030-84702-9_19"},{"issue":"4","key":"R42","doi-asserted-by":"publisher","first-page":"921","DOI":"10.1080\/09515089.2022.2147422","article-title":"Affective scaffolding and chronic illness","volume":"37","author":"Byrne","journal-title":"Philos Psychol"},{"issue":"12","key":"R43","doi-asserted-by":"publisher","first-page":"1625","DOI":"10.1038\/sj.bjc.6604091","article-title":"Adjusting to life after treatment: distress and quality of life following treatment for breast cancer","volume":"97","author":"Costanzo","journal-title":"Br J Cancer"},{"issue":"1","key":"R44","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1111\/ecc.12274","article-title":"\u201cGetting back to normal\u201d or \u201ca new type of normal\u201d? A qualitative study of patients\u2019 responses to the existential threat of cancer","volume":"25","author":"Baker","journal-title":"Eur J Cancer Care (Engl)"},{"issue":"11","key":"R45","doi-asserted-by":"publisher","first-page":"1148","DOI":"10.1002\/pon.1669","article-title":"Use of formal and informal mental health resources by cancer survivors: differences between rural and nonrural survivors and a preliminary test of the theory of planned behavior","volume":"19","author":"Andrykowski","journal-title":"Psychooncology"},{"issue":"3","key":"R46","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1046\/j.1440-1584.2000.00303.x","article-title":"How definition of mental health problems can influence help seeking in rural and remote communities","volume":"8","author":"Fuller","journal-title":"Aust J Rural Health"},{"issue":"2","key":"R47","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1037\/prj0000138","article-title":"How are perceived stigma, self-stigma, and self-reliance related to treatment-seeking? A three-path model","volume":"38","author":"Jennings","journal-title":"Psychiatr Rehabil J"},{"issue":"5","key":"R48","doi-asserted-by":"publisher","first-page":"371","DOI":"10.1191\/0269216305pm1038oa","article-title":"Existential issues do not necessarily result in existential suffering: lessons from cancer patients in Israel","volume":"19","author":"Blinderman","journal-title":"Palliat Med"},{"issue":"2","key":"R49","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1097\/SPC.0b013e3283530e25","article-title":"An existential approach to oncology: meeting the needs of our patients","volume":"6","author":"Wexler","journal-title":"Curr Opin Support Palliat Care"},{"issue":"4","key":"R50","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1016\/j.ijmedinf.2007.04.008","article-title":"Distributed cognition: an alternative model of cognition for medical informatics","volume":"77","author":"Hazlehurst","journal-title":"Int J Med Inform"},{"issue":"2-3","key":"R51","doi-asserted-by":"publisher","first-page":"160","DOI":"10.14740\/jcs275w","article-title":"Redesigning informed consent: enhancing risk communication through a novel risk visualization tool","volume":"5","author":"Arthur","journal-title":"J Curr Surg"},{"key":"R52","unstructured":"Sauro J . Measuring usability with the System Usability Scale (SUS). MeasuringU. 2025. URL: https:\/\/measuringu.com\/sus\/ [Accessed 16-09-2026]"}],"container-title":["JMIR Human Factors"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T20:14:46Z","timestamp":1790799286000},"score":1,"resource":{"primary":{"URL":"https:\/\/humanfactors.jmir.org\/2026\/1\/e86725"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,30]]},"references-count":52,"URL":"https:\/\/doi.org\/10.2196\/86725","relation":{},"ISSN":["2292-9495"],"issn-type":[{"value":"2292-9495","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,30]]},"article-number":"v13i10e86725"}}