{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T19:08:33Z","timestamp":1789067313620,"version":"build-2803163510"},"reference-count":52,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n To provide patients with gastric cancer with adequate health education information for effective overall management is crucial, while traditional manners exposed certain challenges. Conversational agents have increasingly been adopted for health care use to provide innovative solutions for patient education.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to develop a health education embodied conversational agent to focus on gastric cancer disease using an action research approach and test its accuracy, usability, and user experience among patients and other related stakeholders.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n \n The AI-guided conversational agent was developed based on the OpenMEDLab 2.0 foundation model and the Retrieval-Augmented Generation (RAG) architecture. A 4-phase action research approach was adopted to implement this system at a gastric cancer center in China. Diagnose and plan phase used participatory observation and in-depth interviews to explore current health education models and patients\u2019 needs for health education. Act and implement phase was used to develop and deploy the conversational agent. Evaluate phase comprised 3 rounds of alpha testing to assess accuracy and RAG knowledge hit rate, and 1 round of beta testing to assess the usability and relevance. Reflect phase conducted in-depth interviews to gain insights into users' experiences. Data collection was conducted from September 2023 through April 2025. Participants include patients, clinical nurses, nursing managers, surgeons, clinical psychologists, and dietitians. Thematic analysis and multiple-group chi-square tests were performed, respectively, for qualitative and quantitative data. A 2-sided\n P<\/jats:italic>\n value of <.05 was considered statistically significant.\n <\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n A total of 44 patients, 13 nurses, 3 nursing managers, 2 surgeons, 1 clinical psychologist, and 1 dietitian were recruited during the study procedure. Favorable outcomes in terms of accuracy and usability were achieved. The accuracy of the agent in 3 rounds was 67% (37\/55), 71% (44\/62), and 82% (31\/38), respectively; RAG knowledge hit rates reached 86% (47\/55), 98% (61\/62), and 100% (38\/38). Significant differences (\n P<\/jats:italic>\n <.01) in RAG knowledge hit rates were observed. The mean chatbot usability questionnaire score was 91.9 (SD 3.6), while the mean content relevance score was 3.75 (SD 0.9). Three themes of user experiences were identified: perceived usefulness, ease of use, and intention to use, revealing potential in reducing staff workload and reinforcing patient education.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n This study provided insights into how the action research approach can inform the development and usability assessment of a gastric cancer health education conversational agent, also illustrating the value of RAG technology. Additional assessments and improvements are warranted to confirm the effectiveness and safety.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/82746","type":"journal-article","created":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T18:56:13Z","timestamp":1789066573000},"page":"e82746-e82746","source":"Crossref","is-referenced-by-count":0,"title":["Development and Usability Assessment of a Health Education Conversational Agent for Patients With Gastric Cancer: Action Research Study"],"prefix":"10.2196","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-2216-3820","authenticated-orcid":false,"given":"YiChen","family":"Kang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1778-5508","authenticated-orcid":false,"given":"YaMin","family":"Yan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-0242-2861","authenticated-orcid":false,"given":"TianXiao","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-9455-2437","authenticated-orcid":false,"given":"ZhengHong","family":"Yu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6859-4349","authenticated-orcid":false,"given":"Yan","family":"Hu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-6089-9551","authenticated-orcid":false,"given":"ZhiXun","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2019-8312","authenticated-orcid":false,"given":"JiYang","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8087-6461","authenticated-orcid":false,"given":"Jos M","family":"Latour","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4419-7004","authenticated-orcid":false,"given":"YuXia","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,9,10]]},"reference":[{"issue":"3","key":"R1","doi-asserted-by":"publisher","first-page":"229","DOI":"10.3322\/caac.21834","article-title":"Global cancer statistics 2022: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries","volume":"74","author":"Bray","journal-title":"CA Cancer J Clin"},{"issue":"2","key":"R2","doi-asserted-by":"publisher","first-page":"872","DOI":"10.3390\/curroncol31020065","article-title":"Quality of life following the surgical management of gastric cancer using patient-reported outcomes: a systematic review","volume":"31","author":"Vallance","journal-title":"Curr Oncol"},{"issue":"10","key":"R3","doi-asserted-by":"publisher","first-page":"10633","DOI":"10.21037\/apm-21-2420","article-title":"The effect of health education on the quality of life of postoperative patients with gastric cancer: a systematic review and meta-analysis","volume":"10","author":"Zhao","journal-title":"Ann Palliat Med"},{"issue":"4","key":"R4","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1007\/s13187-024-02430-z","article-title":"Fewer feedback opportunities and health perception of gastric cancer survivors: opportunities for patient education","volume":"39","author":"Kim","journal-title":"J Canc Educ"},{"issue":"12","key":"R5","doi-asserted-by":"publisher","DOI":"10.3390\/healthcare9121740IF:3.4Q1B4","article-title":"Online health information seeking behavior: A systematic review","volume":"9","author":"Jia","journal-title":"Healthcare (Basel)"},{"issue":"9","key":"R6","doi-asserted-by":"publisher","first-page":"1248","DOI":"10.1093\/jamia\/ocy072","article-title":"Conversational agents in healthcare: a systematic review","volume":"25","author":"Laranjo","journal-title":"J Am Med Inform Assoc"},{"issue":"1813-4","key":"R7","doi-asserted-by":"publisher","first-page":"1813","DOI":"10.3233\/SHTI190661","article-title":"Intelligent conversational agents in patient self-management: a systematic survey using multi data sources","volume":"264","author":"Xing","journal-title":"Stud Health Technol Inform"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijnurstu.2024.104991","article-title":"Conversational agents in physical and psychological symptom management: a systematic review of randomized controlled trials","volume":"163","author":"Yang","journal-title":"Int J Nurs Stud"},{"key":"R9","doi-asserted-by":"publisher","DOI":"10.2196\/46128","article-title":"Feasibility of a text messaging-integrated and chatbot-interfaced self-management program for symptom control in patients with gastrointestinal cancer undergoing chemotherapy: pilot mixed methods study","volume":"7","author":"Gomaa","journal-title":"JMIR Form Res"},{"issue":"4","key":"R10","doi-asserted-by":"publisher","first-page":"827","DOI":"10.1007\/s13193-024-02145-z","article-title":"AI chatbots in oncology: a comparative study of sider fusion AI and perplexity AI for gastric cancer patients","volume":"16","author":"Naseri","journal-title":"Indian J Surg Oncol"},{"issue":"5","key":"R11","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1177\/01410768231173123","article-title":"Large language models will not replace healthcare professionals: curbing popular fears and hype","volume":"116","author":"Thirunavukarasu","journal-title":"J R Soc Med"},{"issue":"1","key":"R12","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1038\/s44387-025-00047-1","volume":"1","author":"Zhou","journal-title":"NPJ Artif Intell"},{"issue":"8","key":"R13","doi-asserted-by":"publisher","DOI":"10.2196\/17158","article-title":"Conversational agents in health care: scoping review and conceptual analysis","volume":"22","author":"Tudor Car","journal-title":"J Med Internet Res"},{"issue":"1","key":"R14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s41019-025-00335-5","article-title":"Retrieval-augmented generation for ai-generated content: a survey","volume":"11","author":"Zhao","journal-title":"Data Sci Eng"},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.3389\/fmed.2024.1392555","article-title":"GastroBot: a Chinese gastrointestinal disease chatbot based on the retrieval-augmented generation","volume":"11","author":"Zhou","journal-title":"Front Med (Lausanne)"},{"key":"R16","doi-asserted-by":"crossref","unstructured":"Williamson GR Bellman L Webster J . Action Research in Nursing and Healthcare. SAGE Publications; 2011. [doi: 10.4135\/9781446289112] ISBN: 9781446254295","DOI":"10.4135\/9781446289112"},{"key":"R17","unstructured":"McNiff J . Action Research: All You Need to Know. SAGE Publications; 2017. ISBN: 9781473967472"},{"issue":"4","key":"R18","doi-asserted-by":"publisher","first-page":"1003","DOI":"10.11124\/JBISRIR-2016-003200","article-title":"Action research in the healthcare field: a scoping review","volume":"16","author":"Cordeiro","journal-title":"JBI Database System Rev Implement Rep"},{"issue":"6","key":"R19","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1177\/0840470416658905","article-title":"Action research healthcare: focus on patients, improve quality, drive down costs","volume":"29","author":"Bradbury","journal-title":"Healthc Manage Forum"},{"issue":"1","key":"R20","doi-asserted-by":"publisher","DOI":"10.2196\/31795","article-title":"Best practices and lessons learned for action research in eHealth design and implementation: literature review","volume":"24","author":"Oberschmidt","journal-title":"J Med Internet Res"},{"key":"R21","doi-asserted-by":"publisher","DOI":"10.2196\/45259","article-title":"Improvement, implementation, and evaluation of the CMyLife digital care platform: participatory action research approach","volume":"25","author":"Verweij","journal-title":"J Med Internet Res"},{"issue":"1","key":"R22","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-022-08020-3","article-title":"A comprehensive eHealth implementation guide constructed on a qualitative case study on barriers and facilitators of the digital care platform CMyLife","volume":"22","author":"Verweij","journal-title":"BMC Health Serv Res"},{"issue":"4","key":"R23","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1111\/j.1540-4560.1946.tb02295.x","article-title":"Action research and minority problems","volume":"2","author":"Lewin","journal-title":"J Soc Issues"},{"issue":"6","key":"R24","doi-asserted-by":"publisher","first-page":"923","DOI":"10.1007\/s11213-023-09635-1","article-title":"Towards a checklist for improving action research quality in healthcare contexts","volume":"36","author":"Casey","journal-title":"Syst Pract Action Res"},{"issue":"3","key":"R25","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1136\/ebnurs-2019-103145","article-title":"Triangulation in research, with examples","volume":"22","author":"Noble","journal-title":"Evid Based Nurs"},{"key":"R26","doi-asserted-by":"crossref","unstructured":"Blevins MD . The SAGE Encyclopedia of Communication Research Methods. SAGE Publications, Inc; 2017. [doi: 10.4135\/9781483381411.n293]","DOI":"10.4135\/9781483381411.n293"},{"key":"R27","doi-asserted-by":"crossref","unstructured":"Holmes S Moorhead A Bond R Zheng H Coates V Mctear M . Usability Testing of a Healthcare Chatbot: Can We Use Conventional Methods to Assess Conversational User Interfaces? ACM; 2019:207-214. ISBN: 978-1-4503-7166-7","DOI":"10.1145\/3335082.3335094"},{"key":"R28","unstructured":"Gan A Yu H Zhang K Liu Q Yan W Huang Z et al. Retrieval augmented generation evaluation in the era of large language models: a comprehensive survey. arXiv. Preprint posted online on Apr 21, 2025. [doi: 10.48550\/arXiv.2504.14891]"},{"key":"R29","doi-asserted-by":"crossref","unstructured":"Bauer M . Classical content analysis: a review. In: Qualitative Researching with Text, Image and Sound: A Practical Handbook. Sage Publications; 2000:131-151. [doi: 10.4135\/9781849209731.n8]","DOI":"10.4135\/9781849209731.n8"},{"key":"R30","unstructured":"The chatbot usability questionnaire (CUQ). Ulster University. URL: https:\/\/www.ulster.ac.uk\/research\/topic\/computer-science\/artificial-intelligence\/projects\/cuq [Accessed 17-08-2026]"},{"key":"R31","unstructured":"Wang X Zhang X Wang G He J Li Z Zhu W et al. OpenMEDLab: an open-source platform for multi-modality foundation models in medicine. arXiv. Preprint posted online on Feb 28, 2024. [doi: 10.48550\/arXiv.2402.18028]"},{"issue":"5","key":"R32","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1177\/1054773819845824","article-title":"Virtual reality and avatars in health care","volume":"28","author":"O\u2019Connor","journal-title":"Clin Nurs Res"},{"issue":"3","key":"R33","doi-asserted-by":"publisher","DOI":"10.1093\/jamiaopen\/ooad073","article-title":"A chatbot for hypertension self-management support: user-centered design, development, and usability testing","volume":"6","author":"Griffin","journal-title":"JAMIA Open"},{"issue":"01","key":"R34","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1142\/S1793351X08000348","article-title":"The role of gesture in document explanation by embodied conversational agents","volume":"02","author":"Bickmore","journal-title":"Int J Semantic Computing"},{"key":"R35","doi-asserted-by":"publisher","DOI":"10.4103\/jehp.jehp_218_22","article-title":"Health education and global health: Practices, applications, and future research","volume":"11","author":"Rizvi","journal-title":"J Educ Health Promot"},{"issue":"2","key":"R36","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1177\/1559827619892547","article-title":"Utilizing digital health technologies for patient education in lifestyle medicine","volume":"14","author":"Kuwabara","journal-title":"Am J Lifestyle Med"},{"issue":"12","key":"R37","doi-asserted-by":"publisher","DOI":"10.2196\/22947","article-title":"Integrated digital patient education at the bedside for patients with chronic conditions: observational study","volume":"8","author":"Schooley","journal-title":"JMIR Mhealth Uhealth"},{"issue":"3","key":"R38","doi-asserted-by":"publisher","DOI":"10.2196\/24926","article-title":"Developing a web-based shared decision-making tool for fertility preservation among reproductive-age women with breast cancer: an action research approach","volume":"23","author":"Tseng","journal-title":"J Med Internet Res"},{"issue":"7","key":"R39","doi-asserted-by":"publisher","DOI":"10.1016\/S2589-7500(23)00114-0","article-title":"Digital health equity for older populations","volume":"5","author":"The Lancet Digital Health","journal-title":"Lancet Digit Health"},{"issue":"1","key":"R40","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/j.pec.2004.09.008","article-title":"Establishing the computer-patient working alliance in automated health behavior change interventions","volume":"59","author":"Bickmore","journal-title":"Patient Educ Couns"},{"key":"R41","doi-asserted-by":"publisher","DOI":"10.2196\/43068","article-title":"A medical ethics framework for conversational artificial intelligence","volume":"25","author":"Fournier-Tombs","journal-title":"J Med Internet Res"},{"key":"R42","doi-asserted-by":"publisher","DOI":"10.1097\/PHH.0000000000000363","article-title":"Health equity is the issue we have been waiting for","volume":"22 Suppl 1","author":"Kumanyika","journal-title":"J Public Health Manag Pract"},{"key":"R43","doi-asserted-by":"crossref","unstructured":"Batani J Mbunge E Leokana L . A deep learning-based chatbot to enhance maternal health education. In: Batani J Mbunge E Leokana L , editors. Presented at: 2024 Conference on Information Communications Technology and Society (ICTAS); Mar 7-8, 2024; Durban, South Africa. [doi: 10.1109\/ICTAS59620.2024.10507149]","DOI":"10.1109\/ICTAS59620.2024.10507149"},{"issue":"9","key":"R44","doi-asserted-by":"publisher","first-page":"2803","DOI":"10.1007\/s11606-021-06789-3","article-title":"Directing research toward health equity: a health equity research impact assessment","volume":"36","author":"Castillo","journal-title":"J Gen Intern Med"},{"key":"R45","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-publhealth-040119-094119","article-title":"Addressing health equity in public health practice: frameworks, promising strategies, and measurement considerations","volume":"41","author":"Liburd","journal-title":"Annu Rev Public Health"},{"key":"R46","doi-asserted-by":"publisher","DOI":"10.2196\/60205","article-title":"User and provider experiences with health education chatbots: qualitative systematic review","volume":"12","author":"Choi","journal-title":"JMIR Hum Factors"},{"key":"R47","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2024.105640","article-title":"A conversational agent for enhanced self-management after cardiothoracic surgery","volume":"192","author":"Martins","journal-title":"Int J Med Inform"},{"issue":"11","key":"R48","doi-asserted-by":"publisher","first-page":"829","DOI":"10.1097\/CIN.0000000000001153","article-title":"A question answering chatbot for gastric cancer patients after curative gastrectomy: Development and evaluation of user experience and performance","volume":"42","author":"Kim","journal-title":"Comput Inform Nurs"},{"key":"R49","doi-asserted-by":"publisher","DOI":"10.2196\/47134","article-title":"Embodied conversational agents for chronic diseases: scoping review","volume":"26","author":"Jiang","journal-title":"J Med Internet Res"},{"key":"R50","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2025.3566698","article-title":"Embodied conversational agents in extended reality: a systematic review","volume":"13","author":"Yang","journal-title":"IEEE Access"},{"key":"R51","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.111050","article-title":"Systematic literature review of validation methods for AI systems","volume":"181","author":"Myllyaho","journal-title":"J Syst Softw"},{"issue":"3","key":"R52","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1016\/j.gande.2023.06.002","article-title":"Role of chatbots on gastroenterology: Let\u2019s chat about the future","volume":"1","author":"Li","journal-title":"Gastrointest Endosc"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T18:56:16Z","timestamp":1789066576000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2026\/1\/e82746"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,10]]},"references-count":52,"URL":"https:\/\/doi.org\/10.2196\/82746","relation":{},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,10]]},"article-number":"v28i3e82746"}}