{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T16:07:16Z","timestamp":1781626036094,"version":"3.54.5"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,12,22]],"date-time":"2025-12-22T00:00:00Z","timestamp":1766361600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,12,22]],"date-time":"2025-12-22T00:00:00Z","timestamp":1766361600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000156","name":"Fonds de Recherche du Qu\u00e9bec - Sant\u00e9","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000156","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000024","name":"Canadian Institutes of Health Research","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000024","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Unit\u00e9 de soutien SSA Qu\u00e9bec"},{"DOI":"10.13039\/501100003151","name":"Fonds de recherche du Qu\u00e9bec \u2013 Nature et technologies","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003151","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000024","name":"Canadian Institutes of Health Research,Canada","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000024","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Res Involv Engagem"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Uses of large language models (LLMs) in health chatbots are expanding into high-stakes clinical contexts, heightening the need for tools that are evidence-based, accountable, accurate, and patient-centred. This conceptual, practice-informed Perspective reflects on engaging patients and non-academic partners for the responsible integration of LLMs, grounded in the co-construction of MARVIN (for people living with HIV) and in an emerging collaboration with MIT Critical Data. Organised by the Software Development Life Cycle, we describe: conception\/needs assessment with patient partners to identify use cases, acceptable trade-offs, and privacy expectations; development that prioritises grounding via vetted sources, structured human feedback, and data-validation committees including patient partners; testing and evaluation using patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs) chosen in collaboration with patients to capture usability, acceptability, trust, and perceived safety, alongside task performance and harmful-output monitoring; and implementation via diverse governance boards, knowledge-mobilisation materials to set expectations, and risk-management pathways for potentially unsafe outputs. Based on our experience with MARVIN, we recommend early and continuous engagement of patients and non-academic partners, fair compensation, shared decision-making power, transparent decision logging, and inclusive, adaptable governance that can evolve with changing models and standards. These lessons highlight how patient partnership can directly shape chatbot design and oversight, helping teams align LLM-enabled tools with patient-centred goals while building accountable, safe, and equitable systems.<\/jats:p>","DOI":"10.1186\/s40900-025-00804-1","type":"journal-article","created":{"date-parts":[[2025,12,22]],"date-time":"2025-12-22T10:59:29Z","timestamp":1766401169000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Perspective on patient and non-academic partner engagement for the responsible integration of large language models in health chatbots"],"prefix":"10.1186","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6213-0316","authenticated-orcid":false,"given":"Nikhil","family":"Jaiswal","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4048-1705","authenticated-orcid":false,"given":"Yuanchao","family":"Ma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1273-9393","authenticated-orcid":false,"given":"Bertrand","family":"Lebouch\u00e9","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6267-6140","authenticated-orcid":false,"given":"Dan","family":"Poenaru","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5180-8139","authenticated-orcid":false,"given":"Marie-Pascale","family":"Pomey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7730-0701","authenticated-orcid":false,"given":"Sofiane","family":"Achiche","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1151-3763","authenticated-orcid":false,"given":"David","family":"Lessard","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8364-7421","authenticated-orcid":false,"given":"Kim","family":"Engler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zully","family":"Montiel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hector","family":"Acevedo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9600-6228","authenticated-orcid":false,"given":"Rodrigo Rosa","family":"Gameiro","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6712-6626","authenticated-orcid":false,"given":"Leo Anthony","family":"Celi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5590-8866","authenticated-orcid":false,"given":"Esli","family":"Osmanlliu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,12,22]]},"reference":[{"issue":"1","key":"804_CR1","doi-asserted-by":"publisher","first-page":"e40789","DOI":"10.2196\/40789","volume":"25","author":"A Aggarwal","year":"2023","unstructured":"Aggarwal A, Tam CC, Wu D, Li X, Qiao S. Artificial Intelligence\u2013Based chatbots for promoting health behavioral changes: systematic review. J Med Internet Res. 2023;25(1):e40789. https:\/\/doi.org\/10.2196\/40789","journal-title":"J Med Internet Res"},{"issue":"1","key":"804_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-022-00560-6","volume":"5","author":"P Parmar","year":"2022","unstructured":"Parmar P, Ryu J, Pandya S, Sedoc J, Agarwal S. Health-focused conversational agents in person-centred care: a review of apps. Npj Digit Med. 2022;5(1):1\u20139. https:\/\/doi.org\/10.1038\/s41746-022-00560-6","journal-title":"Npj Digit Med"},{"issue":"10377","key":"804_CR3","doi-asserted-by":"publisher","first-page":"641","DOI":"10.1016\/S0140-6736(23)00216-7","volume":"401","author":"A Arora","year":"2023","unstructured":"Arora A, Arora A. The promise of large Language models in health care. Lancet. 2023;401(10377):641.","journal-title":"Lancet"},{"issue":"1","key":"804_CR4","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1038\/s43856-024-00717-2","volume":"5","author":"F Busch","year":"2025","unstructured":"Busch F, Hoffmann L, Rueger C, van Dijk EH, Kader R, Ortiz-Prado E, et al. Current applications and challenges in large Language models for patient care: a systematic review. Commun Med. 2025;5(1):26.","journal-title":"Commun Med"},{"key":"804_CR5","doi-asserted-by":"crossref","unstructured":"Thirunavukarasu AJ, Ting DSJ, Elangovan K, Gutierrez L, Tan TF, Ting DSW. Large language models in medicine. Nat Med. 2023.","DOI":"10.1038\/s41591-023-02448-8"},{"key":"804_CR6","unstructured":"Organization WH. Ethics and governance of artificial intelligence for health: large multi-modal models. WHO guidance. World Health Organization; 2024."},{"issue":"2","key":"804_CR7","doi-asserted-by":"publisher","first-page":"e2457879","DOI":"10.1001\/jamanetworkopen.2024.57879","volume":"8","author":"B Huo","year":"2025","unstructured":"Huo B, Boyle A, Marfo N, Tangamornsuksan W, Steen JP, McKechnie T, et al. Large Language models for chatbot health advice studies: a systematic review. JAMA Netw Open. 2025;8(2):e2457879\u20132457879.","journal-title":"JAMA Netw Open"},{"issue":"4","key":"804_CR8","first-page":"181","volume":"10","author":"HP Silva","year":"2020","unstructured":"Silva HP, Lefebvre AA, Oliveira RR, Lehoux P. Fostering responsible innovation in health: an evidenceinformed assessment tool for innovation stakeholders. Int J Health Policy Manag. 2020;10(4):181\u201391.","journal-title":"Int J Health Policy Manag"},{"issue":"5","key":"804_CR9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pdig.0000492","volume":"3","author":"T Nadarzynski","year":"2024","unstructured":"Nadarzynski T, Knights N, Husbands D, Graham CA, Llewellyn CD, Buchanan T, et al. Achieving health equity through conversational AI: A roadmap for design and implementation of inclusive chatbots in healthcare. PLOS Digit Health. 2024;3(5):1\u201322.","journal-title":"PLOS Digit Health"},{"issue":"1","key":"804_CR10","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1186\/s40900-022-00374-6","volume":"8","author":"E Osmanlliu","year":"2022","unstructured":"Osmanlliu E, Paquette J, Grenier AD, Lewis P, Bouthillier ME, B\u00e9dard S, et al. Fantastic perspectives and where to find them: involving patients and citizens in digital health research. Res Involv Engagem. 2022;8(1):37.","journal-title":"Res Involv Engagem"},{"issue":"8","key":"804_CR11","doi-asserted-by":"publisher","first-page":"626","DOI":"10.1136\/bmjqs-2015-004839","volume":"25","author":"J Ocloo","year":"2016","unstructured":"Ocloo J, Matthews R. From tokenism to empowerment: progressing patient and public involvement in healthcare improvement. BMJ Qual Saf. 2016;25(8):626\u201332.","journal-title":"BMJ Qual Saf"},{"key":"804_CR12","unstructured":"Strategy for Patient-Oriented Research - Patient Engagement Framework [Internet]. Canadian Institutes of Health Research. 2019. Available from: https:\/\/cihr-irsc.gc.ca\/e\/48413.html."},{"issue":"1 Suppl","key":"804_CR13","first-page":"S41","volume":"27","author":"MP Pomey","year":"2015","unstructured":"Pomey MP, Flora L, Karazivan P, Dumez V, Lebel P, Vanier MC, et al. [The Montreal model: the challenges of a partnership relationship between patients and healthcare professionals]. Sante Publique. 2015;27(1 Suppl):S41\u201350.","journal-title":"Sante Publique"},{"key":"804_CR14","unstructured":"Charles-Le Moyne Research Center SU. Purpose and principles | engage [Internet]. [cited 2025 Feb 12]. Available from: https:\/\/engageplus.org\/en\/objectifs-mission.asp."},{"issue":"3","key":"804_CR15","first-page":"290","volume":"34","author":"DL Hahn","year":"2017","unstructured":"Hahn DL, Hoffmann AE, Felzien M, LeMaster JW, Xu J, Fagnan LJ. Tokenism in patient engagement. Fam Pract. 2017;34(3):290\u20135.","journal-title":"Fam Pract"},{"issue":"1","key":"804_CR16","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1186\/s12910-022-00761-4","volume":"23","author":"B Groot","year":"2022","unstructured":"Groot B, Abma T. Ethics framework for citizen science and public and patient participation in research. BMC Med Ethics. 2022;23(1):23.","journal-title":"BMC Med Ethics"},{"key":"804_CR17","doi-asserted-by":"publisher","unstructured":"Ma Y, Achiche S, Tu G, Vicente S, Lessard D, Engler K, et al. The first AI-based chatbot to promote HIV self-management: a mixed methods usability study. HIV Medicine [Internet]. [cited 2024 Dec 21];n\/a(n\/a). Available from: https:\/\/onlinelibrary.wiley.com\/doi\/abs\/. https:\/\/doi.org\/10.1111\/hiv.13720","DOI":"10.1111\/hiv.13720"},{"key":"804_CR18","doi-asserted-by":"publisher","first-page":"e54668","DOI":"10.2196\/54668","volume":"13","author":"Y Ma","year":"2024","unstructured":"Ma Y, Achiche S, Pomey MP, Paquette J, Adjtoutah N, Vicente S, et al. Adapting and evaluating an AI-Based chatbot through patient and stakeholder engagement to provide information for different health conditions: master protocol for an adaptive platform trial (the MARVIN chatbots Study). JMIR Res Protoc. 2024;13:e54668. https:\/\/doi.org\/10.2196\/54668","journal-title":"JMIR Res Protoc"},{"issue":"2","key":"804_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1542\/pedsos.2025-000485","volume":"1","author":"N Jaiswal","year":"2025","unstructured":"Jaiswal N, Ma Y, Lebouch\u00e9 B, Poenaru D, Osmanlliu E, PedMedQA. Comparing large Language model accuracy in pediatric and adult medicine. Pediatr Open Sci. 2025;1(2):1\u20133. https:\/\/doi.org\/10.1542\/pedsos.2025-000485","journal-title":"Pediatr Open Sci"},{"issue":"6","key":"804_CR20","doi-asserted-by":"publisher","first-page":"e045105","DOI":"10.1136\/bmjopen-2020-045105","volume":"11","author":"M Calvert","year":"2021","unstructured":"Calvert M, King M, Mercieca-Bebber R, Aiyegbusi O, Kyte D, Slade A, et al. SPIRIT-PRO extension explanation and elaboration: guidelines for inclusion of patient-reported outcomes in protocols of clinical trials. BMJ Open. 2021;11(6):e045105.","journal-title":"BMJ Open"},{"issue":"3","key":"804_CR21","doi-asserted-by":"publisher","first-page":"650","DOI":"10.1038\/s41591-024-02827-9","volume":"30","author":"OL Aiyegbusi","year":"2024","unstructured":"Aiyegbusi OL, Cruz Rivera S, Roydhouse J, Kamudoni P, Alder Y, Anderson N, et al. Recommendations to address respondent burden associated with patient-reported outcome assessment. Nat Med. 2024;30(3):650\u20139.","journal-title":"Nat Med"},{"issue":"3","key":"804_CR22","doi-asserted-by":"publisher","first-page":"e160","DOI":"10.1016\/S2589-7500(22)00249-7","volume":"5","author":"FJ Pearce","year":"2023","unstructured":"Pearce FJ, Rivera SC, Liu X, Manna E, Denniston AK, Calvert MJ. The role of patient-reported outcome measures in trials of artificial intelligence health technologies: a systematic evaluation of ClinicalTrials.gov records (1997\u20132022). Lancet Digit Health. 2023;5(3):e160\u20137.","journal-title":"Lancet Digit Health"},{"key":"804_CR23","unstructured":"MIT Critical Data. An ecosystem that improves healthcare with data science [Internet]. Available from: https:\/\/criticaldata.mit.edu."},{"issue":"333","key":"804_CR24","doi-asserted-by":"publisher","first-page":"ps3338","DOI":"10.1126\/scitranslmed.aad9072","volume":"8","author":"J Aboab","year":"2016","unstructured":"Aboab J, Celi LA, Charlton P, Feng M, Ghassemi M, Marshall DC, et al. A datathon model to support cross-disciplinary collaboration. Sci Transl Med. 2016;8(333):ps3338\u20133338.","journal-title":"Sci Transl Med"},{"issue":"1","key":"804_CR25","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1186\/s12874-018-0636-1","volume":"18","author":"MC Sendall","year":"2018","unstructured":"Sendall MC, McCosker LK, Brodie A, Hill M, Crane P. Participatory action research, mixed methods, and research teams: learning from philosophically juxtaposed methodologies for optimal research outcomes. BMC Med Res Methodol. 2018;18(1):167.","journal-title":"BMC Med Res Methodol"},{"key":"804_CR26","unstructured":"Canadian Institutes of Health Research, Government of Canada. Considerations when paying patient partners in research - CIHR [Internet]. 2019 [cited 2025 Jan 7]. Available from: https:\/\/cihr-irsc.gc.ca\/e\/51466.html"},{"key":"804_CR27","unstructured":"Quebec Strategy for Patient-Oriented Research (SPOR) Support Unit (Unit\u00e9 de soutien SSA Qu\u00e9bec). [Guiding principles - Financial compensation for research research in partnership with patients and the public.] [Internet]. 2018. Available from: https:\/\/ceppp.ca\/wp-content\/uploads\/2021\/01\/USSQ_Principes-directeurs_Dedommagement_vAo\u00fbt2018.pdf."}],"container-title":["Research Involvement and Engagement"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40900-025-00804-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40900-025-00804-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40900-025-00804-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T15:34:25Z","timestamp":1781624065000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s40900-025-00804-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,22]]},"references-count":27,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["804"],"URL":"https:\/\/doi.org\/10.1186\/s40900-025-00804-1","relation":{},"ISSN":["2056-7529"],"issn-type":[{"value":"2056-7529","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,22]]},"assertion":[{"value":"15 April 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 October 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 December 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The MARVIN Chatbots Study has been reviewed and approved by the McGill University Health Centre Research Ethics Board (MUHC REB) under master protocol MP-37-2023-9333.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"143"}}