{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T03:48:33Z","timestamp":1787024913701,"version":"build-2736575974"},"reference-count":80,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>The integration of artificial intelligence in health care presents a significant opportunity to revolutionize patient care. In the United States, an estimated 129 million people have at least 1 chronic illness, with 42% having 2 or more. Despite being largely preventable, the prevalence of chronic illness is expected to rise and impose significant economic burdens and financial toxicity on health care consumers.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>We leveraged an interdisciplinary team encompassing nursing, public health, and computer science to optimize health through prevention education for cardiovascular and metabolic comorbidities in persons living with HIV. In this tutorial, we describe the iterative, data-based development and evaluation of an intersectionality-informed large language model designed to support patient teaching in this population.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>First, we curated data by scraping publicly available, authoritative, evidence-based sources to capture a comprehensive dataset, supplemented by publicly available HIV forum content. Second, we benchmarked candidate large language models and generated a fine-tuning dataset using GPT-4 through multiturn question and answer conversations, using standardized metrics to assess baseline model performance. Third, we iteratively refined the selected model via low-rank adaptation and reinforcement learning, integrating quantitative metrics with qualitative expert evaluations.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Pre-existing large language models (LLMs) demonstrated poor n-gram agreement, dissonance from model answers (accuracy 4.16, readability 4.63, and professionalism 4.58), and difficult readability (Kincaid 8.54 and Jargon 4.44). After prompt adjustments and fine-tuning, preliminary results demonstrate the potential of a customized Llama-based LLM to provide personalized, culturally salient patient education.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>We present a data-based, step-by-step tutorial for interdisciplinary development of CARDIO, a specialized LLM, for cardiovascular health education in HIV care. Through comprehensive data curation and scraping, systematic benchmarking, and a dual-stage fine-tuning pipeline, CARDIO\u2019s performance improved markedly (accuracy 5.0, readability 4.98, professionalism 4.98, Kincaid 7.17, and Jargon 2.92). Although patient pilot testing remains forthcoming, our results demonstrate that targeted data curation, rigorous benchmarking, and iterative fine-tuning have provided a robust evaluation of the model\u2019s potential. By building an LLM tailored to cardiovascular health promotion and patient education, this work lays the foundation for innovative artificial intelligence\u2013driven strategies to manage comorbid conditions in people living with HIV.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/77053","type":"journal-article","created":{"date-parts":[[2025,8,12]],"date-time":"2025-08-12T18:00:06Z","timestamp":1755021606000},"page":"e77053","source":"Crossref","is-referenced-by-count":6,"title":["Interdisciplinary Development and Fine-Tuning of CARDIO, a Large Language Model for Cardiovascular Health Education in HIV Care: Tutorial"],"prefix":"10.2196","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-4302-4941","authenticated-orcid":false,"given":"Ryan","family":"Rullo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3436-7068","authenticated-orcid":false,"given":"Ali","family":"Maatouk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-5644-4879","authenticated-orcid":false,"given":"Tinglin","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-0909-4620","authenticated-orcid":false,"given":"Jialin","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-9007-8592","authenticated-orcid":false,"given":"Weikang","family":"Qiu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9146-8079","authenticated-orcid":false,"given":"Giselle","family":"O'Connor","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1003-0276","authenticated-orcid":false,"given":"Julie","family":"Womack","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1774-8851","authenticated-orcid":false,"given":"Tatiana","family":"Sadak","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-4239-6094","authenticated-orcid":false,"given":"Christine","family":"Rodriguez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4638-7824","authenticated-orcid":false,"given":"Pedro","family":"Carneiro","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-3312-4121","authenticated-orcid":false,"given":"Tania","family":"de Jesus Espinosa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9874-5514","authenticated-orcid":false,"given":"Ami","family":"Marshall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5856-5229","authenticated-orcid":false,"given":"Rex","family":"Ying","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2403-7222","authenticated-orcid":false,"given":"S Raquel","family":"Ramos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,9,12]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","DOI":"10.2196\/53019"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-023-04698-z"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2025.0946"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-024-70073-7"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.1007\/s44163-024-00129-0"},{"key":"ref6","unstructured":"ANA Center for Ethics and Human RightsThe ethical use of artificial intelligence in nursing practice [Position statement]American Nurses Association20222025-08-14https:\/\/www.nursingworld.org\/globalassets\/practiceandpolicy\/nursing-excellence\/ana-position-statements\/the-ethical-use-of-artificial-intelligence-in-nursing-practice_bod-approved-12_20_22.pdf"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.53430\/ijmru.2024.7.2.0036"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000810"},{"key":"ref9","unstructured":"SaadLAmericans' Ratings of U.S. Professions Stay Historically LowGallup20252025-08-14https:\/\/news.gallup.com\/poll\/655106\/americans-ratings-professions-stay-historically-low.aspx"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.1111\/jan.14855"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1016\/j.outlook.2024.102300"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.5888\/pcd21.230267"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1016\/j.mayocpiqo.2023.08.005"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.3390\/nursrep14030143"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.1161\/JAHA.124.038462"},{"key":"ref16","unstructured":"Addressing social determinants of health and chronic diseasesU.S. Centers for Disease Control and Prevention20242025-08-14https:\/\/www.cdc.gov\/health-equity-chronic-disease\/social-determinants-of-health-and-chronic-disease\/index.html"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-025-91794-3"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.1097\/JNC.0000000000000274"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.1097\/JNC.0000000000000230"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.1161\/CIR.0000000000001303"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1161\/CIR.0000000000000914"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1161\/CIR.0000000000001003"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.1161\/JAHA.124.039239"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2025.1529152"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.2196\/57351"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.3390\/nursrep14030143"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.5888\/pcd22.240268"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.3949\/ccjm.92a.24055"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.1177\/14604582241295930"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.1097\/QAI.0000000000003030"},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.1377\/hlthaff.2024.00842"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpbup.2024.100148"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.1109\/seb4sdg60871.2024.10629982"},{"key":"ref34","doi-asserted-by":"publisher","DOI":"10.1007\/s11904-020-00490-6"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2024.2376808"},{"key":"ref36","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpcardiol.2023.102048"},{"key":"ref37","doi-asserted-by":"publisher","DOI":"10.1111\/hiv.13720"},{"key":"ref38","doi-asserted-by":"publisher","DOI":"10.2196\/50182"},{"key":"ref39","author":"Hao, Y","year":"2024","journal-title":"ArXiv. Preprint posted online on September 27, 2024"},{"key":"ref40","doi-asserted-by":"publisher","DOI":"10.1145\/3729479"},{"key":"ref41","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijcard.2020.12.020"},{"key":"ref42","doi-asserted-by":"publisher","DOI":"10.1097\/NOR.0000000000000601"},{"key":"ref43","doi-asserted-by":"publisher","DOI":"10.1111\/jan.14379"},{"key":"ref44","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2023.0070"},{"key":"ref45","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2013.9318"},{"key":"ref46","doi-asserted-by":"publisher","DOI":"10.1308\/rcsann.2025.0014"},{"key":"ref47","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2024.0357"},{"key":"ref48","doi-asserted-by":"publisher","DOI":"10.1097\/JNC.0000000000000468"},{"key":"ref49","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1609\/aies.v7i1.31684","author":"Leidinger, A","year":"2024","journal-title":"Proceedings of the Seventh AAAI\/ACM Conference on AI, Ethics, and Society (AIES-24)"},{"key":"ref50","doi-asserted-by":"publisher","DOI":"10.2105\/AJPH.2020.306006"},{"key":"ref51","doi-asserted-by":"publisher","DOI":"10.17645\/si.7543"},{"key":"ref52","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.44720"},{"key":"ref53","first-page":"8","volume":"1989","author":"Crenshaw, K","year":"1989","journal-title":"U Chi Legal F"},{"issue":"6","key":"ref54","doi-asserted-by":"crossref","first-page":"1241","DOI":"10.2307\/1229039","volume":"43","author":"Crenshaw, K","year":"1991","journal-title":"Stanf Law Rev"},{"key":"ref55","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.129.5.674"},{"key":"ref56","doi-asserted-by":"publisher","DOI":"10.1016\/j.copsyc.2023.101579"},{"key":"ref57","doi-asserted-by":"publisher","DOI":"10.1111\/jftr.12529"},{"key":"ref58","doi-asserted-by":"publisher","DOI":"10.1161\/CIR.0000000000001078"},{"key":"ref59","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1007\/978-3-030-80122-9_18","author":"Shanableh, A","year":"2022","journal-title":"Higher Education in the Arab World: Research and Development"},{"key":"ref60","unstructured":"Features comparisonPyMuPDF20252025-08-14https:\/\/pymupdf.readthedocs.io\/en\/latest\/about.html#license-and-copyright"},{"key":"ref61","unstructured":"FenniakMpypdf 6.0.0PyPI20252025-08-14https:\/\/pypi.org\/project\/pypdf\/"},{"key":"ref62","unstructured":"MarkitdownGitHub20252025-08-14https:\/\/github.com\/microsoft\/markitdown"},{"key":"ref63","author":"Ou, J","year":"2025","journal-title":"ArXiv. Preprint posted online on May 28, 2025"},{"key":"ref64","author":"Qiu, W","year":"2025","journal-title":"ArXiv. Preprint posted online on Jun 6, 2025"},{"key":"ref65","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.findings-acl.348"},{"key":"ref66","author":"Yang, A","year":"2024","journal-title":"ArXiv. Preprint posted online on Jan 3, 2025"},{"key":"ref67","author":"Grattafiori, A","year":"2024","journal-title":"ArXiv. Preprint posted online on Nov 23, 2024"},{"key":"ref68","author":"Achiam, J","year":"2024","journal-title":"ArXiv. Preprint posted online on Mar 4, 2024"},{"key":"ref69","doi-asserted-by":"publisher","DOI":"10.20944\/preprints202411.2377.v1"},{"key":"ref70","author":"Shao, Z","year":"2024","journal-title":"ArXiv. Preprint posted online on Apr 27, 2024"},{"key":"ref71","doi-asserted-by":"publisher","DOI":"10.1007\/s11999-010-1380-y"},{"key":"ref72","doi-asserted-by":"publisher","DOI":"10.1177\/009286150804200411"},{"key":"ref73","doi-asserted-by":"publisher","DOI":"10.3390\/computers12020037"},{"key":"ref74","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073135"},{"key":"ref75","doi-asserted-by":"publisher","DOI":"10.3115\/1626355.1626389"},{"key":"ref76","first-page":"74","author":"Lin, CY","year":"2004","journal-title":"InText Summarization Branches Out"},{"key":"ref77","doi-asserted-by":"publisher","DOI":"10.3779\/j.issn.1009-3419.2025.102.11"},{"key":"ref78","doi-asserted-by":"publisher","DOI":"10.1093\/eurpub\/ckae144.1209"},{"key":"ref79","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-024-01336-w"},{"key":"ref80","doi-asserted-by":"publisher","DOI":"10.1037\/sgd0000722"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jmir.org\/2025\/1\/e77053","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:09:04Z","timestamp":1782842944000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2025\/1\/e77053"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,12]]},"references-count":80,"URL":"https:\/\/doi.org\/10.2196\/77053","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.77053","asserted-by":"object"}]},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,12]]}}}