{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T07:02:29Z","timestamp":1780038149672,"version":"3.53.1"},"reference-count":43,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T00:00:00Z","timestamp":1780012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Public Health"],"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study aimed to evaluate the comprehensive performance of five large language models (LLMs), namely ChatGPT, DeepSeek, Doubao, Kimi, and Qwen, in addressing medication consultation inquiries for people living with HIV (PLWH) in a Chinese-language context, thereby providing evidence for their clinical application and further model optimization.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>A total of 55 real-world medication consultation questions covering mainstream antiretroviral drugs for PLWH were screened and classified from Beijing Youan Hospital, Capital Medical University, a specialized infectious disease hospital in China. Five LLMs were queried within a fixed period, and expert evaluations were conducted across five dimensions: accuracy, relevance, completeness, clarity, and reliability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      The comprehensive scores ranked from highest to lowest were DeepSeek (4.47), Qwen (4.33), Kimi (4.24), Doubao (4.13), and ChatGPT (3.41), with highly significant differences were observed among all models (\n                      <jats:italic>H<\/jats:italic>\n                      =182.14,\n                      <jats:italic>p<\/jats:italic>\n                      \u202f&amp;lt;\u202f0.001). Regarding dimensional scores, the ranking was clarity (4.53) &amp;gt; reliability (4.33) &amp;gt; completeness (4.13) &amp;gt; accuracy (3.95) &amp;gt; relevance (3.62). ChatGPT exhibited statistically significant differences compared with all other models (\n                      <jats:italic>p<\/jats:italic>\n                      \u202f&amp;lt;\u202f0.001); no significant differences were found between DeepSeek and Qwen or between Doubao and Kimi (\n                      <jats:italic>p<\/jats:italic>\n                      \u202f&amp;gt;\u202f0.05).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Significant differences were observed in the capacity of the five LLMs to address medication consultations for PLWH within the Chinese-language context. DeepSeek and Qwen achieved optimal overall performance, Doubao excelled in clarity, whereas ChatGPT yielded the poorest results. All models demonstrated significant limitations when handling complex pharmaceutical inquiries and cannot fully replace professional clinical pharmacists. Further optimization focusing on high-quality medical domain dataset training and algorithm refinement is therefore warranted.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fpubh.2026.1850095","type":"journal-article","created":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T06:10:08Z","timestamp":1780035008000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Performance comparison of large language models for medication counseling in people living with HIV"],"prefix":"10.3389","volume":"14","author":[{"given":"Can","family":"Huang","sequence":"first","affiliation":[{"name":"Beijing Youan Hospital, Capital Medical University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanfang","family":"Sun","sequence":"additional","affiliation":[{"name":"Beijing Youan Hospital, Capital Medical University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Meng","family":"Chen","sequence":"additional","affiliation":[{"name":"Beijing Youan Hospital, Capital Medical University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lin","family":"Zhang","sequence":"additional","affiliation":[{"name":"Beijing Youan Hospital, Capital Medical University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Liu","sequence":"additional","affiliation":[{"name":"Beijing Youan Hospital, Capital Medical University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,5,29]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"2085","DOI":"10.1038\/s41591-021-01590-5","article-title":"Research priorities for an HIV cure: international aids society global scientific strategy 2021","volume":"27","author":"Deeks","year":"2021","journal-title":"Nat Med"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1016\/S0140-6736(10)60676-9","article-title":"Antiretroviral therapy and management of HIV infection","volume":"376","author":"Volberding","year":"2010","journal-title":"Lancet"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"e0039525","DOI":"10.1128\/cmr.00395-25","article-title":"Interactions between long-acting antiretrovirals and opioids: a call for clinical awareness","author":"Carbajal","year":"2026","journal-title":"Clin Microbiol Rev"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"684","DOI":"10.1124\/pr.117.013706","article-title":"Adverse neuropsychiatric events and recreational use of Efavirenz and other HIV-1 antiretroviral drugs","volume":"70","author":"Dalwadi","year":"2018","journal-title":"Pharmacol Rev"},{"key":"ref5","doi-asserted-by":"publisher","first-page":"1423","DOI":"10.1016\/s0140-6736(00)02854-3","article-title":"Adverse effects of antiretroviral therapy","volume":"356","author":"Carr","year":"2000","journal-title":"Lancet"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"2492208","DOI":"10.1080\/22221751.2025.2492208","article-title":"Grand challenges on HIV\/AIDS in China \u2013 the 5th symposium, Yunnan 2024","volume":"14","author":"Chen","year":"2025","journal-title":"Emerg Microbes Infect"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"922744","DOI":"10.3389\/fphar.2022.922744","article-title":"Time to first line antiretroviral therapy adverse drug reaction and its predictors among adult HIV\/AIDS patients on treatment in eastern Ethiopia","volume":"13","author":"Weldesenbet","year":"2022","journal-title":"Front Pharmacol"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"20420986231194752","DOI":"10.1177\/20420986231194752","article-title":"HIV\/AIDS patients\u2019 knowledge, attitude, and practice toward anti-retroviral therapy medications\u2019 adverse effects and associated factors in Tikur Anbessa specialized hospital","volume":"14","author":"Negash","year":"2023","journal-title":"Ther Adv Drug Saf"},{"key":"ref9","doi-asserted-by":"publisher","first-page":"1123","DOI":"10.1186\/s12879-024-09958-x","article-title":"The prevalence of antiretroviral drug interactions with other drugs used in women living with HIV and its association with HIV drug change and patient compliance","volume":"24","author":"Heydari","year":"2024","journal-title":"BMC Infect Dis"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1089\/apc.2022.0192","article-title":"Pharmacist-involved antiretroviral stewardship programs in people living with HIV\/AIDS: a systematic review","volume":"37","author":"Ahmed","year":"2023","journal-title":"AIDS Patient Care STDs"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1007\/s11904-024-00710-3","article-title":"Feasibility and impact of community pharmacy and novel pick-up points for antiretroviral therapy pre-exposure prophylaxis initiation and continuation in low and middle-income countries","volume":"22","author":"Lalla-Edward","year":"2025","journal-title":"Curr HIV AIDS Rep"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"e70090","DOI":"10.1002\/jia2.70090","article-title":"Role of pharmacists in HIV prophylaxis: a scoping review of pharmacists\u2019 services, interventions and outcomes","volume":"29","author":"Tiguman","year":"2026","journal-title":"J Int AIDS Soc"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"4566","DOI":"10.7150\/thno.108552","article-title":"Artificial intelligence in chronic kidney disease management: a scoping review","volume":"15","author":"Sabanayagam","year":"2025","journal-title":"Theranostics"},{"key":"ref14","doi-asserted-by":"publisher","first-page":"721","DOI":"10.3350\/cmh.2023.0089","article-title":"Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma","volume":"29","author":"Yeo","year":"2023","journal-title":"Clin Mol Hepatol"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"e70535","DOI":"10.2196\/70535","article-title":"Unveiling the potential of large language models in transforming chronic disease management: mixed methods systematic review","volume":"27","author":"Li","year":"2025","journal-title":"J Med Internet Res"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"e58041","DOI":"10.2196\/58041","article-title":"Enhancement of the performance of large language models in diabetes education through retrieval-augmented generation: comparative study","volume":"26","author":"Wang","year":"2024","journal-title":"J Med Internet Res"},{"key":"ref17","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1161\/hypertensionaha.125.25305","article-title":"Large language model agent for managing patients with suspected hypertension","volume":"83","author":"Wang","year":"2026","journal-title":"Hypertension"},{"key":"ref18","doi-asserted-by":"publisher","first-page":"499","DOI":"10.34172\/apb.2024.060","article-title":"Evaluating the accuracy of large language model (ChatGPT) in providing information on metastatic breast Cancer","volume":"14","author":"Gummadi","year":"2024","journal-title":"Adv Pharm Bull"},{"key":"ref19","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1111\/apt.18058","article-title":"Systematic review: the use of large language models as medical chatbots in digestive diseases","volume":"60","author":"Giuffr\u00e8","year":"2024","journal-title":"Aliment Pharmacol Ther"},{"key":"ref20","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1146\/annurev-pharmtox-052020-094321","article-title":"Roadmap for achieving universal antiretroviral treatment","volume":"63","author":"Sokhela","year":"2023","journal-title":"Annu Rev Pharmacol Toxicol"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"1541942","DOI":"10.3389\/fmicb.2025.1541942","article-title":"AI applications in HIV research: advances and future directions","volume":"16","author":"Jin","year":"2025","journal-title":"Front Microbiol"},{"key":"ref22","doi-asserted-by":"publisher","first-page":"1591","DOI":"10.1186\/s12879-025-12022-x","article-title":"Comparison of the accuracy and reliability of ChatGPT-4o and Gemini in answering HIV-related questions","volume":"25","author":"Tarhan","year":"2025","journal-title":"BMC Infect Dis"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1177\/09564624251372369","article-title":"Artificial intelligence meets HIV education: comparing three large language models on accuracy, readability, and reliability","volume":"37","author":"Eren Korkmaz","year":"2026","journal-title":"Int J STD AIDS"},{"key":"ref24","doi-asserted-by":"publisher","first-page":"2022","DOI":"10.1016\/j.arth.2024.02.023","article-title":"Assessing ability for ChatGPT to answer Total knee arthroplasty-related questions","volume":"39","author":"Magruder","year":"2024","journal-title":"J Arthroplast"},{"key":"ref25","doi-asserted-by":"publisher","first-page":"e60291","DOI":"10.2196\/60291","article-title":"Accuracy of prospective assessments of 4 large language model Chatbot responses to patient questions about emergency care: experimental comparative study","volume":"26","author":"Yau","year":"2024","journal-title":"J Med Internet Res"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1186\/s13643-016-0256-y","article-title":"Using qualitative comparative analysis in a systematic review of a complex intervention","volume":"5","author":"Kahwati","year":"2016","journal-title":"Syst Rev"},{"key":"ref27","doi-asserted-by":"publisher","first-page":"450","DOI":"10.1002\/jrsm.1698","article-title":"Using qualitative comparative analysis as a mixed methods synthesis in systematic mixed studies reviews: guidance and a worked example","volume":"15","author":"El Sherif","year":"2024","journal-title":"Res Synth Methods"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-026-07261-9","article-title":"A dataset for evaluating large language models on Chinese national medical licensing examinations","author":"Zong","year":"2026","journal-title":"Sci Data"},{"key":"ref29","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1016\/j.aopr.2025.05.001","article-title":"DeepSeek-R1 outperforms Gemini 2.0 pro, OpenAI o1, and o3-mini in bilingual complex ophthalmology reasoning","volume":"5","author":"Xu","year":"2025","journal-title":"Adv Ophthalmol Pract Res"},{"key":"ref30","doi-asserted-by":"publisher","first-page":"1777577","DOI":"10.3389\/fpubh.2026.1777577","article-title":"Decoupled quality and readability in skin cancer education from large language models","volume":"14","author":"Zhang","year":"2026","journal-title":"Front Public Health"},{"key":"ref31","doi-asserted-by":"publisher","first-page":"e59607","DOI":"10.2196\/59607","article-title":"Examining the role of large language models in orthopedics: systematic review","volume":"26","author":"Zhang","year":"2024","journal-title":"J Med Internet Res"},{"key":"ref32","doi-asserted-by":"publisher","first-page":"2435","DOI":"10.1016\/j.prosdent.2025.02.008","article-title":"Large language models in peri-implant disease: how well do they perform?","volume":"134","author":"Koidou","year":"2025","journal-title":"J Prosthet Dent"},{"key":"ref33","doi-asserted-by":"publisher","first-page":"350","DOI":"10.1186\/s12911-025-03202-5","article-title":"Can large language models follow guidelines? A comparative study of ChatGPT-4o and DeepSeek AI in clavicle fracture management based on AAOS recommendations","volume":"25","author":"Ke\u00e7eci","year":"2025","journal-title":"BMC Med Inform Decis Mak"},{"key":"ref34","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1111\/bcp.15896","article-title":"Evaluating the performance of ChatGPT in clinical pharmacy: a comparative study of ChatGPT and clinical pharmacists","volume":"90","author":"Huang","year":"2024","journal-title":"Brit J Clinical Pharma"},{"key":"ref35","doi-asserted-by":"publisher","first-page":"e76128","DOI":"10.2196\/76128","article-title":"Comparative analysis of generative artificial intelligence systems in solving clinical pharmacy problems: mixed methods study","volume":"13","author":"Li","year":"2025","journal-title":"JMIR Med Inform"},{"key":"ref36","doi-asserted-by":"publisher","first-page":"451","DOI":"10.2147\/JMDH.S400734","article-title":"Application, benefits, and limitations of telepharmacy for patients with diabetes in the outpatient setting","volume":"16","author":"Iftinan","year":"2023","journal-title":"J Multidiscip Healthc"},{"key":"ref37","doi-asserted-by":"publisher","first-page":"2409","DOI":"10.1038\/s41591-024-03181-6","article-title":"Evaluating the clinical benefits of LLMs","volume":"30","author":"Bedi","year":"2024","journal-title":"Nat Med"},{"key":"ref38","doi-asserted-by":"publisher","first-page":"1336","DOI":"10.1016\/j.cmi.2025.03.002","article-title":"Comparing large language models for antibiotic prescribing in different clinical scenarios: Which performs better?","volume":"31","author":"De Vito","year":"2025","journal-title":"Clin Microbiol Infect"},{"key":"ref39","doi-asserted-by":"publisher","first-page":"21501319241312571","DOI":"10.1177\/21501319241312571","article-title":"Opportunities and challenges for large language models in primary health care","volume":"16","author":"Qin","year":"2025","journal-title":"J Prim Care Community Health"},{"key":"ref40","doi-asserted-by":"publisher","first-page":"1188446","DOI":"10.3389\/fpubh.2023.1188446","article-title":"A qualitative inquiry of experiences of HIV-related stigma and its effects among people living with HIV on treatment in rural Kilifi, Kenya","volume":"11","author":"Wanjala","year":"2023","journal-title":"Front Public Health"},{"key":"ref41","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1186\/s12981-025-00724-w","article-title":"A United States HIV provider survey of antiretroviral therapy management in people living with HIV with co-occurring conditions","volume":"22","author":"Krishnan","year":"2025","journal-title":"AIDS Res Ther"},{"key":"ref42","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1038\/s41746-026-02362-6","article-title":"LLM-driven collaborative framework for knowledge-enhanced cancer pain assessment and management","volume":"9","author":"Liu","year":"2026","journal-title":"NPJ Digit Med"},{"key":"ref43","doi-asserted-by":"publisher","first-page":"e66917","DOI":"10.2196\/66917","article-title":"Benchmarking the confidence of large language models in answering clinical questions: cross-sectional evaluation study","volume":"13","author":"Omar","year":"2025","journal-title":"JMIR Med Inform"}],"container-title":["Frontiers in Public Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1850095\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T06:10:13Z","timestamp":1780035013000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1850095\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,29]]},"references-count":43,"alternative-id":["10.3389\/fpubh.2026.1850095"],"URL":"https:\/\/doi.org\/10.3389\/fpubh.2026.1850095","relation":{},"ISSN":["2296-2565"],"issn-type":[{"value":"2296-2565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,29]]},"article-number":"1850095"}}