{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,26]],"date-time":"2026-10-26T21:27:21Z","timestamp":1793050041042,"version":"4.5.0"},"reference-count":33,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2025,2,27]],"date-time":"2025-02-27T00:00:00Z","timestamp":1740614400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Lupus"],"published-print":{"date-parts":[[2025,4]]},"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To assess the accuracy, completeness, and reproducibility of Large Language Models (LLMs) (Copilot, GPT-3.5, and GPT-4) on antimalarial use in systemic lupus erythematosus (SLE).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>We utilized 13 questions derived from patient surveys and common inquiries from the National Health Service. Two independent rheumatologists assessed responses from the LLMs using predefined Likert scales for accuracy, completeness, and reproducibility.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      The GPT models and Copilot achieved high scores in accuracy. However, the completeness of outputs was rated at 38.5%, 55.9%, and 92.3% for Copilot, GPT-3.5, and GPT-4. When questions related to \u201cmechanism of action\u201d and \u201clifestyle\u201d, were analyzed for completeness (\n                      <jats:italic>n<\/jats:italic>\n                      = 8), ChatGPT-4 scored significantly higher (100%) compared to Copilot (37.5%). In contrast, questions related to \u201cside-effects\u201d (\n                      <jats:italic>n<\/jats:italic>\n                      = 5) scored higher for ChatGPT models than Copilot, and the differences were not statistically significant. All three LLMs demonstrated high reproducibility, with rates ranging from 84.6% to 92.3%.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Advanced LLMs like GPT -4 offer significant promise in enhancing patients\u2019 understanding of antimalarial therapy in SLE. Although chatbots\u2019 capability can potentially bridge the information gap patients face, the performance and limitations of such tools need further exploration to optimize their use in clinical settings.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/09612033251324501","type":"journal-article","created":{"date-parts":[[2025,2,27]],"date-time":"2025-02-27T06:26:23Z","timestamp":1740637583000},"page":"374-380","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":5,"title":["Evaluating large language models as a supplementary patient information resource on antimalarial use in systemic lupus erythematosus"],"prefix":"10.1177","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6967-7939","authenticated-orcid":false,"given":"Pamela","family":"Mungu\u00eda-Realpozo","sequence":"first","affiliation":[{"name":"Systemic Rheumatic Autoimmune Diseases Research Unit, Specialties Hospital UMAE- CIBIOR, Mexican Social Security Institute, Puebla, Mexico"},{"name":"Department of Rheumatology, Medicine School, Autonomous University of Puebla, Puebla, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5101-7705","authenticated-orcid":false,"given":"Claudia","family":"Mendoza-Pinto","sequence":"additional","affiliation":[{"name":"Systemic Rheumatic Autoimmune Diseases Research Unit, Specialties Hospital UMAE- CIBIOR, Mexican Social Security Institute, Puebla, Mexico"},{"name":"Department of Rheumatology, Medicine School, Autonomous University of Puebla, Puebla, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5857-4299","authenticated-orcid":false,"given":"Ivet","family":"Etchegaray-Morales","sequence":"additional","affiliation":[{"name":"Department of Rheumatology, Medicine School, Autonomous University of Puebla, Puebla, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7624-3696","authenticated-orcid":false,"given":"Edith","family":"Ram\u00edrez-Lara","sequence":"additional","affiliation":[{"name":"Systemic Rheumatic Autoimmune Diseases Research Unit, Specialties Hospital UMAE- CIBIOR, Mexican Social Security Institute, Puebla, Mexico"},{"name":"Department of Rheumatology, Medicine School, Autonomous University of Puebla, Puebla, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juan Carlos","family":"Solis-Poblano","sequence":"additional","affiliation":[{"name":"Department of Hematology, Specialties Hospital UMAE, Mexican Social Security Institute, Puebla, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Socorro","family":"M\u00e9ndez-Mart\u00ednez","sequence":"additional","affiliation":[{"name":"Coordination of Health Research, Mexican Social Security Institute, Puebla, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"Serrano Vertiz","sequence":"additional","affiliation":[{"name":"Systemic Rheumatic Autoimmune Diseases Research Unit, Specialties Hospital UMAE- CIBIOR, Mexican Social Security Institute, Puebla, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jorge","family":"Ay\u00f3n-Aguilar","sequence":"additional","affiliation":[{"name":"Coordination of Health Research, Mexican Social Security Institute, Puebla, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2025,2,27]]},"reference":[{"key":"e_1_3_5_2_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.79.1.175"},{"key":"e_1_3_5_3_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrrheum.2012.106"},{"key":"e_1_3_5_4_2","doi-asserted-by":"publisher","DOI":"10.1002\/art.40018"},{"key":"e_1_3_5_5_2","doi-asserted-by":"publisher","DOI":"10.1002\/art.27300"},{"key":"e_1_3_5_6_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM199101173240303"},{"key":"e_1_3_5_7_2","doi-asserted-by":"publisher","DOI":"10.1093\/rheumatology\/kead576"},{"key":"e_1_3_5_8_2","doi-asserted-by":"publisher","DOI":"10.1177\/0961203319843343"},{"key":"e_1_3_5_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/s0049-3848(00)00200-0"},{"key":"e_1_3_5_10_2","doi-asserted-by":"publisher","DOI":"10.1186\/ar3868"},{"key":"e_1_3_5_11_2","doi-asserted-by":"publisher","DOI":"10.1002\/acr.24550"},{"key":"e_1_3_5_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ophtha.2016.01.058"},{"key":"e_1_3_5_13_2","doi-asserted-by":"publisher","DOI":"10.3899\/jrheum.180124"},{"key":"e_1_3_5_14_2","doi-asserted-by":"publisher","DOI":"10.1136\/lupus-2022-000720"},{"key":"e_1_3_5_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-019-05109-0"},{"key":"e_1_3_5_16_2","doi-asserted-by":"publisher","DOI":"10.3390\/healthcare11060887"},{"key":"e_1_3_5_17_2","unstructured":"OpenAI. Introducing ChatGPT. https:\/\/openai.com\/blog\/chatgpt (accessed 15 February 2020)."},{"key":"e_1_3_5_18_2","unstructured":"Microsoft. Copilot [Internet]. 2024. https:\/\/copilot.microsoft.com\/."},{"key":"e_1_3_5_19_2","unstructured":"National Health Service (NHS). Common questions about hydroxychloroquine [Internet]. [cited 2024 Feb 2]. Available from: https:\/\/www.nhs.uk\/medicines\/hydroxychloroquine\/common-questions-about-hydroxychloroquine\/"},{"key":"e_1_3_5_20_2","doi-asserted-by":"publisher","DOI":"10.21203\/rs.3.rs-2566942\/v1"},{"key":"e_1_3_5_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00296-023-05340-3"},{"key":"e_1_3_5_22_2","doi-asserted-by":"publisher","DOI":"10.1111\/1756-185X.14749"},{"key":"e_1_3_5_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00296-023-05473-5"},{"key":"e_1_3_5_24_2","doi-asserted-by":"publisher","DOI":"10.1155\/2019\/7962947"},{"key":"e_1_3_5_25_2","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.4368"},{"key":"e_1_3_5_26_2","doi-asserted-by":"publisher","DOI":"10.1002\/acr.24399"},{"key":"e_1_3_5_27_2","doi-asserted-by":"publisher","DOI":"10.1177\/0961203318793213"},{"key":"e_1_3_5_28_2","doi-asserted-by":"publisher","unstructured":"Niko MM Karbasi Z Kazemi M et al. Comparing ChatGPT and bing in response to the home blood pressure monitoring (HBPM) knowledge checklist. Hypertens Res; 47: 1401\u20131409. DOI: 10.1038\/s41440-024-01624-8. Epub ahead of print March 2024.","DOI":"10.1038\/s41440-024-01624-8"},{"key":"e_1_3_5_29_2","doi-asserted-by":"publisher","DOI":"10.1093\/rheumatology\/ken479"},{"key":"e_1_3_5_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.semarthrit.2018.05.012"},{"key":"e_1_3_5_31_2","doi-asserted-by":"publisher","DOI":"10.1177\/0961203308089404"},{"key":"e_1_3_5_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(20)30752-2"},{"key":"e_1_3_5_33_2","first-page":"913","article-title":"Determinants of treatment adherence in ethnically diverse, economically disadvantaged patients with rheumatic disease","volume":"32","author":"Garcia Popa-Lisseanu MG","year":"2005","unstructured":"Garcia Popa-Lisseanu MG, Greisinger A, Richardson M, et al. Determinants of treatment adherence in ethnically diverse, economically disadvantaged patients with rheumatic disease. J Rheumatol 2005; 32: 913\u2013919.","journal-title":"J Rheumatol"},{"key":"e_1_3_5_34_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10067-007-0816-6"}],"container-title":["Lupus"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/09612033251324501","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/09612033251324501","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/09612033251324501","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T23:28:44Z","timestamp":1777678124000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/09612033251324501"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,27]]},"references-count":33,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,4]]}},"alternative-id":["10.1177\/09612033251324501"],"URL":"https:\/\/doi.org\/10.1177\/09612033251324501","relation":{},"ISSN":["0961-2033","1477-0962"],"issn-type":[{"value":"0961-2033","type":"print"},{"value":"1477-0962","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,27]]}}}