{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,18]],"date-time":"2026-10-18T05:02:20Z","timestamp":1792299740676,"version":"4.4.0"},"reference-count":40,"publisher":"SAGE Publications","license":[{"start":{"date-parts":[[2025,9,1]],"date-time":"2025-09-01T00:00:00Z","timestamp":1756684800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,9,1]],"date-time":"2025-09-01T00:00:00Z","timestamp":1756684800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Patient Experience"],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:p>\n                    This study evaluated 4 leading Large Language Models\u2019 (LLMs) (ChatGPT-o1, DeepSeek-v3, Gemini 2.0 Flash, and Claude 3.7 Sonnet) responses to a question about Diabetic Retinopathy.\n                    <jats:bold>Methods:<\/jats:bold>\n                    The following questions were posed to the 4 LLMS: \u201cI am a 52-year-old Caucasian [male\/female] with out-of-control Type 2 Diabetes Mellitus, and I recently cannot read small print. What should I do?\u201d We analyzed each response using Flesch-Kincaid Grade Level scoring and conducted a content analysis of the responses to evaluate for clinical terminology frequency, healthcare recommendations, and privacy considerations.\n                    <jats:bold>Results:<\/jats:bold>\n                    All platforms generated content at high school to college grade reading levels, exceeding recommended sixth-grade health literacy guidelines. DeepSeek incorporated more specialized clinical terminology and referenced specific diabetes guidelines not mentioned by ChatGPT, and exhibited greater gender discrepancy than the other 3 LLMs.\n                    <jats:bold>Conclusion:<\/jats:bold>\n                    While LLMs demonstrate promising capabilities for diabetes education, our results indicated that improvements in readability, gender bias mitigation, and risk of inappropriate output remain essential. Healthcare providers and physicians must review and monitor the answers before sharing with patients.\n                  <\/jats:p>","DOI":"10.1177\/23743735251380954","type":"journal-article","created":{"date-parts":[[2025,9,24]],"date-time":"2025-09-24T13:57:35Z","timestamp":1758722255000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":2,"title":["Chatbots and Diabetes: Is There Gender Bias?"],"prefix":"10.1177","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0050-2401","authenticated-orcid":false,"given":"Gloria","family":"Wu","sequence":"first","affiliation":[{"name":"University of California, San Francisco School of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Swara","family":"Tewari","sequence":"additional","affiliation":[{"name":"University of California, Santa Barbara"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adrial","family":"Wong","sequence":"additional","affiliation":[{"name":"University of California, Davis"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emily","family":"Chung","sequence":"additional","affiliation":[{"name":"Boston University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ivan","family":"Chim","sequence":"additional","affiliation":[{"name":"University of California, San Diego"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian","family":"Hoang","sequence":"additional","affiliation":[{"name":"University of California, Davis"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nikki","family":"Mansubi","sequence":"additional","affiliation":[{"name":"San Jose State University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adam","family":"Shams","sequence":"additional","affiliation":[{"name":"University of California, San Francisco School of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Milan","family":"Del Buono","sequence":"additional","affiliation":[{"name":"University of California, Berkeley"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sahana","family":"Srinivasan","sequence":"additional","affiliation":[{"name":"University of California, San Francisco School of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hrishi","family":"Paliath-Pathiyal","sequence":"additional","affiliation":[{"name":"Nova Southeastern University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Obaid","family":"Khan","sequence":"additional","affiliation":[{"name":"California Health Sciences University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2025,9,24]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"American Diabetes Association. Statistics about diabetes. Diabetes website. 2023; 38(4): 1297\u20131304. Published November 2 2023. Updated November 2 2023. Accessed June 30 2025. https:\/\/diabetes.org\/about-diabetes\/statistics\/about-diabetes"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1177\/0145721719865181"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.4239\/wjd.v2.i6.98"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1093\/fampra\/cmh417"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamaophthalmol.2015.5332"},{"key":"e_1_3_2_7_2","article-title":"How are income and education related to the prevention and management of diabetes?","author":"Allen K","year":"2019","unstructured":"Allen K, McFarland M. How are income and education related to the prevention and management of diabetes? J Aging Health. 2019. Published online October 14, 2019. Accessed June 30, 2025. https:\/\/doi.org\/10.1177\/0898264319879608","journal-title":"J Aging Health."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1177\/15579883251317095"},{"key":"e_1_3_2_9_2","unstructured":"Rawal A. Google\u2019s New Search Engine. The Startup website. Published January. 2020;22. https:\/\/medium.com\/swlh\/googles-new-healthcare-data-search-engine-9e6d824b3ccd. Accessed June 30 2025."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-025-01546-w"},{"key":"e_1_3_2_11_2","unstructured":"US Census Bureau. Census Bureau releases new educational attainment data. Census.gov website. Published February. 2022;24. Accessed June 30 2025. https:\/\/www.census.gov\/newsroom\/press-releases\/2022\/educational-attainment.html."},{"key":"e_1_3_2_12_2","unstructured":"Homepage. Literacy Project Foundation website. Published 2019. Accessed June 30 2025. https:\/\/literacyproj.org\/"},{"key":"e_1_3_2_13_2","article-title":"Concentrating intelligence: scaling and market structure in artificial intelligence","author":"Korinek A","year":"2024","unstructured":"Korinek A, Vipra J. Concentrating intelligence: scaling and market structure in artificial intelligence. Econ Policy. 2024. Published online November 19, 2024. Accessed June 30, 2025. https:\/\/doi.org\/10.1093\/epolic\/eiae057","journal-title":"Econ Policy"},{"key":"e_1_3_2_14_2","article-title":"Analyzing the use of chat generative pre-trained transformer and artificial intelligence","author":"Christanto HJ","year":"2024","unstructured":"Christanto HJ, Dewi C, Sutresno SA, Silalahi ADK. Analyzing the use of chat generative pre-trained transformer and artificial intelligence. Revue d\u2019Intell Artif. 2024. Published online April 2024. Accessed June 30, 2025. https:\/\/doi.org\/10.18280\/ria.380423","journal-title":"Revue d\u2019Intell Artif"},{"key":"e_1_3_2_15_2","doi-asserted-by":"crossref","DOI":"10.3390\/fi15100336","article-title":"Fluent but not factual: a comparative analysis of ChatGPT and other AI Chatbots\u2019 proficiency and originality in scientific writing for humanities","author":"Lozi\u0107 E","year":"2023","unstructured":"Lozi\u0107 E, \u0160tular B. Fluent but not factual: a comparative analysis of ChatGPT and other AI Chatbots\u2019 proficiency and originality in scientific writing for humanities. Future Internet. 2023. Published online September 14, 2023. Accessed June 30, 2025. https:\/\/doi.org\/10.3390\/fi15100336","journal-title":"Future Internet"},{"key":"e_1_3_2_16_2","unstructured":"Telegraph.co.uk. Dr Google will see you now: Search giant wants to cash in on your medical queries. The Telegraph website. Published March 10 2019. Accessed June 30 2025. https:\/\/www.telegraph.co.uk\/technology\/2019\/03\/10\/google-sifting-one-billion-health-questions-day\/"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025539"},{"key":"e_1_3_2_18_2","unstructured":"Guo D Zhu Q Yang D Xie Z Dong K Zhang W Chen G Bi X Wu Y Li YK Luo F Xiong Y Liang W. DeepSeek-Coder: When the Large Language Model Meets Programming \u2013 The Rise of Code Intelligence. arXiv.org website. Published January 26 2024. Accessed June 30 2025. http:\/\/arxiv.org\/abs\/2401.14196"},{"key":"e_1_3_2_19_2","unstructured":"DeepSeek AI Bi X Chen D Guo D Yang D Xie Z Dong K Zhang W Chen G Wu Y Li YK Luo F Xiong Y Liang W. DeepSeek LLM: Scaling Open-Source Language Models with Longtermism. arXiv.org website. Published January 5 2024. Accessed June 30 2025. http:\/\/arxiv.org\/abs\/2401.02954"},{"key":"e_1_3_2_20_2","article-title":"Diabetic retinopathy preferred practice pattern\u00ae","author":"Flaxel CJ","year":"2019","unstructured":"Flaxel CJ, Adelman RA, Bailey ST, Fawzi A, Lim JI, Vemulakonda GA, Ying G-S. Diabetic retinopathy preferred practice pattern\u00ae. Ophthalmology. 2019. Published online September 25, 2019. Accessed June 30, 2025. https:\/\/doi.org\/10.1016\/j.ophtha.2019.09.025","journal-title":"Ophthalmology"},{"key":"e_1_3_2_21_2","unstructured":"Prabhune S Padmanabhan B Dutta K. Do LLMs have a Gender (Entropy) Bias? arXiv.org website. Published May. 2025;24. https:\/\/arxiv.org\/abs\/2505.20343. Accessed June 30 2025."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.21659\/rupkatha.v15n4.10"},{"key":"e_1_3_2_23_2","unstructured":"OSF. A Study of Prompt Engineering and the Quality of AI-Driven Feedback. OSF.io website. Published November. 2024;4. https:\/\/osf.io\/cr257. Accessed June 30 2025."},{"key":"e_1_3_2_24_2","article-title":"Diabetic macular edema: current understanding, molecular mechanisms and therapeutic implications","author":"Zhang J","year":"2022","unstructured":"Zhang J, Zhang J, Zhang C, Wang Y, Wang J, Wang Y, Wang J, Wang F. Diabetic macular edema: current understanding, molecular mechanisms and therapeutic implications. Cells. 2022. Published online October 31, 2022. Accessed June 30, 2025. https:\/\/doi.org\/10.3390\/cells11213362","journal-title":"Cells"},{"key":"e_1_3_2_25_2","unstructured":"WebFX. Flesch-Kincaid readability test. WebFX. Accessed [June 30 2025]. https:\/\/www.webfx.com\/tools\/read-able\/flesch-kincaid\/"},{"key":"e_1_3_2_26_2","unstructured":"Moritz E. Chatting with Chat (GPT-4): Quid Est Understanding. Centre for Digital Philosophy at Western University website. Published. 2024. https:\/\/philpapers.org\/rec\/MORCWC-2. Accessed June 30 2025."},{"key":"e_1_3_2_27_2","first-page":"555","volume-title":"5th international conference on advances in information communication technology & computing (AICTC-2024)","author":"Yadav NS","year":"2024","unstructured":"Yadav NS, Goar V, Yadav PS, Rajpurohit J, Kotecha K. Retrospective analysis of Google Gemini. In: 5th international conference on advances in information communication technology & computing (AICTC-2024). Published online October 26, 2024; 555\u2013580. Accessed June 30, 2025. https:\/\/doi.org\/10.1007\/978-981-97-6106-7_35"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.48185\/jaai.v5i1.1052"},{"key":"e_1_3_2_29_2","unstructured":"Atlas S. ChatGPT for Higher Education and Professional Development: A Guide to Conversational AI. DigitalCommons@URI website. Published. January 2023. https:\/\/digitalcommons.uri.edu\/cba_facpubs\/548\/. Accessed June 30 2025."},{"key":"e_1_3_2_30_2","article-title":"Generating credible referenced medical research: a comparative study of OpenAI\u2019s GPT-4 and Google\u2019s Gemini","author":"Omar M","year":"2024","unstructured":"Omar M, Nassar S, Hijazi K, Glicksberg BS, Nadkarni GN, Klang E. Generating credible referenced medical research: a comparative study of OpenAI\u2019s GPT-4 and Google\u2019s Gemini. Comput Biol Med website. Published 2024. Accessed June 30, 2025. https:\/\/doi.org\/10.1016\/j.compbiomed.2024.109545","journal-title":"Comput Biol Med website"},{"key":"e_1_3_2_31_2","first-page":"133","volume-title":"Assessing bias in large language models: a comparative study of ChatGPT, Gemini, and Claude2024 MOSICOM: International Conference on Modeling, Simulation and Optimization in Communication","author":"Shetty P","unstructured":"Shetty P, Rao VSS, Muralikrishna SN. Assessing bias in large language models: a comparative study of ChatGPT, Gemini, and Claude. In 2024 MOSICOM: International Conference on Modeling, Simulation and Optimization in Communication. Published online December 9, 2024:133\u2013137. Accessed June 30, 2025. https:\/\/doi.org\/10.1109\/mosicom63082.2024.10881888"},{"key":"e_1_3_2_32_2","doi-asserted-by":"crossref","unstructured":"Zhan HJ. Aging Health Care and Elder Care: Perpetuation of Gender Inequalities in China. Health Care for Women International website. Published 2005. Accessed June 30 2025. https:\/\/doi.org\/10.1080\/07399330500177196","DOI":"10.1080\/07399330500177196"},{"key":"e_1_3_2_33_2","doi-asserted-by":"crossref","unstructured":"Adinath DR Smiju IS. Advancements in AI-Powered NLP Models: A Critical Analysis of Manus AI Gemini Grok AI DeepSeek and ChatGPT. SSRN website. Published March 19 2025. Last revised April 16 2025. Accessed June 30 2025. https:\/\/doi.org\/10.2139\/ssrn.5185131","DOI":"10.2139\/ssrn.5185131"},{"key":"e_1_3_2_34_2","article-title":"The use of large language models to generate education materials about uveitis","author":"Kianian R","year":"2023","unstructured":"Kianian R, Sun D, Crowell EL, Tsui E. The use of large language models to generate education materials about uveitis. Ophthalmol Retina. website. Published September 1, 2023. Accessed June 30, 2025. https:\/\/doi.org\/10.1016\/j.oret.2023.09.008","journal-title":"Ophthalmol Retina"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.2196\/52597"},{"key":"e_1_3_2_36_2","unstructured":"Roose K. Can AI. Be Blamed for a Teen\u2019s Suicide? The New York Times website. Published October 23 2024. Accessed June 30 2025. https:\/\/www.nytimes.com\/2024\/10\/23\/technology\/characterai-lawsuit-teen-suicide.html"},{"key":"e_1_3_2_37_2","article-title":"Unveiling the black box: the significance of XAI in making LLMs transparent","author":"Souza ME de C","year":"2025","unstructured":"Souza ME de C, Souza MEDC, Weigang L. Unveiling the black box: the significance of XAI in making LLMs transparent. Authorea website. Published February 18, 2025. Accessed June 30, 2025. https:\/\/doi.org\/10.22541\/au.173991264.46233479\/v1","journal-title":"Authorea"},{"key":"e_1_3_2_38_2","unstructured":"Coleman T. What Elon Musk\u2019s Grok AI controversy reveals about chatbots. The Week website. Published. May 19 2025. https:\/\/theweek.com\/tech\/grok-ai-controversy-chatbots. Accessed June 30 2025."},{"key":"e_1_3_2_39_2","article-title":"Addressing algorithmic bias and the perpetuation of health inequities: an AI bias aware framework","author":"Agarwal R","year":"2022","unstructured":"Agarwal R, Bjarnadottir M, Rhue L, et al Addressing algorithmic bias and the perpetuation of health inequities: an AI bias aware framework. Health Policy Technol. website. Published 2022. Accessed June 30, 2025. https:\/\/doi.org\/10.1016\/j.hlpt.2022.100702","journal-title":"Health Policy Technol."},{"key":"e_1_3_2_40_2","article-title":"Be careful with DeepSeek, Australia says \u2013 so is it safe to use? BBC Website","volume":"28","author":"Gerken T","year":"2025","unstructured":"Gerken T. Be careful with DeepSeek, Australia says \u2013 so is it safe to use? BBC Website. Published January. 2025;28. https:\/\/www.bbc.com\/news\/articles\/cx2k7r5nrvpo. Accessed June 21, 2025.","journal-title":"Published January"},{"key":"e_1_3_2_41_2","unstructured":"Kruppa M. In battle with Microsoft Google bets on medical AI program to crack healthcare industry. The Wall Street Journal website. Published July 8 2023. Accessed June 21 2025. https:\/\/www.wsj.com\/tech\/in-battle-with-microsoft-google-bets-on-medical-ai-program-to-crack-healthcare-industry-bb7c2db8"}],"container-title":["Journal of Patient Experience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/23743735251380954","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/23743735251380954","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/23743735251380954","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T00:37:49Z","timestamp":1777509469000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/23743735251380954"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9]]},"references-count":40,"alternative-id":["10.1177\/23743735251380954"],"URL":"https:\/\/doi.org\/10.1177\/23743735251380954","relation":{},"ISSN":["2374-3735","2374-3743"],"issn-type":[{"value":"2374-3735","type":"print"},{"value":"2374-3743","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9]]},"article-number":"23743735251380954"}}