{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T01:23:04Z","timestamp":1791249784374,"version":"4.1.0"},"reference-count":39,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T00:00:00Z","timestamp":1787011200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Background\/Objectives: Rosacea is a chronic inflammatory skin disease that requires long-term management and continuous patient education regarding triggers, skincare practices, and treatment adherence. In recent years, patients have increasingly turned to online platforms and artificial intelligence (AI)-based chatbots for health-related information. Although ChatGPT has been evaluated in the context of rosacea, evidence regarding the performance of other AI chatbots remains limited. This study aimed to evaluate the accuracy, reliability, quality, readability, and diagnostic relevance of AI-generated responses to common rosacea-related patient questions and to assess their potential role as sources of health-related information. Methods: Between 21 December 2025 and 22 February 2026, rosacea-related questions were collected from the publicly accessible Quora platform using a systematic screening process. Twenty clinically relevant and representative questions covering diagnosis, triggers, treatment options, skincare practices, and disease manifestations were selected. Each question was independently submitted to three AI chatbots (Claude Sonnet 4.5, ChatGPT-5.2, and DeepSeek-V3.2). Responses were evaluated by domain experts using the modified DISCERN (mDISCERN) for reliability, the Global Quality Scale (GQS) for overall quality, the Flesch Reading Ease Score (FRES) for readability, and a 5-point Likert scale for accuracy. Reference hallucinations were assessed through manual verification of cited sources. Statistical comparisons were performed using the Friedman test with Bonferroni-adjusted post hoc analyses, and effect sizes were calculated using Kendall\u2019s coefficient of concordance (Kendall\u2019s W). Results: Significant differences were observed among the AI chatbots across all evaluation domains (p &lt; 0.05), with moderate to large effect sizes (Kendall\u2019s W = 0.272\u20130.683). ChatGPT-5.2 and DeepSeek-V3.2 demonstrated significantly higher reliability and accuracy scores than Claude Sonnet 4.5. DeepSeek-V3.2 achieved the highest overall quality scores, whereas ChatGPT-5.2 produced the most readable responses. Reference analysis revealed variable hallucination rates among the evaluated models. Conclusions: Generative AI chatbots demonstrate considerable potential as sources of health-related information for rosacea-related queries. However, variability in performance and reference hallucination rates highlights the need for careful validation before their widespread use as complementary sources of patient health information.<\/jats:p>","DOI":"10.3390\/diagnostics16162620","type":"journal-article","created":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T16:12:11Z","timestamp":1787069531000},"page":"2620","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Comparative Evaluation of ChatGPT-5.2, Claude Sonnet 4.5, and DeepSeek-V3.2 for Rosacea-Related Information: Accuracy, Reliability, Readability, and Reference Hallucinations"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1433-4832","authenticated-orcid":false,"given":"Mahmut Talha","family":"U\u00e7ar","sequence":"first","affiliation":[{"name":"Saray District Health Directorate, Tekirda\u011f Provincial Health Directorate, Republic of T\u00fcrkiye Ministry of Health, Tekirda\u011f 59600, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ecem","family":"Bostan","sequence":"additional","affiliation":[{"name":"Dermatology and Venereology Department, Faculty of Medicine, Ankara Medipol University, Ankara 06050, T\u00fcrkiye"},{"name":"Dermatology and Venereology Department, Private Bilgi Hospital, Ankara 06050, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"T\u00fclay","family":"Ortaba\u011f","sequence":"additional","affiliation":[{"name":"Department of Nursing, Faculty of Health Sciences, Istanbul Topkapi University, Istanbul 34087, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elif","family":"D\u00f6nmez","sequence":"additional","affiliation":[{"name":"Department of Oncology Nursing, Hamidiye Faculty of Nursing, University of Health Sciences, Istanbul 34668, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,8,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"120683","DOI":"10.1016\/j.jad.2025.120683","article-title":"Increased long-term risks of depression, anxiety, stress, and suicidality in rosacea and perioral dermatitis","volume":"394","author":"Najeeb","year":"2026","journal-title":"J. Affect. Disord."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"48","DOI":"10.4103\/TJD.TJD_14_20","article-title":"Assessment of acne rosacea prevalence and quality of life between individuals aged 18 years and over in Mahmudiye district center, Eskisehir, Turkey (A population-based study)","volume":"14","author":"Emiral","year":"2020","journal-title":"Turk. J. Dermatol."},{"key":"ref_3","first-page":"37","article-title":"The rosacea patient journey: A novel approach to conceptualizing patient experiences","volume":"95","author":"Kuo","year":"2015","journal-title":"Cutis"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1053\/j.semnuclmed.2024.05.005","article-title":"Generative artificial intelligence biases, limitations and risks in nuclear medicine: An argument for appropriate use framework and recommendations","volume":"55","author":"Currie","year":"2025","journal-title":"Semin. Nucl. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"235","DOI":"10.4274\/tjd.galenos.2025.06977","article-title":"Evaluation of the accuracy, reliability, quality, and readability of artificial intelligence chatbots\u2013generated responses to acne-related questions","volume":"19","author":"Bostan","year":"2025","journal-title":"Turk. J. Dermatol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1177\/12034754241229365","article-title":"Rosacea: Pathogenesis and Therapeutic Correlates","volume":"28","author":"Geng","year":"2024","journal-title":"J. Cutan. Med. Surg."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1038\/s41746-026-02428-5","article-title":"Large language models provide unsafe answers to patient-posed medical questions","volume":"9","author":"Draelos","year":"2026","journal-title":"npj Digit. Med."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"e66905","DOI":"10.2196\/66905","article-title":"Using Large Language Models for Chronic Disease Man-agement Tasks: Scoping Review","volume":"13","author":"Serugunda","year":"2025","journal-title":"JMIR Med. Inform."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2302980","DOI":"10.1080\/07853890.2024.2302980","article-title":"A systematic review of artifi-cial intelligence-powered (AI-powered) chatbot intervention for managing chronic illness","volume":"56","author":"Kurniawan","year":"2024","journal-title":"Ann. Med."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"790","DOI":"10.1080\/10810730.2015.1018590","article-title":"Is Online Health Activity Alive and Well or Flatlining? Findings From 10 Years of the Health Information National Trends Survey","volume":"20","author":"Prestin","year":"2015","journal-title":"J. Health Commun."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103722","DOI":"10.1016\/j.breast.2024.103722","article-title":"A systematic review and meta-analysis of English language online patient education materials in breast cancer: Is readability the only story?","volume":"75","author":"Gu","year":"2024","journal-title":"Breast"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3284199","DOI":"10.1155\/2022\/3284199","article-title":"Assessing the Readability of Anesthesia-Related Patient Education Materials from Major Anesthesiology Organizations","volume":"2022","author":"Pashkova","year":"2022","journal-title":"BioMed Res. Int."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"249","DOI":"10.2147\/PPA.S444928","article-title":"Assessment of the Reliability and Clinical Applicability of ChatGPT\u2019s Responses to Patients\u2019 Common Queries About Rosacea","volume":"18","author":"Yan","year":"2024","journal-title":"Patient Prefer. Adherence"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Goktas, P., and Grzybowski, A. (2024). Assessing the Impact of ChatGPT in Dermatology: A Comprehensive Rapid Review. J. Clin. Med., 13.","DOI":"10.3390\/jcm13195909"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3397","DOI":"10.2147\/CCID.S568058","article-title":"Current trends and future insights on rosacea treatment: A bibliometric analysis","volume":"18","author":"Wang","year":"2025","journal-title":"Clin. Cosmet. Investig. Dermatol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2177","DOI":"10.1111\/jdv.16305","article-title":"The top 100 most cited articles in rosacea: A bibliometric analysis","volume":"34","author":"Wang","year":"2020","journal-title":"J. Eur. Acad. Dermatol. Venereol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1038\/s44222-025-00279-5","article-title":"Application of large language models in medicine","volume":"3","author":"Liu","year":"2025","journal-title":"Nat. Rev. Bioeng."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Alkalbani, A.M., Alrawahi, A.S., Salah, A., Haghighi, V., Zhang, Y., Alkindi, S., and Sheng, Q.Z. (2025). A systematic review of large language models in medical specialties: Applications, challenges and future directions. Information, 16.","DOI":"10.21203\/rs.3.rs-5128451\/v2"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1136\/jech.53.2.105","article-title":"DISCERN: An instrument for judging the quality of written consumer health information on treatment choices","volume":"53","author":"Charnock","year":"1999","journal-title":"J. Epidemiol. Community Health"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2070","DOI":"10.1111\/j.1572-0241.2007.01325.x","article-title":"A systematic review of patient inflammatory bowel disease information resources on the World Wide Web","volume":"102","author":"Bernard","year":"2007","journal-title":"Am. J. Gastroenterol."},{"key":"ref_21","unstructured":"(2025, November 10). Readability Formulas [Internet]. Available online: https:\/\/readabilityformulas.com."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"e53164","DOI":"10.2196\/53164","article-title":"Hallucination Rates and Reference Accuracy of ChatGPT and Bard for Systematic Reviews: Comparative Analysis","volume":"26","author":"Chelli","year":"2024","journal-title":"J. Med. Internet Res."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"e54704","DOI":"10.2196\/54704","article-title":"A Preliminary Checklist (METRICS) to Standardize the Design and Reporting of Studies on Generative Artificial Intelligence\u2013Based Models in Health Care Education and Practice: Development Study Involving a Literature Review","volume":"13","author":"Sallam","year":"2024","journal-title":"Interact. J. Med. Res."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Erkin, Y., \u00d6zduran, E., \u00d6zbek, \u0130.C., and Hanc\u0131, V. (2026). Readability, quality, and reliability of AI-generated information on my-ofascial pain syndrome: A comparative analysis of ChatGPT, Gemini, and Perplexity. PLoS ONE, 21.","DOI":"10.1371\/journal.pone.0350402"},{"key":"ref_25","first-page":"135","article-title":"Evaluation of the readability of Turkish internet-based patient education materials related to low back pain","volume":"36","author":"Erkin","year":"2022","journal-title":"Dokuz Eyl\u00fcl \u00dcniversitesi T\u0131p Fak\u00fcltesi Derg."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"28","DOI":"10.4103\/ds.ds_43_19","article-title":"Social media use in dermatology","volume":"38","author":"Laughter","year":"2020","journal-title":"Dermatol. Sin."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"e42609","DOI":"10.2196\/42609","article-title":"Use of Social Media for Patient Education in Dermatology: Narrative Review","volume":"6","author":"Wojtara","year":"2023","journal-title":"JMIR Dermatol."},{"key":"ref_28","first-page":"e86543","article-title":"The Reliability Gap: How Traditional Search Engines Outperform Artificial Intelligence (AI) Chatbots in Rosacea Public Health Information Quality","volume":"17","author":"Nelson","year":"2025","journal-title":"Cureus"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"e49280","DOI":"10.2196\/49280","article-title":"Evaluation of ChatGPT Dermatology Responses to Common Patient Queries","volume":"6","author":"Ferreira","year":"2023","journal-title":"JMIR Dermatol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e55204","DOI":"10.2196\/55204","article-title":"Readability of information generated by ChatGPT for hidradenitis suppurativa","volume":"7","author":"Gawey","year":"2024","journal-title":"JMIR Dermatol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"e359","DOI":"10.1111\/jdv.20324","article-title":"ChatGPT and acne: Accuracy and reliability of the information provided-The AI-check study","volume":"39","author":"Bettoli","year":"2025","journal-title":"J. Eur. Acad. Dermatol. Venereol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"e60827","DOI":"10.2196\/60827","article-title":"The Comparative Sufficiency of ChatGPT, Google Bard, and Bing AI in Answering Diagnosis, Treatment, and Prognosis Questions About Common Dermatological Diagnoses","volume":"8","author":"Chau","year":"2025","journal-title":"JMIR Dermatol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1038\/s41598-025-29791-9","article-title":"Artificial intelligence-assisted prediction of Demodex mite density in facial erythema","volume":"16","author":"Kim","year":"2025","journal-title":"Sci. Rep."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1881","DOI":"10.1111\/ijd.17729","article-title":"Diagnostic Performance of GPT-4o and Gemini Flash 2.0 in Acne and Rosacea","volume":"64","author":"Boostani","year":"2025","journal-title":"Int. J. Dermatol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"e23415","DOI":"10.2196\/23415","article-title":"A Novel Convolutional Neural Network for the Diagnosis and Classification of Rosacea: Usability Study","volume":"9","author":"Zhao","year":"2021","journal-title":"JMIR Med. Inf."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2225","DOI":"10.1111\/jdv.20286","article-title":"Natural language processing in dermatology: A systematic literature review and state of the art","volume":"38","author":"Paganelli","year":"2024","journal-title":"J. Eur. Acad. Dermatol. Venereol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"210","DOI":"10.7326\/M23-2772","article-title":"Large Language Models in Medicine: The Potentials and Pitfalls: A Narrative Review","volume":"177","author":"Omiye","year":"2024","journal-title":"Ann. Intern. Med."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Mara\u015fl\u0131, E., Ozduran, E., and Hanc\u0131, V. (2026). A comparative analysis of readability, quality, and reliability in large language model outputs pertaining to knee osteoarthritis queries. PLoS ONE, 21.","DOI":"10.1371\/journal.pone.0353355"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"14604582251388879","DOI":"10.1177\/14604582251388879","article-title":"Quality and readability of chatbot responses to patient questions: A systematic cross-sectional meta-synthesis","volume":"31","author":"Whittaker","year":"2025","journal-title":"Health Inform. J."}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/16\/16\/2620\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,20]],"date-time":"2026-08-20T08:34:00Z","timestamp":1787214840000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/16\/16\/2620"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,18]]},"references-count":39,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2026,8]]}},"alternative-id":["diagnostics16162620"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics16162620","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,18]]}}}