{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T04:44:27Z","timestamp":1787028267730,"version":"build-2736575974"},"reference-count":25,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T00:00:00Z","timestamp":1778198400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Healthcare"],"abstract":"<jats:p>Introduction: Artificial intelligence (AI)-based chatbots are becoming an increasingly popular source of health information, particularly for common dermatological conditions such as scabies. However, concerns remain about the accuracy, reliability, quality and readability of the information they provide. Objectives: The aim of this study was to evaluate the accuracy, reliability, quality and readability of responses generated by different AI chatbots in answer to patient questions about scabies. Methods: Scabies-related questions were collected from Quora, a publicly accessible question-and-answer platform, and screened for relevance. Following expert review, 20 representative questions were selected. Responses were generated by three large language models: ChatGPT-5.2, DeepSeek and Claude Sonnet 4.5. The outputs were evaluated by expert reviewers using the hallucination rate, modified DISCERN (mDISCERN), Global Quality Score (GQS), Flesch Reading Ease Score (FRES), and an accuracy assessment based on a 5-point Likert scale. Results: In this study, it was found that ChatGPT-5.2 demonstrated the highest information quality (mDISCERN: 33.6 \u00b1 1.8) and readability (FRES: 63.25 \u00b1 11.5). DeepSeek achieved the highest global quality score (GQS: 5.00 \u00b1 0.00) and accuracy score (5.00 \u00b1 0.00). Claude Sonnet 4.5 had lower scores across most metrics. There were significant differences in hallucination rates among the models (p = 0.003), with DeepSeek exhibiting higher rates. Overall, statistically significant differences were observed among the models in terms of quality, readability and accuracy. Conclusions: AI chatbots provide generally informative but variable-quality responses to scabies-related questions. While DeepSeek demonstrated higher accuracy and overall quality, it also showed higher hallucination rates, whereas ChatGPT-5.2 provided more readable and reliable responses. These findings highlight variability across models and the need for cautious use. AI tools should be considered supportive resources rather than substitutes for professional medical advice.<\/jats:p>","DOI":"10.3390\/healthcare14101278","type":"journal-article","created":{"date-parts":[[2026,5,11]],"date-time":"2026-05-11T20:14:16Z","timestamp":1778530456000},"page":"1278","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Can Artificial Intelligence Support Patient Education in Scabies? A Comparative Analysis of Large Language Model Responses"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1433-4832","authenticated-orcid":false,"given":"Mahmut Talha","family":"U\u00e7ar","sequence":"first","affiliation":[{"name":"Saray District Health Directorate, Tekirda\u011f Provincial Health Directorate, Ministry of Health, Tekirda\u011f 59100, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8296-4836","authenticated-orcid":false,"given":"Ecem","family":"Bostan","sequence":"additional","affiliation":[{"name":"Dermatology and Venereology Department, Faculty of Medicine, Ankara Medipol University, Ankara 06050, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5030-3411","authenticated-orcid":false,"given":"Elif","family":"D\u00f6nmez","sequence":"additional","affiliation":[{"name":"Oncology Nursing Department, Hamidiye Faculty of Nursing, University of Health Sciences, Istanbul 34668, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4636-5534","authenticated-orcid":false,"given":"Fatma","family":"Cerit Soydan","sequence":"additional","affiliation":[{"name":"Department of Nursing, Faculty of Health Sciences, Istanbul Topkapi University, Istanbul 34087, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,5,8]]},"reference":[{"key":"ref_1","first-page":"566","article-title":"ChatGPT and dermatology","volume":"159","author":"Feo","year":"2024","journal-title":"Ital. J. Dermatol. Venereol."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Goktas, P., and Grzybowski, A. (2024). Assessing the impact of ChatGPT in dermatology: A comprehensive rapid review. J. Clin. Med., 13.","DOI":"10.3390\/jcm13195909"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"26","DOI":"10.5114\/dr.2024.140796","article-title":"Exploring the performance of ChatGPT-3.5 in addressing dermatological queries: A research investigation into AI capabilities","volume":"111","author":"Rojek","year":"2024","journal-title":"Dermatol. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1006","DOI":"10.1111\/tmi.14058","article-title":"Prevalence and determinants of scabies: A global systematic review and meta-analysis","volume":"29","author":"Gupta","year":"2024","journal-title":"Trop. Med. Int. Health"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1749","DOI":"10.1111\/jdv.19167","article-title":"Prevalence of scabies worldwide: An updated systematic literature review in 2022","volume":"37","author":"Schneider","year":"2023","journal-title":"J. Eur. Acad. Dermatol. Venereol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"28","DOI":"10.12703\/r\/10-28","article-title":"Recent advances in understanding and treating scabies","volume":"10","author":"Welch","year":"2021","journal-title":"Fac. Rev."},{"key":"ref_7","unstructured":"World Health Organization (2026, February 23). Scabies. Published 31 May 2023. Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/scabies."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"271","DOI":"10.35516\/jmj.v58i2.2960","article-title":"Evaluation of artificial intelligence-based chatbot responses to common dermatological queries","volume":"58","author":"Podder","year":"2024","journal-title":"Jordan Med. J."},{"key":"ref_9","first-page":"1371","article-title":"ScabAI: A deep learning-based mobile application for scabies detection from skin images","volume":"13","author":"Can","year":"2025","journal-title":"Gazi Univ. Fen Bilim. Derg. Part C Tasar\u0131m Teknol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"235","DOI":"10.4274\/tjd.galenos.2025.06977","article-title":"Evaluation of the accuracy, reliability, quality, and readability of artificial intelligence chatbots-generated responses to acne-related questions","volume":"19","author":"Bostan","year":"2025","journal-title":"Turk. J. Dermatol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1136\/jech.53.2.105","article-title":"DISCERN: An instrument for judging the quality of written consumer health information on treatment choices","volume":"53","author":"Charnock","year":"1999","journal-title":"J. Epidemiol. Community Health"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2070","DOI":"10.1111\/j.1572-0241.2007.01325.x","article-title":"A systematic review of patient inflammatory bowel disease information resources on the World Wide Web","volume":"102","author":"Bernard","year":"2007","journal-title":"Am. J. Gastroenterol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1037\/h0057532","article-title":"A new readability yardstick","volume":"32","author":"Flesch","year":"1948","journal-title":"J. Appl. Psychol."},{"key":"ref_14","unstructured":"Readability Formulas (2026, February 01). Flesch Reading Ease Calculator. Available online: https:\/\/readabilityformulas.com."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Hatia, A., Doldo, T., Parrini, S., Chisci, E., Cipriani, L., Montagna, L., Lagana, G., Guenza, G., Agosta, E., and Vinjolli, F. (2024). Accuracy and completeness of ChatGPT-generated information on interceptive orthodontics: A multicenter collaborative study. J. Clin. Med., 13.","DOI":"10.3390\/jcm13030735"},{"key":"ref_16","first-page":"e20255929","article-title":"Artificial intelligence in patient education for androgenetic alopecia: A comparative study of ChatGPT, Gemini, and Deepseek R1","volume":"15","year":"2025","journal-title":"Dermatol. Pract. Concept."},{"key":"ref_17","first-page":"e86543","article-title":"The reliability gap: How traditional search engines outperform artificial intelligence (AI) chatbots in rosacea public health information quality","volume":"17","author":"Nelson","year":"2025","journal-title":"Cureus"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"e46924","DOI":"10.2196\/46924","article-title":"Artificial intelligence can generate fraudulent but authentic-looking scientific medical articles: Pandora\u2019s box has been opened","volume":"25","author":"Kasal","year":"2023","journal-title":"J. Med. Internet Res."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1038\/s41572-024-00552-8","article-title":"Scabies","volume":"10","author":"Fernando","year":"2024","journal-title":"Nat. Rev. Dis. Primers"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1308","DOI":"10.3855\/jidc.20659","article-title":"Scabies cases at a dermatological outpatient clinic in T\u00fcrkiye: Effects of the COVID-19 pandemic","volume":"19","author":"Atalik","year":"2025","journal-title":"J. Infect. Dev. Ctries."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"29","DOI":"10.4274\/tpd.galenos.2025.70894","article-title":"Clinical features and quality of life in patients with scabies","volume":"49","author":"Guven","year":"2025","journal-title":"Turk. Parazitol. Derg."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"80","DOI":"10.4274\/tjd.galenos.2024.73645","article-title":"Scabies on YouTube: The quality, accuracy, and reliability of the videos","volume":"19","author":"Gurok","year":"2025","journal-title":"Turk. J. Dermatol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"14045","DOI":"10.1038\/s41598-023-41032-5","article-title":"Fabrication and errors in the bibliographic citations generated by ChatGPT","volume":"13","author":"Walters","year":"2023","journal-title":"Sci. Rep."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1278","DOI":"10.1057\/s41599-024-03811-x","article-title":"AI hallucination: Towards a comprehensive classification of distorted information in artificial intelligence-generated content","volume":"11","author":"Sun","year":"2024","journal-title":"Humanit. Soc. Sci. Commun."},{"key":"ref_25","first-page":"e39238","article-title":"High rates of fabricated and inaccurate references in ChatGPT-generated medical content","volume":"15","author":"Bhattacharyya","year":"2023","journal-title":"Cureus"}],"container-title":["Healthcare"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9032\/14\/10\/1278\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,11]],"date-time":"2026-05-11T20:39:51Z","timestamp":1778531991000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9032\/14\/10\/1278"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,8]]},"references-count":25,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2026,5]]}},"alternative-id":["healthcare14101278"],"URL":"https:\/\/doi.org\/10.3390\/healthcare14101278","relation":{},"ISSN":["2227-9032"],"issn-type":[{"value":"2227-9032","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,8]]}}}