{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T00:43:50Z","timestamp":1785545030193,"version":"3.56.0"},"reference-count":22,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Dermatol"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Artificial intelligence tools such as ChatGPT are increasingly used by the public to seek health-related information. However, the accuracy and quality of artificial intelligence\u2013generated dermatological guidance, particularly regarding sun protection and skin cancer prevention, have not been systematically assessed.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to evaluate the quality of ChatGPT-generated responses to common patient questions on sun protection and skin cancer prevention by benchmarking them against guidelines from the American Academy of Dermatology.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n Nine standardized questions reflecting common public inquiries were submitted to ChatGPT (GPT-4 free tier) in a single session on May 13, 2025. Responses were independently evaluated by 2 board-certified consultant dermatologists (>15 years\u2019 experience each) across 4 domains (accuracy, completeness, clarity, and relevance) using an author-developed 5-point ordinal rating scale anchored to American Academy of Dermatology guidelines. Scoring disagreements were resolved through discussion between raters until consensus was reached. Interrater reliability was assessed using the linear weighted Cohen \u03ba and intraclass correlation coefficient.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Overall mean scores were 5.0 (SD 0.0) for accuracy (ceiling effect observed), 4.1 (SD 0.6) for completeness, 5.0 (SD 0.0) for clarity (ceiling effect observed), and 4.9 (SD 0.3) for relevance, yielding an overall mean of 4.75\/5.0 (SD 0.49). Interrater reliability was excellent (weighted Cohen \u03ba=0.80; intraclass correlation coefficient=0.85; exact agreement on 33\/36, 91.7% of the items). Completeness was the lowest-scoring domain (range 3.0-5.0), primarily reflecting errors of omission rather than commission.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n ChatGPT provided largely accurate and guideline-consistent advice on sun protection and skin cancer prevention in this targeted content analysis. Its primary limitation was incomplete coverage of nuanced guideline details. While not a replacement for professional health care, ChatGPT may serve as a valuable adjunct tool for public health education on skin cancer prevention provided that its outputs are subject to ongoing, systematic evaluation.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/93839","type":"journal-article","created":{"date-parts":[[2026,6,14]],"date-time":"2026-06-14T16:25:07Z","timestamp":1781454307000},"page":"e93839-e93839","source":"Crossref","is-referenced-by-count":0,"title":["ChatGPT-Generated Advice on Sun Protection and Skin Cancer Prevention Compared to American Academy of Dermatology Guidelines: Cross-Sectional Content Analysis"],"prefix":"10.2196","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-0689-774X","authenticated-orcid":false,"given":"Hanadi","family":"Qeyam","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9588-827X","authenticated-orcid":false,"given":"Ahmed","family":"Al-Rusan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,6,30]]},"reference":[{"key":"R1","doi-asserted-by":"crossref","unstructured":"Leiter U Keim U Garbe C . Epidemiology of skin cancer: update 2019. In: Reichrath J , editor. Sunlight, Vitamin D and Skin Cancer. Springer; 2020:123-139. [doi: 10.1007\/978-3-030-46227-7_6]","DOI":"10.1007\/978-3-030-46227-7_6"},{"issue":"5","key":"R2","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1001\/jamadermatol.2022.0160","article-title":"Global burden of cutaneous melanoma in 2020 and projections to 2040","volume":"158","author":"Arnold","journal-title":"JAMA Dermatol"},{"key":"R3","doi-asserted-by":"publisher","DOI":"10.1016\/j.jdin.2020.10.013","article-title":"The global burden of skin cancer: a longitudinal analysis from the Global Burden of Disease Study, 1990-2017","volume":"2","author":"Urban","journal-title":"JAAD Int"},{"issue":"1","key":"R4","doi-asserted-by":"publisher","DOI":"10.1186\/s12885-024-12426-z","article-title":"Patterns and trends in melanoma mortality in the United States, 1999-2020","volume":"24","author":"Didier","journal-title":"BMC Cancer"},{"issue":"3","key":"R5","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1016\/j.soncn.2016.05.005","article-title":"Ultraviolet radiation exposure and its impact on skin cancer risk","volume":"32","author":"Watson","journal-title":"Semin Oncol Nurs"},{"issue":"6","key":"R6","doi-asserted-by":"publisher","first-page":"1665","DOI":"10.1007\/s00403-023-02547-z","article-title":"Sun-protective behaviors and sunburn among US adults","volume":"315","author":"McKenzie","journal-title":"Arch Dermatol Res"},{"issue":"19","key":"R7","doi-asserted-by":"publisher","DOI":"10.3390\/jcm13195909","article-title":"Assessing the impact of ChatGPT in dermatology: a comprehensive rapid review","volume":"13","author":"Goktas","journal-title":"J Clin Med"},{"issue":"4","key":"R8","doi-asserted-by":"publisher","first-page":"482","DOI":"10.4103\/idoj.idoj_72_23","article-title":"Using ChatGPT for writing articles for patients' education for dermatological diseases: a pilot study","volume":"14","author":"Mondal","journal-title":"Indian Dermatol Online J"},{"key":"R9","doi-asserted-by":"publisher","DOI":"10.2196\/90759","article-title":"Toward retrieval-grounded evaluation for conversational large language model-based risk assessment","volume":"5","author":"Hu","journal-title":"JMIR AI"},{"key":"R10","doi-asserted-by":"publisher","DOI":"10.1016\/j.jdin.2024.07.028","article-title":"Evaluating the appropriateness of skin cancer prevention recommendations obtained from an online chat-based artificial intelligence model","volume":"18","author":"Cai","journal-title":"JAAD Int"},{"key":"R11","doi-asserted-by":"publisher","DOI":"10.2196\/54704","article-title":"A preliminary checklist (METRICS) to standardize the design and reporting of studies on generative artificial intelligence-based models in health care education and practice: development study involving a literature review","volume":"13","author":"Sallam","journal-title":"Interact J Med Res"},{"key":"R12","unstructured":"Gao L Sherwood J Aleisa N Damoah A Lu Y Qu Q . Human-centered AI agents for healthcare and education: a systematic literature review. The George Washington University. 2025. URL: https:\/\/faculty.cs.gwu.edu\/xiaodongqu\/papers\/HCII_2025_5774_AI_Agent.pdf [Accessed 23-06-2026]"},{"key":"R13","unstructured":"How to prevent skin cancer. American Academy of Dermatology Association. URL: https:\/\/www.aad.org\/public\/diseases\/skin-cancer\/prevent\/how [Accessed 13-05-2025]"},{"key":"R14","unstructured":"Sunscreen FAQs. American Academy of Dermatology Association. URL: https:\/\/www.aad.org\/media\/stats-sunscreen [Accessed 13-05-2025]"},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.1016\/j.clinimag.2025.110525","article-title":"Classifying the clinical significance of common breast pain symptoms using a large language model, ChatGPT (GPT-4)","volume":"125","author":"Haver","journal-title":"Clin Imaging"},{"key":"R16","unstructured":"What to wear to protect your skin from the sun. American Academy of Dermatology Association. URL: https:\/\/www.aad.org\/public\/everyday-care\/sun-protection\/shade-clothing-sunscreen\/what-to-wear-protect-skin-from-sun [Accessed 13-05-2025]"},{"key":"R17","unstructured":"Types of skin cancer. American Academy of Dermatology Association. URL: https:\/\/www.aad.org\/public\/diseases\/skin-cancer\/types\/common [Accessed 13-05-2025]"},{"key":"R18","unstructured":"Find skin cancer: how to perform a skin self-exam. American Academy of Dermatology Association. URL: https:\/\/www.aad.org\/public\/diseases\/skin-cancer\/find\/check-skin [Accessed 13-05-2025]"},{"key":"R19","unstructured":"What to look for: ABCDEs of melanoma. American Academy of Dermatology Association. URL: https:\/\/www.aad.org\/public\/diseases\/skin-cancer\/find\/at-risk\/abcdes [Accessed 13-05-2025]"},{"issue":"1","key":"R20","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1159\/000541943","article-title":"Artificial intelligence-driven skin aging simulation as a novel skin cancer prevention","volume":"241","author":"Gantenbein","journal-title":"Dermatology"},{"issue":"3","key":"R21","doi-asserted-by":"publisher","first-page":"492","DOI":"10.1016\/j.jid.2023.10.004","article-title":"Artificial intelligence in skin cancer diagnosis: a reality check","volume":"144","author":"Brancaccio","journal-title":"J Invest Dermatol"},{"issue":"1","key":"R22","doi-asserted-by":"publisher","DOI":"10.3390\/medicina62010227","article-title":"Dermatology \u201cAI Babylon\u201d: cross-language evaluation of AI-crafted dermatology descriptions","volume":"62","author":"Karampinis","journal-title":"Medicina (Kaunas)"}],"container-title":["JMIR Dermatology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/derma.jmir.org\/2026\/1\/e93839","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T22:23:37Z","timestamp":1785536617000},"score":1,"resource":{"primary":{"URL":"https:\/\/derma.jmir.org\/2026\/1\/e93839"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,30]]},"references-count":22,"URL":"https:\/\/doi.org\/10.2196\/93839","relation":{},"ISSN":["2562-0959"],"issn-type":[{"value":"2562-0959","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,30]]},"article-number":"v9i5e93839"}}