{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T06:13:14Z","timestamp":1788415994666,"version":"build-2803163510"},"reference-count":31,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T00:00:00Z","timestamp":1788393600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Oncol."],"abstract":"\n Background<\/jats:title>\n Bladder cancer ranks among the most prevalent urological tumors worldwide, with its global incidence continuing to rise steadily. Although patient education materials (PEMs) play a crucial role in enhancing disease comprehension and supporting joint clinical decision-making, current online resources frequently surpass the readability thresholds recommended for the general public. Large language models (LLMs) hold promise for health communication, yet no systematic assessment has been conducted regarding their feasibility and trustworthiness specifically for bladder cancer patient education.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to systematically benchmark five leading LLMs in producing question-and-answer content for bladder cancer science popularization, with a particular focus on readability, informational quality, and appropriateness for patient education.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n In this cross-sectional simulation study, 20 common patient questions covering five disease domains were compiled. On January 15, 2026, each question was submitted identically to five publicly available LLMs (Doubao, DeepSeek, Kimi, Gemini, and ChatGPT). Readability was evaluated using seven conventional metrics. Two independent pharmacists, blinded to model identity, rated the responses using the Chinese version of the Patient Education Materials Assessment Tool for print materials (C-PEMAT-P) and the Global Quality Score (GQS). Additionally, two independent clinical specialists assessed factual accuracy and alignment with the Chinese Bladder Cancer Diagnosis and Treatment Guidelines (2024 edition) employing a 4-point scale. Cohen\u2019s kappa was used to determine inter-rater reliability.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n ChatGPT, DeepSeek, and Doubao outperformed Kimi and Gemini on both C-PEMAT and GQS (all P &lt; 0.001), indicating superior understandability, actionability, and overall quality. Across all models, median C-PEMAT scores ranged from 8 to 10, suggesting broadly acceptable suitability for patient education. Readability varied significantly by content domain, with treatment-oriented texts showing the highest complexity. ChatGPT achieved the best alignment with clinical guidelines. No model produced harmful advice or directly contradicted guideline recommendations. Traditional readability measures correlated weakly with GQS, whereas C-PEMAT showed a moderate positive correlation (r = 0.34).<\/jats:p>\n <\/jats:sec>\n \n Conclusion<\/jats:title>\n Current mainstream LLMs demonstrate initial potential for generating educational content on bladder cancer, albeit with considerable heterogeneity across models. Disease-specific evaluation instruments for patient education materials are more effective than general readability formulas in reflecting perceived quality. Our results advocate for a prudent, assistive role of LLMs in health communication under a human-AI collaborative model.<\/jats:p>\n <\/jats:sec>","DOI":"10.3389\/fonc.2026.1909227","type":"journal-article","created":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T05:21:20Z","timestamp":1788412880000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Performance evaluation of large language models in bladder cancer patient education Q&A: a cross-sectional study"],"prefix":"10.3389","volume":"16","author":[{"given":"Dian","family":"Wan","sequence":"first","affiliation":[{"name":"Department of Urology, Huanggang Central Hospital, Affiliated Huanggang Hospital, Hubei University of Science and Technology","place":["Huanggang, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Youwen","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Urology, Huanggang Central Hospital, Affiliated Huanggang Hospital, Hubei University of Science and Technology","place":["Huanggang, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zheng","family":"Dong","sequence":"additional","affiliation":[{"name":"Department of Urology, Huanggang Central Hospital, Affiliated Huanggang Hospital, Hubei University of Science and Technology","place":["Huanggang, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chen","family":"Dai","sequence":"additional","affiliation":[{"name":"College of Clinical Medicine, Hubei University of Science and Technology","place":["Xianning, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinghe","family":"Ye","sequence":"additional","affiliation":[{"name":"Department of Urology, Huanggang Central Hospital, Affiliated Huanggang Hospital, Hubei University of Science and Technology","place":["Huanggang, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Song","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Urology, Huanggang Central Hospital, Affiliated Huanggang Hospital, Hubei University of Science and Technology","place":["Huanggang, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sunlu","family":"Jiang","sequence":"additional","affiliation":[{"name":"Department of Minimally Invasive Intervention, Hubei Cancer Hospital, Tongji Medical College, Huazhong University of Science and Technology","place":["Wuhan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,9,3]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1186\/s40164-025-00694-9","article-title":"Incidence, mortality, and risk factors of bladder, kidney, prostate and testicular cancers in China and comparisons with the United States, the United Kingdom, Japan, and the Republic of Korea: an up-to-date overview based on the Global Burden of Disease 2021","volume":"14","author":"Kadeerhan","year":"2025","journal-title":"Exp Hematol Oncol"},{"key":"B2","doi-asserted-by":"publisher","first-page":"S33","DOI":"10.1038\/551s33a","article-title":"Bladder cancer","volume":"551","author":"Grayson","year":"2017","journal-title":"Nature"},{"key":"B3","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1186\/s41043-025-01113-9","article-title":"Diseases burden and trends of bladder cancer attributable to behavioral and metabolic factors among global and Chinese population, 1990-2021: results from the global burden of disease study 2021","volume":"44","author":"Liu","year":"2025","journal-title":"J Health Popul Nutr"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1016\/j.lanwpc.2025.101517","article-title":"Age-sex-specific burden of urological cancers attributable to risk factors in China and its provinces, 1990-2021, and forecasts with scenarios simulation: a systematic analysis for the Global Burden of Disease Study 2021","volume":"56","author":"Xue","year":"2025","journal-title":"Lancet Reg Health West Pac"},{"key":"B5","doi-asserted-by":"publisher","first-page":"20811","DOI":"10.2139\/ssrn.5192801","article-title":"Disease burden of bladder cancer in China and the different SDI regions over the world from 1990 to 2021","volume":"15","author":"Chen","year":"2025","journal-title":"Sci Rep"},{"key":"B6","doi-asserted-by":"publisher","first-page":"34","DOI":"10.20944\/preprints202412.1528.v1","article-title":"ChatGPT vs. Gemini: Which Provides Better Information on Bladder Cancer","volume":"6","author":"Alasker","year":"2025","journal-title":"Soci\u00e9t\u00e9 Internationale d\u2019Urol J"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1097\/upj.0000000000000574","article-title":"Quality and readability of online health information on common urologic cancers: assessing barriers to health literacy in urologic oncology","volume":"11","author":"Giakas","year":"2024","journal-title":"Urol Pract"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.3233\/blc-200387","article-title":"Bladder cancer health literacy: assessing readability of online patient education materials","volume":"7","author":"Powell","year":"2021","journal-title":"Bladder Cancer"},{"key":"B9","doi-asserted-by":"publisher","first-page":"3553","DOI":"10.1186\/s12889-025-24834-2","article-title":"National and subnational trends of years of life lost and reduced life expectancy caused by bladder cancer in China from 2005 to 2020","volume":"25","author":"Liu","year":"2025","journal-title":"BMC Public Health"},{"key":"B10","article-title":"Artificial intelligence improves urologic oncology patient education and counseling","volume":"31","author":"Shah","year":"2024","journal-title":"Can J Urol"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1007\/s11764-025-01921-2","article-title":"What do the current popular artificial intelligence chatbots offer us regarding patient information? Comparison of responses from the ten most popular chatbots about bladder cancer","author":"Sahin","year":"2025","journal-title":"J Cancer Surviv"},{"key":"B12","doi-asserted-by":"publisher","first-page":"4","DOI":"10.5455\/aim.2024.33.4-10","article-title":"The use of large language models in generating patient education materials: a scoping review","volume":"33","author":"AlSammarraie","year":"2025","journal-title":"Acta Inform Med"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.3390\/healthcare13212670","article-title":"Balancing accuracy and readability: comparative evaluation of AI chatbots for patient education on rotator cuff tears","volume":"13","author":"Koluman","year":"2025","journal-title":"Healthcare (Basel)"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1089\/end.2024.0860","article-title":"Enhanced artificial intelligence in bladder cancer management: A comparative analysis and optimization study of multiple large language models","volume":"39","author":"Li","year":"2025","journal-title":"J Endourol"},{"key":"B15","doi-asserted-by":"publisher","first-page":"186","DOI":"10.6004\/jnccn.2026.0022","article-title":"Bladder cancer, version 1.2026, NCCN clinical practice guidelines in oncology","volume":"24","author":"Flaig","year":"2026","journal-title":"J Natl Compr Canc Netw"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.85277","article-title":"Evaluating AI-generated patient education guides: A comparative study of chatGPT and deepseek","volume":"17","author":"Jabeen","year":"2025","journal-title":"Cureus"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1007\/s12020-025-04421-6","article-title":"Evaluation of large language models in patient education for hyperthyroidism: A comparative study of chatgpt, gemini, and deepseek","volume":"90","author":"Hu","year":"2025","journal-title":"Endocrine"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph181910329","article-title":"Assessing communicative effectiveness of public health information in chinese: developing automatic decision aids for international health professionals","volume":"18","author":"Ji","year":"2021","journal-title":"Int J Environ Res Public Health"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2022.46051","article-title":"Comparison of Readability Scores for Written Health Information Across Formulas Using Automated vs Manual Measures","volume":"5","author":"Mac","year":"2022","journal-title":"JAMA Netw Open"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0324175","article-title":"GPT-4 generates accurate and readable patient education materials aligned with current oncological guidelines: A randomized assessment","volume":"20","author":"Rodler","year":"2025","journal-title":"PloS One"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.5826\/dpc.1504a5929","article-title":"Artificial intelligence in patient education for androgenetic alopecia: A comparative study of chatGPT, gemini, and deepseek R1","volume":"15","author":"Yigen \u0130rita\u015f","year":"2025","journal-title":"Dermatol Pract Concept"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1016\/j.jse.2025.02.025","article-title":"Improving readability of shoulder and elbow surgery online patient education material with Chat GPT (Chat Generative Pretrained Transformer) 4","volume":"34","author":"Chandra","year":"2025","journal-title":"J Shoulder Elbow Surg"},{"key":"B23","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1038\/s41405-025-00349-1","article-title":"Assessing the power of AI: a comparative evaluation of large language models in generating patient education materials in dentistry","volume":"11","author":"Sivaramakrishnan","year":"2025","journal-title":"BDJ Open"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-026-57001-7","article-title":"Performance of large language models on the Turkish Pharmacy Specialty Examination: a comparative analysis of accuracy, confidence, and readability","author":"Balaban","year":"2026","journal-title":"Sci Rep"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1016\/j.jtha.2025.09.004","article-title":"Large language models vs thrombosis experts: a comparative study on patient education and clinical decision-making in venous thromboembolism","volume":"24","author":"Vladic","year":"2026","journal-title":"J Thromb Haemost"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.3389\/frai.2025.1652556","article-title":"DiaGuide-LLM-Using large language models for patient-specific education and health guidance in diabetes","volume":"8","author":"Skjervold","year":"2025","journal-title":"Front Artif Intell"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2025.1616488","article-title":"Generative AI in consumer health: leveraging large language models for health literacy and clinical safety with a digital health framework","volume":"7","author":"Tilton","year":"2025","journal-title":"Front Digit Health"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.5534\/wjmh.250144","article-title":"Quality and readability analysis of artificial intelligence-generated medical information related to prostate cancer: a cross-sectional study of ChatGPT and DeepSeek","author":"Luo","year":"2025","journal-title":"World J Mens Health"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.4103\/1357-6283.210517","article-title":"Assessing reading levels of health information: uses and limitations of flesch formula","volume":"30","author":"Jindal","year":"2017","journal-title":"Educ Health (Abingdon)"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2025.1584883","article-title":"Perspective: advancing public health education by embedding AI literacy","volume":"7","author":"Acosta","year":"2025","journal-title":"Front Digit Health"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1136\/bmjhci-2025-101570","article-title":"Development and evaluation of an agentic LLM based RAG framework for evidence-based patient education","volume":"32","author":"AlSammarraie","year":"2025","journal-title":"BMJ Health Care Inform"}],"container-title":["Frontiers in Oncology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fonc.2026.1909227\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T05:21:21Z","timestamp":1788412881000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fonc.2026.1909227\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,3]]},"references-count":31,"alternative-id":["10.3389\/fonc.2026.1909227"],"URL":"https:\/\/doi.org\/10.3389\/fonc.2026.1909227","relation":{},"ISSN":["2234-943X"],"issn-type":[{"value":"2234-943X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,3]]},"article-number":"1909227"}}