{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,29]],"date-time":"2026-10-29T04:35:10Z","timestamp":1793248510781,"version":"4.5.0"},"reference-count":33,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,7,23]],"date-time":"2025-07-23T00:00:00Z","timestamp":1753228800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Public Health"],"abstract":"Background<\/jats:title>With the rapid advancement and widespread adoption of artificial intelligence (AI), patients increasingly turn to AI for initial medical guidance. Therefore, a comprehensive evaluation of AI-generated responses is warranted. This study aimed to compare the performance of DeepSeek and ChatGPT in answering urinary incontinence-related questions and to delineate their respective strengths and limitations.<\/jats:p><\/jats:sec>Methods<\/jats:title>Based on the American Urological Association\/Society of Urodynamics, Female Pelvic Medicine &amp; Urogenital Reconstruction (AUA\/SUFU) and European Association of Urology (EAU) guidelines, we designed 25 urinary incontinence-related questions. Responses from DeepSeek and ChatGPT-4.0 were evaluated for reliability, quality, and readability. Fleiss' kappa was employed to calculate inter-rater reliability. For clinical case scenarios, we additionally assessed the appropriateness of responses. A comprehensive comparative analysis was performed.<\/jats:p><\/jats:sec>Results<\/jats:title>The modified DISCERN (mDISCERN) scores for DeepSeek and ChatGPT-4.0 were 28.24 \u00b1 0.88 and 28.76 \u00b1 1.56, respectively, showing no practically meaningful difference [P<\/jats:italic> = 0.188, Cohen's d<\/jats:italic> = 0.41 (95% CI<\/jats:italic>: \u22120.15, 0.97)]. Both AI chatbots rarely provided source references. In terms of quality, DeepSeek achieved a higher mean Global Quality Scale (GQS) score than ChatGPT-4.0 (4.76 \u00b1 0.52 vs. 4.32 \u00b1 0.69, P<\/jats:italic> = 0.001). DeepSeek also demonstrated superior readability, as indicated by a higher Flesch Reading Ease (FRE) score (76.43 \u00b1 10.90 vs. 70.95 \u00b1 11.16, P<\/jats:italic> = 0.039) and a lower Simple Measure of Gobbledygook (SMOG) index (12.26 \u00b1 1.39 vs. 14.21 \u00b1 1.88, P<\/jats:italic> &lt; 0.001), suggesting easier comprehension. Regarding guideline adherence, DeepSeek had 11 (73.33%) fully compliant responses, while ChatGPT-4.0 had 13 (86.67%), with no significant difference [P<\/jats:italic> = 0.651, Cohen's w<\/jats:italic> = 0.083 (95% CI: 0.021, 0.232)].<\/jats:p><\/jats:sec>Conclusion<\/jats:title>DeepSeek and ChatGPT-4.0 might exhibit comparable reliability in answering urinary incontinence-related questions, though both lacked sufficient references. However, DeepSeek outperformed ChatGPT-4.0 in response quality and readability. While both AI chatbots largely adhered to clinical guidelines, occasional deviations were observed. Further refinements are necessary before the widespread clinical implementation of AI chatbots in urology.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fpubh.2025.1605908","type":"journal-article","created":{"date-parts":[[2025,7,23]],"date-time":"2025-07-23T05:36:13Z","timestamp":1753248973000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Battle of the artificial intelligence: a comprehensive comparative analysis of DeepSeek and ChatGPT for urinary incontinence-related questions"],"prefix":"10.3389","volume":"13","author":[{"given":"Huawei","family":"Cao","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Changzhen","family":"Hao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tao","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiang","family":"Zheng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zihao","family":"Gao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiyue","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lijian","family":"Gan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiangjun","family":"Zeng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,7,23]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"17042","DOI":"10.1038\/nrdp.2017.42","article-title":"Urinary incontinence in women","volume":"3","author":"Aoki","year":"2017","journal-title":"Nat Rev Dis Primers."},{"key":"B2","doi-asserted-by":"publisher","first-page":"2314","DOI":"10.3390\/jcm10112314","article-title":"Population-level prevalence, bother, and treatment behavior for urinary incontinence in an eastern European country: findings from the LUTS Poland study","volume":"10","author":"Przydacz","year":"2021","journal-title":"J Clin Med."},{"key":"B3","doi-asserted-by":"publisher","first-page":"1772","DOI":"10.3390\/healthcare11121772","article-title":"Urinary incontinence affects the quality of life and increases psychological distress and low self-esteem","volume":"11","author":"AlQuaiz","year":"2023","journal-title":"Healthcare."},{"key":"B4","doi-asserted-by":"publisher","first-page":"1112","DOI":"10.1111\/jocn.12729","article-title":"Effects of stigma on Chinese women's attitudes towards seeking treatment for urinary incontinence","volume":"24","author":"Wang","year":"2015","journal-title":"J Clin Nurs."},{"key":"B5","doi-asserted-by":"publisher","first-page":"cxcix","DOI":"10.12968\/jowc.2021.0394","article-title":"Patients' experience of incontinence and incontinence-associated dermatitis in hospital settings: a qualitative study","volume":"33","author":"Barakat-Johnson","year":"2024","journal-title":"J Wound Care."},{"key":"B6","doi-asserted-by":"publisher","first-page":"1047","DOI":"10.2147\/PPA.S461027","article-title":"Exploring the hidden struggles: a qualitative insight into urinary incontinence among prostate cancer survivors post-surgery","volume":"18","author":"Sun","year":"2024","journal-title":"Patient Prefer Adherence."},{"key":"B7","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1007\/s10916-024-02125-4","article-title":"How useful are current chatbots regarding urology patient information? Comparison of the ten most popular Chatbots' responses about female urinary incontinence","volume":"48","author":"Malak","year":"2024","journal-title":"J Med Syst."},{"key":"B8","doi-asserted-by":"publisher","first-page":"4291","DOI":"10.1093\/eurheartj\/ehae465","article-title":"Artificial intelligence in cardiovascular medicine: clinical applications","volume":"45","author":"Luscher","year":"2024","journal-title":"Eur Heart J."},{"key":"B9","doi-asserted-by":"publisher","first-page":"2182659","DOI":"10.1080\/10872981.2023.2182659","article-title":"Chatbots for future docs: exploring medical students' attitudes and knowledge towards artificial intelligence and medical chatbots","volume":"28","author":"Moldt","year":"2023","journal-title":"Med Educ Online."},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-024-02630-z","article-title":"Chatbots in science: what can ChatGPT do for you?","author":"Pividori","year":"2024","journal-title":"Nature."},{"key":"B11","doi-asserted-by":"publisher","first-page":"e47479","DOI":"10.2196\/47479","article-title":"Reliability of medical information provided by ChatGPT: assessment against clinical guidelines and patient information quality instrument","volume":"25","author":"Walker","year":"2023","journal-title":"J Med Int Res."},{"key":"B12","doi-asserted-by":"publisher","first-page":"rs","DOI":"10.21203\/rs.3.rs-2566942\/v1","article-title":"Assessing the accuracy and reliability of AI-generated medical responses: an evaluation of the Chat-GPT model","volume":"28","author":"Johnson","year":"2023","journal-title":"Res Sq."},{"key":"B13","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1038\/d41586-025-00460-1","article-title":"China made waves with Deepseek, but its real ambition is AI-driven industrial innovation","volume":"638","author":"Dreyer","year":"2025","journal-title":"Nature."},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-025-03727-2","article-title":"Benchmark evaluation of deepseek large language models in clinical decision-making","author":"Sandmann","year":"2025","journal-title":"Nat Med."},{"key":"B15","doi-asserted-by":"publisher","first-page":"558","DOI":"10.1097\/JU.0000000000000309","article-title":"Diagnosis and treatment of overactive bladder (non-neurogenic) in adults: AUA\/SUFU guideline amendment 2019","volume":"202","author":"Lightner","year":"2019","journal-title":"J Urol."},{"key":"B16","doi-asserted-by":"publisher","first-page":"1091","DOI":"10.1097\/JU.0000000000003435","article-title":"Updates to surgical treatment of female stress urinary incontinence (SUI): AUA\/SUFU guideline","volume":"209","author":"Kobashi","year":"2023","journal-title":"J Urol."},{"key":"B17","doi-asserted-by":"publisher","first-page":"596","DOI":"10.1016\/j.eururo.2017.12.031","article-title":"EAU guidelines on assessment and nonsurgical management of urinary incontinence","volume":"73","author":"Nambiar","year":"2018","journal-title":"Eur Urol."},{"key":"B18","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1038\/s41598-023-50884-w","article-title":"Evaluation of the reliability and readability of ChatGPT-4 responses regarding hypothyroidism during pregnancy","volume":"14","author":"Onder","year":"2024","journal-title":"Sci Rep."},{"key":"B19","doi-asserted-by":"publisher","first-page":"454","DOI":"10.1016\/j.clgc.2023.12.017","article-title":"Urological cancers and ChatGPT: assessing the quality of information and possible risks for patients","volume":"22","author":"Ozgor","year":"2024","journal-title":"Clin Genitourin Cancer."},{"key":"B20","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1002\/eat.23173","article-title":"Readability and quality of online eating disorder information-are they sufficient? A systematic review evaluating websites on anorexia nervosa using discern and flesch readability","volume":"53","author":"Arts","year":"2020","journal-title":"Int J Eat Disord"},{"key":"B21","doi-asserted-by":"publisher","first-page":"38","DOI":"10.5195\/jmla.2018.262","article-title":"Computerized versus hand-scored health literacy tools: a comparison of simple measure of Gobbledygook (SMOG) and Flesch-Kincaid in printed patient education materials","volume":"106","author":"Grabeel","year":"2018","journal-title":"J Med Libr Assoc."},{"key":"B22","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1016\/j.semcancer.2021.02.011","article-title":"Artificial intelligence and pathology: from principles to practice and future applications in histomorphology and molecular profiling","volume":"84","author":"Stenzinger","year":"2022","journal-title":"Semin Cancer Biol."},{"key":"B23","doi-asserted-by":"publisher","first-page":"1773","DOI":"10.3390\/curroncol29030146","article-title":"Applications of artificial intelligence in screening, diagnosis, treatment, and prognosis of colorectal cancer","volume":"29","author":"Qiu","year":"2022","journal-title":"Curr Oncol."},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1108\/JHOM-12-2023-0376","article-title":"A systematic review of AI-based chatbot usages in healthcare services","author":"Mohamed Jasim","year":"2025","journal-title":"J Health Organ Manag."},{"key":"B25","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1007\/s00345-024-05326-1","article-title":"Battle of the bots: a comparative analysis of ChatGPT and Bing AI for kidney stone-related questions","volume":"42","author":"McMahon","year":"2024","journal-title":"World J Urol."},{"key":"B26","doi-asserted-by":"publisher","first-page":"105871","DOI":"10.1016\/j.ijmedinf.2025.105871","article-title":"Evaluating AI-generated patient education materials for spinal surgeries: comparative analysis of readability and discern quality across ChatGPT and Deepseek models","volume":"198","author":"Zhou","year":"2025","journal-title":"Int J Med Inform."},{"key":"B27","doi-asserted-by":"publisher","first-page":"38","DOI":"10.3352\/jeehp.2023.20.38","article-title":"Application of artificial intelligence chatbots, including ChatGPT, in education, scholarly work, programming, and content generation and its prospects: a narrative review","volume":"20","author":"Kim","year":"2023","journal-title":"J Educ Eval Health Prof."},{"key":"B28","doi-asserted-by":"publisher","first-page":"104","DOI":"10.3390\/jpm14010104","article-title":"Assessment of quality and readability of information provided by Chatgpt in relation to anterior cruciate ligament injury","volume":"14","author":"Fahy","year":"2024","journal-title":"J Pers Med."},{"key":"B29","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1038\/s41746-024-01239-w","article-title":"Closing the gap between open source and commercial large language models for medical evidence summarization","volume":"7","author":"Zhang","year":"2024","journal-title":"NPJ Digit Med."},{"key":"B30","doi-asserted-by":"publisher","first-page":"1277756","DOI":"10.3389\/fpsyt.2023.1277756","article-title":"ChatGPT is not ready yet for use in providing mental health assessment and interventions","volume":"14","author":"Dergaa","year":"2024","journal-title":"Front Psychiatry."},{"key":"B31","doi-asserted-by":"publisher","first-page":"104264","DOI":"10.1016\/j.actpsy.2024.104264","article-title":"The influence of the COVID-19 pandemic on the adoption and impact of AI chatgpt: challenges, applications, and ethical considerations","volume":"246","author":"Hussain","year":"2024","journal-title":"Acta Psychol."},{"key":"B32","doi-asserted-by":"publisher","first-page":"3590","DOI":"10.1038\/s41591-024-03258-2","article-title":"A toolbox for surfacing health equity harms and biases in large language models","volume":"30","author":"Pfohl","year":"2024","journal-title":"Nat Med."},{"key":"B33","doi-asserted-by":"publisher","first-page":"56","DOI":"10.3390\/ai6030056","article-title":"Emotion-aware embedding fusion in large language models (Flan-T5, Llama 2, DeepSeek-R1, and ChatGPT 4) for intelligent response generation","volume":"6","author":"Rasool","year":"2025","journal-title":"AI."}],"container-title":["Frontiers in Public Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2025.1605908\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,23]],"date-time":"2025-07-23T05:36:14Z","timestamp":1753248974000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2025.1605908\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,23]]},"references-count":33,"alternative-id":["10.3389\/fpubh.2025.1605908"],"URL":"https:\/\/doi.org\/10.3389\/fpubh.2025.1605908","relation":{},"ISSN":["2296-2565"],"issn-type":[{"value":"2296-2565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,23]]},"article-number":"1605908"}}