{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T13:35:39Z","timestamp":1787924139315,"version":"build-2784847793"},"reference-count":23,"publisher":"FapUNIFESP (SciELO)","issue":"8","license":[{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"am","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Rev. Assoc. Med. Bras."],"abstract":"<jats:p>SUMMARY  OBJECTIVE: The aim of this study was to evaluate the responses generated by ChatGPT-5, Gemini, and Grok to the \u201csix most frequently asked patient questions\u201d on cryptorchidism published by the European Association of Urology, assessing them in terms of quality, understandability, actionability, and readability.  METHODS: ChatGPT-5, Gemini, and Grok were asked these six frequently asked questions listed on the European Association of Urology patient information page on cryptorchidism. The quality of the responses was evaluated using the Quality Assessment Tool for Patient Health Information instrument, understandability and actionability were assessed using Patient Education Materials Assessment Tool scores, and readability was measured with the Coleman-Liau Index. All evaluations were performed by four urologists.  RESULTS: Among the three artificial intelligence-based large language models, Gemini achieved the highest mean Quality Assessment Tool for Patient Health Information and Patient Education Materials Assessment Tool for Printable Materials scores. Kruskal-Wallis analysis demonstrated a statistically significant difference in Quality Assessment Tool for Patient Health Information scores among the groups (p=0.005); pairwise comparisons revealed that Gemini scored significantly higher than ChatGPT-5 (p=0.001). No significant differences were observed among the models for Patient Education Materials Assessment Tool\u2014Understandability Section or Patient Education Materials Assessment Tool\u2014Actionability Section scores (p&gt;0.05). In the readability analysis, Grok had the highest Coleman-Liau Index value (Coleman-Liau Index=14.68), and all models produced texts requiring a university-level reading ability. Although the Gemini model achieved higher overall quality scores, all artificial intelligence-based large language models provided good-quality but difficult-to-read information.  CONCLUSION: The responses generated by all three models demonstrated high levels of understandability and strong actionability. We anticipate that future, more advanced versions of artificial intelligence-based large language models will further improve these outcomes and contribute positively to the existing literature.<\/jats:p>","DOI":"10.1590\/1806-9282.20260541","type":"journal-article","created":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T13:15:47Z","timestamp":1787922947000},"source":"Crossref","is-referenced-by-count":0,"title":["Assessment of patient information quality provided by artificial intelligence-based large language models on cryptorchidism: a comparison of ChatGPT-5, Gemini, and Grok"],"prefix":"10.1590","volume":"72","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7670-9003","authenticated-orcid":false,"given":"Doruk","family":"Demirel","sequence":"first","affiliation":[{"name":"Ankara Bilkent City Hospital,  T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6343-383X","authenticated-orcid":false,"given":"Kaz\u0131m","family":"Ceviz","sequence":"additional","affiliation":[{"name":"Ankara Bilkent City Hospital,  T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5217-6011","authenticated-orcid":false,"given":"Tanju","family":"Keten","sequence":"additional","affiliation":[{"name":"Ankara Bilkent City Hospital,  T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1466-6490","authenticated-orcid":false,"given":"Cevdet Serkan","family":"G\u00f6kkaya","sequence":"additional","affiliation":[{"name":"Ankara Bilkent City Hospital,  T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"530","published-online":{"date-parts":[[2026]]},"reference":[{"key":"ref1","first-page":"261","article-title":"Maldescendus testis","volume":"51","author":"Toppari J","year":"2000","journal-title":"Horm Res"},{"key":"ref2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.1365-2605.2007.00770.x","article-title":"The frequency of undescended testis from birth to adulthood: a review","volume":"31","author":"Sijstermans K","year":"2008","journal-title":"Int J Androl"},{"key":"ref3","doi-asserted-by":"crossref","first-page":"2538860","DOI":"10.1080\/08916934.2025.2538860","article-title":"CPN2 alleviates cryptorchidism by inhibiting the NF-\u03baB pathway and regulating immune responses","volume":"58","author":"Wang L","year":"2025","journal-title":"Autoimmunity"},{"key":"ref4","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1007\/s10439-022-03121-w","article-title":"The future of AI in medicine: a perspective from a chatbot","volume":"51","author":"King MR","year":"2023","journal-title":"Ann Biomed Eng"},{"key":"ref5","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.eururo.2023.10.014","article-title":"Awareness and use of ChatGPT and large language models: a prospective cross-sectional global survey in urology","volume":"85","author":"Eppler M","year":"2024","journal-title":"Eur Urol"},{"key":"ref6","doi-asserted-by":"crossref","first-page":"3149","DOI":"10.1007\/s00345-023-04563-0","article-title":"ChatGPT and most frequent urological diseases: analysing the quality of information and potential risks for patients","volume":"41","author":"Szczesniewski JJ","year":"2023","journal-title":"World J Urol"},{"key":"ref7","doi-asserted-by":"crossref","first-page":"e0319782","DOI":"10.1371\/journal.pone.0319782","article-title":"Evaluating AI-based breastfeeding chatbots: quality, readability, and reliability analysis","volume":"20","author":"Kacer EO","year":"2025","journal-title":"PLoS One"},{"key":"ref8","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.euros.2024.08.015","article-title":"ChatGPT as a clinical decision maker for urolithiasis: compliance with the current European Association of Urology Guidelines","volume":"69","author":"Talyshinskii A","year":"2024","journal-title":"Eur Urol Open Sci"},{"issue":"10","key":"ref9","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1038\/s41443-025-01179-3","article-title":"Chatbots\u2019 performance in premature ejaculation questions: a comparative analysis of reliability, readability, and understandability","volume":"37","author":"Gonultas S","year":"2025","journal-title":"Int J Impot Res"},{"key":"ref10","series-title":"Frequently asked questions about cryptorchidism (undescended testicles)","author":"Radmayr C","year":"2025"},{"key":"ref11","doi-asserted-by":"crossref","first-page":"879","DOI":"10.21037\/tau-23-635","article-title":"Evaluating the efficacy of artificial intelligence chatbots in urological health: insights for urologists on patient interactions with large language models","volume":"13","author":"Simon BD","year":"2024","journal-title":"Transl Androl Urol"},{"key":"ref12","doi-asserted-by":"crossref","first-page":"7804","DOI":"10.3390\/jcm14217804","article-title":"Evaluating the readability and quality of bladder cancer information from AI chatbots: a comparative study between ChatGPT, Google Gemini, Grok, Claude and DeepSeek","volume":"14","author":"Patel K","year":"2025","journal-title":"J Clin Med"},{"key":"ref13","doi-asserted-by":"crossref","first-page":"e55939","DOI":"10.2196\/55939","article-title":"Evaluating the efficacy of ChatGPT as a patient education tool in prostate cancer: multimetric assessment","volume":"26","author":"Gibson D","year":"2024","journal-title":"J Med Internet Res"},{"key":"ref14","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1007\/s11701-025-02871-8","article-title":"Quality assessment of patient-facing urologic telesurgery content using validated tools","volume":"19","author":"Davuluri T","year":"2025","journal-title":"J Robot Surg"},{"key":"ref15","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1136\/jech.53.2.105","article-title":"DISCERN: an instrument for judging the quality of written consumer health information on treatment choices","volume":"53","author":"Charnock D","year":"1999","journal-title":"J Epidemiol Commun Health"},{"key":"ref16","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1016\/j.pec.2014.05.027","article-title":"Development of the Patient Education Materials Assessment Tool (PEMAT): a new measure of understandability and actionability for print and audiovisual patient information","volume":"96","author":"Shoemaker SJ","year":"2014","journal-title":"Patient Educ Couns"},{"key":"ref17","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1037\/h0076540","article-title":"A computer readability formula designed for machine scoring","volume":"60","author":"Coleman M","year":"1975","journal-title":"J Appl Psychol"},{"issue":"6","key":"ref18","doi-asserted-by":"crossref","first-page":"1551","DOI":"10.1016\/j.jpurol.2025.08.029","article-title":"Quality of information on hypospadias from artificial intelligence chatbots: how safe is AI for patient and family information?","volume":"21","author":"Stapleton P","year":"2025","journal-title":"J Pediatr Urol"},{"key":"ref19","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1097\/UPJ.0000000000000792","article-title":"Assessing ChatGPT responses to frequently asked patient questions in reconstructive urology","volume":"12","author":"Alshak MN","year":"2025","journal-title":"Urol Pract"},{"key":"ref20","doi-asserted-by":"crossref","first-page":"102206","DOI":"10.1016\/j.clgc.2024.102206","article-title":"Can patients with urogenital cancer rely on artificial intelligence chatbots for treatment decisions?","volume":"22","author":"Erkan A","year":"2024","journal-title":"Clin Genitourin Cancer"},{"key":"ref21","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1016\/j.urology.2025.01.054","article-title":"Quality of information on wilms tumor from artificial intelligence chatbots: what are your patients and their families reading?","volume":"198","author":"Stapleton P","year":"2025","journal-title":"Urology"},{"issue":"Suppl 2","key":"ref22","first-page":"S57","article-title":"Quality of patient information on interstitial cystitis from artificial intelligence chatbots","volume":"138","author":"Santucci J","year":"2025","journal-title":"BJU Int"},{"key":"ref23","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1016\/j.juro.2014.05.005","article-title":"Evaluation and treatment of cryptorchidism: AUA guideline","volume":"192","author":"Kolon TF","year":"2014","journal-title":"J Urol"}],"container-title":["Revista da Associa\u00e7\u00e3o M\u00e9dica Brasileira"],"original-title":[],"link":[{"URL":"http:\/\/www.scielo.br\/scielo.php?script=sci_pdf&pid=S0104-42302026000802212&tlng=en","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T13:15:51Z","timestamp":1787922951000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.scielo.br\/scielo.php?script=sci_arttext&pid=S0104-42302026000802212&tlng=en"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026]]},"references-count":23,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2026]]}},"alternative-id":["S0104-42302026000802212"],"URL":"https:\/\/doi.org\/10.1590\/1806-9282.20260541","relation":{},"ISSN":["1806-9282","0104-4230"],"issn-type":[{"value":"1806-9282","type":"electronic"},{"value":"0104-4230","type":"print"}],"subject":[],"published":{"date-parts":[[2026]]},"article-number":"e20260541"}}