{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,19]],"date-time":"2026-10-19T19:56:11Z","timestamp":1792439771740,"version":"4.5.0"},"reference-count":32,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T00:00:00Z","timestamp":1773187200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JCM"],"abstract":"<jats:p>Background\/Objectives: Artificial intelligence (AI) tools, particularly large language models (LLMs) such as ChatGPT-4o, are gaining prominence in medicine. While their diagnostic capabilities have been explored across various oncologic domains, their role in clinical decision-making within multidisciplinary tumor boards (MTBs) remains largely unexamined in urologic oncology. This study evaluates the performance of ChatGPT-4o as a decision-support tool in a real-world MTB setting by comparing its recommendations with those of expert clinicians. Materials and Methods: A retrospective study was conducted using 98 anonymized clinical cases discussed by a urologic MTB between June 2024 and February 2025. An independent urologist entered the same cases into ChatGPT-4o using a standardized prompt replicating real-world presentation. Two certified urologists independently assessed the model\u2019s responses. Agreement was analyzed overall and by tumor type, disease stage, clinical context, and treatment strategy. Results: ChatGPT-4o fully agreed with the MTB in 56.1% of cases, was correct but incomplete in 23.5%, and provided partially accurate but flawed recommendations in 18.4%. Overall concordance between ChatGPT-4o and the MTB yielded a Cohen\u2019s kappa of 0.61, indicating moderate-to-good agreement. Discrepancies were most common in metastatic prostate cancer, often due to misclassification of tumor burden or errors in treatment sequencing. Highest agreement rates were observed in bladder and renal tumors, and in standardized therapeutic scenarios such as radiotherapy. Conclusions: ChatGPT-4o demonstrated moderate alignment with expert MTB decisions and performed best in well-defined clinical contexts. While it cannot replace multidisciplinary expertise, it may serve as a supportive tool to enhance access to standardized oncologic care.<\/jats:p>","DOI":"10.3390\/jcm15062130","type":"journal-article","created":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T10:43:27Z","timestamp":1773225807000},"page":"2130","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Evaluation of Artificial Intelligence as a Decision-Support Tool in Urological Tumor Boards: A Study in Real Clinical Practice"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9983-3392","authenticated-orcid":false,"given":"Javier","family":"De la Torre-Trillo","sequence":"first","affiliation":[{"name":"Urology Department, Hospital Regional Santa Ana, Av. Enrique Mart\u00edn Cuevas, s\/n, 18600 Motril, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6167-0890","authenticated-orcid":false,"given":"Yaiza","family":"Y\u00e1\u00f1ez Castillo","sequence":"additional","affiliation":[{"name":"Urology Department, Hospital Regional Santa Ana, Av. Enrique Mart\u00edn Cuevas, s\/n, 18600 Motril, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4183-2060","authenticated-orcid":false,"given":"Maria Teresa","family":"Melgarejo Segura","sequence":"additional","affiliation":[{"name":"Grupo URO-MET, Instituto IBS Granada, Avda. de Madrid, 15, 18012 Granada, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elisa","family":"Carmona S\u00e1nchez","sequence":"additional","affiliation":[{"name":"Urology Department, Hospital Regional Santa Ana, Av. Enrique Mart\u00edn Cuevas, s\/n, 18600 Motril, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-2320-5088","authenticated-orcid":false,"given":"Alberto","family":"Zambudio Munuera","sequence":"additional","affiliation":[{"name":"Urology Department, Hospital Universitario San Cecilio, Av. de la Investigaci\u00f3n, 18016 Granada, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7633-9794","authenticated-orcid":false,"given":"Juan","family":"Mora-Delgado","sequence":"additional","affiliation":[{"name":"Infectious Diseases and Clinical Microbiology Department, Hospital Jerez de la Frontera, Ctra. Trebujena, s\/n, Jerez de la Frontera, 11407 Cadiz, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alfonso","family":"L\u00f3pez Luque","sequence":"additional","affiliation":[{"name":"Urology Department, Hospital Regional Santa Ana, Av. Enrique Mart\u00edn Cuevas, s\/n, 18600 Motril, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1233","DOI":"10.1056\/NEJMsr2214184","article-title":"Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine","volume":"388","author":"Lee","year":"2023","journal-title":"N. Engl. J. Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1007\/s10916-023-01925-4","article-title":"Evaluating the Feasibility of ChatGPT in Healthcare: An Analysis of Multiple Clinical and Research Scenarios","volume":"47","author":"Cascella","year":"2023","journal-title":"J. Med. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep Learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"e27850","DOI":"10.2196\/27850","article-title":"Chatbot for Health Care and Oncology Applications Using Artificial Intelligence and Machine Learning: Systematic Review","volume":"7","author":"Xu","year":"2021","journal-title":"JMIR Cancer"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1145\/3571730","article-title":"Survey of Hallucination in Natural Language Generation","volume":"55","author":"Ji","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","article-title":"Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead","volume":"1","author":"Rudin","year":"2019","journal-title":"Nat. Mach. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"9363","DOI":"10.2147\/CMAR.S220976","article-title":"Benefits and Limitations of a Multidisciplinary Approach in Cancer Patient Management","volume":"12","author":"Berardi","year":"2020","journal-title":"Cancer Manag. Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"e996","DOI":"10.1002\/onco.13643","article-title":"Survival Impact and Cost-Effectiveness of a Multidisciplinary Tumor Board for Breast Cancer in Mozambique, Sub-Saharan Africa","volume":"26","author":"Guisseve","year":"2021","journal-title":"Oncologist"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ammo, T., Guillaume, V.G.J., Hofmann, U.K., Ulmer, N.M., Buenting, N., Laenger, F., Beier, J.P., and Leypold, T. (2024). Evaluating ChatGPT-4o as a Decision Support Tool in Multidisciplinary Sarcoma Tumor Boards: Heterogeneous Performance across Various Specialties. Front. Oncol., 14.","DOI":"10.3389\/fonc.2024.1526288"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"114100","DOI":"10.1016\/j.ejca.2024.114100","article-title":"ChatGPT\u2019s Gastrointestinal Tumor Board Tango: A Limping Dance Partner?","volume":"205","author":"Aghamaliyev","year":"2024","journal-title":"Eur. J. Cancer"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"6099","DOI":"10.1007\/s00405-024-08828-1","article-title":"Assessing the Use of the Novel Tool Claude 3 in Comparison to ChatGPT 4.0 as an Artificial Intelligence Tool in the Diagnosis and Therapy of Primary Head and Neck Cancer Cases","volume":"281","author":"Schmidl","year":"2024","journal-title":"Eur. Arch. Otorhinolaryngol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1186\/s40164-022-00333-7","article-title":"Introducing AI to the Molecular Tumor Board: One Direction toward the Establishment of Precision Medicine Using Large-Scale Cancer Clinical and Biological Information","volume":"11","author":"Hamamoto","year":"2022","journal-title":"Exp. Hematol. Oncol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1038\/s41523-023-00557-8","article-title":"Large Language Model (ChatGPT) as a Support Tool for Breast Tumor Board","volume":"9","author":"Sorin","year":"2023","journal-title":"npj Breast Cancer"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1007\/s12029-023-00967-8","article-title":"The Fidelity of Artificial Intelligence to Multidisciplinary Tumor Board Recommendations for Patients with Gastric Cancer: A Retrospective Study","volume":"55","author":"Park","year":"2024","journal-title":"J. Gastrointest. Cancer"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1056\/NEJMoa1503747","article-title":"Chemohormonal Therapy in Metastatic Hormone-Sensitive Prostate Cancer","volume":"373","author":"Sweeney","year":"2015","journal-title":"N. Engl. J. Med."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1080\/20905998.2024.2443334","article-title":"Artificial Intelligence in Urology: Revolutionizing Diagnostics and Treatment Planning","volume":"23","author":"Eskandar","year":"2024","journal-title":"Arab J. Urol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1007\/s11934-023-01184-3","article-title":"Potential of AI-Driven Chatbots in Urology: Revolutionizing Patient Care Through Artificial Intelligence","volume":"25","author":"Talyshinskii","year":"2024","journal-title":"Curr. Urol. Rep."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Karabu\u011fa, B., Kara\u00e7in, C., B\u00fcy\u00fckk\u00f6r, M., Bayram, D., Aydemir, E., Kaya, O.B., Y\u0131lmaz, M.E., \u00c7am\u00f6z, E.S., and Erg\u00fcn, Y. (2025). The Role of Artificial Intelligence (ChatGPT-4o) in Supporting Tumor Board Decisions. J. Clin. Med., 14.","DOI":"10.3390\/jcm14103535"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3793","DOI":"10.1007\/s12094-025-03905-1","article-title":"Assessing the Accuracy of the GPT-4 Model in Multidisciplinary Tumor Board Decision Prediction","volume":"27","author":"Erdat","year":"2025","journal-title":"Clin. Transl. Oncol."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Dogan, I., Bartin, M.K., Sonmez, E., Seyran, E., Bozkurt, H.A., Yuksek, M., Serbes, E.D., Zalova, G., and Celik, S. (2025). Chat GPT Performance in Multi-Disciplinary Boards\u2014Should AI Be a Member of Cancer Boards?. Healthcare, 13.","DOI":"10.3390\/healthcare13182254"},{"key":"ref_21","first-page":"e68808","article-title":"Evaluation of ChatGPT-4\u2019s Performance in Therapeutic Decision-Making During Multidisciplinary Oncology Meetings for Head and Neck Squamous Cell Carcinoma","volume":"16","author":"Alami","year":"2024","journal-title":"Cureus"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zabaleta, J., Aguinagalde, B., Lopez, I., Fernandez-Monge, A., Lizarbe, J.A., Mainer, M., Ferrer-Bonsoms, J.A., and De Assas, M. (2025). Utility of Artificial Intelligence for Decision Making in Thoracic Multidisciplinary Tumor Boards. J. Clin. Med., 14.","DOI":"10.3390\/jcm14020399"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"e59823","DOI":"10.2196\/59823","article-title":"The Clinicians\u2019 Guide to Large Language Models: A General Perspective with a Focus on Hallucinations","volume":"14","author":"Roustan","year":"2025","journal-title":"Interact. J. Med. Res."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1038\/s41746-025-01670-7","article-title":"A Framework to Assess Clinical Safety and Hallucination Rates of LLMs for Medical Text Summarisation","volume":"8","author":"Asgari","year":"2025","journal-title":"npj Digit. Med."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1831","DOI":"10.1007\/s00404-023-07130-5","article-title":"Evaluating ChatGPT as an Adjunct for the Multidisciplinary Tumor Board Decision-Making in Primary Breast Cancer Cases","volume":"308","author":"Lukac","year":"2023","journal-title":"Arch. Gynecol. Obstet."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1543","DOI":"10.1093\/bjs\/znad264","article-title":"Artificial Intelligence-Based Decision-Making: Can ChatGPT Replace a Multidisciplinary Tumour Board?","volume":"110","year":"2023","journal-title":"Br. J. Surg."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Schmidl, B., H\u00fctten, T., Pigorsch, S., St\u00f6gbauer, F., Hoch, C.C., Hussain, T., Wollenberg, B., and Wirth, M. (2024). Assessing the Role of Advanced Artificial Intelligence as a Tool in Multidisciplinary Tumor Board Decision-Making for Recurrent\/Metastatic Head and Neck Cancer Cases\u2014The First Study on ChatGPT 4o and a Comparison to ChatGPT 4.0. Front. Oncol., 14.","DOI":"10.3389\/fonc.2024.1455413"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Griewing, S., Gremke, N., Wagner, U., Lingenfelder, M., Kuhn, S., and Boekhoff, J. (2023). Challenging ChatGPT 3.5 in Senology-An Assessment of Concordance with Breast Cancer Tumor Board Decision Making. J. Pers. Med., 13.","DOI":"10.3390\/jpm13101502"},{"key":"ref_29","first-page":"93","article-title":"A Survey of Methods for Explaining Black Box Models","volume":"51","author":"Guidotti","year":"2018","journal-title":"ACM Comput. Surv."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"gnae039","DOI":"10.1093\/geront\/gnae039","article-title":"Addressing the Black Box of AI\u2014A Model and Research Agenda on the Co-Constitution of Aging and Artificial Intelligence","volume":"64","author":"Gallistl","year":"2024","journal-title":"Gerontologist"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"c951","DOI":"10.1136\/bmj.c951","article-title":"Multidisciplinary Team Working in Cancer: What Is the Evidence?","volume":"340","author":"Taylor","year":"2010","journal-title":"BMJ"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Specchia, M.L., Frisicale, E.M., Carini, E., Di Pilla, A., Cappa, D., Barbara, A., Ricciardi, W., and Damiani, G. (2020). The Impact of Tumor Board on Cancer Care: Evidence from an Umbrella Review. BMC Health Serv. Res., 20.","DOI":"10.1186\/s12913-020-4930-3"}],"container-title":["Journal of Clinical Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2077-0383\/15\/6\/2130\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T11:11:44Z","timestamp":1773227504000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2077-0383\/15\/6\/2130"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,11]]},"references-count":32,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2026,3]]}},"alternative-id":["jcm15062130"],"URL":"https:\/\/doi.org\/10.3390\/jcm15062130","relation":{},"ISSN":["2077-0383"],"issn-type":[{"value":"2077-0383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,11]]}}}