{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T11:58:56Z","timestamp":1790251136091,"version":"4.1.0"},"reference-count":16,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,6,14]],"date-time":"2025-06-14T00:00:00Z","timestamp":1749859200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,6,14]],"date-time":"2025-06-14T00:00:00Z","timestamp":1749859200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Klinikum der Universit\u00e4t M\u00fcnchen"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Radiat Oncol"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>The study explores the potential of ChatGPT, an advanced large language model (LLM) by OpenAI, in educating patients about meningioma, a common type of brain tumor. While ChatGPT has generated significant debate regarding its utility and ethics, its growing popularity suggests that patients may increasingly use such tools for medical information. The study specifically examines how patients who have undergone radiation therapy for meningioma perceive the information generated by ChatGPT, integrating both patient feedback and clinical assessment.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Eight meningioma-related questions on diagnosis, treatment options, and radiation therapy were posed to ChatGPT 4. A questionnaire with these responses and feedback items was developed to assess utility, accuracy, clarity, and alignment with patients\u2019 experiences. Nine clinicians first rated each response\u2019s relevance, correctness, and completeness on a five-point Likert scale. Subsequently, 28 patients with meningioma completed the questionnaire during their first follow-up visit (three months post\u2013radiation therapy). Finally, the same questions were presented to three other large language models (ChatGPT 4o mini, Gemini Free, Gemini Advanced), and seven blinded clinicians rated each model\u2019s responses before selecting the most accurate, eloquent, and comprehensive overall.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The study cohort included 28 meningioma patients, mostly female, with a median age of 60 years. Most patients found the information clear, accurate, and reflective of their experiences, with 60% willing to use ChatGPT for future inquiries. Clinicians rated the relevance and correctness of the information highly, although completeness was rated slightly lower, particularly for questions about specific radiation therapy details and side effects. ChatGPT 4 and its newer version ChatGPT 4o mini received the highest, nearly identical scores among the four LLMs evaluated, while Gemini Free scored the lowest in clinician assessments.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>ChatGPT demonstrates potential as a supplementary educational tool for meningioma patients, though some areas may require improvement, particularly in providing comprehensive information. The study highlights the potential for integrating AI in patient education, while also noting the need for clinical oversight to ensure accuracy and completeness.<\/jats:p>\n                    <jats:p>\n                      <jats:italic>Trial registration<\/jats:italic>\n                      : LMU ethics vote nr.: 23-0742\n                    <\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s13014-025-02671-2","type":"journal-article","created":{"date-parts":[[2025,6,14]],"date-time":"2025-06-14T14:43:36Z","timestamp":1749912216000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Evaluating large language models as an educational tool for meningioma patients: patient and clinician perspectives"],"prefix":"10.1186","volume":"20","author":[{"given":"Diana-Coralia","family":"Dehelean","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastian H.","family":"Maier","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alev","family":"Altay-Langguth","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Nitschmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Schmeling","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel F.","family":"Fleischmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Rogowski","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Trapp","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefanie","family":"Corradini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Claus","family":"Belka","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephan","family":"Sch\u00f6necker","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastian N.","family":"Marschner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,6,14]]},"reference":[{"key":"2671_CR1","doi-asserted-by":"publisher","DOI":"10.3389\/frai.2023.1169595","author":"T Dave","year":"2023","unstructured":"Dave T, Athaluri SA, Singh S. ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations. Front. Artif. Intell. 2023. https:\/\/doi.org\/10.3389\/frai.2023.1169595.","journal-title":"Frontiers in Artificial Intelligence"},{"issue":"2","key":"2671_CR2","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1111\/bju.16042","volume":"132","author":"JYM Tung","year":"2023","unstructured":"Tung JYM, Lim DYZ, Sng GGR. Potential safety concerns in use of the artificial intelligence chatbot \u2018ChatGPT\u2019 for perioperative patient communication. BJU Int. 2023;132(2):157\u20139. https:\/\/doi.org\/10.1111\/bju.16042.","journal-title":"BJU Int"},{"issue":"2","key":"2671_CR3","doi-asserted-by":"publisher","first-page":"877","DOI":"10.3390\/biomedinformatics4020049","volume":"4","author":"M C\u00e8","year":"2024","unstructured":"C\u00e8 M, et al. Exploring the role of ChatGPT in oncology: providing information and support for cancer patients. BioMedInformatics. 2024;4(2):877\u201388. https:\/\/doi.org\/10.3390\/biomedinformatics4020049.","journal-title":"BioMedInformatics"},{"key":"2671_CR4","doi-asserted-by":"publisher","DOI":"10.21203\/rs.3.rs-2566942\/v1","author":"D Johnson","year":"2023","unstructured":"Johnson D, et al. Assessing the accuracy and reliability of AI-generated medical responses: an evaluation of the Chat-GPT model. Res Sq. 2023. https:\/\/doi.org\/10.21203\/rs.3.rs-2566942\/v1.","journal-title":"Res Sq"},{"key":"2671_CR5","doi-asserted-by":"publisher","DOI":"10.1002\/pon.5194","author":"M Lleras de Frutos","year":"2020","unstructured":"Lleras de Frutos M, Casellas-Grau A, Sumalla EC, de Gracia M, Borr\u00e0s JM, Ochoa Arnedo C. A systematic and comprehensive review of internet use in cancer patients: psychological factors. Psycho-Oncology. 2020. https:\/\/doi.org\/10.1002\/pon.5194.","journal-title":"Psycho-Oncology"},{"issue":"10","key":"2671_CR6","doi-asserted-by":"publisher","first-page":"1742","DOI":"10.1093\/neuonc\/noae082","volume":"26","author":"JZ Wang","year":"2024","unstructured":"Wang JZ, et al. Meningioma: international consortium on Meningiomas consensus review on scientific advances and treatment paradigms for clinicians, researchers, and patients. Neuro Oncol. 2024;26(10):1742\u201380. https:\/\/doi.org\/10.1093\/neuonc\/noae082.","journal-title":"Neuro Oncol"},{"key":"2671_CR7","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.urology.2023.05.040","volume":"180","author":"B Coskun","year":"2023","unstructured":"Coskun B, Ocakoglu G, Yetemen M, Kaygisiz O. Can ChatGPT, an artificial intelligence language model, provide accurate and high-quality patient information on prostate cancer? Urology. 2023;180:35\u201358. https:\/\/doi.org\/10.1016\/j.urology.2023.05.040.","journal-title":"Urology"},{"issue":"11","key":"2671_CR8","doi-asserted-by":"publisher","first-page":"102797","DOI":"10.1016\/j.cpcardiol.2024.102797","volume":"49","author":"F Anaya","year":"2024","unstructured":"Anaya F, Prasad R, Bashour M, Yaghmour R, Alameh A, Balakumaran K. Evaluating ChatGPT platform in delivering heart failure educational material: a comparison with the leading national cardiology institutes. Curr Probl Cardiol. 2024;49(11):102797. https:\/\/doi.org\/10.1016\/j.cpcardiol.2024.102797.","journal-title":"Curr Probl Cardiol"},{"key":"2671_CR9","doi-asserted-by":"publisher","first-page":"e55939","DOI":"10.2196\/55939","volume":"26","author":"D Gibson","year":"2024","unstructured":"Gibson D, et al. Evaluating the efficacy of ChatGPT as a patient education tool in prostate cancer: multimetric assessment. J Med Internet Res. 2024;26:e55939. https:\/\/doi.org\/10.2196\/55939.","journal-title":"J Med Internet Res"},{"key":"2671_CR10","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2023.1256459","author":"O Ku\u015fcu","year":"2023","unstructured":"Ku\u015fcu O, Pamuk AE, S\u00fctay S\u00fcsl\u00fc N, Hosal S. Is ChatGPT accurate and reliable in answering questions regarding head and neck cancer? Front Oncol. 2023. https:\/\/doi.org\/10.3389\/fonc.2023.1256459.","journal-title":"Front Oncol"},{"issue":"7","key":"2671_CR11","doi-asserted-by":"publisher","first-page":"734","DOI":"10.1038\/s41443-023-00797-z","volume":"36","author":"S Razdan","year":"2024","unstructured":"Razdan S, Siegal AR, Brewer Y, Sljivich M, Valenzuela RJ. Assessing ChatGPT\u2019s ability to answer questions pertaining to erectile dysfunction: can our patients trust it? Int J Impot Res. 2024;36(7):734\u201340. https:\/\/doi.org\/10.1038\/s41443-023-00797-z.","journal-title":"Int J Impot Res"},{"key":"2671_CR12","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.CD001431.pub5","author":"D Stacey","year":"2017","unstructured":"Stacey D, et al. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2017. https:\/\/doi.org\/10.1002\/14651858.CD001431.pub5.","journal-title":"Cochrane Database Syst Rev"},{"key":"2671_CR13","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.35179","author":"H Alkaissi","year":"2023","unstructured":"Alkaissi H, McFarlane SI. Artificial hallucinations in ChatGPT: implications in scientific writing. Cureus. 2023. https:\/\/doi.org\/10.7759\/cureus.35179.","journal-title":"Cureus"},{"key":"2671_CR14","doi-asserted-by":"publisher","DOI":"10.3389\/fradi.2023.1224682","author":"Z Liu","year":"2024","unstructured":"Liu Z, et al. Surviving ChatGPT in healthcare. Front Radiol. 2024. https:\/\/doi.org\/10.3389\/fradi.2023.1224682.","journal-title":"Front Radiol"},{"key":"2671_CR15","doi-asserted-by":"publisher","DOI":"10.3390\/jcm13216543","author":"M Leon","year":"2024","unstructured":"Leon M, et al. Harnessing the power of ChatGPT in cardiovascular medicine: innovations, challenges, and future directions. Multidiscip Digit Publ Inst (MDPI). 2024. https:\/\/doi.org\/10.3390\/jcm13216543.","journal-title":"Multidiscip Digit Publ Inst (MDPI)"},{"key":"2671_CR16","doi-asserted-by":"publisher","DOI":"10.1136\/bmjhci-2023-100775","author":"J Haemmerli","year":"2023","unstructured":"Haemmerli J, et al. ChatGPT in glioma adjuvant therapy decision making: ready to assume the role of a doctor in the tumour board? BMJ Health Care Inform. 2023. https:\/\/doi.org\/10.1136\/bmjhci-2023-100775.","journal-title":"BMJ Health Care Inform"}],"container-title":["Radiation Oncology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13014-025-02671-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13014-025-02671-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13014-025-02671-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,14]],"date-time":"2025-06-14T14:43:37Z","timestamp":1749912217000},"score":1,"resource":{"primary":{"URL":"https:\/\/ro-journal.biomedcentral.com\/articles\/10.1186\/s13014-025-02671-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,14]]},"references-count":16,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["2671"],"URL":"https:\/\/doi.org\/10.1186\/s13014-025-02671-2","relation":{},"ISSN":["1748-717X"],"issn-type":[{"value":"1748-717X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,14]]},"assertion":[{"value":"3 April 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 May 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 June 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"101"}}