{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T18:11:05Z","timestamp":1789150265640,"version":"build-2803163510"},"reference-count":49,"publisher":"SAGE Publications","license":[{"start":{"date-parts":[[2026,9,9]],"date-time":"2026-09-09T00:00:00Z","timestamp":1788912000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Surg Innov"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Patients increasingly consult artificial intelligence (AI) tools for breast cancer information. While Large Language Models (LLMs) enhance information accessibility, their accuracy, reliability, and alignment with patient health literacy remain critical concerns. This study compared the quality, reliability, and readability of breast cancer-related responses generated by ChatGPT and Gemini.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>In this cross-sectional study, conducted between March 20 and March 31, 2026, 40 questions spanning diagnosis, treatment, genetics, and follow-up were submitted to ChatGPT-5.3 and Gemini 3.0 Flash. Three independent surgeons evaluated the responses in a double-blinded manner using the modified DISCERN (mDISCERN) for reliability and Global Quality Score (GQS) for content quality assessment. Readability was assessed via Flesch Reading Ease (FRES), Flesch-Kincaid Grade Level (FKGL), Gunning Fog Index (GFI), and Simple Measure of Gobbledygook (SMOG) indices.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Gemini demonstrated statistically significant superiority over ChatGPT in both GQS (4.35 \u00b1 0.30 vs 3.90 \u00b1 0.29;\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt; .001) and mDISCERN (3.63 \u00b1 0.58 vs 3.02 \u00b1 0.48;\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt; .001) scores. In readability analysis, Gemini exhibited higher FRES (53.90 vs 45.13) and lower FKGL (9.31 vs 10.91) values, indicating enhanced patient accessibility (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt; .05). For both models, the \u201cDiagnosis\u201d category yielded the highest readability, whereas \u201cTreatment\u201d scored the lowest. Inter-rater reliability for mDISCERN was moderate (ICC = 0.595).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Gemini significantly outperforms ChatGPT in response quality, reliability, and linguistic accessibility for breast cancer education. However, both models exceed the recommended sixth-grade reading level, indicating suboptimal optimization for general health literacy. While LLMs serve as promising auxiliary tools, expert supervision and cross-validation remain mandatory to ensure patient safety.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/15533506261488588","type":"journal-article","created":{"date-parts":[[2026,9,9]],"date-time":"2026-09-09T20:07:51Z","timestamp":1788984471000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Large Language Models for Breast Cancer Education: A Comparative Analysis of Quality, Reliability and Readability"],"prefix":"10.1177","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9859-5580","authenticated-orcid":false,"given":"Burak","family":"Altunpak","sequence":"first","affiliation":[{"name":"Istanbul Research and Training Hospital"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2026,9,9]]},"reference":[{"key":"e_1_3_6_2_2","doi-asserted-by":"publisher","DOI":"10.3322\/caac.21834"},{"key":"e_1_3_6_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/s13187-020-01758-6"},{"key":"e_1_3_6_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/s13187-020-01756-8"},{"key":"e_1_3_6_5_2","doi-asserted-by":"publisher","DOI":"10.5336\/978-625-395-854-1_p377"},{"key":"e_1_3_6_6_2","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.14089"},{"key":"e_1_3_6_7_2","doi-asserted-by":"publisher","DOI":"10.14744\/ejp.2022.9221"},{"key":"e_1_3_6_8_2","doi-asserted-by":"publisher","DOI":"10.26650\/jchild.2024.1301406"},{"key":"e_1_3_6_9_2","doi-asserted-by":"publisher","DOI":"10.2196\/47564"},{"key":"e_1_3_6_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2023.06.044"},{"key":"e_1_3_6_11_2","doi-asserted-by":"publisher","DOI":"10.3390\/healthcare11060887"},{"key":"e_1_3_6_12_2","doi-asserted-by":"publisher","DOI":"10.1245\/s10434-024-16369-4"},{"key":"e_1_3_6_13_2","doi-asserted-by":"publisher","DOI":"10.4274\/tod.galenos.2024.76743"},{"key":"e_1_3_6_14_2","doi-asserted-by":"publisher","DOI":"10.4274\/tod.galenos.2025.66664"},{"key":"e_1_3_6_15_2","doi-asserted-by":"publisher","DOI":"10.31609\/jpmrs.2025-115285"},{"key":"e_1_3_6_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00432-024-05678-6"},{"key":"e_1_3_6_17_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0350402"},{"key":"e_1_3_6_18_2","doi-asserted-by":"publisher","DOI":"10.29058\/mjwbs.1881313"},{"key":"e_1_3_6_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.acra.2023.05.024"},{"key":"e_1_3_6_20_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00464-024-10739-5"},{"key":"e_1_3_6_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jemermed.2025.08.014"},{"key":"e_1_3_6_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.urology.2023.05.040"},{"key":"e_1_3_6_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40618-025-02715-0"},{"key":"e_1_3_6_24_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2023.1838"},{"key":"e_1_3_6_25_2","doi-asserted-by":"publisher","DOI":"10.1038\/s44271-024-00182-6"},{"key":"e_1_3_6_26_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamaoncol.2023.2947"},{"key":"e_1_3_6_27_2","doi-asserted-by":"publisher","DOI":"10.1002\/jso.27715"},{"key":"e_1_3_6_28_2","doi-asserted-by":"publisher","DOI":"10.2196\/72839"},{"key":"e_1_3_6_29_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12905-024-03320-8"},{"key":"e_1_3_6_30_2","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.97525"},{"key":"e_1_3_6_31_2","unstructured":"ESMO. Breast Cancer: An ESMO guide for patients. Lugano Switzerland: European Society for Medical Oncology; 2018. Available from: https:\/\/www.esmo.org\/for-patients\/patient-guides\/patient-guides-by-language\/cancer-patient-guides-in-english."},{"key":"e_1_3_6_32_2","unstructured":"National Comprehensive Cancer Network. NCCN Guidelines for Patients: Invasive Breast Cancer. Plymouth Meeting PA: National Comprehensive Cancer Network;2026. Available from: https:\/\/www.nccn.org\/patientresources\/patient-resources\/guidelines-for-patients\/guidelines-for-patients-details?patientGuidelineId=16."},{"key":"e_1_3_6_33_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0326351"},{"key":"e_1_3_6_34_2","doi-asserted-by":"publisher","DOI":"10.1097\/MD.0000000000041780"},{"key":"e_1_3_6_35_2","doi-asserted-by":"publisher","DOI":"10.1093\/jncics\/pkad015"},{"key":"e_1_3_6_36_2","doi-asserted-by":"publisher","DOI":"10.1002\/cncr.35521"},{"key":"e_1_3_6_37_2","doi-asserted-by":"publisher","DOI":"10.21203\/rs.3.rs-2566942\/v1"},{"key":"e_1_3_6_38_2","doi-asserted-by":"publisher","DOI":"10.1177\/20552076241284771"},{"key":"e_1_3_6_39_2","doi-asserted-by":"publisher","DOI":"10.1148\/rycan.230086"},{"key":"e_1_3_6_40_2","doi-asserted-by":"publisher","DOI":"10.1002\/cam4.71364"},{"key":"e_1_3_6_41_2","first-page":"2","article-title":"Evaluation of the readability of Turkish internet-based patient education materials related to \u201c\u2018low back pain\u2019\u201d","volume":"36","author":"\u00d6zduran E","year":"2022","unstructured":"\u00d6zduran E, Erkin Y, Hanc\u0131 V, Ta\u015ftan A, Tosun DD, Sayan EN. Evaluation of the readability of Turkish internet-based patient education materials related to \u201c\u2018low back pain\u2019\u201d. Dokuz Eyl\u00fcl \u00dcniversitesi T\u0131p Fak\u00fcltesi Dergisi. 2022;36:2.","journal-title":"Dokuz Eyl\u00fcl \u00dcniversitesi T\u0131p Fak\u00fcltesi Dergisi"},{"key":"e_1_3_6_42_2","volume-title":"Manual for Clinicians Second Edition Help Patients Understand","author":"Weiss BD","year":"2007","unstructured":"Weiss BD. Manual for Clinicians Second Edition Help Patients Understand. AMA Foundation; 2007. Published online."},{"key":"e_1_3_6_43_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1470-2045(20)30615-X"},{"key":"e_1_3_6_44_2","doi-asserted-by":"publisher","DOI":"10.1200\/jco.2025.43.16_suppl.e13686"},{"key":"e_1_3_6_45_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-41032-5"},{"key":"e_1_3_6_46_2","doi-asserted-by":"publisher","DOI":"10.5137\/1019-5149.JTN.42973-22.3"},{"key":"e_1_3_6_47_2","doi-asserted-by":"publisher","DOI":"10.12996\/gmj.2023.77"},{"key":"e_1_3_6_48_2","doi-asserted-by":"publisher","DOI":"10.32768\/abc.2958670413-529"},{"key":"e_1_3_6_49_2","doi-asserted-by":"publisher","DOI":"10.1177\/02683555261460252"},{"key":"e_1_3_6_50_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-022-00700-y"}],"container-title":["Surgical Innovation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/15533506261488588","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/15533506261488588","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/15533506261488588","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T17:50:39Z","timestamp":1789149039000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/15533506261488588"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,9]]},"references-count":49,"alternative-id":["10.1177\/15533506261488588"],"URL":"https:\/\/doi.org\/10.1177\/15533506261488588","relation":{},"ISSN":["1553-3506","1553-3514"],"issn-type":[{"value":"1553-3506","type":"print"},{"value":"1553-3514","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,9]]},"article-number":"15533506261488588"}}