{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T18:03:51Z","timestamp":1789581831541,"version":"build-2803163510"},"reference-count":25,"publisher":"Public Library of Science (PLoS)","issue":"9","license":[{"start":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T00:00:00Z","timestamp":1789516800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS One"],"abstract":"<jats:sec id=\"sec001\">\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Breast cancer, the most common malignancy among women, remains a major global public health concern. With the rapid growth of artificial intelligence\u2013based language models, it is essential to evaluate their potential roles in patient education. This study compared ChatGPT and Gemini in responding to patient-oriented questions about breast cancer and its surgical treatment regarding scientific accuracy, clarity, and unnecessary detail.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec002\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Forty frequently asked questions were collected from Turkish online sources. Both models were queried under identical conditions on August 13, 2025, and the responses were anonymized for blinded evaluation. Four general surgeons experienced in breast surgery independently assessed each response using a five-point Likert scale across three domains: scientific accuracy, clarity, and unnecessary detail.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec003\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Response lengths were recorded and compared. ChatGPT achieved significantly higher median scores than Gemini in scientific accuracy [4.75 (3.50\u20135.00) vs. 4.25 (3.50\u20135.00); p\u2009&lt;\u20090.001], clarity [4.75 (3.50\u20135.00) vs. 4.25 (3.25\u20135.00); p\u2009=\u20090.005], and unnecessary detail [5.00 (5.00\u20135.00) vs. 4.50 (3.50\u20135.00); p\u2009&lt;\u20090.001]. The overall median score was 4.83 (4.08\u20135.00) for ChatGPT and 4.33 (3.50\u20134.92) for Gemini (p\u2009&lt;\u20090.001). Gemini\u2019s responses were significantly longer (244\u2009\u00b1\u200984 vs. 170\u2009\u00b1\u200947 words; p\u2009&lt;\u20090.001).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec004\">\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Both models demonstrated acceptable overall performance. However, ChatGPT\u2019s higher scores and shorter, more focused responses indicate that it may be a more efficient tool for addressing breast cancer\u2013related patient questions. In their current form, these models should not be used for diagnostic or clinical decision-making purposes. AI-generated health information should be used only under expert supervision and for educational or supportive purposes.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1371\/journal.pone.0358325","type":"journal-article","created":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T17:36:00Z","timestamp":1789580160000},"page":"e0358325","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["Comparative evaluation of ChatGPT and gemini responses to patient-oriented questions on breast cancer"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1811-122X","authenticated-orcid":true,"given":"Yeliz","family":"Yilmaz Bozok","sequence":"first","affiliation":[{"name":"\u0130zmir Katip \u00c7elebi University","place":["\u0130zmir, Turkey"],"department":["Department of General Surgery, \u0130zmir Atat\u00fcrk Training and Research Hospital"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nihan","family":"Acar","sequence":"additional","affiliation":[{"name":"\u0130zmir Katip \u00c7elebi University","place":["\u0130zmir, Turkey"],"department":["Department of General Surgery, \u0130zmir Atat\u00fcrk Training and Research Hospital"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Murat Kemal","family":"Atahan","sequence":"additional","affiliation":[{"name":"\u0130zmir Katip \u00c7elebi University","place":["\u0130zmir, Turkey"],"department":["Department of General Surgery, \u0130zmir Atat\u00fcrk Training and Research Hospital"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2743-7360","authenticated-orcid":true,"given":"Cem","family":"Karaali","sequence":"additional","affiliation":[{"name":"\u0130zmir Katip \u00c7elebi University","place":["\u0130zmir, Turkey"],"department":["Department of General Surgery, \u0130zmir Atat\u00fcrk Training and Research Hospital"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,9,16]]},"reference":[{"issue":"3","key":"pone.0358325.ref001","first-page":"229","article-title":"Global cancer statistics 2022: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries","volume":"74","author":"F Bray","year":"2024","journal-title":"CA Cancer J Clin"},{"issue":"1","key":"pone.0358325.ref002","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1038\/s41392-024-02108-4","article-title":"Breast cancer: pathogenesis and treatments","volume":"10","author":"X Xiong","year":"2025","journal-title":"Signal Transduct Target Ther"},{"issue":"3","key":"pone.0358325.ref003","first-page":"209","article-title":"Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries","volume":"71","author":"H Sung","year":"2021","journal-title":"CA Cancer J Clin"},{"issue":"1","key":"pone.0358325.ref004","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1186\/s12893-022-01835-1","article-title":"Time to surgery and survival in breast cancer","volume":"22","author":"D An","year":"2022","journal-title":"BMC Surg"},{"issue":"22","key":"pone.0358325.ref005","doi-asserted-by":"crossref","first-page":"8325","DOI":"10.3390\/ijerph17228325","article-title":"Impact of Time to Initiation of Treatment on the Quality of Life of Women with Breast Cancer","volume":"17","author":"M Konieczny","year":"2020","journal-title":"Int J Environ Res Public Health"},{"issue":"6","key":"pone.0358325.ref006","doi-asserted-by":"crossref","first-page":"1271","DOI":"10.1093\/eurpub\/ckaf108","article-title":"Causes of diagnostic and treatment delays in locally advanced breast cancer: a nationwide multicenter survey and electronic health records analysis in Turkiye","volume":"35","author":"G Karadeniz Cakmak","year":"2025","journal-title":"Eur J Public Health"},{"issue":"3","key":"pone.0358325.ref007","doi-asserted-by":"crossref","first-page":"124","DOI":"10.25259\/NMJI_327_2022","article-title":"Evaluating the readability, quality and reliability of online patient education materials on chronic low back pain","volume":"37","author":"E Ozduran","year":"2024","journal-title":"Natl Med J India"},{"key":"pone.0358325.ref008","article-title":"YouTube as a source of information about pulmonary rehabilitation during the COVID-19 pandemic","author":"E \u00d6zduran","year":"2022","journal-title":"Eurasian J Pulmonol"},{"issue":"1","key":"pone.0358325.ref009","doi-asserted-by":"crossref","first-page":"15","DOI":"10.26650\/jchild.2024.1301406","article-title":"Exploring the Reliability and Accessibility of Youtube for Cerebral Palsy Rehabilitation Information","volume":"24","author":"E \u00d6zduran","year":"2024","journal-title":"jchild"},{"key":"pone.0358325.ref010","first-page":"377","article-title":"YouTube as an information source for myofascial pain syndrome.","author":"E. \u00d6zduran","year":"2026","journal-title":"Ankara: T\u00fcrkiye Klinikleri"},{"issue":"1","key":"pone.0358325.ref011","first-page":"12","article-title":"Digital guidance: quality and readability analysis of artificial intelligence-generated spondyloarthropathy texts","volume":"31","author":"\u0130C \u00d6zbek","year":"2025","journal-title":"Turk J Osteoporos"},{"issue":"2","key":"pone.0358325.ref012","first-page":"245","article-title":"Evaluating the readability, quality, and reliability of responses generated by artificial intelligence programs about acupuncture for pain","volume":"29","author":"A Mengi","year":"2026","journal-title":"J Phys Med Rehabil Sci"},{"key":"pone.0358325.ref013","doi-asserted-by":"crossref","first-page":"1226776","DOI":"10.3389\/fpubh.2023.1226776","article-title":"AI chatbots and (mis)information in public health: impact on vulnerable communities","volume":"11","author":"DW Meyrowitsch","year":"2023","journal-title":"Front Public Health"},{"issue":"3","key":"pone.0358325.ref014","doi-asserted-by":"crossref","first-page":"11","DOI":"10.30621\/jbachs.1096610","article-title":"Evaluation of the 100 Most Cited Articles on Sj\u00f6gren\u2019s Syndrome: A BibliometricAnalysis","volume":"7","author":"E \u00d6zduran","year":"2023","journal-title":"J Basic Clin Health Sci"},{"key":"pone.0358325.ref015","doi-asserted-by":"crossref","first-page":"220121","DOI":"10.1109\/ACCESS.2020.3042874","article-title":"Industrial artificial intelligence in industry 4.0 - systematic review, challenges and outlook","volume":"8","author":"RS Peres","year":"2020","journal-title":"IEEE Access"},{"key":"pone.0358325.ref016","first-page":"1359073","article-title":"Evaluating Chatbot responses to patient questions in the field of glaucoma","volume":"11","author":"DNH Tan","year":"2024","journal-title":"Front Med (Lausanne)"},{"issue":"4","key":"pone.0358325.ref017","doi-asserted-by":"crossref","DOI":"10.1001\/jamanetworkopen.2024.4630","article-title":"Quality of Large Language Model Responses to Radiation Oncology Patient Care Questions","volume":"7","author":"A Yalamanchili","year":"2024","journal-title":"JAMA Netw Open"},{"issue":"6","key":"pone.0358325.ref018","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0326351","article-title":"Evaluating the readability, quality, and reliability of responses generated by ChatGPT, Gemini, and Perplexity on the most commonly asked questions about Ankylosing spondylitis","volume":"20","author":"M Kara","year":"2025","journal-title":"PLoS One"},{"key":"pone.0358325.ref019","article-title":"Accuracy and reliability of ChatGPT in answering patient questions about lung cancer and its surgery: An expert panel evaluation by thoracic surgeons","author":"O Ak\u00e7ay","year":"2025","journal-title":"J Cancer Educ"},{"issue":"6","key":"pone.0358325.ref020","doi-asserted-by":"crossref","first-page":"399","DOI":"10.3325\/cmj.2025.66.399","article-title":"ChatGPT and Gemini in warfarin counseling","volume":"66","author":"MH Erkan","year":"2026","journal-title":"Croat Med J"},{"issue":"2","key":"pone.0358325.ref021","doi-asserted-by":"crossref","DOI":"10.1590\/1806-9282.20251453","article-title":"Expert evaluation of GPT-4o and Gemini responses to patient questions on carotid endarterectomy","volume":"72","author":"\u00d6F Rahman","year":"2026","journal-title":"Rev Assoc Med Bras (1992)"},{"issue":"1","key":"pone.0358325.ref022","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1186\/s13018-024-04996-2","article-title":"Comparative performance analysis of large language models: ChatGPT-3.5, ChatGPT-4 and Google Gemini in glucocorticoid-induced osteoporosis","volume":"19","author":"L Tong","year":"2024","journal-title":"J Orthop Surg Res"},{"key":"pone.0358325.ref023","doi-asserted-by":"crossref","first-page":"20552076241284771","DOI":"10.1177\/20552076241284771","article-title":"Assessing the performance of large language models (LLMs) in answering medical questions regarding breast cancer in the Chinese context","volume":"10","author":"Y Piao","year":"2024","journal-title":"Digit Health"},{"issue":"2","key":"pone.0358325.ref024","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1002\/jso.27715","article-title":"Reliability of artificial intelligence chatbot responses to frequently asked questions in breast surgical oncology","volume":"130","author":"E Roldan-Vasquez","year":"2024","journal-title":"J Surg Oncol"},{"issue":"2","key":"pone.0358325.ref025","doi-asserted-by":"crossref","first-page":"135","DOI":"10.18614\/deutip.1174522","article-title":"\u201cBel A\u011fr\u0131s\u0131\u201d ile \u0130lgili T\u00fcrk\u00e7e \u0130nternet Kaynakl\u0131 Hasta E\u011fitim Materyallerinin Okunabilirliklerinin De\u011ferlendirilmesi","volume":"36","author":"E \u00d6zduran","year":"2022","journal-title":"Dokuz Eyl\u00fcl \u00dcniversitesi T\u0131p Fak\u00fcltesi Dergisi"}],"container-title":["PLOS One"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0358325","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T17:36:05Z","timestamp":1789580165000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0358325"}},"subtitle":[],"editor":[{"given":"Lorenzo","family":"Faggioni","sequence":"first","affiliation":[{"name":"University of Pisa","place":["ITALY"]}],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,9,16]]},"references-count":25,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,9,16]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0358325","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,16]]}}}