{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T20:08:51Z","timestamp":1789589331640,"version":"build-2803163510"},"reference-count":20,"publisher":"American Society of Clinical Oncology (ASCO)","issue":"3","content-domain":{"domain":["ascopubs.org"],"crossmark-restriction":true},"short-container-title":["JCO Clin Cancer Inform"],"published-print":{"date-parts":[[2026,7]]},"abstract":"<jats:sec>\n                    <jats:title>PURPOSE<\/jats:title>\n                    <jats:p>To compare the concordance of ChatGPT, Gemini, and Claude with a prespecified expert guideline-based reference standard in fabricated endometrial cancer clinical vignettes under standardized prompting.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>METHODS<\/jats:title>\n                    <jats:p>We conducted a case-based in silico benchmarking study using 35 fabricated postoperative endometrial cancer vignettes representing a broad spectrum of ESGO-ESTRO-ESP 2025 management scenarios. Each vignette was submitted to ChatGPT, Gemini, and Claude in independent chat sessions using the same standardized prompt. The primary end point was concordance with the prespecified expert reference standard, scored as 0 (discordant), 1 (partially concordant), or 2 (fully concordant). Secondary end points were major safety issues and recognition of missing critical information. A post hoc subgroup analysis evaluated the effect of guideline-informed prompting in 12 cases.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>RESULTS<\/jats:title>\n                    <jats:p>\n                      Concordance differed significantly across models (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt; .001). Gemini achieved the highest performance, with a median concordance score of 2 (IQR 1-2), compared with 1 (IQR 0-1) for ChatGPT and 0 (IQR 0-1) for Claude. Fully concordant recommendations were generated in 65.7% of cases by Gemini, 2.9% by ChatGPT, and 8.6% by Claude. Major safety issues also differed across models (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = .007), occurring in 22.9% of Gemini responses, 48.6% of ChatGPT responses, and 54.3% of Claude responses. In the subset of vignettes with intentionally missing decisive information, Gemini identified the need for additional data in 83.3% of cases, compared with 50.0% for both ChatGPT and Claude. In the post hoc subgroup analysis, guideline-informed prompting significantly improved concordance for Gemini and Claude.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>CONCLUSION<\/jats:title>\n                    <jats:p>Mainstream consumer large language models showed substantially different performance in postoperative endometrial cancer decision making. Although Gemini achieved higher concordance and fewer major safety issues than ChatGPT and Claude, no model demonstrated performance sufficient to support autonomous clinical use in multidisciplinary management.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1200\/cci-26-00142","type":"journal-article","created":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T20:00:12Z","timestamp":1789588812000},"update-policy":"https:\/\/doi.org\/10.1200\/crossmark","source":"Crossref","is-referenced-by-count":0,"title":["Accuracy and Safety of Large Language Models in Endometrial Cancer Decision Making: A Case-Based In Silico Benchmarking Study"],"prefix":"10.1200","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0938-2493","authenticated-orcid":true,"given":"Emanuele","family":"Perrone","sequence":"first","affiliation":[{"name":"Gynecologic Oncology Unit, Department of Women and Child Health and Public Health, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-9560-6833","authenticated-orcid":true,"given":"Giuseppe","family":"Parisi","sequence":"additional","affiliation":[{"name":"Gynecologic Oncology Unit, Department of Women and Child Health and Public Health, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-0203-5055","authenticated-orcid":true,"given":"Maria Consiglia","family":"Giuliano","sequence":"additional","affiliation":[{"name":"Gynecologic Oncology Unit, Department of Women and Child Health and Public Health, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ilaria","family":"Capasso","sequence":"additional","affiliation":[{"name":"Gynecologic Oncology Unit, Department of Women and Child Health and Public Health, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicola","family":"Macellari","sequence":"additional","affiliation":[{"name":"Gynecologic Oncology Unit, Department of Women and Child Health and Public Health, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0495-7462","authenticated-orcid":true,"given":"Luca","family":"Russo","sequence":"additional","affiliation":[{"name":"Department of Diagnostic Imaging and Radiation Oncology, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6964-5152","authenticated-orcid":true,"given":"Angela","family":"Santoro","sequence":"additional","affiliation":[{"name":"Pathology Unit, Department of Woman and Child Health and Public Health, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Francesco","family":"Fanfani","sequence":"additional","affiliation":[{"name":"Gynecologic Oncology Unit, Department of Women and Child Health and Public Health, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy"},{"name":"Catholic University of the Sacred Heart, Rome, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"233","reference":[{"key":"e_1_3_6_2_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-023-02448-8"},{"key":"e_1_3_6_3_2","doi-asserted-by":"publisher","DOI":"10.7326\/M23-2772"},{"key":"e_1_3_6_4_2","doi-asserted-by":"publisher","DOI":"10.1136\/ijgc-2023-005162"},{"key":"e_1_3_6_5_2","doi-asserted-by":"publisher","unstructured":"Kalai AT Nachum O Vempala SS et al: Why language models hallucinate. arXiv. 10.48550\/arXiv.2509.04664","DOI":"10.48550\/arXiv.2509.04664"},{"key":"e_1_3_6_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijgc.2026.104558"},{"key":"e_1_3_6_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ygyno.2023.11.008"},{"key":"e_1_3_6_8_2","doi-asserted-by":"publisher","DOI":"10.1002\/ijgo.15869"},{"key":"e_1_3_6_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.csbj.2024.10.050"},{"key":"e_1_3_6_10_2","doi-asserted-by":"publisher","DOI":"10.1111\/1471-0528.70095"},{"key":"e_1_3_6_11_2","first-page":"1649","article-title":"Evaluation of ChatGPT\u2019s potential in tailoring gynecological cancer therapies","volume":"38","author":"Kr\u00fcckel A","year":"2024","unstructured":"Kr\u00fcckel A, Br\u00fcckner L, Psilopatis I, et al: Evaluation of ChatGPT\u2019s potential in tailoring gynecological cancer therapies. In Vivo (Athens, Greece) 38:1649-1659, 2024","journal-title":"In Vivo (Athens, Greece)"},{"key":"e_1_3_6_12_2","doi-asserted-by":"publisher","DOI":"10.1002\/ijgo.14923"},{"key":"e_1_3_6_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1470-2045(25)00167-6"},{"key":"e_1_3_6_14_2","doi-asserted-by":"publisher","DOI":"10.1111\/1471-0528.17929"},{"key":"e_1_3_6_15_2","doi-asserted-by":"publisher","DOI":"10.1002\/ijgo.15861"},{"key":"e_1_3_6_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ygyno.2024.07.007"},{"key":"e_1_3_6_17_2","doi-asserted-by":"publisher","DOI":"10.2196\/63626"},{"key":"e_1_3_6_18_2","doi-asserted-by":"publisher","DOI":"10.3390\/curroncol31050212"},{"key":"e_1_3_6_19_2","doi-asserted-by":"publisher","DOI":"10.2196\/64364"},{"key":"e_1_3_6_20_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2025.1635381"},{"key":"e_1_3_6_21_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2023.1166120"}],"container-title":["JCO Clinical Cancer Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/ascopubs.org\/doi\/pdfdirect\/10.1200\/CCI-26-00142","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T20:00:13Z","timestamp":1789588813000},"score":1,"resource":{"primary":{"URL":"https:\/\/ascopubs.org\/doi\/10.1200\/CCI-26-00142"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7]]},"references-count":20,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,7]]}},"alternative-id":["10.1200\/CCI-26-00142"],"URL":"https:\/\/doi.org\/10.1200\/cci-26-00142","relation":{},"ISSN":["2473-4276"],"issn-type":[{"value":"2473-4276","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7]]},"assertion":[{"value":"2026-04-26","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-23","order":1,"name":"revised","label":"Revised","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-08-06","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2600142"}}