{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T19:06:28Z","timestamp":1790708788587,"version":"4.1.0"},"reference-count":23,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Cancer"],"abstract":"\n Background<\/jats:title>\n Patients with newly diagnosed gynecologic cancers often seek information online, but the quality of available resources may be inconsistent. Although GPT-4 may offer an alternative to traditional internet search engines, its performance remains largely under-studied in gynecologic oncology.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to compare the completeness, accuracy, and reference quality of responses generated by GPT-4 with those generated by Google in clinical scenarios involving a new diagnosis of a gynecologic cancer.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n Clinical scenarios representing early- and advanced-stage endometrial, ovarian, and cervical cancers were developed by gynecologic oncologists using publicly available patient education materials. Each scenario included 4 standardized questions addressing etiology, prognosis, treatment, and treatment efficacy. GPT-4 and Google were queried for each question, with new sessions for GPT-4 and private browsing for Google to minimize bias. Responses were independently evaluated by 4 gynecologic oncology experts who were blinded to each other\u2019s ratings. Accuracy was scored on a 6-point Likert scale; completeness and reference quality were scored on 3-point scales. Reference quality was categorized as low (commercial), medium (institutional or government), or high (peer reviewed). Optional free-text reviewer comments were collected and summarized descriptively to provide context for the quantitative findings. Descriptive statistics and Wilcoxon signed-rank tests were used for analysis.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Across 6 clinical scenarios and 21 standardized questions (N=84 total responses), GPT-4 outperformed Google across all evaluated domains. The median accuracy score was 6.00 (IQR 5.00-6.00) for GPT-4 and 5.00 (IQR 4.00-6.00) for Google (P=.04). The median completeness score was 3.00 (IQR 3.00-3.00) for GPT-4 and 2.00 (IQR 1.00-3.00) for Google (P=.009). Reference quality was also higher for GPT-4, with a median score of 3.00 (IQR 3.00-3.00) compared to 2.00 (IQR 2.00-2.00) for Google (P=.009). Reviewer comments noted that GPT-4 provided more accurate, comprehensive, and personalized responses, while Google returned less detailed content from general consumer health websites rather than peer-reviewed sources.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n GPT-4 may serve as a reliable and high-quality resource for information in gynecologic oncology. Compared to Google, it delivered more accurate and complete content, with higher-quality references. Further research is needed to assess the readability and accessibility of GPT-4\u2013generated content across diverse patient populations.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/76471","type":"journal-article","created":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T19:00:05Z","timestamp":1787684405000},"page":"e76471","source":"Crossref","is-referenced-by-count":0,"title":["Assessing the Accuracy, Completeness, and Reference Quality of GPT-4 and Google for Gynecologic Cancer Information: Comparative Quantitative Study"],"prefix":"10.2196","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6396-506X","authenticated-orcid":false,"given":"Alexandra H","family":"Smick","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2323-1923","authenticated-orcid":false,"given":"Martins","family":"Ayoola","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-9398-5522","authenticated-orcid":false,"given":"Rajeshree","family":"Rajpara","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2831-2631","authenticated-orcid":false,"given":"Isabel","family":"Lazo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1073-8688","authenticated-orcid":false,"given":"Dana M","family":"Chase","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,9,29]]},"reference":[{"key":"ref1","unstructured":"SEER*Stat databases: SEER November 2023 submissionNational Cancer Institute20232025-07-01https:\/\/www.seer.cancer.gov"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.27336"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2023.1268915"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMra2302038"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.1007\/s11604-024-01705-1"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.1002\/2056-4538.70009"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvs.2019.04.460"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.5114\/wo.2024.141567"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1016\/j.crad.2024.08.019"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.3390\/curroncol31050212"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1016\/j.ygyno.2024.07.007"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.1370\/afm.250386"},{"key":"ref13","unstructured":"ChatGPT2026-09-09https:\/\/chatgpt.com\/"},{"key":"ref14","unstructured":"Educational materialsFoundation for Women\u2019s Cancer2025-07-01https:\/\/foundationforwomenscancer.org\/resources\/educational-materials\/"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.1007\/s42001-023-00208-9"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1177\/1049732305276687"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.1007\/s00520-025-09389-7"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.2196\/55898"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.1177\/15248399241285060"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcm.2016.02.012"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1007\/s00405-023-08423-w"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2024.105593"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.1002\/ijgo.15869"}],"container-title":["JMIR Cancer"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/cancer.jmir.org\/2026\/1\/e76471","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T18:30:09Z","timestamp":1790706609000},"score":1,"resource":{"primary":{"URL":"https:\/\/cancer.jmir.org\/2026\/1\/e76471"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,29]]},"references-count":23,"URL":"https:\/\/doi.org\/10.2196\/76471","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.76471","asserted-by":"object"}]},"ISSN":["2369-1999"],"issn-type":[{"value":"2369-1999","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,29]]}}}