{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T18:58:56Z","timestamp":1790881136925,"version":"4.1.0"},"reference-count":33,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"30","license":[{"start":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T00:00:00Z","timestamp":1784851200000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,7,24]]},"abstract":"<jats:sec>\n                    <jats:title\/>\n                    <jats:p>\n                      Esophageal cancer remains a significant global health issue. ChatGPT-4o and DeepSeek V3 can provide the public with health-related knowledge about esophageal cancer. This study aimed to evaluate the accuracy of DeepSeek V3 and ChatGPT-4o in responding to health knowledge questions related to esophageal cancer. Fifty-two questions related to esophageal cancer were classified into themes of basic knowledge, diagnosis and molecular biology, management of local and locoregional diseases, management of advanced and metastatic diseases, clinical case analysis and patient frequently asked questions (FAQs). These questions were entered into DeepSeek V3 and ChatGPT-4o to obtain responses, and 2 experienced gastroenterologists independently evaluated the accuracy and temporal stability of each response. Overall, the scores of DeepSeek V3 and ChatGPT-4o on all questions were 4 (3\u20134), and there was no statistically significant difference between the 2 groups. The final scores of DeepSeek V3 in basic knowledge, diagnosis and molecular biology, management of local and locoregional diseases, management of advanced and metastatic diseases, clinical case analysis, and FAQs were 4 (3\u20134), 4 (3\u20134), 4 (3\u20134), 3 (3\u20134), 4 (4\u20134), and 4 (4\u20134), respectively, while the scores of ChatGPT-4o were 4 (3\u20134), 3 (2\u20134), 4 (3\u20134), 3 (3\u20134), 4 (4\u20134), and 4 (4\u20134), respectively. For temporal stability across 2 independent test runs, DeepSeek V3 presented inconsistent responses on 2 questions, and ChatGPT-4o on 1 question; no statistically significant differences were found in overall and subgroup scores between the 2 runs for both models (all\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      \u2005&gt;\u2005.05). ChatGPT-4o and DeepSeek V3 showed favorable accuracy and comprehensive responses to most of the 52 esophageal cancer-related questions in this study, but our findings do not confirm their general reliability for esophageal cancer health information in routine clinical or public use.\n                    <\/jats:p>\n                  <\/jats:sec>","DOI":"10.1097\/md.0000000000049896","type":"journal-article","created":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T19:01:18Z","timestamp":1784919678000},"page":"e49896","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":0,"title":["Performance of DeepSeek V3 and ChatGPT-4o in answering esophageal cancer-related questions"],"prefix":"10.1097","volume":"105","author":[{"given":"Qian","family":"Yang","sequence":"first","affiliation":[{"name":"Department of Gastroenterology, Jiujiang City Key Laboratory of Cell Therapy, Jiujiang No. 1 People\u2019s Hospital, Jiujiang, Jiangxi, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Yi","sequence":"additional","affiliation":[{"name":"Department of Gastroenterology, Jiujiang City Key Laboratory of Cell Therapy, Jiujiang No. 1 People\u2019s Hospital, Jiujiang, Jiangxi, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anran","family":"Gong","sequence":"additional","affiliation":[{"name":"Department of Clinical Medicine, Medical College, Jinzhou Medical University, Jinzhou, Liaoning, China."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanyan","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Gastroenterology, Jiujiang City Key Laboratory of Cell Therapy, Jiujiang No. 1 People\u2019s Hospital, Jiujiang, Jiangxi, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qingyan","family":"Feng","sequence":"additional","affiliation":[{"name":"Department of Gastroenterology, Jiujiang City Key Laboratory of Cell Therapy, Jiujiang No. 1 People\u2019s Hospital, Jiujiang, Jiangxi, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aiyan","family":"Fu","sequence":"additional","affiliation":[{"name":"Department of Gastroenterology, Jiujiang City Key Laboratory of Cell Therapy, Jiujiang No. 1 People\u2019s Hospital, Jiujiang, Jiangxi, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiangtao","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Gastroenterology, Jiujiang City Key Laboratory of Cell Therapy, Jiujiang No. 1 People\u2019s Hospital, Jiujiang, Jiangxi, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-9182-6492","authenticated-orcid":false,"given":"Yunkai","family":"Zhan","sequence":"additional","affiliation":[{"name":"Department of Gastroenterology, Jiujiang City Key Laboratory of Cell Therapy, Jiujiang No. 1 People\u2019s Hospital, Jiujiang, Jiangxi, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","reference":[{"key":"R1-20261001","first-page":"229","article-title":"Global cancer statistics 2022: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries.","volume":"74","author":"Bray","year":"2024","journal-title":"CA Cancer J Clin"},{"key":"R2-20261001","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1002\/cac2.12645","article-title":"Current status and perspectives of esophageal cancer: a comprehensive review.","volume":"45","author":"Jiang","year":"2025","journal-title":"Cancer Commun (London, England)"},{"key":"R3-20261001","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1093\/aje\/kwr117","article-title":"Population attributable fractions of adenocarcinoma of the esophagus and gastroesophageal junction.","volume":"174","author":"Olsen","year":"2011","journal-title":"Am J Epidemiol"},{"key":"R4-20261001","doi-asserted-by":"crossref","first-page":"e236","DOI":"10.1016\/S2214-109X(21)00506-4","article-title":"Alcohol consumption and oesophageal squamous cell cancer risk in east Africa: findings from the large multicentre ESCCAPE case-control study in Kenya, Tanzania, and Malawi.","volume":"10","author":"Middleton","year":"2022","journal-title":"Lancet Global health"},{"key":"R5-20261001","doi-asserted-by":"crossref","first-page":"897","DOI":"10.1053\/j.gastro.2019.04.054","article-title":"Tobacco smoking and alcohol drinking: two clinically significant risk factors for esophageal squamous cell carcinoma.","volume":"157","author":"Najafi","year":"2019","journal-title":"Gastroenterology"},{"key":"R6-20261001","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1038\/s41575-021-00419-3","article-title":"Global burden and epidemiology of Barrett oesophagus and oesophageal cancer.","volume":"18","author":"Thrift","year":"2021","journal-title":"Nature Rev Gastroenterol Hepatol"},{"key":"R7-20261001","first-page":"e074962","article-title":"Advances in diagnosis and management of cancer of the esophagus.","volume":"385","author":"Deboever","year":"2024","journal-title":"BMJ (Clinical research ed.)"},{"key":"R8-20261001","doi-asserted-by":"crossref","first-page":"101367","DOI":"10.1016\/j.eclinm.2022.101367","article-title":"Public acceptance and uptake of oesophageal adenocarcinoma screening strategies: a mixed-methods systematic review.","volume":"46","author":"Sijben","year":"2022","journal-title":"EClinicalMedicine"},{"key":"R9-20261001","doi-asserted-by":"crossref","first-page":"1795","DOI":"10.1038\/s41416-024-02663-1","article-title":"Oesophageal cancer awareness and anticipated time to help-seeking: results from a population-based survey.","volume":"130","author":"Sijben","year":"2024","journal-title":"Br J Cancer"},{"key":"R10-20261001","doi-asserted-by":"crossref","first-page":"4563","DOI":"10.1002\/cncr.33029","article-title":"Association of cancer awareness levels with the risk of cancer in rural China: a population-based cohort study.","volume":"126","author":"Li","year":"2020","journal-title":"Cancer"},{"key":"R11-20261001","doi-asserted-by":"crossref","first-page":"1269","DOI":"10.1038\/s41591-024-02943-6","article-title":"The health risks of generative AI-based wellness apps.","volume":"30","author":"De Freitas","year":"2024","journal-title":"Nat Med"},{"key":"R12-20261001","doi-asserted-by":"crossref","first-page":"1349","DOI":"10.1001\/jama.2023.5321","article-title":"AI-generated medical advice-GPT and beyond.","volume":"329","author":"Haupt","year":"2023","journal-title":"JAMA"},{"key":"R13-20261001","doi-asserted-by":"crossref","first-page":"6509","DOI":"10.1097\/JS9.0000000000001850","article-title":"The performance of large language model-powered chatbots compared to oncology physicians on colorectal cancer queries.","volume":"110","author":"Zhou","year":"2024","journal-title":"Int J Surg (London, England)"},{"key":"R14-20261001","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1038\/d41586-025-00229-6","article-title":"China\u2019s cheap, open AI model DeepSeek thrills scientists.","volume":"638","author":"Gibney","year":"2025","journal-title":"Nature"},{"key":"R15-20261001","doi-asserted-by":"crossref","first-page":"2550","DOI":"10.1038\/s41591-025-03726-3","article-title":"Comparative benchmarking of the DeepSeek large language model on medical tasks and clinical reasoning.","volume":"31","author":"Tordjman","year":"2025","journal-title":"Nat Med"},{"key":"R16-20261001","doi-asserted-by":"crossref","first-page":"2546","DOI":"10.1038\/s41591-025-03727-2","article-title":"Benchmark evaluation of DeepSeek large language models in clinical decision-making.","volume":"31","author":"Sandmann","year":"2025","journal-title":"Nat Med"},{"key":"R17-20261001","doi-asserted-by":"crossref","first-page":"1447","DOI":"10.1016\/j.annonc.2025.09.001","article-title":"ESMO guidance on the use of Large Language Models in Clinical Practice (ELCAP).","volume":"36","author":"Wong","year":"2025","journal-title":"Ann Oncol"},{"key":"R18-20261001","doi-asserted-by":"crossref","first-page":"1670510","DOI":"10.3389\/fdgth.2025.1670510","article-title":"Comparative performance evaluation of large language models in answering esophageal cancer-related questions: a multi-model assessment study.","volume":"7","author":"He","year":"2025","journal-title":"Front Digital Health"},{"key":"R19-20261001","doi-asserted-by":"crossref","first-page":"20552076251393291","DOI":"10.1177\/20552076251393291","article-title":"Effectiveness of ChatGPT to provide esophageal cancer information: a SERVQUAL-based analysis.","volume":"11","author":"Cheng","year":"2025","journal-title":"Digital Health"},{"key":"R20-20261001","doi-asserted-by":"crossref","first-page":"1384","DOI":"10.4103\/jfmpc.jfmpc_1236_24","article-title":"Discussion of the ability to use chatGPT to answer questions related to esophageal cancer of patient concern.","volume":"14","author":"Yu","year":"2025","journal-title":"J Family Med Primary Care"},{"key":"R21-20261001","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1056\/AIoa2300151","article-title":"Comparative Evaluation of LLMs in Clinical Oncology.","volume":"1","author":"Rydzewski","year":"2024","journal-title":"NEJM AI"},{"key":"R22-20261001","doi-asserted-by":"crossref","first-page":"1057","DOI":"10.1111\/iej.14217","article-title":"Evaluation of the performance of ChatGPT-4 and ChatGPT-4o as a learning tool in endodontics.","volume":"59","author":"Arili \u00d6zt\u00fcrk","year":"2025","journal-title":"Int Endod J"},{"key":"R23-20261001","doi-asserted-by":"crossref","first-page":"721","DOI":"10.3350\/cmh.2023.0089","article-title":"Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma.","volume":"29","author":"Yeo","year":"2023","journal-title":"Clin Mol Hepatol"},{"key":"R24-20261001","doi-asserted-by":"crossref","first-page":"1256459","DOI":"10.3389\/fonc.2023.1256459","article-title":"Is ChatGPT accurate and reliable in answering questions regarding head and neck cancer?","volume":"13","author":"Ku\u015fcu","year":"2023","journal-title":"Front Oncol"},{"key":"R25-20261001","doi-asserted-by":"crossref","first-page":"865","DOI":"10.3348\/kjr.2024.0843","article-title":"Minimum reporting items for clear evaluation of accuracy reports of large language models in healthcare (MI-CLEAR-LLM).","volume":"25","author":"Park","year":"2024","journal-title":"Korean J Radiol"},{"key":"R26-20261001","doi-asserted-by":"crossref","first-page":"916","DOI":"10.1016\/j.ijrobp.2023.11.012","article-title":"Toward clinical-grade evaluation of large language models.","volume":"118","author":"Moreno","year":"2024","journal-title":"Int J Radiat Oncol Biol Phys"},{"key":"R27-20261001","doi-asserted-by":"crossref","first-page":"e13078","DOI":"10.1111\/hel.13078","article-title":"Exploring the capacities of ChatGPT: a comprehensive evaluation of its accuracy and repeatability in addressing helicobacter pylori-related queries.","volume":"29","author":"Lai","year":"2024","journal-title":"Helicobacter"},{"key":"R28-20261001","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1111\/j.1471-6712.2005.00368.x","article-title":"Statistical methods for assessing agreement for ordinal data.","volume":"19","author":"Jakobsson","year":"2005","journal-title":"Scand J Caring Sci"},{"key":"R29-20261001","doi-asserted-by":"crossref","first-page":"1991","DOI":"10.1016\/S0140-6736(24)02226-8","article-title":"Oesophageal cancer.","volume":"404","author":"Yang","year":"2024","journal-title":"Lancet (London, England)"},{"key":"R30-20261001","doi-asserted-by":"crossref","DOI":"10.3399\/bjgpopen20X101001","article-title":"Patient symptom experience prior to a diagnosis of oesophageal or gastric cancer: a multi-methods study.","volume":"4","author":"Humphrys","year":"2020","journal-title":"BJGP Open"},{"key":"R31-20261001","first-page":"e12745","article-title":"Patient factors influencing symptom appraisal and subsequent adjustment to oesophageal cancer: a qualitative interview study.","volume":"27","author":"Lewis","year":"2018","journal-title":"Eur J Cancer Care (Engl)"},{"key":"R32-20261001","doi-asserted-by":"crossref","first-page":"863","DOI":"10.1007\/s13187-022-02198-0","article-title":"Quality of online information for esophageal cancer.","volume":"38","author":"Parmar","year":"2023","journal-title":"J Cancer Educ"},{"key":"R33-20261001","doi-asserted-by":"crossref","first-page":"38","DOI":"10.3352\/jeehp.2023.20.38","article-title":"Application of artificial intelligence chatbots, including ChatGPT, in education, scholarly work, programming, and content generation and its prospects: a narrative review.","volume":"20","author":"Kim","year":"2023","journal-title":"J Educ Eval Health Prof"}],"container-title":["Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.ovid.com\/10.1097\/MD.0000000000049896","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T18:02:05Z","timestamp":1790877725000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ovid.com\/10.1097\/MD.0000000000049896"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,24]]},"references-count":33,"journal-issue":{"issue":"30","published-print":{"date-parts":[[2026]]}},"URL":"https:\/\/doi.org\/10.1097\/md.0000000000049896","relation":{},"ISSN":["0025-7974","1536-5964"],"issn-type":[{"value":"0025-7974","type":"print"},{"value":"1536-5964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,24]]},"assertion":[{"value":"2026-03-15","name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-09","name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}}]}}