{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T01:22:47Z","timestamp":1791249767352,"version":"4.1.0"},"reference-count":33,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,8,24]],"date-time":"2026-08-24T00:00:00Z","timestamp":1787529600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"2024 Evidence-Based Nursing Project of Changzhou First People\u2019s Hospital","award":["2024-004"],"award-info":[{"award-number":["2024-004"]}]},{"name":"2024 Hospital-level Nursing Special Science and Technology Project of Changzhou First People\u2019s Hospital","award":["YY2024010"],"award-info":[{"award-number":["YY2024010"]}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Public Health"],"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To compare the safety, accuracy, empathy, reliability, information quality, and readability of five publicly accessible large language model chatbots when answering patient-facing lung cancer prognostic questions under standardized single-turn English prompting.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>In this Chatbot Health Advice Reporting Transparency-guided cross-sectional evaluation, 53 standardized English prompts were submitted once to ChatGPT, Gemini, Copilot, DeepSeek, and Doubao through official web interfaces during April 1\u201321, 2026. Five blinded raters assessed 265 responses for safety, accuracy, empathy, DISCERN, EQIP, JAMA benchmark criteria, Global Quality Scale, and readability. Paired repeated-measures analyses were used.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Inter-rater agreement was good to excellent. Safety differed significantly across models (Cochran\u2019s Q\u202f=\u202f14.089, df\u202f=\u202f4,\n                      <jats:italic>p<\/jats:italic>\n                      \u202f=\u202f0.007). Gemini generated the highest proportion of safe responses (48\/53, 90.6%), whereas DeepSeek generated the lowest (33\/53, 62.3%). The only adjusted pairwise safety difference that remained significant was Gemini versus DeepSeek (adjusted\n                      <jats:italic>p<\/jats:italic>\n                      \u202f=\u202f0.023). Accuracy, empathy, reliability, information quality, and readability also differed significantly across models (all\n                      <jats:italic>p<\/jats:italic>\n                      \u202f&amp;lt;\u202f0.001). Gemini showed the most favorable descriptive profile for safety, accuracy, empathy, and reliability, while Copilot produced the most readable responses.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Public-facing chatbots differed substantially in safety, reliability, communication quality, and readability. These findings are time-, interface-, and prompt-dependent. Chatbots may support general patient education but should not replace individualized clinician-led prognostic communication.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fpubh.2026.1935121","type":"journal-article","created":{"date-parts":[[2026,8,24]],"date-time":"2026-08-24T05:28:18Z","timestamp":1787549298000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Safety and quality of public chatbots for lung cancer prognostic information: a comparative evaluation"],"prefix":"10.3389","volume":"14","author":[{"given":"Yanru","family":"Jiang","sequence":"first","affiliation":[{"name":"Department of Thoracic Surgery, The First People\u2019s Hospital of Changzhou","place":["Changzhou, Jiangsu, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qianyun","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Thoracic Surgery, The First People\u2019s Hospital of Changzhou","place":["Changzhou, Jiangsu, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liang","family":"Zheng","sequence":"additional","affiliation":[{"name":"Department of Thoracic Surgery, The First People\u2019s Hospital of Changzhou","place":["Changzhou, Jiangsu, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lei","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Thoracic Surgery, The First People\u2019s Hospital of Changzhou","place":["Changzhou, Jiangsu, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bo","family":"Jiang","sequence":"additional","affiliation":[{"name":"Department of Thoracic Surgery, The First People\u2019s Hospital of Changzhou","place":["Changzhou, Jiangsu, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingjuan","family":"Xu","sequence":"additional","affiliation":[{"name":"Department of Thoracic Surgery, The First People\u2019s Hospital of Changzhou","place":["Changzhou, Jiangsu, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jun","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Thoracic Surgery, The First People\u2019s Hospital of Changzhou","place":["Changzhou, Jiangsu, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiaying","family":"Zhu","sequence":"additional","affiliation":[{"name":"Department of Thoracic Surgery, The First People\u2019s Hospital of Changzhou","place":["Changzhou, Jiangsu, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhishui","family":"Wu","sequence":"additional","affiliation":[{"name":"Department of Thoracic Surgery, The First People\u2019s Hospital of Changzhou","place":["Changzhou, Jiangsu, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,8,24]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1016\/S0140-6736(21)00312-3","article-title":"Lung cancer","volume":"398","author":"Thai","year":"2021","journal-title":"Lancet"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1038\/s41572-024-00551-9","article-title":"Non-small-cell lung cancer","volume":"10","author":"Hendriks","year":"2024","journal-title":"Nat Rev Dis Primers"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"229","DOI":"10.3322\/caac.21834","article-title":"Global cancer statistics 2022: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries","volume":"74","author":"Bray","year":"2024","journal-title":"CA Cancer J Clin"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"6144","DOI":"10.3390\/curroncol31100458","article-title":"Effects of symptom burden on quality of life in patients with lung cancer","volume":"31","author":"Chiou","year":"2024","journal-title":"Curr Oncol"},{"key":"ref5","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1016\/j.vhri.2022.07.007","article-title":"Cost of lung cancer: a systematic review","volume":"33","author":"Yousefi","year":"2023","journal-title":"Value Health Reg Issues"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"249","DOI":"10.6004\/jnccn.2204.0023","article-title":"Non-small cell lung cancer, version 4.2024, NCCN clinical practice guidelines in oncology","volume":"22","author":"Riely","year":"2024","journal-title":"J Natl Compr Cancer Netw"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"e67914","DOI":"10.2196\/67914","article-title":"Evaluation of large language models in tailoring educational content for Cancer survivors and their caregivers: quality analysis","volume":"11","author":"Liu","year":"2025","journal-title":"JMIR Cancer"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"887","DOI":"10.3390\/healthcare11060887","article-title":"ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns","volume":"11","author":"Sallam","year":"2023","journal-title":"Healthcare (Basel)"},{"key":"ref9","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1038\/d41586-023-00288-7","article-title":"ChatGPT: five priorities for research","volume":"614","author":"van Dis","year":"2023","journal-title":"Nature"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"100196","DOI":"10.1016\/j.jposna.2025.100196","article-title":"Artificial intelligence-based large language models can facilitate patient education","volume":"12","author":"Bryson","year":"2025","journal-title":"J Pediatr Soc North Am"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"oyae264","DOI":"10.1093\/oncolo\/oyae264","article-title":"Servicing open-source large language models for oncology","volume":"30","author":"Ray","year":"2025","journal-title":"Oncologist"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"e69955","DOI":"10.2196\/69955","article-title":"Enhancing the readability of online patient education materials using large language models: cross-sectional study","volume":"27","author":"Will","year":"2025","journal-title":"J Med Internet Res"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"e0324175","DOI":"10.1371\/journal.pone.0324175","article-title":"GPT-4 generates accurate and readable patient education materials aligned with current oncological guidelines: a randomized assessment","volume":"20","author":"Rodler","year":"2025","journal-title":"PLoS One"},{"key":"ref14","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1370\/afm.250386","article-title":"Reporting guideline for chatbot health advice studies: chatbot assessment reporting tool (CHART) statement","volume":"23","year":"2025","journal-title":"Ann Fam Med"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"e31","DOI":"10.1200\/JCO-25-01061","article-title":"Therapy for stage IV non-small cell lung Cancer with driver alterations: ASCO living guideline, version 2025.1","volume":"43","author":"Reuss","year":"2025","journal-title":"J Clin Oncol"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"e45","DOI":"10.1200\/JCO-25-01062","article-title":"Therapy for stage IV non-small cell lung Cancer without driver alterations: ASCO living guideline, version 2025.1","volume":"43","author":"Owen","year":"2025","journal-title":"J Clin Oncol"},{"key":"ref17","doi-asserted-by":"publisher","first-page":"358","DOI":"10.1016\/j.annonc.2022.12.013","article-title":"Non-oncogene-addicted metastatic non-small-cell lung cancer: ESMO clinical practice guideline for diagnosis, treatment and follow-up","volume":"34","author":"Hendriks","year":"2023","journal-title":"Ann Oncol"},{"key":"ref18","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1136\/jech.53.2.105","article-title":"DISCERN: an instrument for judging the quality of written consumer health information on treatment choices","volume":"53","author":"Charnock","year":"1999","journal-title":"J Epidemiol Community Health"},{"key":"ref19","doi-asserted-by":"publisher","first-page":"e0334250","DOI":"10.1371\/journal.pone.0334250","article-title":"Evaluating the quality of ChatGPT-generated medical information on major ophthalmic conditions: a comparative assessment against the EQIP tool and guidelines","volume":"20","author":"Hu","year":"2025","journal-title":"PLoS One"},{"key":"ref20","doi-asserted-by":"crossref","first-page":"1244","DOI":"10.1001\/jama.1997.03540390074039","article-title":"Assessing, controlling, and assuring the quality of medical information on the internet: Caveant lector et viewor\u2014let the reader and viewer beware","volume":"277","author":"Silberg","year":"1997","journal-title":"JAMA"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"6069","DOI":"10.1007\/s00405-024-08643-8","article-title":"To trust or not to trust: evaluating the reliability and safety of AI responses to laryngeal cancer queries","volume":"281","author":"Ostrowska","year":"2024","journal-title":"Eur Arch Otorrinolaringol"},{"key":"ref22","volume-title":"Automated Readability Index. AMRL-TR-66-220","author":"Smith","year":"1967"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1037\/h0076540","article-title":"A computer readability formula designed for machine scoring","volume":"60","author":"Coleman","year":"1975","journal-title":"J Appl Psychol"},{"key":"ref24","volume-title":"Derivation of New Readability Formulas for Navy Enlisted Personnel. Research Branch Report 8\u201375","author":"Kincaid","year":"1975"},{"key":"ref25","volume-title":"The Technique of Clear Writing","author":"Gunning","year":"1952"},{"key":"ref26","first-page":"639","article-title":"Smog grading: a new readability formula","volume":"12","author":"McLaughlin","year":"1969","journal-title":"J Read"},{"key":"ref27","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1037\/h0057532","article-title":"A new readability yardstick","volume":"32","author":"Flesch","year":"1948","journal-title":"J Appl Psychol"},{"key":"ref28","volume-title":"IBM SPSS Statistics for Windows, Version 30.0","year":"2024"},{"key":"ref29","year":""},{"key":"ref30","year":""},{"key":"ref31","year":""},{"key":"ref32","year":""},{"key":"ref33","year":""}],"container-title":["Frontiers in Public Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1935121\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,24]],"date-time":"2026-08-24T05:28:22Z","timestamp":1787549302000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1935121\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,24]]},"references-count":33,"alternative-id":["10.3389\/fpubh.2026.1935121"],"URL":"https:\/\/doi.org\/10.3389\/fpubh.2026.1935121","relation":{},"ISSN":["2296-2565"],"issn-type":[{"value":"2296-2565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,24]]},"article-number":"1935121"}}