{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T02:11:03Z","timestamp":1787451063718,"version":"build-2736575974"},"reference-count":89,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Public Health Surveill"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>The growing use of artificial intelligence (AI) chatbots for seeking health-related information is concerning, as they were not originally developed for delivering medical guidance. The quality of AI chatbots\u2019 responses relies heavily on their training data and is often limited in medical contexts due to their lack of specific training data in medical literature. Findings on the quality of AI chatbot responses related to health are mixed. Some studies showed the quality surpassed physicians\u2019 responses, while others revealed occasional major errors and low readability. This study addresses a critical gap by examining the performance of various AI chatbots in a complex, misinformation-rich environment.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study examined AI chatbots' responses to human papillomavirus (HPV)\u2013related questions by analyzing structure, linguistic features, information accuracy and currency, and vaccination stance.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We conducted a qualitative content analysis following the approach outlined by Schreier to examine 4 selected AI chatbots\u2019 (ChatGPT 4, Claude 3.7 Sonnet, DeepSeek V3, and Docus [General AI Doctor]) responses to HPV vaccine questions. These questions, simulated by young adults, were adapted from items on the Vaccine Conspiracy Beliefs Scale and Google Trends. The selection criteria for AI chatbots included popularity, accessibility, countries of origin, response update methods, and intended use. Two researchers, simulating a 22-year-old man or woman, collected 8 conversations between February 22 and 28, 2025. We used a deductive approach to develop initial code groups, then an inductive approach to generate codes. The responses were analyzed based on a comprehensive codebook, with codes examining response structure, linguistic features, information accuracy and currency, and vaccination stance. We also assessed readability using the Flesch-Kincaid Grade Level and Reading Ease Score.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>All AI chatbots cited evidence-based sources from reputable health organizations. We found no fabricated information or inaccuracies in numerical data. For complex questions, all AI chatbots appropriately deferred to health care professionals\u2019 suggestions. All AI chatbots maintained a neutral or provaccine stance, corresponding with scientific consensus. The mean and range of response lengths varied [word count; ChatGPT: 436.4 (218-954); Claude: 188.0 (138-255); DeepSeek: 510.0 (325-735); and Docus: 159.4 (61-200)], as did readability [Flesch-Kincaid Grade Level; ChatGPT: 10.7 (6.0-14.9); Claude: 13.2 (7.7-17.8); DeepSeek: 11.3 (7.0-14.7); and Docus: 12.2 (8.9-15.5); and Flesch-Kincaid Reading Ease Score; ChatGPT: 46.8 (25.4-72.2); Claude: 32.5 (6.3-67.3); DeepSeek: 43.7 (22.8-67.4); and Docus: 40.5 (19.6-58.2)]. ChatGPT and Claude offered personalized responses, while DeepSeek and Docus lacked this. Occasionally, some responses included broken or irrelevant links and medical jargon.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Amidst an online environment saturated with misinformation, AI chatbots have the potential to serve as an alternative source of accurate HPV-related information to conventional online platforms (websites and social media). Improvements in readability, personalization, and link accuracy are still needed. Furthermore, we recommend that users treat AI chatbots as complements, not replacements, to health care professionals\u2019 guidance on clinical settings.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/79720","type":"journal-article","created":{"date-parts":[[2025,12,22]],"date-time":"2025-12-22T12:30:06Z","timestamp":1766406606000},"page":"e79720","source":"Crossref","is-referenced-by-count":3,"title":["Examining Artificial Intelligence Chatbots\u2019 Responses in Providing Human Papillomavirus Vaccine Information for Young Adults: Qualitative Content Analysis"],"prefix":"10.2196","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7438-8007","authenticated-orcid":false,"given":"Alfu","family":"Laily","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9174-1730","authenticated-orcid":false,"given":"Laura M","family":"Schwab-Reese","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-2857-2400","authenticated-orcid":false,"given":"Megan","family":"Davish","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-8430-7979","authenticated-orcid":false,"given":"Emily","family":"Cahue","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1849-4873","authenticated-orcid":false,"given":"Kathryn J","family":"LaRoche","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2633-4397","authenticated-orcid":false,"given":"Natalia M","family":"Rodriguez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6900-0322","authenticated-orcid":false,"given":"Robert J","family":"Duncan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9376-8075","authenticated-orcid":false,"given":"Randolph D","family":"Hubach","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9879-7235","authenticated-orcid":false,"given":"Monica L","family":"Kasting","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,2,18]]},"reference":[{"key":"ref1","unstructured":"Human papillomavirus and cancerWorld Health Organization2024352025-09-20https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/human-papilloma-virus-and-cancer"},{"key":"ref2","unstructured":"Cancers linked with HPV each yearCDC20251232024-11-22https:\/\/www.cdc.gov\/cancer\/hpv\/cases.html"},{"key":"ref3","author":"Elissa, M","year":"2021","journal-title":"Pink Book: Epidemiology and Prevention of Vaccine-Preventable Diseases"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1080\/14760584.2017.1383158"},{"key":"ref5","unstructured":"Vaccination coverage among adults in the United States, National Health Interview Survey, 2022CDC20241042024-11-22https:\/\/www.cdc.gov\/adultvaxview\/publications-resources\/adult-vaccination-coverage-2022.html"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.1002\/cam4.3192"},{"key":"ref7","author":"Wang, X","year":"2023","journal-title":"NCHS Data Briefs, no. 482"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.2196\/37656"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1177\/1090198119859412"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.2196\/21451"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1080\/21645515.2017.1306159"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.1007\/s10865-022-00342-1"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2019-035626"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.1016\/j.ypmed.2021.106615"},{"key":"ref15","unstructured":"Urgent health challenges for the next decadeWorld Health Organization202012023-11-15https:\/\/www.who.int\/news-room\/photo-story\/photo-story-detail\/urgent-health-challenges-for-the-next-decade"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocab150"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.1080\/21645515.2022.2126251"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.1186\/s12889-020-09877-x"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.1016\/j.vaccine.2020.01.053"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0266081"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0276465"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.3390\/healthcare10091721"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.2196\/15185"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1093\/jncics\/pkad010"},{"key":"ref25","unstructured":"Roo, a sexual health chatbotPlanned Parenthood2025-05-27https:\/\/www.plannedparenthood.org\/learn\/roo-sexual-health-chatbot"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2024.2376808"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.1177\/2055207619871808"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.1007\/s00259-023-06172-w"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0321093"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.1016\/j.iotcps.2023.04.003"},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.3389\/frai.2023.1237704"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.4140506"},{"key":"ref33","unstructured":"What is DeepSeek AI?DeepSeek AI2025-04-19https:\/\/deepseek.ai\/"},{"key":"ref34","unstructured":"Docus, AI-powered health platformDocus2025-04-21https:\/\/docus.ai"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.2196\/47564"},{"key":"ref36","doi-asserted-by":"publisher","DOI":"10.1080\/0194262x.2023.2250835"},{"key":"ref37","doi-asserted-by":"publisher","DOI":"10.1136\/bmjsrh-2018-200271"},{"key":"ref38","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.44316"},{"key":"ref39","doi-asserted-by":"publisher","DOI":"10.1056\/CAT.23.0043"},{"key":"ref40","doi-asserted-by":"publisher","DOI":"10.3390\/su15075614"},{"key":"ref41","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2023.1838"},{"key":"ref42","doi-asserted-by":"publisher","DOI":"10.1093\/jamiaopen\/ooaf005"},{"key":"ref43","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2023.36483"},{"key":"ref44","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2024-017476"},{"key":"ref45","doi-asserted-by":"publisher","DOI":"10.1016\/j.pvr.2016.09.001"},{"key":"ref46","unstructured":"HPV vaccineGoogle Trends2024-02-07https:\/\/trends.google.com\/trends\/explore?geo=US&q=%2Fm%2F094j5f&hl=en-US"},{"key":"ref47","unstructured":"KanMDeepSeek sees huge surge to become second most popular AI chatbotPCMag2025232025-04-21https:\/\/www.pcmag.com\/news\/deepseek-sees-huge-surge-to-become-second-most-popular-ai-chatbot"},{"key":"ref48","doi-asserted-by":"crossref","DOI":"10.4135\/9781446282243","author":"Flick, U","year":"2014","journal-title":"The SAGE Handbook of Qualitative Data Analysis"},{"key":"ref49","unstructured":"SSA - POMS: NL 10605.105 - What is the Flesch-Kincaid readability test?Social Security Administration (USA)20152025-04-22https:\/\/secure.ssa.gov\/poms.nsf\/lnx\/0910605105"},{"key":"ref50","doi-asserted-by":"publisher","DOI":"10.1177\/21925682211015955"},{"key":"ref51","doi-asserted-by":"publisher","DOI":"10.1111\/ans.18666"},{"key":"ref52","doi-asserted-by":"publisher","DOI":"10.1308\/rcsann.2022.0147"},{"key":"ref53","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2022.107584"},{"key":"ref54","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmedr.2025.103241"},{"key":"ref55","doi-asserted-by":"publisher","DOI":"10.1016\/j.whi.2018.04.009"},{"key":"ref56","doi-asserted-by":"publisher","DOI":"10.1111\/psrh.12262"},{"key":"ref57","doi-asserted-by":"publisher","DOI":"10.1007\/s10508-022-02423-3"},{"key":"ref58","doi-asserted-by":"publisher","DOI":"10.1186\/s12978-022-01394-x"},{"key":"ref59","doi-asserted-by":"publisher","DOI":"10.1177\/10547738211045227"},{"key":"ref60","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmedr.2024.102602"},{"key":"ref61","doi-asserted-by":"publisher","DOI":"10.1089\/whr.2023.0113"},{"key":"ref62","doi-asserted-by":"publisher","DOI":"10.2196\/42049"},{"key":"ref63","doi-asserted-by":"publisher","DOI":"10.1177\/10778012241279106"},{"key":"ref64","doi-asserted-by":"publisher","DOI":"10.1089\/apc.2023.0090"},{"key":"ref65","doi-asserted-by":"publisher","DOI":"10.1007\/s13187-023-02268-x"},{"key":"ref66","doi-asserted-by":"publisher","DOI":"10.1145\/3757544"},{"key":"ref67","unstructured":"ZhouJAlfonsoMSchwab-ReeseLEthical use of AI in public health2025APHA Annual Meeting 2025November 2-5, 2025Washington, DC"},{"key":"ref68","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmedr.2022.101772"},{"key":"ref69","doi-asserted-by":"publisher","DOI":"10.1016\/j.ypmed.2025.108280"},{"key":"ref70","unstructured":"Feminizing hormone therapyMayo Clinic2026-01-21https:\/\/www.mayoclinic.org\/tests-procedures\/feminizing-hormone-therapy\/about\/pac-20385096"},{"key":"ref71","doi-asserted-by":"publisher","DOI":"10.1093\/infdis\/jir073"},{"key":"ref72","doi-asserted-by":"publisher","DOI":"10.2196\/48659"},{"key":"ref73","doi-asserted-by":"publisher","DOI":"10.2196\/42758"},{"key":"ref74","unstructured":"SingerEThousands of U.S. government web pages have been taken down since FridayThe New York Times202522025-05-09https:\/\/www.nytimes.com\/2025\/02\/02\/upshot\/trump-government-websites-missing-pages.html"},{"key":"ref75","unstructured":"StoneWJudge orders restoration of federal health websitesNPR20252112025-05-09https:\/\/www.npr.org\/sections\/shots-health-news\/2025\/02\/11\/nx-s1-5293387\/judge-orders-cdc-fda-hhs-websites-restored"},{"key":"ref76","doi-asserted-by":"publisher","DOI":"10.2196\/54345"},{"key":"ref77","doi-asserted-by":"publisher","DOI":"10.51866\/lte.527"},{"key":"ref78","doi-asserted-by":"publisher","DOI":"10.1177\/2374373521998847"},{"key":"ref79","doi-asserted-by":"publisher","DOI":"10.1098\/rsos.191412"},{"key":"ref80","doi-asserted-by":"publisher","DOI":"10.1177\/01655515221118047"},{"key":"ref81","doi-asserted-by":"publisher","DOI":"10.1177\/20552076221129718"},{"key":"ref82","doi-asserted-by":"publisher","DOI":"10.1080\/1553118x.2025.2462087"},{"key":"ref83","doi-asserted-by":"publisher","DOI":"10.1007\/s11934-023-01184-3"},{"key":"ref84","doi-asserted-by":"publisher","DOI":"10.1111\/ans.18721"},{"key":"ref85","doi-asserted-by":"publisher","DOI":"10.2196\/54657"},{"key":"ref86","doi-asserted-by":"publisher","DOI":"10.1017\/cts.2024.15"},{"key":"ref87","doi-asserted-by":"publisher","DOI":"10.1016\/j.vaccine.2022.12.059"},{"key":"ref88","doi-asserted-by":"publisher","DOI":"10.3390\/jpm13091363"},{"key":"ref89","doi-asserted-by":"publisher","DOI":"10.1016\/j.vaccine.2024.126559"}],"container-title":["JMIR Public Health and Surveillance"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/publichealth.jmir.org\/2026\/1\/e79720","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:12:54Z","timestamp":1782843174000},"score":1,"resource":{"primary":{"URL":"https:\/\/publichealth.jmir.org\/2026\/1\/e79720"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,18]]},"references-count":89,"URL":"https:\/\/doi.org\/10.2196\/79720","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.79720","asserted-by":"object"}]},"ISSN":["2369-2960"],"issn-type":[{"value":"2369-2960","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,18]]}}}