{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T03:18:07Z","timestamp":1787023087638,"version":"build-2736575974"},"reference-count":25,"publisher":"FapUNIFESP (SciELO)","issue":"11","license":[{"start":{"date-parts":[[2025,1,1]],"date-time":"2025-01-01T00:00:00Z","timestamp":1735689600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,1,1]],"date-time":"2025-01-01T00:00:00Z","timestamp":1735689600000},"content-version":"am","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,1,1]],"date-time":"2025-01-01T00:00:00Z","timestamp":1735689600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Rev. Assoc. Med. Bras."],"abstract":"<jats:p>SUMMARY  OBJECTIVE: Artificial intelligence chatbots are increasingly used to disseminate health information. The aim of this study was to evaluate the accuracy, reliability, quality, and readability of responses generated by four artificial intelligence chatbots regarding human papillomavirus vaccination.  METHODS: Frequently asked questions about human papillomavirus vaccination were identified using a Google search tool, and these questions were posed to the ChatGPT-3.5, Gemini, Copilot artificial intelligence, and ChatGPT-4 models. Responses were assessed for accuracy (five-point Likert scale), reliability (modified DISCERN scale), quality (Global Quality Scale), and readability (Flesch Reading Ease Score). Interobserver agreement was evaluated by the intraclass correlation coefficient. The results were evaluated at a significance level of p&lt;0.05. SPSS 23.0 package programme was used in the analyses.  RESULTS: There were significant differences between chatbots in terms of accuracy (p=0.001), reliability (p&lt;0.001), and quality (p&lt;0.001), but no significant difference in readability (p=0.497). ChatGPT-4 demonstrated the highest accuracy and quality, while Copilot artificial intelligence demonstrated superior reliability. All models produced responses that were moderately difficult to read. The intraclass correlation coefficient values for inter-rater reliability ranged from 0.034 to 0.512.  CONCLUSION: Artificial intelligence chatbots show promising potential for use as patient information counsellors regarding human papillomavirus vaccination. However, improvements in readability and consistent evidence-based content generation are required before widespread clinical application.<\/jats:p>","DOI":"10.1590\/1806-9282.20250809","type":"journal-article","created":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T15:07:28Z","timestamp":1764947248000},"source":"Crossref","is-referenced-by-count":1,"title":["Evaluation of the feasibility of artificial intelligence models as patient information advisors for human papillomavirus vaccines"],"prefix":"10.1590","volume":"71","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1725-1220","authenticated-orcid":false,"given":"Abdulkadir","family":"Kaya","sequence":"first","affiliation":[{"name":"D\u00fczce University,  Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1803-7701","authenticated-orcid":false,"given":"H\u00fcseyin Nejat","family":"K\u00fcc\u00fckdag","sequence":"additional","affiliation":[{"name":"D\u00fczce University,  Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7472-551X","authenticated-orcid":false,"given":"Bet\u00fcl","family":"Keyif","sequence":"additional","affiliation":[{"name":"D\u00fczce University,  Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"530","published-online":{"date-parts":[[2025]]},"reference":[{"key":"ref1","doi-asserted-by":"crossref","first-page":"1237704","DOI":"10.3389\/frai.2023.1237704","article-title":"Overview of chatbots with special emphasis on artificial intelligence-enabled ChatGPT in medical science","volume":"6","author":"Chakraborty C","year":"2023","journal-title":"Front Artif Intell"},{"issue":"5","key":"ref2","doi-asserted-by":"crossref","first-page":"546","DOI":"10.1016\/j.ajodo.2023.11.012","article-title":"Examination of the reliability and readability of Chatbot Generative Pretrained Transformer's (ChatGPT) responses to questions about orthodontics and the evolution of these responses in an updated version","volume":"165","author":"K\u0131l\u0131n\u00e7 DD","year":"2024","journal-title":"Am J Orthod Dentofacial Orthop"},{"issue":"1","key":"ref3","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1007\/s10916-024-02045-3","article-title":"The breakthrough of large language models release for medical applications: 1-year timeline and perspectives","volume":"48","author":"Cascella M","year":"2024","journal-title":"J Med Syst"},{"key":"ref4","doi-asserted-by":"crossref","first-page":"cjae017","DOI":"10.1093\/ejo\/cjae017","article-title":"Evidence-based potential of generative artificial intelligence large language models in orthodontics: a comparative study of ChatGPT, Google Bard, and Microsoft Bing","author":"Makrygiannakis MA","year":"2024","journal-title":"Eur J Orthod"},{"key":"ref5","doi-asserted-by":"crossref","first-page":"1161098","DOI":"10.3389\/fdgth.2023.1161098","article-title":"AI chatbots not yet ready for clinical use","volume":"5","author":"Au Yeung J","year":"2023","journal-title":"Front Digit Health"},{"issue":"3","key":"ref6","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.jinf.2012.10.024","article-title":"Risk factors for and prevention of human papillomaviruses (HPV), genital warts and cervical cancer","volume":"66","author":"Chelimo C","year":"2013","journal-title":"J Infect"},{"issue":"2","key":"ref7","first-page":"80","article-title":"Review of HPV-related diseases and cancers","volume":"40","author":"Brianti P","year":"2017","journal-title":"New Microbiol"},{"issue":"1","key":"ref8","first-page":"2","article-title":"Human papillomavirus (HPV), HPV-related disease, and the HPV vaccine","volume":"1","author":"Braaten KP","year":"2008","journal-title":"Rev Obstet Gynecol"},{"issue":"52","key":"ref9","doi-asserted-by":"crossref","first-page":"7236","DOI":"10.1016\/j.vaccine.2009.05.019","article-title":"WHO position on HPV vaccines","volume":"27","year":"2009","journal-title":"Vaccine"},{"issue":"11","key":"ref10","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0241674","article-title":"Human papillomavirus (HPV) and the quadrivalent HPV vaccine among Brazilian adolescents and parents: factors associated with and divergences in knowledge and acceptance","volume":"15","author":"Gomes JM","year":"2020","journal-title":"PLoS One"},{"key":"ref11","doi-asserted-by":"crossref","DOI":"10.1016\/j.vaccine.2006.05.124","article-title":"Chapter 25: education, training, and communication for HPV vaccines","volume":"24","author":"Sherris J","year":"2006","journal-title":"Vaccine"},{"issue":"3","key":"ref12","doi-asserted-by":"crossref","first-page":"419","DOI":"10.2319\/072419-491.1","article-title":"YouTube as a source of information about orthodontic clear aligners","volume":"90","author":"Ustdal G","year":"2020","journal-title":"Angle Orthod"},{"issue":"1","key":"ref13","doi-asserted-by":"crossref","first-page":"1096","DOI":"10.1186\/s12909-024-06048-z","article-title":"Understanding and training for the impact of large language models and artificial intelligence in healthcare practice: a narrative review","volume":"24","author":"McCoy LG","year":"2024","journal-title":"BMC Med Educ"},{"issue":"1","key":"ref14","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1186\/s12911-024-02824-5","article-title":"Assessing the accuracy and quality of artificial intelligence (AI) chatbot-generated responses in making patient-specific drug-therapy and healthcare-related decisions","volume":"24","author":"Shiferaw MW","year":"2024","journal-title":"BMC Med Inform Decis Mak"},{"issue":"4","key":"ref15","doi-asserted-by":"crossref","first-page":"1212","DOI":"10.4103\/jfmpc.jfmpc_1231_24","article-title":"Identifying the e-health prevalence and influence pattern: a cross-sectional study","volume":"14","author":"Goraya GS","year":"2025","journal-title":"J Family Med Prim Care"},{"issue":"2","key":"ref16","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1136\/jech.53.2.105","article-title":"DISCERN: an instrument for judging the quality of written consumer health information on treatment choices","volume":"53","author":"Charnock D","year":"1999","journal-title":"J Epidemiol Community Health"},{"issue":"1","key":"ref17","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1186\/s12911-024-02619-8","article-title":"Can artificial intelligence models serve as patient information consultants in orthodontics?","volume":"24","author":"Dursun D","year":"2024","journal-title":"BMC Med Inform Decis Mak"},{"key":"ref18","doi-asserted-by":"crossref","DOI":"10.2196\/51421","article-title":"Exploring the possible use of AI chatbots in public health education: feasibility study","volume":"9","author":"Baglivo F","year":"2023","journal-title":"JMIR Med Educ"},{"issue":"2","key":"ref19","doi-asserted-by":"crossref","first-page":"138","DOI":"10.30934\/kusbed.874847","article-title":"Gen\u00e7 eri\u015fkinlerin human papilloma vir\u00fcs (HPV) ve HPV a\u015fisina ili\u015fkin bilgi ve g\u00f6r\u00fc\u015fleri: kesitsel bir \u00e7ali\u015fma","volume":"7","author":"Y\u0131lmaz B","year":"2021","journal-title":"KOU Sag Bil Derg"},{"issue":"2","key":"ref20","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/j.pec.2005.05.004","article-title":"The role of pictures in improving health communication: a review of research on attention, comprehension, recall, and adherence","volume":"61","author":"Houts PS","year":"2006","journal-title":"Patient Educ Couns"},{"issue":"3","key":"ref21","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0230058","article-title":"Knowledge gaps and acquisition about HPV and its vaccine among Brazilian medical students","volume":"15","author":"Costa AS","year":"2020","journal-title":"PLoS One"},{"issue":"4","key":"ref22","doi-asserted-by":"crossref","first-page":"666","DOI":"10.1080\/02602938.2017.1393495","article-title":"Student evaluation of teaching and matters of reliability","volume":"43","author":"Clayson DE","year":"2018","journal-title":"Assess Eval High Educ"},{"issue":"1","key":"ref23","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1002\/asi.21447","article-title":"On the measurability of information quality","volume":"62","author":"Arazy O","year":"2011","journal-title":"J Am Soc Inform Sci Tech"},{"issue":"1","key":"ref24","doi-asserted-by":"crossref","first-page":"14604582251315587","DOI":"10.1177\/14604582251315587","article-title":"Presentation suitability and readability of ChatGPT's medical responses to patient questions about on knee osteoarthritis","volume":"31","author":"Yoo M","year":"2025","journal-title":"Health Informatics J"},{"key":"ref25","doi-asserted-by":"crossref","DOI":"10.2196\/63677","article-title":"Assessing the quality and reliability of ChatGPT's responses to radiotherapy-related patient queries: comparative study with GPT-3.5 and GPT-4","volume":"11","author":"Grilo A","year":"2025","journal-title":"JMIR Cancer"}],"container-title":["Revista da Associa\u00e7\u00e3o M\u00e9dica Brasileira"],"original-title":[],"link":[{"URL":"http:\/\/www.scielo.br\/scielo.php?script=sci_pdf&pid=S0104-42302025001100609&tlng=en","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T15:07:32Z","timestamp":1764947252000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.scielo.br\/scielo.php?script=sci_arttext&pid=S0104-42302025001100609&tlng=en"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025]]},"references-count":25,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2025]]}},"alternative-id":["S0104-42302025001100609"],"URL":"https:\/\/doi.org\/10.1590\/1806-9282.20250809","relation":{},"ISSN":["1806-9282","0104-4230"],"issn-type":[{"value":"1806-9282","type":"electronic"},{"value":"0104-4230","type":"print"}],"subject":[],"published":{"date-parts":[[2025]]},"article-number":"e20250809"}}