{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T12:49:04Z","timestamp":1792154944433,"version":"4.4.0"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T00:00:00Z","timestamp":1784592000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T00:00:00Z","timestamp":1792108800000},"content-version":"vor","delay-in-days":87,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Public Health"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Vaccine hesitancy is a major public health problem that threatens global immunisation programmes. The use of artificial intelligence-based chatbots to access health information is increasing. This study aimed to evaluate the responses of ChatGPT-4o to frequently asked questions about vaccine hesitancy in terms of health information quality, based on expert opinion.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>This cross-sectional expert evaluation study included 20 questions on vaccine hesitancy. These questions were submitted to ChatGPT-4o, and the responses were evaluated by nine experts from the fields of public health, paediatrics, and infectious diseases. The evaluation was based on six criteria synthesised from HONcode, DISCERN, JAMA Benchmarks, CRAAP, GQS, and QUEST: scientific accuracy, comprehensiveness, understandability, correction of misinformation, source attribution, and actionability. Each criterion was scored on a scale from 1 to 10. Inter-rater reliability was assessed using the intraclass correlation coefficient (ICC) and, as a prevalence-robust sensitivity analysis, Gwet\u2019s AC2 with quadratic weights.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      The highest mean scores were found for understandability (9.4\u2009\u00b1\u20091.1) and scientific accuracy (8.9\u2009\u00b1\u20091.3), while the lowest mean score was found for source attribution (4.5\u2009\u00b1\u20093.4). At the question level, the highest scores were obtained for Question 4, on aluminium in vaccines, and Question 14, on claims that pharmaceutical companies endanger children\u2019s health by producing and promoting vaccines. The lowest scores were obtained for Question 5, on live vaccines during pregnancy, and Question 6, on natural immunity. ICC analysis showed moderate agreement only for source attribution (ICC\u2009=\u20090.582;\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001); the low ICC values for the other criteria were attributable to a ceiling effect, as confirmed by Gwet\u2019s AC2, which indicated substantially higher agreement for the high-scoring criteria.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>ChatGPT-4o can generate scientifically accurate and understandable responses to questions about vaccine hesitancy. However, it shows a systematic shortcoming in source attribution. Although the model has potential as a supportive tool in public health communication, its outputs should be reviewed by experts and supported with verifiable sources.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12889-026-28626-0","type":"journal-article","created":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T11:44:31Z","timestamp":1784634271000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Evaluating the reliability and information quality of ChatGPT responses on vaccine hesitancy: an expert panel study"],"prefix":"10.1186","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-5271-3327","authenticated-orcid":false,"given":"Hande","family":"Can G\u00fcvercin","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4799-5669","authenticated-orcid":false,"given":"Cemal","family":"Ko\u00e7ak","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-7150-8695","authenticated-orcid":false,"given":"Mehmet Furkan","family":"Aytekin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,7,21]]},"reference":[{"issue":"34","key":"28626_CR1","doi-asserted-by":"publisher","first-page":"4161","DOI":"10.1016\/j.vaccine.2015.04.036","volume":"33","author":"NE MacDonald","year":"2015","unstructured":"MacDonald NE. Vaccine hesitancy: definition, scope and determinants. Vaccine. 2015;33(34):4161\u20134. https:\/\/doi.org\/10.1016\/j.vaccine.2015.04.036.","journal-title":"Vaccine"},{"key":"28626_CR2","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.puhe.2021.02.025","volume":"194","author":"G Troiano","year":"2021","unstructured":"Troiano G, Nardi A. Vaccine hesitancy in the era of COVID-19. Public Health. 2021;194:245\u201351. https:\/\/doi.org\/10.1016\/j.puhe.2021.02.025.","journal-title":"Public Health"},{"key":"28626_CR3","unstructured":"World Health Organization. Vaccine hesitancy: a growing challenge for immunization programmes. 2015. Available from: https:\/\/www.who.int\/news\/item\/18-08-2015-vaccine-hesitancy-a-growing-challenge-for-immunization-programmes. Cited 19 Aug 2025."},{"key":"28626_CR4","unstructured":"Eysenbach G, Kohler C. What is the prevalence of health-related searches on the World Wide Web? Qualitative and quantitative analysis of search engine queries on the Internet. AMIA Annu Symp Proc. 2003;2003:225\u20139. PMID: 14728167."},{"issue":"6","key":"28626_CR5","doi-asserted-by":"publisher","first-page":"1484","DOI":"10.1002\/ohn.465","volume":"170","author":"NF Ayoub","year":"2024","unstructured":"Ayoub NF, Lee YJ, Grimm D, Divi V. Head-to-head comparison of ChatGPT versus google search for medical knowledge acquisition. Otolaryngol Head Neck Surg. 2024;170(6):1484\u201391. https:\/\/doi.org\/10.1002\/ohn.465.","journal-title":"Otolaryngol Head Neck Surg"},{"issue":"6","key":"28626_CR6","doi-asserted-by":"publisher","first-page":"887","DOI":"10.3390\/healthcare11060887","volume":"11","author":"M Sallam","year":"2023","unstructured":"Sallam M. ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. Healthcare. 2023;11(6):887. https:\/\/doi.org\/10.3390\/healthcare11060887.","journal-title":"Healthcare"},{"key":"28626_CR7","unstructured":"Exploding Topics. Most visited websites in the world (August 2025). 2025. Available from: https:\/\/explodingtopics.com\/blog\/most-visited-websites. Cited 25 Aug 2025."},{"key":"28626_CR8","unstructured":"Exploding Topics. Number of ChatGPT users (July 2025). 2024. Available from: https:\/\/explodingtopics.com\/blog\/chatgpt-users. Cited 25 Aug 2025."},{"issue":"3","key":"28626_CR9","doi-asserted-by":"publisher","first-page":"e102","DOI":"10.1016\/S2589-7500(23)00023-7","volume":"5","author":"The Lancet Digital Health","year":"2023","unstructured":"The Lancet Digital Health. ChatGPT: friend or foe? Lancet Digit Health. 2023;5(3):e102. https:\/\/doi.org\/10.1016\/S2589-7500(23)00023-7.","journal-title":"Lancet Digit Health"},{"key":"28626_CR10","doi-asserted-by":"publisher","first-page":"1457131","DOI":"10.3389\/fpubh.2024.1457131","volume":"12","author":"SY Chen","year":"2024","unstructured":"Chen SY, Kuo HY, Chang SH. Perceptions of ChatGPT in healthcare: usefulness, trust, and risk. Front Public Health. 2024;12:1457131. https:\/\/doi.org\/10.3389\/fpubh.2024.1457131.","journal-title":"Front Public Health"},{"issue":"2","key":"28626_CR11","doi-asserted-by":"publisher","first-page":"e35029","DOI":"10.7759\/cureus.35029","volume":"15","author":"M Sallam","year":"2023","unstructured":"Sallam M, Salim NA, Al-Tammemi AB, et al. ChatGPT output regarding compulsory vaccination and COVID-19 vaccine conspiracy: a descriptive study at the outset of a paradigm shift in online search for information. Cureus. 2023;15(2):e35029. https:\/\/doi.org\/10.7759\/cureus.35029.","journal-title":"Cureus"},{"issue":"1","key":"28626_CR12","doi-asserted-by":"publisher","first-page":"e103","DOI":"10.52225\/narra.v3i1.103","volume":"3","author":"M Sallam","year":"2023","unstructured":"Sallam M, Salim NA, Barakat M, Al-Tammemi AB. ChatGPT applications in medical, dental, pharmacy, and public health education: a descriptive study highlighting the advantages and limitations. Narra J. 2023;3(1):e103. https:\/\/doi.org\/10.52225\/narra.v3i1.103.","journal-title":"Narra J"},{"key":"28626_CR13","doi-asserted-by":"publisher","first-page":"765","DOI":"10.1186\/s12889-021-10790-0","volume":"21","author":"R Lang","year":"2021","unstructured":"Lang R, Benham JL, Atabati O, et al. Attitudes, behaviours and barriers to public health measures for COVID-19: a survey to inform public health messaging. BMC Public Health. 2021;21:765. https:\/\/doi.org\/10.1186\/s12889-021-10790-0.","journal-title":"BMC Public Health"},{"key":"28626_CR14","unstructured":"World Health Organization. Vaccines: frequently asked questions (FAQ). https:\/\/www.who.int\/mongolia\/health-topics\/vaccines\/faq. Accessed 4 Aug 2025."},{"key":"28626_CR15","unstructured":"Centers for Disease Control and Prevention. Questions parents may ask about vaccines. https:\/\/www.cdc.gov\/vaccines-children\/hcp\/conversation-tips\/questions-parents-may-ask.html. Accessed 4 Aug 2025."},{"key":"28626_CR16","unstructured":"Immunize.org. Ask the experts. https:\/\/www.immunize.org\/ask-experts\/. Accessed 4 Aug 2025."},{"key":"28626_CR17","unstructured":"The History of Vaccines. Top 20 questions about vaccination. https:\/\/historyofvaccines.org\/getting-vaccinated\/vaccine-faq\/top-20-questions-about-vaccination\/. Accessed 4 Aug 2025."},{"issue":"5","key":"28626_CR18","doi-asserted-by":"publisher","first-page":"603","DOI":"10.1016\/S0010-4825(98)00037-7","volume":"28","author":"C Boyer","year":"1998","unstructured":"Boyer C, Selby M, Scherrer JR, Appel RD. The Health On the Net Code of Conduct for medical and health Websites. Comput Biol Med. 1998;28(5):603\u201310.","journal-title":"Comput Biol Med"},{"issue":"2","key":"28626_CR19","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1136\/jech.53.2.105","volume":"53","author":"D Charnock","year":"1999","unstructured":"Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999;53(2):105\u201311.","journal-title":"J Epidemiol Community Health"},{"issue":"15","key":"28626_CR20","doi-asserted-by":"publisher","first-page":"1244","DOI":"10.1001\/jama.1997.03540390074039","volume":"277","author":"WM Silberg","year":"1997","unstructured":"Silberg WM, Lundberg GD, Musacchio RA. Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor\u2014Let the reader and viewer beware. JAMA. 1997;277(15):1244\u20135.","journal-title":"JAMA"},{"issue":"3","key":"28626_CR21","first-page":"6","volume":"31","author":"S Blakeslee","year":"2004","unstructured":"Blakeslee S. The CRAAP test. LOEX Q. 2004;31(3):6\u20137.","journal-title":"LOEX Q"},{"issue":"9","key":"28626_CR22","doi-asserted-by":"publisher","first-page":"2070","DOI":"10.1111\/j.1572-0241.2007.01325.x","volume":"102","author":"A Bernard","year":"2007","unstructured":"Bernard A, Langille M, Hughes S, Rose C, Leddin D, Veldhuyzen van Zanten S. A systematic review of patient inflammatory bowel disease information resources on the World Wide Web. Am J Gastroenterol. 2007;102(9):2070\u20137.","journal-title":"Am J Gastroenterol"},{"issue":"1","key":"28626_CR23","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1186\/s12911-018-0668-9","volume":"18","author":"JM Robillard","year":"2018","unstructured":"Robillard JM, Jun JH, Lai JA, Feng TL. The QUEST for quality online health information: validation of a short quantitative tool. BMC Med Inf Decis Mak. 2018;18(1):87.","journal-title":"BMC Med Inf Decis Mak"},{"issue":"2","key":"28626_CR24","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","volume":"15","author":"TK Koo","year":"2016","unstructured":"Koo TK, Li MY. A Guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155\u201363. https:\/\/doi.org\/10.1016\/j.jcm.2016.02.012.","journal-title":"J Chiropr Med"},{"issue":"1","key":"28626_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.4274\/MMJ.galenos.2024.78990","volume":"39","author":"C Torun","year":"2024","unstructured":"Torun C, Sarmis A, Oguz A. Is ChatGPT an accurate and reliable source of information for patients with vaccine and statin hesitancy? Medeni Med J. 2024;39(1):1\u20137. https:\/\/doi.org\/10.4274\/MMJ.galenos.2024.78990.","journal-title":"Medeni Med J"},{"issue":"2","key":"28626_CR26","doi-asserted-by":"publisher","first-page":"2235200","DOI":"10.1080\/21645515.2023.2235200","volume":"19","author":"A Salas","year":"2023","unstructured":"Salas A, Rivero-Calle I, Martin\u00f3n-Torres F. Chatting with ChatGPT to learn about safety of COVID-19 vaccines \u2013 a perspective. Hum Vaccin Immunother. 2023;19(2):2235200. https:\/\/doi.org\/10.1080\/21645515.2023.2235200.","journal-title":"Hum Vaccin Immunother"},{"issue":"3","key":"28626_CR27","doi-asserted-by":"publisher","first-page":"390","DOI":"10.7416\/ai.2024.2657","volume":"37","author":"M Fiore","year":"2025","unstructured":"Fiore M, Bianconi A, Acuti Martellucci C, Rosso A, Zauli E, Flacco ME, et al. Vaccination hesitancy: agreement between WHO and ChatGPT-4.0 or Gemini Advanced. Ann Ig. 2025;37(3):390\u20136. https:\/\/doi.org\/10.7416\/ai.2024.2657.","journal-title":"Ann Ig"},{"issue":"6","key":"28626_CR28","doi-asserted-by":"publisher","first-page":"865","DOI":"10.20515\/otd.1694615","volume":"47","author":"E Barut","year":"2025","unstructured":"Barut E, Barut K, Giden R, Yasak \u0130H. Acil T\u0131pta Yapay Zek\u00e2 Kullan\u0131m\u0131: ChatGPT\u2019nin T\u00fcrkiye Sa\u011fl\u0131k Bakanl\u0131\u011f\u0131 Kuduz Profilaksisi Rehberi ile Uyumunun De\u011ferlendirilmesi. Osmangazi J Med. 2025;47(6):865\u201370. https:\/\/doi.org\/10.20515\/otd.1694615.","journal-title":"Osmangazi J Med"},{"key":"28626_CR29","doi-asserted-by":"publisher","first-page":"101838","DOI":"10.1016\/j.physio.2024.101838","volume":"130","author":"C Bernal-Utrera","year":"2026","unstructured":"Bernal-Utrera C, Bravo-V\u00e1zquez A, Montero-Bancalero FJ, Su\u00e1rez-Vega A, Casuso-Holgado MJ, Anarte-Lazo E. Evaluation of ChatGPT accuracy and reliability in answering questions about exercise recommendations for breast cancer survivors. Physiotherapy. 2026;130:101838. https:\/\/doi.org\/10.1016\/j.physio.2024.101838.","journal-title":"Physiotherapy"},{"issue":"5","key":"28626_CR30","doi-asserted-by":"publisher","first-page":"852","DOI":"10.1080\/10790268.2024.2407573","volume":"48","author":"F \u00d6zcan","year":"2025","unstructured":"\u00d6zcan F, \u00d6r\u00fcc\u00fc Atar M, K\u00f6ro\u011flu \u00d6, Y\u0131lmaz B. Assessment of the reliability and usability of ChatGPT in response to spinal cord injury questions. J Spinal Cord Med. 2025;48(5):852\u20137. https:\/\/doi.org\/10.1080\/10790268.2024.2407573.","journal-title":"J Spinal Cord Med"},{"issue":"1","key":"28626_CR31","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1186\/s12903-025-05432-3","volume":"25","author":"M \u00c7itir","year":"2025","unstructured":"\u00c7itir M. ChatGPT and oral cancer: a study on informational reliability. BMC Oral Health. 2025;25(1):86. https:\/\/doi.org\/10.1186\/s12903-025-05432-3.","journal-title":"BMC Oral Health"},{"issue":"11","key":"28626_CR32","doi-asserted-by":"publisher","first-page":"1269","DOI":"10.3390\/healthcare13111269","volume":"13","author":"MCY Koh","year":"2025","unstructured":"Koh MCY, Ngiam JN, Salada BMA, Tambyah PA, Archuleta S, Oon JEL. Can ChatGPT counter vaccine hesitancy? An evaluation of ChatGPT\u2019s responses to simulated queries from the general public. Healthcare. 2025;13(11):1269. https:\/\/doi.org\/10.3390\/healthcare13111269.","journal-title":"Healthcare"},{"issue":"7","key":"28626_CR33","doi-asserted-by":"publisher","first-page":"1217","DOI":"10.3390\/vaccines11071217","volume":"11","author":"G Deiana","year":"2023","unstructured":"Deiana G, Dettori M, Arghittu A, Azara A, Gabutti G, Castiglia P. Artificial intelligence and public health: evaluating ChatGPT responses to vaccination myths and misconceptions. Vaccines. 2023;11(7):1217. https:\/\/doi.org\/10.3390\/vaccines11071217.","journal-title":"Vaccines"},{"issue":"1","key":"28626_CR34","doi-asserted-by":"publisher","first-page":"daab105","DOI":"10.1093\/heapro\/daab105","volume":"37","author":"J Truong","year":"2022","unstructured":"Truong J, Bakshi S, Wasim A, Ahmad M, Majid U. What factors promote vaccine hesitancy or acceptance during pandemics? A systematic review and thematic analysis. Health Promot Int. 2022;37(1):daab105. https:\/\/doi.org\/10.1093\/heapro\/daab105.","journal-title":"Health Promot Int"},{"issue":"3","key":"28626_CR35","doi-asserted-by":"publisher","first-page":"446","DOI":"10.1007\/s10439-023-03305-y","volume":"52","author":"SS Sohail","year":"2024","unstructured":"Sohail SS, Madsen D\u00d8, Farhat F, Alam MA. ChatGPT and vaccines: can AI chatbots boost awareness and uptake? Ann Biomed Eng. 2024;52(3):446\u201350. https:\/\/doi.org\/10.1007\/s10439-023-03305-y.","journal-title":"Ann Biomed Eng"},{"issue":"5","key":"28626_CR36","doi-asserted-by":"publisher","first-page":"e20231558","DOI":"10.1590\/1806-9282.20231558","volume":"70","author":"AV Singh","year":"2024","unstructured":"Singh AV. Application of ChatGPT in reducing vaccine hesitancy and enhancing vaccine acceptance: hope or myth? Rev Assoc Med Bras. 2024;70(5):e20231558. https:\/\/doi.org\/10.1590\/1806-9282.20231558.","journal-title":"Rev Assoc Med Bras"},{"key":"28626_CR37","doi-asserted-by":"publisher","first-page":"104620","DOI":"10.1016\/j.jbi.2024.104620","volume":"151","author":"Q Wei","year":"2024","unstructured":"Wei Q, Yao Z, Cui Y, Wei B, Jin Z, Xu X. Evaluation of ChatGPT-generated medical responses: a systematic review and meta-analysis. J Biomed Inf. 2024;151:104620. https:\/\/doi.org\/10.1016\/j.jbi.2024.104620.","journal-title":"J Biomed Inf"},{"key":"28626_CR38","doi-asserted-by":"publisher","first-page":"eaec8352","DOI":"10.1126\/science.aec8352","volume":"391","author":"M Cheng","year":"2026","unstructured":"Cheng M, Lee C, Khadpe P, Yu S, et al. Sycophantic AI decreases prosocial intentions and promotes dependence. Science. 2026;391:eaec8352. https:\/\/doi.org\/10.1126\/science.aec8352.","journal-title":"Science"},{"key":"28626_CR39","doi-asserted-by":"publisher","first-page":"1283","DOI":"10.1007\/s11606-025-10071-1","volume":"41","author":"T Mee","year":"2026","unstructured":"Mee T, Choi JJ, Baduashvili A. Same prompt, different answer: why AI disagrees with itself. J Gen Intern Med. 2026;41:1283\u20135. https:\/\/doi.org\/10.1007\/s11606-025-10071-1.","journal-title":"J Gen Intern Med"},{"issue":"46","key":"28626_CR40","doi-asserted-by":"publisher","first-page":"39116","DOI":"10.1609\/aaai.v40i46.41259","volume":"40","author":"E Poole-Dayan","year":"2026","unstructured":"Poole-Dayan E, Roy D, Kabbara J. LLM targeted underperformance disproportionately impacts vulnerable users. Proc AAAI Conf Artif Intell. 2026;40(46):39116\u201324. https:\/\/doi.org\/10.1609\/aaai.v40i46.41259.","journal-title":"Proc AAAI Conf Artif Intell"},{"issue":"5","key":"28626_CR41","doi-asserted-by":"publisher","first-page":"868","DOI":"10.1007\/s10439-023-03153-w","volume":"51","author":"SS Biswas","year":"2023","unstructured":"Biswas SS. Role of Chat GPT in Public Health. Ann Biomed Eng. 2023;51(5):868\u20139. https:\/\/doi.org\/10.1007\/s10439-023-03153-w.","journal-title":"Ann Biomed Eng"},{"key":"28626_CR42","doi-asserted-by":"publisher","first-page":"109729","DOI":"10.1016\/j.resuscitation.2023.109729","volume":"185","author":"C Ahn","year":"2023","unstructured":"Ahn C. Exploring ChatGPT for information of cardiopulmonary resuscitation. Resuscitation. 2023;185:109729. https:\/\/doi.org\/10.1016\/j.resuscitation.2023.109729.","journal-title":"Resuscitation"},{"issue":"1","key":"28626_CR43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/21645515.2021.1874218","volume":"18","author":"F Dib","year":"2022","unstructured":"Dib F, Mayaud P, Chauvin P, Launay O. Online mis\/disinformation and vaccine hesitancy in the era of COVID-19: why we need an eHealth literacy revolution. Hum Vaccin Immunother. 2022;18(1):1\u20133. https:\/\/doi.org\/10.1080\/21645515.2021.1874218.","journal-title":"Hum Vaccin Immunother"},{"issue":"12","key":"28626_CR44","doi-asserted-by":"publisher","first-page":"101397","DOI":"10.1016\/j.patter.2025.101397","volume":"6","author":"A Wang","year":"2025","unstructured":"Wang A, Ho DE, Koyejo S. The inadequacy of offline large language model evaluations: a need to account for personalization in model behavior. Patterns. 2025;6(12):101397. https:\/\/doi.org\/10.1016\/j.patter.2025.101397.","journal-title":"Patterns"},{"key":"28626_CR45","first-page":"9459","volume":"33","author":"P Lewis","year":"2020","unstructured":"Lewis P, Perez E, Piktus A, Petroni F, Karpukhin V, Goyal N, et al. Retrieval-augmented generation for knowledge-intensive NLP tasks. Adv Neural Inf Process Syst. 2020;33:9459\u201374.","journal-title":"Adv Neural Inf Process Syst"}],"container-title":["BMC Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12889-026-28626-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12889-026-28626-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12889-026-28626-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T12:02:26Z","timestamp":1792152146000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12889-026-28626-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,21]]},"references-count":45,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["28626"],"URL":"https:\/\/doi.org\/10.1186\/s12889-026-28626-0","relation":{},"ISSN":["1471-2458"],"issn-type":[{"value":"1471-2458","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,21]]},"assertion":[{"value":"11 May 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 July 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 July 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"This study was approved by the Human Research Ethics Committee of Ankara University Faculty of Medicine (Decision No: \u013001-111-26). All experiments were performed in accordance with the Declaration of Helsinki. Participation was voluntary, and verbal informed consent was obtained from all participants prior to their involvement.","order":1,"name":"Ethics","label":"Ethics approval and consent to participate","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","label":"Consent for publication","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Declarations"}}],"article-number":"2986"}}