{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,10]],"date-time":"2026-08-10T06:27:57Z","timestamp":1786343277261,"version":"build-2736575974"},"reference-count":39,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,8,10]],"date-time":"2026-08-10T00:00:00Z","timestamp":1786320000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Public Health"],"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>Artificial intelligence (AI) is becoming increasingly relevant for public health practice. However, scalable training models and validated usability instruments for AI chatbots are still limited in non-English contexts. We aimed to (i) assess AI knowledge, attitudes, and practices (KAP) among a sample of Italian public health professionals, and (ii) translate, culturally adapt, and psychometrically validate an Italian version of the Chatbot Usability Questionnaire (CUQ-IT) by applying it to a workshop-developed vaccination counseling chatbot.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We conducted a three-phase study during the 57th Italian National Congress of Hygiene, Preventive Medicine and Public Health (Italy, October 2024): (i) use of an Italian translation and adaptation of the CUQ within a cross-sectional KAP survey; (ii) a 90-min theoretical-practical workshop with guided prompt engineering and collaborative development of a Custom GPT for vaccination counseling (VaxSense), followed by supervised interaction; (iii) post-workshop usability evaluation with CUQ-IT and psychometric testing. Construct adequacy was assessed using KMO and Bartlett's test. Internal consistency was estimated with Cronbach's \u03b1. Associations between KAP and usability ratings were explored.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Of 150 workshop attendees, 87 returned questionnaires (58%); 86 were eligible for KAP analyses, and 77 completed CUQ-IT for usability evaluation. Participants (mean age 35.9 \u00b1 8.7; 55.8% females) reported moderate AI knowledge (mean 2.74 \u00b1 1.05\/5), positive attitudes (3.87 \u00b1 0.73\/5), and limited routine use (2.88 \u00b1 1.11\/5). CUQ-IT showed good sampling adequacy (KMO = 0.81) and significant item correlations (Bartlett's \u03c7\n                      <jats:sup>2<\/jats:sup>\n                      (120) = 515.36,\n                      <jats:italic>p<\/jats:italic>\n                      -value &amp;lt;0.001). Internal consistency was high overall, with Cronbach's \u03b1 = 0.881. The mean CUQ-IT usability score for VaxSense was 66.60 \u00b1 15.29 (range 18.75\u201395.31). Participants with higher AI knowledge, more positive attitudes, and more frequent AI use tended to assign higher usability scores.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>In our sample of Italian public health professionals, moderate baseline AI knowledge, positive attitudes, and limited routine use of AI emerged, while the workshop-developed vaccination chatbot achieved overall good usability. The significant gender differences observed in both self-rated AI knowledge and usability scores indicated that \u201cAI readiness\u201d may be uneven, even within trained professional groups, underscoring the need for inclusive capacity-building strategies. In the public health sector, training should be framed as a component of safe implementation: strengthening the ability to critically appraise outputs, recognize common failure modes, mitigate bias and equity risks, and apply privacy-by-design principles. CUQ-IT demonstrated robust psychometric performance and represents a standardized tool to benchmark chatbot usability in Italian settings. Future work should confirm its measurement structure in larger samples and assess whether targeted training may reduce capability gaps and support appropriate and sustained use of AI in public health practice.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fpubh.2026.1860473","type":"journal-article","created":{"date-parts":[[2026,8,10]],"date-time":"2026-08-10T05:30:43Z","timestamp":1786339843000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Training the public health workforce for generative AI: validation of the Italian Chatbot Usability Questionnaire"],"prefix":"10.3389","volume":"14","author":[{"given":"Francesco","family":"Baglivo","sequence":"first","affiliation":[{"name":"Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa","place":["Pisa, Italy"]},{"name":"Italian Society for Artificial Intelligence in Medicine (SIIAM - Societ\u00e0 Italiana Intelligenza Artificiale in Medicina)","place":["Rome, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aldo","family":"Gorga","sequence":"additional","affiliation":[{"name":"Department of Sciences of Public Health and Pediatrics, University of Turin","place":["Turin, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Giuseppe","family":"Vella","sequence":"additional","affiliation":[{"name":"Department of Health Promotion, Maternal and Infant Care, Internal Medicine and Medical Specialties (PROMISE) \u201cG. D'Alessandro\u201d, University of Palermo","place":["Palermo, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chiara","family":"Barbati","sequence":"additional","affiliation":[{"name":"Department of Public Health, Experimental and Forensic Medicine, University of Pavia","place":["Pavia, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antonella Lucia","family":"D'Atri","sequence":"additional","affiliation":[{"name":"Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa","place":["Pisa, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matilde","family":"Pecchioli","sequence":"additional","affiliation":[{"name":"Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa","place":["Pisa, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luigi","family":"De Angelis","sequence":"additional","affiliation":[{"name":"Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa","place":["Pisa, Italy"]},{"name":"Italian Society for Artificial Intelligence in Medicine (SIIAM - Societ\u00e0 Italiana Intelligenza Artificiale in Medicina)","place":["Rome, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roberta","family":"Siliquini","sequence":"additional","affiliation":[{"name":"Department of Sciences of Public Health and Pediatrics, University of Turin","place":["Turin, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Walter","family":"Mazzucco","sequence":"additional","affiliation":[{"name":"Department of Health Promotion, Maternal and Infant Care, Internal Medicine and Medical Specialties (PROMISE) \u201cG. D'Alessandro\u201d, University of Palermo","place":["Palermo, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna","family":"Odone","sequence":"additional","affiliation":[{"name":"Department of Public Health, Experimental and Forensic Medicine, University of Pavia","place":["Pavia, Italy"]},{"name":"Medical Direction, Fondazione IRCCS Policlinico San Matteo","place":["Pavia, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Caterina","family":"Rizzo","sequence":"additional","affiliation":[{"name":"Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa","place":["Pisa, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,8,10]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"e428","DOI":"10.1016\/S2468-2667(25)00036-2","article-title":"Artificial intelligence in public health: promises, challenges, and an agenda for policy makers and public health institutions","volume":"10","author":"Panteli","year":"2025","journal-title":"Lancet Public Health"},{"key":"B2","doi-asserted-by":"publisher","first-page":"2146","DOI":"10.1186\/s12889-022-14422-z","article-title":"Priorities for successful use of artificial intelligence by public health organizations: a literature review","volume":"22","author":"Fisher","year":"2022","journal-title":"BMC Public Health."},{"key":"B3","doi-asserted-by":"publisher","first-page":"1524616","DOI":"10.3389\/fpubh.2025.1524616","article-title":"Integrating health equity in artificial intelligence for public health in Canada: a rapid narrative review","volume":"13","author":"Ghanem","year":"2025"},{"key":"B4","unstructured":"Artificial Intelligence for Health\n          \n          2024"},{"key":"B5","doi-asserted-by":"crossref","DOI":"10.1787\/9a31d8af-en","volume-title":"Artificial Intelligence and the Health Workforce: Perspectives from Medical Associations on AI in Health. OECD Artificial Intelligence Papers","author":"Almyranti","year":"2024"},{"key":"B6","doi-asserted-by":"publisher","first-page":"e43333","DOI":"10.2196\/43333","article-title":"Digital education for the deployment of artificial intelligence in health care","volume":"25","author":"Malerbi","year":"2023","journal-title":"J Med Internet Res."},{"key":"B7","doi-asserted-by":"publisher","first-page":"105945","DOI":"10.1016\/j.ijmedinf.2025.105945","article-title":"Knowledge, attitude, and practice of primary care physicians toward clinical AI-assisted digital health technologies: Systematic review and meta-analysis","volume":"201","author":"Abdulazeem","year":"2025","journal-title":"Int J Med Inform."},{"key":"B8","doi-asserted-by":"publisher","first-page":"PU24001","DOI":"10.1071\/PU24001","article-title":"Artificial intelligence and public health: prospects, hype and challenges","volume":"35","author":"Nutbeam","year":"2025","journal-title":"Public Health Res Pract."},{"key":"B9","doi-asserted-by":"publisher","first-page":"e0300487","DOI":"10.1371\/journal.pone.0300487","article-title":"Protocol for human evaluation of generative artificial intelligence chatbots in clinical consultations","volume":"20","author":"Chiu","year":"2025","journal-title":"PLoS ONE."},{"key":"B10","doi-asserted-by":"publisher","first-page":"e2457879","DOI":"10.1001\/jamanetworkopen.2024.57879","article-title":"Large language models for Chatbot health advice studies: a systematic review","volume":"8","author":"Huo","year":"2025","journal-title":"JAMA Netw Open."},{"key":"B11","doi-asserted-by":"publisher","first-page":"126559","DOI":"10.1016\/j.vaccine.2024.126559","article-title":"Exploring chatbot contributions to enhancing vaccine literacy and uptake: a scoping review of the literature","volume":"44","author":"Cosma","year":"2025","journal-title":"Vaccine."},{"key":"B12","doi-asserted-by":"publisher","first-page":"1855","DOI":"10.1038\/s41591-025-03618-6","article-title":"A vaccine chatbot intervention for parents to improve HPV vaccination uptake among middle school girls: a cluster randomized trial","volume":"31","author":"Hou","year":"2025","journal-title":"Nat Med."},{"key":"B13","doi-asserted-by":"publisher","first-page":"e69006","DOI":"10.2196\/69006","article-title":"Standardizing and scaffolding health care AI-chatbot evaluation: systematic review","volume":"4","author":"Hua","year":"2025","journal-title":"JMIR AI."},{"key":"B14","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1007\/978-3-031-35708-4_24","article-title":"editors","author":"Holmes","year":"2023","journal-title":"Toward Validating a Chatbot Usability Scale: HCI International 2023. Design, User Experience, and Usability-"},{"key":"B15","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1055\/s-0039-3400270","article-title":"Artificial intelligence in radiology residency training","volume":"24","author":"Forney","year":"2020","journal-title":"Semin Musculoskelet Radiol."},{"key":"B16","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1145\/3335082.3335094","article-title":"Usability testing of a healthcare chatbot: Can we use conventional methods to assess conversational user interfaces?","author":"Holmes","year":"2019","journal-title":"Proceedings of the 31st European conference on cognitive ergonomics (ECCE'19)"},{"key":"B17","doi-asserted-by":"publisher","first-page":"2701","DOI":"10.2147\/JMDH.S419714","article-title":"Silva M, et al. Translation, cross-cultural adaptation, and validation of measurement instruments: a practical guideline for novice researchers","volume":"17","author":"Cruchinho","year":"2024","journal-title":"J Multidiscip Healthc"},{"key":"B18","unstructured":"Piano Nazionale Prevenzione Vaccinale PNPV 2023\u20132025\n          \n          2023"},{"key":"B19","unstructured":"Vaccines & Immunizations. Contraindications and Precautions.\n          \n          2024"},{"key":"B20","doi-asserted-by":"publisher","first-page":"e54769","DOI":"10.2196\/54769","article-title":"COVID-19 vaccine hesitancy: umbrella review of systematic reviews and meta-analysis","volume":"10","author":"Rahbeni","year":"2024","journal-title":"JMIR Public Health Surveill."},{"key":"B21","doi-asserted-by":"publisher","first-page":"1689","DOI":"10.1038\/s41562-024-01940-6","article-title":"A systematic review and meta-analysis of strategies to promote vaccination uptake","volume":"8","author":"Liu","year":"2024","journal-title":"Nat Hum Behav."},{"key":"B22","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1093\/eurpub\/ckz161","article-title":"Public health digitalization in Europe","volume":"29","author":"Odone","year":"2019","journal-title":"Eur J Public Health"},{"key":"B23","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1186\/s12909-021-02870-x","article-title":"The impact of artificial intelligence on clinical education: perceptions of postgraduate trainee doctors in London (UK) and recommendations for trainers","volume":"21","author":"Banerjee","year":"2021","journal-title":"BMC Med Educ."},{"key":"B24","doi-asserted-by":"publisher","first-page":"1640","DOI":"10.1007\/s00330-018-5601-1","article-title":"Medical students' attitude toward artificial intelligence: a multicentre survey","volume":"29","author":"Pinto dos Santos","year":"2019","journal-title":"Eur Radiol."},{"key":"B25","doi-asserted-by":"publisher","first-page":"1394","DOI":"10.3390\/healthcare13121394","article-title":"Gender differences in the use of ChatGPT as generative artificial intelligence for clinical research and decision-making in occupational medicine","volume":"13","author":"Mashburn","year":"2025","journal-title":"Healthcare."},{"key":"B26","doi-asserted-by":"publisher","first-page":"e51086","DOI":"10.2196\/51086","article-title":"AI hesitancy and acceptability-perceptions of AI chatbots for chronic health management and long COVID support: survey study","volume":"11","author":"Wu","year":"2024","journal-title":"JMIR Hum Factors."},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1093\/eurpub\/ckae144.684","article-title":"The assessment of society's acceptance of artificial intelligence use in healthcare","author":"Smola","year":"2024","journal-title":"Eur J Public Health"},{"key":"B28","doi-asserted-by":"publisher","first-page":"1342","DOI":"10.3233\/SHTI251057","article-title":"Factors shaping healthcare professionals' perceptions of AI in Saudi Arabia: a cross-sectional study","volume":"329","author":"Almalki","year":"2025","journal-title":"Stud Health Technol Inform."},{"key":"B29","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1186\/s12909-024-05400-7","article-title":"Medical students' AI literacy and attitudes toward AI: a cross-sectional two-center study using pre-validated assessment instruments","volume":"24","author":"Laupichler","year":"2024","journal-title":"BMC Med Educ."},{"key":"B30","doi-asserted-by":"publisher","first-page":"024","DOI":"10.58459\/rptel.2025.20024","article-title":"Developing and validating an artificial intelligent empowerment instrument: evaluating the impact of an artificial intelligent literacy programme for secondary school and university students","volume":"20","author":"Kong","year":"2025","journal-title":"Res Pract Technol Enhanc Learn."},{"key":"B31","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1038\/s41746-023-00979-5","article-title":"Systematic review and meta-analysis of AI-based conversational agents for promoting mental health and well-being","volume":"6","author":"Li","year":"2023","journal-title":"NPJ Digit Med."},{"key":"B32","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1038\/s43856-024-00717-2","article-title":"Current applications and challenges in large language models for patient care: a systematic review","volume":"5","author":"Busch","year":"2025","journal-title":"Commun Med."},{"key":"B33","doi-asserted-by":"publisher","first-page":"ooaf005","DOI":"10.1093\/jamiaopen\/ooaf005","article-title":"VaxBot-HPV: a GPT-based chatbot for answering HPV vaccine-related questions","volume":"8","author":"Li","year":"2025","journal-title":"JAMIA Open"},{"key":"B34","doi-asserted-by":"publisher","first-page":"taae026","DOI":"10.1093\/jtm\/taae026","article-title":"A decalogue for personalized travel health assistance with AI-driven chatbots","volume":"31","author":"Baglivo","year":"2024","journal-title":"J Travel Med"},{"key":"B35","doi-asserted-by":"publisher","first-page":"2567","DOI":"10.1111\/aphw.12564","article-title":"Effectiveness of chatbots in increasing uptake, intention, and attitudes related to any type of vaccination: a systematic review and meta-analysis","volume":"16","author":"Chan","year":"2024","journal-title":"Appl Psychol Health Well Being."},{"key":"B36","doi-asserted-by":"publisher","first-page":"e50638","DOI":"10.2196\/50638","article-title":"Prompt engineering as an important emerging skill for medical professionals: tutorial","volume":"25","author":"Mesk\u00f3","year":"2023","journal-title":"J Med Internet Res."},{"key":"B37","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1186\/s12909-025-08319-9","article-title":"Medical students' perception of AI's role in radiology before and after an AI-focused educational panel: a paired pre-post design","volume":"25","author":"Sirajudeen","year":"2025","journal-title":"BMC Med Educ."},{"key":"B38","doi-asserted-by":"publisher","first-page":"e76507","DOI":"10.2196\/76507","article-title":"Incorporating generative AI into a health informatics curriculum to build 21st century competencies: multisite pre-post study","volume":"13","author":"Seba","year":"2025","journal-title":"JMIR Med Inform."},{"key":"B39","unstructured":"Skills assessments in education: AI and the Future of Skills, Volume 1\n          \n          2021"}],"container-title":["Frontiers in Public Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1860473\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,10]],"date-time":"2026-08-10T05:30:45Z","timestamp":1786339845000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1860473\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,10]]},"references-count":39,"alternative-id":["10.3389\/fpubh.2026.1860473"],"URL":"https:\/\/doi.org\/10.3389\/fpubh.2026.1860473","relation":{},"ISSN":["2296-2565"],"issn-type":[{"value":"2296-2565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,10]]},"article-number":"1860473"}}