{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:48:30Z","timestamp":1782841710578,"version":"3.54.5"},"reference-count":34,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Infodemiology"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec sec-type=\"background\">\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Human papillomavirus (HPV) vaccine hesitancy remains a significant public health challenge in Japan, where proactive vaccination recommendations were suspended between 2013 and 2021. The resulting information gap between medical institutions and vaccine-hesitant populations is exacerbated by misinformation on social media platforms. Traditional public health communication strategies cannot address individual queries while simultaneously monitoring population-level discourse.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"objective\">\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study aimed to develop and conduct a feasibility evaluation of a dual-purpose artificial intelligence agent system that delivers verified HPV vaccine information to the public through a conversational interface while generating infoveillance reports for medical institutions based on user interactions and social media discourse.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"methods\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We implemented a system with 3 components: a vector database integrating 139,803 documents, including academic papers, Japanese government sources, news media, and social media posts; a retrieval-augmented generation chatbot using a ReAct agent architecture with iterative multitool orchestration across 5 specialized knowledge sources; and an automated report generation system with modules for news analysis, research synthesis, social media sentiment analysis, including stance classification and topic modeling, and user interaction pattern identification. System performance was assessed using both automated and manual evaluation protocols on a scale from 0 to 5.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"results\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The entire system functioned as expected. For single-turn evaluation, the chatbot achieved mean scores of 4.83 (SD 0.67; 95% CI 4.71-4.93) for relevance, 4.89 (SD 0.53; 95% CI 4.79-4.97) for routing, 4.50 (SD 1.29; 95% CI 4.27-4.70) for reference quality, 4.90 (SD 0.62; 95% CI 4.78-4.99) for correctness, and 4.88 (SD 0.54; 95% CI 4.78-4.96) for professional identity, with an overall mean of 4.80. Multiturn evaluation yielded higher mean scores: 4.94 for context memory (SD 0.25; 95% CI 4.84-5.00) and an overall mean of 4.98, with topic centering and identity achieving 5.00. The report generation system achieved high scores across all sections: 4.83 for completeness (SD 0.37; 95% CI 4.73-4.94), 4.88 for correctness (SD 0.33; 95% CI 4.77-4.96), and 4.12 for helpfulness (SD 0.48; 95% CI 3.98-4.27). Reference validity achieved perfect scores (5.00) across all periods, with citation correctness averaging 4.21 (SD 0.58; 95% CI 3.96-4.46).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"conclusions\">\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>This feasibility study demonstrated that an integrated artificial intelligence agent system can support both public HPV vaccine communication and social media infoveillance in a Japanese-language context. Prospective deployment with real users is needed to assess actual public health impact.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/90295","type":"journal-article","created":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T21:24:30Z","timestamp":1779398670000},"page":"e90295-e90295","source":"Crossref","is-referenced-by-count":0,"title":["Japanese-Language AI Agent System for Human Papillomavirus Vaccine Infoveillance and Public Communication: Development and Feasibility Evaluation"],"prefix":"10.2196","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6232-4199","authenticated-orcid":false,"given":"Junyu","family":"Liu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5720-6490","authenticated-orcid":false,"given":"Siwen","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-8221-2639","authenticated-orcid":false,"given":"Dexiu","family":"Ma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7139-384X","authenticated-orcid":false,"given":"Qian","family":"Niu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5566-761X","authenticated-orcid":false,"given":"Zequn","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3972-8800","authenticated-orcid":false,"given":"Momoko","family":"Nagai-Tanima","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-5172-5477","authenticated-orcid":false,"given":"Tomoki","family":"Aoyama","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,5,21]]},"reference":[{"issue":"3","key":"R1","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1016\/j.jncc.2024.11.006","article-title":"Global burden of cervical cancer: current estimates, temporal trend and future projections based on the GLOBOCAN 2022","volume":"5","author":"Wu","journal-title":"J Natl Cancer Cent"},{"issue":"5","key":"R2","doi-asserted-by":"publisher","first-page":"565","DOI":"10.1016\/S1473-3099(14)71073-4","article-title":"Population-level impact and herd effects following human papillomavirus vaccination programmes: a systematic review and meta-analysis","volume":"15","author":"Drolet","journal-title":"Lancet Infect Dis"},{"issue":"34","key":"R3","doi-asserted-by":"publisher","first-page":"4161","DOI":"10.1016\/j.vaccine.2015.04.036","article-title":"Vaccine hesitancy: definition, scope and determinants","volume":"33","author":"MacDonald","journal-title":"Vaccine (Auckl)"},{"issue":"4","key":"R4","doi-asserted-by":"publisher","first-page":"e223","DOI":"10.1016\/S2468-2667(20)30010-4","article-title":"Impact of HPV vaccine hesitancy on cervical cancer in Japan: a modelling study","volume":"5","author":"Simms","journal-title":"Lancet Public Health"},{"issue":"7811","key":"R5","doi-asserted-by":"publisher","first-page":"230","DOI":"10.1038\/s41586-020-2281-1","article-title":"The online competition between pro- and anti-vaccination views","volume":"582","author":"Johnson","journal-title":"Nature"},{"issue":"S3","key":"R6","doi-asserted-by":"publisher","first-page":"S273","DOI":"10.2105\/AJPH.2020.305905","article-title":"Where we go from here: health misinformation on social media","volume":"110","author":"Sylvia Chou","journal-title":"Am J Public Health"},{"key":"R7","unstructured":"Lewis P Perez E Piktus A Petroni F Karpukhin V Goyal N . Retrieval-augmented generation for knowledge-intensive NLP tasks. In: Advances in Neural Information Processing Systems. Curran Associates; 2020:9459-9474."},{"issue":"8","key":"R8","doi-asserted-by":"publisher","first-page":"1930","DOI":"10.1038\/s41591-023-02448-8","article-title":"Large language models in medicine","volume":"29","author":"Thirunavukarasu","journal-title":"Nat Med"},{"key":"R9","unstructured":"Kudo T Yamamoto K Matsumoto Y . Applying conditional random fields to Japanese morphological analysis. Presented at: Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing. 206-213."},{"issue":"2","key":"R10","doi-asserted-by":"publisher","DOI":"10.2196\/19273","article-title":"Tracking social media discourse about the COVID-19 pandemic: development of a public coronavirus Twitter data set","volume":"6","author":"Chen","journal-title":"JMIR Public Health Surveill"},{"issue":"9","key":"R11","doi-asserted-by":"publisher","first-page":"1248","DOI":"10.1093\/jamia\/ocy072","article-title":"Conversational agents in healthcare: a systematic review","volume":"25","author":"Laranjo","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"R12","doi-asserted-by":"publisher","DOI":"10.1080\/21645515.2022.2090777","article-title":"Resumption of active recommendation of the human papillomavirus vaccine in Japan and future challenges for the National Immunization Program","volume":"18","author":"Ujiie","journal-title":"Hum Vaccin Immunother"},{"key":"R13","unstructured":"Yao S Zhao J Yu D et al. React: synergizing reasoning and acting in language models. Presented at: 11th International Conference on Learning Representations, ICLR 2023; May 1-5, 2023; Kigali, Rwanda. URL: https:\/\/collaborate.princeton.edu\/en\/publications\/react-synergizing-reasoning-and-acting-in-language-models\/ [Accessed 03-05-2026]"},{"key":"R14","unstructured":"Qdrant. URL: https:\/\/qdrant.tech\/ [Accessed 29-11-2025]"},{"key":"R15","unstructured":"PLaMo-embedding-1B. Hugging Face. URL: https:\/\/huggingface.co\/pfnet\/plamo-embedding-1b [Accessed 29-11-2025]"},{"key":"R16","doi-asserted-by":"crossref","unstructured":"Reimers N Gurevych I . Sentence-BERT: sentence embeddings using Siamese BERT-networks. Presented at: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP); Nov 3-7, 2019; Hong Kong, China. [doi: 10.18653\/v1\/D19-1410]","DOI":"10.18653\/v1\/D19-1410"},{"issue":"3","key":"R17","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1109\/TBDATA.2019.2921572","article-title":"Billion-scale similarity search with GPUs","volume":"7","author":"Johnson","journal-title":"IEEE Trans Big Data"},{"key":"R18","unstructured":"PubMed. URL: https:\/\/pubmed.ncbi.nlm.nih.gov\/ [Accessed 29-11-2025]"},{"key":"R19","unstructured":"World Health Organization. URL: https:\/\/www.who.int\/ [Accessed 29-11-2025]"},{"key":"R20","unstructured":"Ministry of Health, Labour and Welfare, Japan. URL: https:\/\/www.mhlw.go.jp\/ [Accessed 29-11-2025]"},{"key":"R21","unstructured":"Tweepy. URL: https:\/\/www.tweepy.org\/ [Accessed 29-11-2025]"},{"key":"R22","unstructured":"LlamaIndex. URL: https:\/\/www.llamaindex.ai\/ [Accessed 18-10-2024]"},{"key":"R23","unstructured":"Streamlit. URL: https:\/\/streamlit.io\/ [Accessed 29-11-2025]"},{"issue":"4","key":"R24","doi-asserted-by":"publisher","DOI":"10.2196\/21660","article-title":"Social media as a research tool (SMaaRT) for risky behavior analytics: methodological review","volume":"6","author":"Singh","journal-title":"JMIR Public Health Surveill"},{"issue":"10","key":"R25","doi-asserted-by":"publisher","first-page":"1378","DOI":"10.2105\/AJPH.2018.304567","article-title":"Weaponized health communication: Twitter bots and Russian trolls amplify the vaccine debate","volume":"108","author":"Broniatowski","journal-title":"Am J Public Health"},{"key":"R26","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944937","article-title":"Latent Dirichlet allocation","volume":"3","author":"Blei","journal-title":"J Mach Learn Res"},{"key":"R27","unstructured":"Kudo T Yamamoto K Matsumoto Y . Applying conditional random fields to Japanese morphological analysis. In: Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics; 2004:230-237."},{"issue":"5","key":"R28","doi-asserted-by":"publisher","first-page":"513","DOI":"10.1016\/0306-4573(88)90021-0","article-title":"Term-weighting approaches in automatic text retrieval","volume":"24","author":"Salton","journal-title":"Inf Process Manag"},{"key":"R29","unstructured":"\u0158eh\u016f\u0159ek R Sojka P . Software framework for topic modelling with large corpora. Presented at: Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks; May 22, 2010; Valletta, Malta. [doi: 10.13140\/2.1.2393.1847]"},{"key":"R30","unstructured":"Ethical guidelines for medical and biological research involving human subjects. Ministry of Education, Culture, Sports, Science and Technology, Ministry of Health, Labour and Welfare, Ministry of Economy, Trade and Industry, Japan. 2021. URL: https:\/\/www.mext.go.jp\/content\/20250325-mxt_life-000035486-01.pdf [Accessed 03-05-2026]"},{"key":"R31","doi-asserted-by":"crossref","unstructured":"Es S James J Espinosa-Anke L Schockaert S . Ragas: automated evaluation of retrieval augmented generation. arXiv. Preprint posted online on Sep 26, 2023. [doi: 10.48550\/arXiv.2309.15217]","DOI":"10.18653\/v1\/2024.eacl-demo.16"},{"key":"R32","doi-asserted-by":"crossref","unstructured":"Yu H Gan A Zhang K Tong S Liu Q Liu Z . Evaluation of retrieval-augmented generation: a survey. arXiv. Preprint posted online on May 13, 2024. [doi: 10.48550\/arXiv.2405.07437]","DOI":"10.1007\/978-981-96-1024-2_8"},{"key":"R33","unstructured":"Claude. URL: https:\/\/www.anthropic.com\/claude [Accessed 18-10-2024]"},{"key":"R34","unstructured":"Humanalysis-square\/HPV_agent_data. Hugging Face. URL: https:\/\/huggingface.co\/datasets\/humanalysis-square\/HPV_agent_data [Accessed 25-12-2025]"}],"container-title":["JMIR Infodemiology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/infodemiology.jmir.org\/2026\/1\/e90295","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:15:35Z","timestamp":1782839735000},"score":1,"resource":{"primary":{"URL":"https:\/\/infodemiology.jmir.org\/2026\/1\/e90295"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,21]]},"references-count":34,"URL":"https:\/\/doi.org\/10.2196\/90295","relation":{},"ISSN":["2564-1891"],"issn-type":[{"value":"2564-1891","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,21]]},"article-number":"v6i3e90295"}}