{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T05:51:34Z","timestamp":1772862694866,"version":"3.50.1"},"reference-count":25,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2023,2,23]],"date-time":"2023-02-23T00:00:00Z","timestamp":1677110400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100000065","name":"National Institute of Neurological Disorders and Stroke","doi-asserted-by":"publisher","award":["R01NS110779"],"award-info":[{"award-number":["R01NS110779"]}],"id":[{"id":"10.13039\/100000065","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000065","name":"National Institute of Neurological Disorders and Stroke","doi-asserted-by":"publisher","award":["U01NS110772"],"award-info":[{"award-number":["U01NS110772"]}],"id":[{"id":"10.13039\/100000065","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","award":["R01LM013337"],"award-info":[{"award-number":["R01LM013337"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006108","name":"National Center for Advancing Translational Science","doi-asserted-by":"crossref","award":["UL1TR001422"],"award-info":[{"award-number":["UL1TR001422"]}],"id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Natinoal Institute of Allergy and Infectious Diseses"},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["NIAID-K23 AI139337"],"award-info":[{"award-number":["NIAID-K23 AI139337"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,4,19]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objectives<\/jats:title>\n                  <jats:p>Vaccines are crucial components of pandemic responses. Over 12 billion coronavirus disease 2019 (COVID-19) vaccines were administered at the time of writing. However, public perceptions of vaccines have been complex. We integrated social media and surveillance data to unravel the evolving perceptions of COVID-19 vaccines.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>Applying human-in-the-loop deep learning models, we analyzed sentiments towards COVID-19 vaccines in 11\u00a0211\u00a0672 tweets of 2\u00a0203\u00a0681 users from 2020 to 2022. The diverse sentiment patterns were juxtaposed against user demographics, public health surveillance data of over 180 countries, and worldwide event timelines. A subanalysis was performed targeting the subpopulation of pregnant people. Additional feature analyses based on user-generated content suggested possible sources of vaccine hesitancy.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Our trained deep learning model demonstrated performances comparable to educated humans, yielding an accuracy of 0.92 in sentiment analysis against our manually curated dataset. Albeit fluctuations, sentiments were found more positive over time, followed by a subsequence upswing in population-level vaccine uptake. Distinguishable patterns were revealed among subgroups stratified by demographic variables. Encouraging news or events were detected surrounding positive sentiments crests. Sentiments in pregnancy-related tweets demonstrated a lagged pattern compared with the general population, with delayed vaccine uptake trends. Feature analysis detected hesitancies stemmed from clinical trial logics, risks and complications, and urgency of scientific evidence.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>Integrating social media and public health surveillance data, we associated the sentiments at individual level with observed populational-level vaccination patterns. By unraveling the distinctive patterns across subpopulations, the findings provided evidence-based strategies for improving vaccine promotion during pandemics.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocad029","type":"journal-article","created":{"date-parts":[[2023,2,23]],"date-time":"2023-02-23T17:26:42Z","timestamp":1677173202000},"page":"923-931","source":"Crossref","is-referenced-by-count":9,"title":["Patterns of diverse and changing sentiments towards COVID-19 vaccines: a sentiment analysis study integrating 11 million tweets and surveillance data across over 180 countries"],"prefix":"10.1093","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9884-9683","authenticated-orcid":false,"given":"Hanyin","family":"Wang","sequence":"first","affiliation":[{"name":"Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University , Chicago, Illinois, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7546-9979","authenticated-orcid":false,"given":"Yikuan","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University , Chicago, Illinois, USA"}]},{"given":"Meghan R","family":"Hutch","sequence":"additional","affiliation":[{"name":"Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University , Chicago, Illinois, USA"}]},{"given":"Adrienne S","family":"Kline","sequence":"additional","affiliation":[{"name":"Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University , Chicago, Illinois, USA"}]},{"given":"Sebastian","family":"Otero","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Feinberg School of Medicine, Ann & Robert H. Lurie Children's Hospital of Chicago, Northwestern University , Chicago, Illinois, USA"}]},{"given":"Leena B","family":"Mithal","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Feinberg School of Medicine, Ann & Robert H. Lurie Children's Hospital of Chicago, Northwestern University , Chicago, Illinois, USA"}]},{"given":"Emily S","family":"Miller","sequence":"additional","affiliation":[{"name":"Department of Obstetrics & Gynecology, Northwestern Medicine , Chicago, Illinois, USA"}]},{"given":"Andrew","family":"Naidech","sequence":"additional","affiliation":[{"name":"Department of Neurology, Northwestern Medicine , Chicago, Illinois, USA"}]},{"given":"Yuan","family":"Luo","sequence":"additional","affiliation":[{"name":"Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University , Chicago, Illinois, USA"}]}],"member":"286","published-online":{"date-parts":[[2023,2,23]]},"reference":[{"issue":"5","key":"2023041909000266700_ocad029-B1","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1038\/d41573-020-00073-5","article-title":"The COVID-19 vaccine development landscape","volume":"19","author":"Andreadakis","year":"2020","journal-title":"Nat Rev Drug Discov"},{"issue":"6","key":"2023041909000266700_ocad029-B2","doi-asserted-by":"crossref","first-page":"e24435","DOI":"10.2196\/24435","article-title":"COVID-19 vaccine-related discussion on twitter: topic modeling and sentiment analysis","volume":"23","author":"Lyu","year":"2021","journal-title":"J Med Internet Res"},{"issue":"1","key":"2023041909000266700_ocad029-B3","doi-asserted-by":"crossref","first-page":"e26089","DOI":"10.2196\/26089","article-title":"Unfolding the determinants of COVID-19 vaccine acceptance in China","volume":"23","author":"Yin","year":"2021","journal-title":"J Med Internet Res"},{"issue":"11","key":"2023041909000266700_ocad029-B4","doi-asserted-by":"crossref","first-page":"2586","DOI":"10.1080\/21645515.2020.1780846","article-title":"Social media and vaccine hesitancy: new updates for the era of COVID-19 and globalized infectious diseases","volume":"16","author":"Puri","year":"2020","journal-title":"Hum Vaccin Immunother"},{"issue":"6","key":"2023041909000266700_ocad029-B5","doi-asserted-by":"publisher","DOI":"10.1056\/CAT.20.0676","article-title":"Health care workers\u2019 reluctance to take the Covid-19 vaccine: a consumer-marketing approach to identifying and overcoming hesitancy","volume":"1","author":"Roy","year":"2020","journal-title":"NEJM Catalyst Innov Care Deliv"},{"issue":"1","key":"2023041909000266700_ocad029-B6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12889-021-10862-1","article-title":"Individual and social determinants of COVID-19 vaccine uptake","volume":"21","author":"Viswanath","year":"2021","journal-title":"BMC Public Health"},{"issue":"12","key":"2023041909000266700_ocad029-B7","doi-asserted-by":"crossref","first-page":"e2033324","DOI":"10.1001\/jamanetworkopen.2020.33324","article-title":"US public attitudes toward COVID-19 vaccine mandates","volume":"3","author":"Largent","year":"2020","journal-title":"JAMA Netw Open"},{"key":"2023041909000266700_ocad029-B8","doi-asserted-by":"crossref","first-page":"113414","DOI":"10.1016\/j.socscimed.2020.113414","article-title":"The French public's attitudes to a future COVID-19 vaccine: the politicization of a public health issue","volume":"265","author":"Ward","year":"2020","journal-title":"Soc Sci Med"},{"issue":"14","key":"2023041909000266700_ocad029-B9","doi-asserted-by":"crossref","first-page":"3127","DOI":"10.1017\/S0033291720005188","article-title":"COVID-19 vaccine hesitancy in the UK: the Oxford coronavirus explanations, attitudes, and narratives survey (Oceans) II","volume":"52","author":"Freeman","year":"2022","journal-title":"Psychol Med"},{"issue":"10","key":"2023041909000266700_ocad029-B10","doi-asserted-by":"crossref","first-page":"e004206","DOI":"10.1136\/bmjgh-2020-004206","article-title":"Social media and vaccine hesitancy","volume":"5","author":"Wilson","year":"2020","journal-title":"BMJ Glob Health"},{"issue":"4","key":"2023041909000266700_ocad029-B11","doi-asserted-by":"crossref","first-page":"315","DOI":"10.3390\/vaccines9040315","article-title":"Reasons for taking the COVID-19 vaccine by US social media users","volume":"9","author":"Benis","year":"2021","journal-title":"Vaccines"},{"issue":"3","key":"2023041909000266700_ocad029-B12","doi-asserted-by":"crossref","first-page":"315","DOI":"10.3390\/epidemiologia2030024","article-title":"A large-scale COVID-19 Twitter chatter dataset for open scientific research\u2014an international collaboration","volume":"2","author":"Banda","year":"2021","journal-title":"Epidemiologia (Basel)"},{"key":"2023041909000266700_ocad029-B13","first-page":"1","article-title":"A global database of COVID-19 vaccinations","author":"Mathieu","year":"2021","journal-title":"Nat Hum Behav"},{"issue":"2","key":"2023041909000266700_ocad029-B14","doi-asserted-by":"crossref","DOI":"10.2196\/26302","article-title":"Using tweets to understand how COVID-19\u2013related health beliefs are affected in the age of social media: twitter data analysis study","volume":"23","author":"Wang","year":"2021","journal-title":"J Med Internet Res"},{"key":"2023041909000266700_ocad029-B15","article-title":"Xlnet: Generalized autoregressive pretraining for language understanding","volume":"32","author":"Yang","year":"2019","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2023041909000266700_ocad029-B16","year":"2017"},{"key":"2023041909000266700_ocad029-B17","doi-asserted-by":"publisher","first-page":"37","DOI":"10.18653\/v1\/P19-3007","author":"Vig","year":"2019"},{"key":"2023041909000266700_ocad029-B18","year":"2021"},{"issue":"9","key":"2023041909000266700_ocad029-B19","doi-asserted-by":"crossref","first-page":"91","DOI":"10.21105\/joss.00091","article-title":"Mordecai: full text geoparsing and event geocoding","volume":"2","author":"Halterman","year":"2017","journal-title":"J Open Source Softw"},{"issue":"5","key":"2023041909000266700_ocad029-B20","doi-asserted-by":"crossref","first-page":"894","DOI":"10.1097\/AOG.0000000000004367","article-title":"Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) antibodies in neonatal cord blood after vaccination in pregnancy","volume":"137","author":"Gill","year":"2021","journal-title":"Obstet Gynecol"},{"issue":"1","key":"2023041909000266700_ocad029-B21","first-page":"1","article-title":"Self-reported COVID-19 vaccine hesitancy and uptake among participants from different racial and ethnic groups in the United States and United Kingdom","volume":"13","author":"Nguyen","year":"2022","journal-title":"Nat Commun"},{"key":"2023041909000266700_ocad029-B22","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1016\/j.ijid.2021.08.013","article-title":"Side effects and perceptions following Sinopharm COVID-19 vaccination","volume":"111","author":"Saeed","year":"2021","journal-title":"Int J Infect Dis"},{"issue":"6","key":"2023041909000266700_ocad029-B23","doi-asserted-by":"crossref","first-page":"577","DOI":"10.3390\/vaccines9060577","article-title":"Side effects reported by Jordanian healthcare workers who received COVID-19 vaccines","volume":"9","author":"Abu-Hammad","year":"2021","journal-title":"Vaccines"},{"issue":"1","key":"2023041909000266700_ocad029-B24","doi-asserted-by":"crossref","first-page":"e14","DOI":"10.1016\/S2214-109X(20)30464-2","article-title":"Sex differences in COVID-19 case fatality: do we know enough?","volume":"9","author":"Dehingia","year":"2021","journal-title":"Lancet Glob Health"},{"issue":"1","key":"2023041909000266700_ocad029-B25","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1152\/physrev.00024.2020","article-title":"Pregnancy and COVID-19","volume":"101","author":"Wastnedge","year":"2021","journal-title":"Physiol Rev"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/advance-article-pdf\/doi\/10.1093\/jamia\/ocad029\/49445828\/ocad029.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/5\/923\/49872962\/ocad029.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/5\/923\/49872962\/ocad029.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,19]],"date-time":"2023-04-19T09:17:14Z","timestamp":1681895834000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/30\/5\/923\/7055300"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,23]]},"references-count":25,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,2,23]]},"published-print":{"date-parts":[[2023,4,19]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad029","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,5,1]]},"published":{"date-parts":[[2023,2,23]]}}}