{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T17:10:26Z","timestamp":1792689026412,"version":"4.5.0"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,2,19]],"date-time":"2020-02-19T00:00:00Z","timestamp":1582070400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2020,2,19]],"date-time":"2020-02-19T00:00:00Z","timestamp":1582070400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Public Health"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Recently, social networks have become a popular source of information on health topics. Particularly, in Italy, there is a lively discussion on the web regarding vaccines also because there is low vaccination coverage, vaccines hesitancy, and anti-vaccine movements. For these reasons, in 2017, Institutions have introduced a law to force children to make ten compulsory vaccines for school attendance and proposed a vaccination campaign. On social networks, this law has fostered a fierce discussion between pro-vaccinations and anti-vaccinations people. This paper aims to understand if and how the population\u2019s opinion has changed before the law and after the vaccination campaign using the titles of the videos uploaded on Youtube in these periods.<\/jats:p><\/jats:sec><jats:sec><jats:title>Method<\/jats:title><jats:p>Using co-occurrence network (CON) and sentiment analysis, we analysed the topics of YouTube Italian videos on vaccines in 2017 and 2018.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The CON confirms that vaccinations were very disapproved before the law. Instead, after the communication campaign, people start to be less critical. The sentiment analysis shows that the intense vaccination campaign also promoted by medical doctors pushed the sentiment to change polarity from a prevailing negative opinion in 2017 (52% negative) to a positive one in 2018 (54% positive).<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>At the population level, the potential misinformation of social networks could be significant and is a real risk for health. Our study highlights that vaccination campaigns on social networks could be an essential instrument of health policies and a sharp weapon to fight ignorance and misrepresentations of non-qualified people influencing individuals\u2019 decision-making.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12889-020-8342-4","type":"journal-article","created":{"date-parts":[[2020,2,19]],"date-time":"2020-02-19T17:35:18Z","timestamp":1582133718000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":49,"title":["Using text mining and sentiment analysis to analyse YouTube Italian videos concerning vaccination"],"prefix":"10.1186","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3278-1561","authenticated-orcid":false,"given":"Annamaria","family":"Porreca","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Francesca","family":"Scozzari","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marta","family":"Di Nicola","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,2,19]]},"reference":[{"issue":"2","key":"8342_CR1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.8.2.e9","volume":"8","author":"CD Norman","year":"2006","unstructured":"Norman CD, Skinner HA. eHealth literacy: essential skills for consumer health in a networked world. J Med Internet Res. 2006;8(2):e9.","journal-title":"J Med Internet Res"},{"issue":"1","key":"8342_CR2","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1186\/1471-2458-7-53","volume":"7","author":"HK Andreassen","year":"2007","unstructured":"Andreassen HK, Bujnowska-Fedak MM, Chronaki CE, Dumitru RC, Pudule I, Santana S, et al. European citizens' use of E-health services: a study of seven countries. BMC Public Health. 2007;7(1):53.","journal-title":"BMC Public Health"},{"issue":"3","key":"8342_CR3","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1046\/j.1525-1497.2002.10603.x","volume":"17","author":"JA Diaz","year":"2002","unstructured":"Diaz JA, Griffith RA, Ng JJ, Reinert SE, Friedmann PD, Moulton AW. Patients' use of the internet for medical information. J Gen Intern Med. 2002;17(3):180\u20135.","journal-title":"J Gen Intern Med"},{"issue":"4","key":"8342_CR4","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1111\/j.1471-6712.2008.00662.x","volume":"23","author":"S Wangberg","year":"2009","unstructured":"Wangberg S, Andreassen H, Kummervold P, Wynn R, S\u00f8rensen T. Use of the internet for health purposes: trends in Norway 2000\u20132010. Scand J Caring Sci. 2009;23(4):691\u20136.","journal-title":"Scand J Caring Sci"},{"key":"8342_CR5","unstructured":"WHO (World Health Organization). (2014). https:\/\/www.who.int\/immunization\/newsroom\/press\/immunization_coverage_july2014\/en\/. Accessed 22 July 2019."},{"key":"8342_CR6","volume-title":"SAGE issues its 2018 assessment report of the Global Vaccine Action Plan","author":"WHO (World Health Organization)","year":"2018","unstructured":"WHO (World Health Organization). (2018). SAGE issues its 2018 assessment report of the Global Vaccine Action Plan. http:\/\/www.who.int\/immunization\/sage\/sagewgvaccinehesitancyapr12\/en. Accessed 22 July 2019."},{"key":"8342_CR7","unstructured":"Ministero della Salute. (2017). http:\/\/www.salute.gov.it\/portale\/news\/p3_2_1_1_1.jsp?lingua=italiano&menu=notizie&p=dalministero&id=3633. Accessed 25 June 2018."},{"key":"8342_CR8","unstructured":"Decreto Lorenzin. (n.d.) Legge n.119\/17. Disposizioni urgenti in materia di prevenzione vaccinale http:\/\/www.gazzettaufficiale.it\/eli\/id\/2017\/08\/5\/17G00132\/sg. Accessed 22 July 2019."},{"key":"8342_CR9","doi-asserted-by":"publisher","DOI":"10.1007\/5584_2019_396","volume-title":"The internet as a source of health information and services","author":"MM Bujnowska-Fedak","year":"2019","unstructured":"Bujnowska-Fedak MM, Walig\u00f3ra J, Mastalerz-Migas A. The internet as a source of health information and services; 2019."},{"issue":"1","key":"8342_CR10","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1093\/her\/cyh043","volume":"21","author":"P Korp","year":"2005","unstructured":"Korp P. Health on the internet: implications for health promotion. Health Educ Res. 2005;21(1):78\u201386.","journal-title":"Health Educ Res"},{"issue":"4","key":"8342_CR11","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1093\/heapro\/dag409","volume":"18","author":"M Benigeri","year":"2003","unstructured":"Benigeri M, Pluye P. Shortcomings of health information on the internet. Health Promot Int. 2003;18(4):381\u20136.","journal-title":"Health Promot Int"},{"issue":"3p1","key":"8342_CR12","doi-asserted-by":"publisher","first-page":"819","DOI":"10.1111\/j.1475-6773.2006.00510.x","volume":"41","author":"MK Bundorf","year":"2006","unstructured":"Bundorf MK, Wagner TH, Singer SJ, Baker LC. Who searches the internet for health information? Health Serv Res. 2006;41(3p1):819\u201336.","journal-title":"Health Serv Res"},{"issue":"6","key":"8342_CR13","doi-asserted-by":"publisher","first-page":"671","DOI":"10.1093\/her\/16.6.671","volume":"16","author":"RJ Cline","year":"2001","unstructured":"Cline RJ, Haynes KM. Consumer health information seeking on the internet: the state of the art. Health Educ Res. 2001;16(6):671\u201392.","journal-title":"Health Educ Res"},{"issue":"6","key":"8342_CR14","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1007\/s00038-004-3149-0","volume":"49","author":"V H\u00fcfken","year":"2004","unstructured":"H\u00fcfken V, Deutschmann M, Baehring T, Scherbaum W. Use of the internet for health care information: results from a national telephone survey. Sozial-und Praventivmedizin. 2004;49(6):381\u201390.","journal-title":"Sozial-und Praventivmedizin"},{"issue":"1","key":"8342_CR15","doi-asserted-by":"publisher","first-page":"25","DOI":"10.3109\/17538150903358784","volume":"35","author":"E Renahy","year":"2010","unstructured":"Renahy E, Parizot I, Chauvin P. Determinants of the frequency of online health information seeking: results of a web-based survey conducted in France in 2007. Inform Health Soc Care. 2010;35(1):25\u201339.","journal-title":"Inform Health Soc Care"},{"issue":"6","key":"8342_CR16","doi-asserted-by":"publisher","first-page":"779","DOI":"10.1016\/j.vaccine.2017.12.074","volume":"36","author":"C Giambi","year":"2018","unstructured":"Giambi C, Fabiani M, D\u2019 Ancona F, et al. Parental vaccine hesitancy in Italy \u2013 results from a national survey. Vaccine. 2018;36(6):779\u201387.","journal-title":"Vaccine"},{"key":"8342_CR17","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1016\/j.ebiom.2016.08.042","volume":"12","author":"HJ Larson","year":"2016","unstructured":"Larson HJ, de Figueiredo A, Xiahong Z, et al. The state of vaccine confidence 2016: global insights through a 67-country survey. eBioMedicine. 2016;12:295\u2013301.","journal-title":"eBioMedicine"},{"issue":"9s","key":"8342_CR18","doi-asserted-by":"publisher","first-page":"5","DOI":"10.2217\/fmb-2018-0262","volume":"14","author":"HC Maltezou","year":"2019","unstructured":"Maltezou HC, Theodoridou K, Ledda C, Rapisarda V. Vaccination of healthcare personnel: time to rethink the current situation in Europe. Future Microbiol. 2019;14(9s):5\u20138. https:\/\/doi.org\/10.2217\/fmb-2018-0262.","journal-title":"Future Microbiol"},{"key":"8342_CR19","volume-title":"Digital Report 2018","author":"We are social","year":"2018","unstructured":"We are social. Digital Report 2018. (2018). https:\/\/digitalreport.wearesocial.com. Accessed 22 July 2019."},{"issue":"7","key":"8342_CR20","doi-asserted-by":"publisher","first-page":"1693","DOI":"10.1080\/21645515.2017.1306159","volume":"13","author":"L Covolo","year":"2017","unstructured":"Covolo L, Ceretti E, Passeri C, Boletti M, Gelatti U. What arguments on vaccinations run through YouTube videos in Italy? A content analysis. Hum Vaccin Immunother. 2017;13(7):1693\u20139.","journal-title":"Hum Vaccin Immunother"},{"issue":"44","key":"8342_CR21","doi-asserted-by":"publisher","first-page":"5776","DOI":"10.1016\/j.vaccine.2014.08.042","volume":"32","author":"JB Ruiz","year":"2014","unstructured":"Ruiz JB, Bell RA. Understanding vaccination resistance: vaccine search term selection bias and the valence of retrieved information. Vaccine. 2014;32(44):5776\u201380.","journal-title":"Vaccine"},{"issue":"1","key":"8342_CR22","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1186\/1472-6947-11-21","volume":"11","author":"R Siliquini","year":"2011","unstructured":"Siliquini R, Ceruti M, Lovato E, Bert F, Bruno S, De Vito E, et al. Surfing the internet for health information: an italian survey on use and population choices. BMC Med Inform Decis Mak. 2011;11(1):21.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"8342_CR23","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1186\/s12889-016-3933-9","volume":"17","author":"KE Wiley","year":"2017","unstructured":"Wiley KE, Steffens M, Berry N, Leask J. An audit of the quality of online immunisation information available to Australian parents. BMC Public Health. 2017;17(1):76.","journal-title":"BMC Public Health"},{"issue":"15","key":"8342_CR24","doi-asserted-by":"publisher","first-page":"2057","DOI":"10.1016\/j.vaccine.2019.03.001","volume":"37","author":"N Yiannakoulias","year":"2019","unstructured":"Yiannakoulias N, Slavik CE, Chase M. Expressions of pro-and anti-vaccine sentiment on YouTube. Vaccine. 2019;37(15):2057\u201364.","journal-title":"Vaccine"},{"key":"8342_CR25","volume-title":"YouTube data tools. Computer software. version. 1.0","author":"B Rieder","year":"2015","unstructured":"Rieder, B. (2015). YouTube data tools. Computer software. version. 1.0. https:\/\/tools.digitalmethods.net\/netvizz\/youtube. Accessed 22 July 2019."},{"key":"8342_CR26","unstructured":"Youtube Data API. (n.d.) https:\/\/developers.google.com\/youtube\/v3\/. Accessed 1 December 2018."},{"key":"8342_CR27","volume-title":"English Version","author":"Ministero della Salute","year":"2019","unstructured":"Ministero della Salute 2019b. English Version. http:\/\/www.salute.gov.it\/portale\/p5_11.jsp. Accessed on the 1 Jan 2020."},{"key":"8342_CR28","volume-title":"Elenco pagine per tag: Vaccini","author":"Ministero della Salute","year":"2019","unstructured":"Ministero della Salute 2019a. Elenco pagine per tag: Vaccini. http:\/\/www.salute.gov.it\/portale\/temi\/p2_2_0.jsp?lingua=italiano&id=881. Accessed on 1 Jan 2020."},{"key":"8342_CR29","first-page":"35","volume-title":"A set of measures of centrality based on betweenness. Sociometry","author":"LC Freeman","year":"1977","unstructured":"Freeman LC. A set of measures of centrality based on betweenness. Sociometry; 1977. p. 35\u201341."},{"key":"8342_CR30","first-page":"92","volume":"8","author":"K Higuchi","year":"2012","unstructured":"Higuchi K. Analysis of free comments in a questionnaire survey: quantitative analysis by KH coder. Shakai Chosa. 2012;8:92\u20136.","journal-title":"Shakai Chosa"},{"key":"8342_CR31","first-page":"547","volume":"37","author":"P Jaccard","year":"1901","unstructured":"Jaccard P. \u00c9tude comparative de la distribution florale dans une portion des Alpes et des Jura. Bull Soc Vaudoise Sci Nat. 1901;37:547\u201379.","journal-title":"Bull Soc Vaudoise Sci Nat"},{"key":"8342_CR32","volume-title":"Package \u2018syuzhet\u2019","author":"M Jockers","year":"2017","unstructured":"Jockers, M. (2017). Package \u2018syuzhet\u2019. URL: https:\/\/cran.r-project.org\/web\/packages\/syuzhet."},{"issue":"17","key":"8342_CR33","doi-asserted-by":"crossref","first-page":"19849","DOI":"10.2807\/ese.16.17.19849-en","volume":"16","author":"C Betsch","year":"2011","unstructured":"Betsch C. Innovations in communication: the internet and the psychology of vaccination decisions. Eurosurveillance. 2011;16(17):19849.","journal-title":"Eurosurveillance"},{"key":"8342_CR34","volume-title":"Le tecnologie dell'informazione e della comunicazione: disponibilit\u00e0 nelle famiglie e utilizzo degli individui","author":"ISTAT","year":"2007","unstructured":"ISTAT. (2007). Le tecnologie dell'informazione e della comunicazione: disponibilit\u00e0 nelle famiglie e utilizzo degli individui. http:\/\/www.istat.it\/salastampa\/comunicati\/non_calendario\/20080116_00\/testointegrale20080116.pdf. Accessed 22 July 2019."},{"key":"8342_CR35","volume-title":"Statistiche demografiche","author":"ISTAT","year":"2008","unstructured":"ISTAT. (2008). Statistiche demografiche. http:\/\/demo.istat.it\/bil2008\/index.html. Accessed 22 July 2019."},{"key":"8342_CR36","unstructured":"Internet World Stats. (2019). http:\/\/www.internetworldstats.com\/stats.htm. Accessed 22 July 2019."},{"key":"8342_CR37","volume-title":"La nuova domanda di comunicazione sulla salute","author":"Censis","year":"2006","unstructured":"Censis. (2006). La nuova domanda di comunicazione sulla salute. http:\/\/www.webcitation.org\/5uX12IbQS. Accessed 22 July 2019."},{"key":"8342_CR38","volume-title":"European citizens\u2019 digital health literacy","author":"Flash Eurobarometer","year":"2014","unstructured":"Flash Eurobarometer. European citizens\u2019 digital health literacy. (2014). http:\/\/ec.europa.eu\/commfrontoffice\/ publicopinion\/flash\/fl_404_en.pdf. Accessed 2017 July 19."},{"issue":"suppl_1","key":"8342_CR39","doi-asserted-by":"publisher","first-page":"ckw174","DOI":"10.1093\/eurpub\/ckw174.227","volume":"26","author":"L Covolo","year":"2016","unstructured":"Covolo L, Passeri C, Gelatti U. YouTube Italian videos on vaccinations: a content analysis: Loredana Covolo. Eur J Public Health. 2016;26(suppl_1):ckw174\u2013227.","journal-title":"Eur J Public Health"},{"issue":"34","key":"8342_CR40","doi-asserted-by":"publisher","first-page":"4161","DOI":"10.1016\/j.vaccine.2015.04.036","volume":"33","author":"NE MacDonald","year":"2015","unstructured":"MacDonald NE. Vaccine hesitancy: definition, scope and determinants. Vaccine. 2015;33(34):4161\u20134.","journal-title":"Vaccine"},{"issue":"4","key":"8342_CR41","doi-asserted-by":"publisher","first-page":"310","DOI":"10.3163\/1536-5050.96.4.006","volume":"96","author":"JA Abrahamson","year":"2008","unstructured":"Abrahamson JA, Fisher KE, Turner AG, Durrance JC, Turner TC. Lay information mediary behavior uncovered: exploring how nonprofessionals seek health information for themselves and others online. Journal of the Medical Library Association: JMLA. 2008;96(4):310.","journal-title":"Journal of the Medical Library Association: JMLA"},{"issue":"1","key":"8342_CR42","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1186\/s12889-016-2722-9","volume":"16","author":"G Sak","year":"2015","unstructured":"Sak G, Diviani N, Allam A, Schulz PJ. Comparing the quality of pro-and anti-vaccination online information: a content analysis of vaccination-related webpages. BMC Public Health. 2015;16(1):38.","journal-title":"BMC Public Health"},{"issue":"5","key":"8342_CR43","doi-asserted-by":"publisher","first-page":"1268","DOI":"10.1080\/21645515.2015.1019980","volume":"11","author":"A Odone","year":"2015","unstructured":"Odone A, Fara GM, Giammaco G, Blangiardi F, Signorelli C. The future of immunization policies in Italy and in the European Union: the declaration of Erice. Human Vaccin Immunother. 2015;11(5):1268\u201371.","journal-title":"Human Vaccin Immunother"}],"container-title":["BMC Public Health"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12889-020-8342-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12889-020-8342-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12889-020-8342-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,16]],"date-time":"2022-10-16T01:01:31Z","timestamp":1665882091000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcpublichealth.biomedcentral.com\/articles\/10.1186\/s12889-020-8342-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,19]]},"references-count":43,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["8342"],"URL":"https:\/\/doi.org\/10.1186\/s12889-020-8342-4","relation":{},"ISSN":["1471-2458"],"issn-type":[{"value":"1471-2458","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,19]]},"assertion":[{"value":"12 September 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 February 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 February 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"259"}}