{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T12:03:31Z","timestamp":1773057811134,"version":"3.50.1"},"reference-count":47,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2021,2,4]],"date-time":"2021-02-04T00:00:00Z","timestamp":1612396800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004731","name":"Natural Science Foundation of Zhejiang Province","doi-asserted-by":"publisher","award":["LQ19F030011"],"award-info":[{"award-number":["LQ19F030011"]}],"id":[{"id":"10.13039\/501100004731","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61806061"],"award-info":[{"award-number":["61806061"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Previous studies have pointed out that it is hard to achieve the level of herd immunity for the population and then effectively stop disease propagation from the perspective of public health, if individuals just make vaccination decisions based on individualism. Individuals in reality often exist in the form of groups and cooperate in or among communities. Meanwhile, society studies have suggested that we cannot ignore the existence and influence of collectivism for studying individuals\u2019 decision-making. Regarding this, we formulate two vaccination strategies: individualistic strategy and collectivist strategy. The former helps individuals taking vaccination action after evaluating their perceived risk and cost of themselves, while the latter focuses on evaluating their contribution to their communities. More significantly, we propose a reinforcement learning mechanism based on policy gradient. Each individual can adaptively pick one of these two strategies after weighing their probabilities with a two-layer neural network whose parameters are dynamically updated with his\/her more and more vaccination experience. Experimental results on scale-free networks verify that the reinforcement learning mechanism can effectively improve the vaccine coverage level of communities. Moreover, communities can always get higher total payoffs with fewer costs paid, comparing that of pure individualistic strategy. Such performance mostly stems from individuals\u2019 adaptively picking collectivist strategy. Our study suggests that public health authorities should encourage individuals to make vaccination decisions from the perspective of their local mixed groups. Especially, it is more worthy of noting that individuals with low degrees are more significant as their vaccination behaviors can more sharply improve vaccination coverage of their groups and greatly reduce epidemic size.<\/jats:p>","DOI":"10.3390\/info12020066","type":"journal-article","created":{"date-parts":[[2021,2,4]],"date-time":"2021-02-04T12:02:10Z","timestamp":1612440130000},"page":"66","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Individualism or Collectivism: A Reinforcement Learning Mechanism for Vaccination Decisions"],"prefix":"10.3390","volume":"12","author":[{"given":"Chaohao","family":"Wu","sequence":"first","affiliation":[{"name":"School of Cyberspace, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tong","family":"Qiao","sequence":"additional","affiliation":[{"name":"School of Cyberspace, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3239-4473","authenticated-orcid":false,"given":"Hongjun","family":"Qiu","sequence":"additional","affiliation":[{"name":"School of Cyberspace, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benyun","family":"Shi","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Nanjing Tech University, Nanjing 211800, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qing","family":"Bao","sequence":"additional","affiliation":[{"name":"School of Cyberspace, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1399","DOI":"10.1126\/science.1085953","article-title":"The genome sequence of the SARS-associated coronavirus","volume":"300","author":"Marra","year":"2003","journal-title":"Science"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"The Chinese SARS Molecular Epidemiology Consortium (2004). Molecular evolution of the SARS Coronavirus, during the Course of the SARS epidemic in China. Science, 303, 1666\u20131669.","DOI":"10.1126\/science.1092002"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1038\/423240a","article-title":"Aetiology: Koch\u2019s postulates fulfilled for SARS virus","volume":"423","author":"Fouchier","year":"2003","journal-title":"Nature"},{"key":"ref_4","first-page":"253","article-title":"Scale-Free distribution of Avian influenza outbreaks","volume":"53","author":"Small","year":"2006","journal-title":"J. Math. Biol. Nat."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2605","DOI":"10.1056\/NEJMoa0903810","article-title":"Emergence of a novel swine-origin influenza A (H1N1) virus in humans","volume":"360","author":"Fatimah","year":"2009","journal-title":"N. Engl. J. Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/j.jcv.2009.06.006","article-title":"Emergence of a novel swine-origin influenza A virus (S-OIV) H1N1 virus in humans","volume":"45","author":"Peiris","year":"2009","journal-title":"J. Clin. Virol. Off. Publ. Pan Am. Soc. Clin. Virol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1235","DOI":"10.1016\/S0025-7125(16)30190-0","article-title":"Immunology of tuberculosis","volume":"77","author":"Alamelu","year":"1993","journal-title":"Med. Clin. N. Am."},{"key":"ref_8","first-page":"122","article-title":"Global tuberculosis control: Surveillance, planning, financing","volume":"78","author":"Christopher","year":"2003","journal-title":"Wkly. Epidemiol. Rep."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1001\/jama.282.7.677","article-title":"Estimated incidence, prevalence, and mortality by country","volume":"282","author":"Dye","year":"2003","journal-title":"JAMA"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"102433","DOI":"10.1016\/j.jaut.2020.102433","article-title":"The epidemiology and pathogenesis of Coronavirus disease (COVID-19) outbreak","volume":"109","author":"Rothan","year":"2020","journal-title":"J. Autoimmun."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1111\/tmi.13383","article-title":"The COVID-19 epidemic","volume":"25","author":"Velavan","year":"2020","journal-title":"Trop. Med. Int. Health"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Liu, Y., Gayle, A.A., Wilder-Smith, A., and R\u00f6cklv, J. (2020). The reproductive number of COVID-19 is higher compared to SARS coronavirus. J. Travel Med., 2020.","DOI":"10.1093\/jtm\/taaa021"},{"key":"ref_13","first-page":"677","article-title":"The development of critical care medicine in China: From SARS to COVID-19 pandemic","volume":"282","author":"Yin","year":"1999","journal-title":"Crit. Care Res. Pract."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"S120","DOI":"10.1016\/S0264-410X(99)00306-0","article-title":"Demographic impact of vaccination: A review","volume":"17","author":"Paolo","year":"1999","journal-title":"Vaccine"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1136\/jech.43.1.92","article-title":"Smallpox and its eradication","volume":"43","author":"Elwood","year":"1988","journal-title":"J. Epidemiol. Commun. Health"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1012","DOI":"10.1093\/oxfordjournals.aje.a114471","article-title":"Individual versus public priorities in the determination of optimal vaccination policies","volume":"124","author":"Fine","year":"1987","journal-title":"Am. J. Epidemiol."},{"key":"ref_17","first-page":"889","article-title":"The effectiveness of vaccination against influenza in healthy, working adults","volume":"333","author":"Kristin","year":"1995","journal-title":"Phys. Life Rev."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/0169-4758(92)90018-W","article-title":"Infectious diseases of humans: Dynamics and control","volume":"8","author":"Klaus","year":"1992","journal-title":"Parasitol. Today"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1007\/s00285-006-0006-1","article-title":"A susceptible-infected epidemic model with voluntary vaccinations","volume":"53","author":"Chen","year":"2006","journal-title":"J. Math. Biol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"996","DOI":"10.1093\/aje\/kwg239","article-title":"Prediction of the spread of influenza epidemics by the method of analogues","volume":"158","author":"Viboud","year":"2003","journal-title":"Am. J. Epidemiol."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, G., Qiu, H., Shi, B., and Zhen, W. (2017, January 15\u201317). Imitation and memory-based self-organizing behaviors under voluntary vaccination. Proceedings of the International Conference on Security, Pattern Analysis, and Cybernetics, Shenzhen, China.","DOI":"10.1109\/SPAC.2017.8304328"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"20140013","DOI":"10.1098\/rsif.2014.0013","article-title":"A belief-based model for characterizing the spread of awareness and its impacts on individuals\u2019 vaccination decisions","volume":"11","author":"Xia","year":"2014","journal-title":"J. R. Soc. Interface"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"S33","DOI":"10.1038\/nm1221","article-title":"Annulling a dangerous liaison: Vaccination strategies against AIDS and tuberculosis","volume":"11","author":"Kaufmann","year":"2005","journal-title":"Nat. Med."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1038\/nature01343","article-title":"Modelling vaccination strategies against foot-and-mouth disease","volume":"421","author":"Keeling","year":"2003","journal-title":"Nature"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1038\/nature04324","article-title":"Optimal reactive vaccination strategies for a foot-and-mouth outbreak in the UK","volume":"404","author":"Tildesley","year":"2006","journal-title":"Nature"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"13391","DOI":"10.1073\/pnas.0403823101","article-title":"Vaccination and the theory of games","volume":"101","author":"Bauch","year":"2004","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.physa.2018.09.151","article-title":"Exploring voluntary vaccination with bounded rationality through reinforcement learning","volume":"515","author":"Shi","year":"2019","journal-title":"Phys. Stat. Mech. Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"10564","DOI":"10.1073\/pnas.1731324100","article-title":"Group interest versus self-interest in smallpox vaccination policy","volume":"100","author":"Bauch","year":"2003","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1006\/obhd.1994.1055","article-title":"The roles of altruism, free riding, and bandwagoning in vaccination decisions","volume":"59","author":"Hershey","year":"1994","journal-title":"Organ. Behav. Hum. Decis. Process."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2248","DOI":"10.1111\/j.1558-5646.2009.00708.x","article-title":"Coevolution between cooperators and cheats in a microbial system","volume":"63","author":"Zhang","year":"2009","journal-title":"Evolution"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1560","DOI":"10.1126\/science.1133755","article-title":"Five rules for the evolution of cooperation","volume":"314","author":"Nowak","year":"2007","journal-title":"Science"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/0022-5193(64)90039-6","article-title":"The genetical evolution of social behaviour","volume":"7","author":"Hamilton","year":"1964","journal-title":"J. Theor. Biol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.tree.2005.11.020","article-title":"Kin selection is the key to altruism","volume":"21","author":"Foster","year":"2006","journal-title":"Trends Ecol. Evol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1020","DOI":"10.1111\/j.1420-9101.2011.02236.x","article-title":"The genetical theory of kin selection","volume":"24","author":"Gardner","year":"2011","journal-title":"J. Evol. Biol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"165","DOI":"10.2307\/1313262","article-title":"Kin selection and social insects","volume":"48","author":"Queller","year":"1998","journal-title":"Bioscience"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1016\/j.jtbi.2005.08.008","article-title":"The leading eight: Social norms that can maintain cooperation by indirect reciprocity","volume":"239","author":"Ohtsuki","year":"2006","journal-title":"J. Theor. Biol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/j.jtbi.2004.06.005","article-title":"How should we define goodness? Reputation dynamics in indirect reciprocity","volume":"231","author":"Ohtsuki","year":"2004","journal-title":"J. Theor. Biol."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Cucciniello, M., Pin, P., Imre, B., Porumbescu, G., and Melegaro, A. (2020). Altruism and Vaccination Intentions: Evidence from Behavioral Experiments. medRxiv.","DOI":"10.1101\/2020.05.14.20100586"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"78","DOI":"10.4103\/SHB.SHB_39_20","article-title":"Triggering Altruism Increases the Willingness to Get Vaccinated against COVID-19","volume":"3","author":"Rieger","year":"2020","journal-title":"Soc. Health Behav."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2665","DOI":"10.1038\/s41598-017-02967-8","article-title":"Voluntary vaccination through self-organizing behaviors on locally-mixed social networks","volume":"7","author":"Shi","year":"2017","journal-title":"Sci. Rep."},{"key":"ref_41","first-page":"13","article-title":"Perceiving epidemic severity in social network","volume":"2019","author":"Liu","year":"2019","journal-title":"Complexity"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Jalil, R., Mehri, S., Jorge, D., Cristina, J., and Nuno, M. (2018). On the dynamical complexity of a seasonally forced discrete SIR epidemic model with a constant vaccination strategy. Complexity, 2018.","DOI":"10.1155\/2018\/7191487"},{"key":"ref_43","first-page":"42","article-title":"Imitation dynamics of vaccination behaviour on social networks","volume":"278","author":"Feng","year":"2011","journal-title":"Proc. Biol. Sci."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2962","DOI":"10.1073\/pnas.0912515107","article-title":"Human strategy updating in evolutionary games","volume":"107","author":"Arne","year":"2010","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_45","first-page":"1057","article-title":"Policy gradient methods for reinforcement learning with function approximation","volume":"12","author":"Sutton","year":"2000","journal-title":"Neural Inf. Process. Syst."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1016\/j.amc.2016.08.057","article-title":"Preferential imitation can invalidate targeted subsidy policies on seasonal-influenza diseases","volume":"294","author":"Zhang","year":"2017","journal-title":"Appl. Math. Comput."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Anderson, R., and May, R. (1992). Infectious Diseases of Humans, Oxford University Press.","DOI":"10.1093\/oso\/9780198545996.001.0001"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/2\/66\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:20:15Z","timestamp":1760160015000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/2\/66"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,4]]},"references-count":47,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["info12020066"],"URL":"https:\/\/doi.org\/10.3390\/info12020066","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,4]]}}}