{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,20]],"date-time":"2026-11-20T13:18:38Z","timestamp":1795180718850,"version":"4.10.3"},"reference-count":79,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,3,12]],"date-time":"2025-03-12T00:00:00Z","timestamp":1741737600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,3,12]],"date-time":"2025-03-12T00:00:00Z","timestamp":1741737600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005416","name":"Norges Forskningsr\u00e5d","doi-asserted-by":"publisher","award":["288083"],"award-info":[{"award-number":["288083"]}],"id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005366","name":"University of Oslo","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005366","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med"],"abstract":"<jats:title>Abstract\n<\/jats:title>\n          <jats:sec>\n            <jats:title>Background\n<\/jats:title>\n            <jats:p>Vaccine hesitancy, the delay in acceptance or reluctance to vaccinate, ranks among the top threats to global health. Identifying modifiable factors contributing to vaccine hesitancy is crucial for developing targeted interventions to increase vaccination uptake.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods<\/jats:title>\n            <jats:p>This mixed-methods multiple population study utilized gradient boosting machines and thematic analysis to identify modifiable predictors of vaccine hesitancy during the COVID-19 pandemic. Predictors of vaccine hesitancy were investigated in 2926 Norwegian adults (<jats:italic>M<\/jats:italic>\n              <jats:sub>age<\/jats:sub>\u2009=\u200937.91, 79.69% female), before the predictive utility of these variables was investigated in an independent sample of 734 adults in the UK (<jats:italic>M<\/jats:italic>\n              <jats:sub>age<\/jats:sub>\u2009=\u200940.34, 57.08% female). Two independent teams of authors conducted the machine learning and thematic analyses, blind to each other\u2019s analytic procedures and results.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>The machine learning model performed well in discerning vaccine hesitant (<jats:italic>n<\/jats:italic>\u2009=\u2009248, 8.48% and <jats:italic>n<\/jats:italic>\u2009=\u2009109, 14.85%, Norway and UK, respectively) from vaccine uptaking individuals (<jats:italic>n<\/jats:italic>\u2009=\u20092678, 91.52% and <jats:italic>n<\/jats:italic>\u2009=\u2009625, 85.15%), achieving an AUC of 0.94 (AUPRC: 0.72; balanced accuracy: 86%; sensitivity\u2009=\u20090.81; specificity\u2009=\u20090.98) in the Norwegian sample, and an AUC of 0.98 (AUPRC: 0.89; balanced accuracy: 89%; sensitivity\u2009=\u20090.83; specificity\u2009=\u20090.97) in the out-of-sample replication in the UK. The mixed methods investigation identified five categories of modifiable risk tied to vaccine hesitancy, including illusion of invulnerability, doubts about vaccine efficacy, mistrust in official entities, minimization of the societal impact of COVID-19, and health-related fears tied to vaccination. The portrayal of rare incidents across alternative media platforms as fear amplifiers, and the mainstream media\u2019s stigmatizing presentation of unvaccinated individuals, were provided as additional motives underlying vaccine reluctance and polarization. The thematic analysis further revealed information overload, fear of needles, previous negative vaccination experiences, fear of not getting healthcare follow-up after vaccination if needed, and vaccine aversion due to underlying (psychiatric) illness (e.g., eating disorders) as motives underlying vaccine hesitance.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusions<\/jats:title>\n            <jats:p>The identified influential predictors were consistent across two European samples, highlighting their generalizability across European populations. These predictors offer insights about modifiable factors that could be adapted by public health campaigns in mitigating misconceptions and fears related to vaccination toward increasing vaccine uptake. Moreover, the results highlight the media\u2019s responsibility, as mediators of the public perception of vaccines, to minimize polarization and provide accurate portrayals of rare vaccine-related incidents, reducing the risk aggravating fear and reactance to vaccination.\n<\/jats:p>\n          <\/jats:sec>","DOI":"10.1186\/s12916-025-03953-y","type":"journal-article","created":{"date-parts":[[2025,3,12]],"date-time":"2025-03-12T13:16:16Z","timestamp":1741785376000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Modifiable risk factors of vaccine hesitancy: insights from a mixed methods multiple population study combining machine learning and thematic analysis during the COVID-19 pandemic"],"prefix":"10.1186","volume":"23","author":[{"given":"Omid V.","family":"Ebrahimi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ella Marie","family":"Sandbakken","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sigrun Marie","family":"Moss","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sverre Urnes","family":"Johnson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Asle","family":"Hoffart","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Bauermeister","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ole Andr\u00e9","family":"Solbakken","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lars T.","family":"Westlye","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Esten H.","family":"Leonardsen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,3,12]]},"reference":[{"key":"3953_CR1","unstructured":"WHO. Ten threats to global health in 2019. Available from: https:\/\/www.who.int\/news-room\/spotlight\/ten-threats-to-global-health-in-2019."},{"key":"3953_CR2","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1146\/annurev-publhealth-090419-102240","volume":"42","author":"\u00c8 Dub\u00e9","year":"2021","unstructured":"Dub\u00e9 \u00c8, Ward JK, Verger P, MacDonald NE. Vaccine hesitancy, acceptance, and anti-vaccination: trends and future prospects for public health. Annu Rev Public Health. 2021;42:175\u201391.","journal-title":"Annu Rev Public Health"},{"key":"3953_CR3","doi-asserted-by":"publisher","first-page":"4161","DOI":"10.1016\/j.vaccine.2015.04.036","volume":"33","author":"NE MacDonald","year":"2015","unstructured":"MacDonald NE. Vaccine hesitancy: definition, scope and determinants. Vaccine. 2015;33:4161\u20134.","journal-title":"Vaccine"},{"key":"3953_CR4","doi-asserted-by":"publisher","first-page":"808","DOI":"10.1080\/10810730.2021.1879366","volume":"25","author":"R Obregon","year":"2020","unstructured":"Obregon R, Mosquera M, Tomsa S, Chitnis K. Vaccine hesitancy and demand for immunization in Eastern Europe and Central Asia: implications for the region and beyond. J Health Commun. 2020;25:808\u201315.","journal-title":"J Health Commun"},{"key":"3953_CR5","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/j.coi.2021.05.003","volume":"71","author":"J Ryan","year":"2021","unstructured":"Ryan J, Malinga T. Interventions for vaccine hesitancy. Curr Opin Immunol. 2021;71:89\u201391.","journal-title":"Curr Opin Immunol"},{"key":"3953_CR6","doi-asserted-by":"publisher","first-page":"931","DOI":"10.1016\/S0140-6736(20)30567-5","volume":"395","author":"RM Anderson","year":"2020","unstructured":"Anderson RM, Heesterbeek H, Klinkenberg D, Hollingsworth TD. How will country-based mitigation measures influence the course of the COVID-19 epidemic? The Lancet. 2020;395:931\u20134.","journal-title":"The Lancet"},{"key":"3953_CR7","doi-asserted-by":"publisher","first-page":"1224","DOI":"10.1016\/S0140-6736(22)01585-9","volume":"400","author":"JD Sachs","year":"2022","unstructured":"Sachs JD, Karim SSA, Aknin L, Allen J, Brosb\u00f8l K, Colombo F, et al. The lancet commission on lessons for the future from the COVID-19 pandemic. The Lancet. 2022;400:1224\u201380.","journal-title":"The Lancet"},{"key":"3953_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/21645515.2021.1893062","volume":"18","author":"CS Wiysonge","year":"2022","unstructured":"Wiysonge CS, Ndwandwe D, Ryan J, Jaca A, Batour\u00e9 O, Anya BPM, et al. Vaccine hesitancy in the era of COVID-19: could lessons from the past help in divining the future? Hum Vaccines Immunother. 2022;18:1\u20133.","journal-title":"Hum Vaccines Immunother"},{"key":"3953_CR9","doi-asserted-by":"publisher","first-page":"1614","DOI":"10.1016\/S0140-6736(20)32318-7","volume":"396","author":"RM Anderson","year":"2020","unstructured":"Anderson RM, Vegvari C, Truscott J, Collyer BS. Challenges in creating herd immunity to SARS-CoV-2 infection by mass vaccination. The Lancet. 2020;396:1614\u20136.","journal-title":"The Lancet"},{"key":"3953_CR10","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1038\/s41591-020-1124-9","volume":"27","author":"JV Lazarus","year":"2021","unstructured":"Lazarus JV, Ratzan SC, Palayew A, Gostin LO, Larson HJ, Rabin K, et al. A global survey of potential acceptance of a COVID-19 vaccine. Nat Med. 2021;27:225\u20138.","journal-title":"Nat Med"},{"key":"3953_CR11","doi-asserted-by":"publisher","first-page":"977","DOI":"10.1007\/s10198-020-01208-6","volume":"21","author":"S Neumann-B\u00f6hme","year":"2020","unstructured":"Neumann-B\u00f6hme S, Varghese NE, Sabat I, Barros PP, Brouwer W, van Exel J, et al. Once we have it, will we use it? A European survey on willingness to be vaccinated against COVID-19. Eur J Health Econ. 2020;21:977\u201382.","journal-title":"Eur J Health Econ"},{"key":"3953_CR12","doi-asserted-by":"publisher","first-page":"498","DOI":"10.1016\/j.medj.2021.04.002","volume":"2","author":"B Trogen","year":"2021","unstructured":"Trogen B, Pirofski LA. Understanding vaccine hesitancy in COVID-19. Med. 2021;2:498\u2013501.","journal-title":"Med"},{"key":"3953_CR13","doi-asserted-by":"publisher","DOI":"10.1136\/fmch-2019-000262","volume":"8","author":"MZI Chowdhury","year":"2020","unstructured":"Chowdhury MZI, Turin TC. Variable selection strategies and its importance in clinical prediction modelling. Fam Med Community Health. 2020;8: e000262.","journal-title":"Fam Med Community Health"},{"key":"3953_CR14","doi-asserted-by":"publisher","first-page":"1216","DOI":"10.1056\/NEJMp1606181","volume":"375","author":"Z Obermeyer","year":"2016","unstructured":"Obermeyer Z, Emanuel EJ. Predicting the Future \u2014 big data, machine learning, and clinical medicine. N Engl J Med. 2016;375:1216\u20139.","journal-title":"N Engl J Med"},{"key":"3953_CR15","doi-asserted-by":"publisher","first-page":"262","DOI":"10.1016\/j.ajic.2021.12.013","volume":"50","author":"S Khairat","year":"2022","unstructured":"Khairat S, Zou B, Adler-Milstein J. Factors and reasons associated with low COVID-19 vaccine uptake among highly hesitant communities in the US. Am J Infect Control. 2022;50:262\u20137.","journal-title":"Am J Infect Control"},{"key":"3953_CR16","doi-asserted-by":"publisher","first-page":"300","DOI":"10.1111\/bjhp.12546","volume":"27","author":"CJ Davis","year":"2022","unstructured":"Davis CJ, Golding M, McKay R. Efficacy information influences intention to take COVID-19 vaccine. Br J Health Psychol. 2022;27:300\u201319.","journal-title":"Br J Health Psychol"},{"key":"3953_CR17","doi-asserted-by":"publisher","first-page":"642","DOI":"10.1037\/hea0000143","volume":"34","author":"M Conner","year":"2015","unstructured":"Conner M, McEachan R, Taylor N, O\u2019Hara J, Lawton R. Role of affective attitudes and anticipated affective reactions in predicting health behaviors. Health Psychol. 2015;34:642\u201352.","journal-title":"Health Psychol"},{"key":"3953_CR18","doi-asserted-by":"publisher","first-page":"592","DOI":"10.1007\/s12160-016-9798-4","volume":"50","author":"R McEachan","year":"2016","unstructured":"McEachan R, Taylor N, Harrison R, Lawton R, Gardner P, Conner M. Meta-analysis of the Reasoned Action Approach (RAA) to understanding health behaviors. Ann Behav Med. 2016;50:592\u2013612.","journal-title":"Ann Behav Med"},{"key":"3953_CR19","doi-asserted-by":"publisher","first-page":"2055","DOI":"10.1038\/s41598-022-05915-3","volume":"12","author":"TM Lincoln","year":"2022","unstructured":"Lincoln TM, Schlier B, Strakeljahn F, Gaudiano BA, So SH, Kingston J, et al. Taking a machine learning approach to optimize prediction of vaccine hesitancy in high income countries. Sci Rep. 2022;12:2055.","journal-title":"Sci Rep"},{"key":"3953_CR20","doi-asserted-by":"publisher","first-page":"3750","DOI":"10.1017\/S0033291720004067","volume":"52","author":"GD Salali","year":"2022","unstructured":"Salali GD, Uysal MS. COVID-19 vaccine hesitancy is associated with beliefs on the origin of the novel coronavirus in the UK and Turkey. Psychol Med. 2022;52:3750\u20132.","journal-title":"Psychol Med"},{"key":"3953_CR21","doi-asserted-by":"publisher","first-page":"1030","DOI":"10.1080\/21645515.2019.1695458","volume":"16","author":"AK Shen","year":"2020","unstructured":"Shen AK. Finding a way to address a wicked problem: vaccines, vaccination, and a shared understanding. Hum Vaccines Immunother. 2020;16:1030\u20133.","journal-title":"Hum Vaccines Immunother"},{"key":"3953_CR22","doi-asserted-by":"publisher","first-page":"881","DOI":"10.1037\/abn0000786","volume":"131","author":"OV Ebrahimi","year":"2022","unstructured":"Ebrahimi OV, Bauer DJ, Hoffart A, Johnson SU. A critical period for pandemic adaptation: the evolution of depressive symptomatology in a representative sample of adults across a 17-month period during COVID-19. J Psychopathol Clin Sci. 2022;131:881\u201394.","journal-title":"J Psychopathol Clin Sci"},{"key":"3953_CR23","doi-asserted-by":"crossref","unstructured":"McBride O, Butter S, Hartman T, Murphy J, Hyland P, Shevlin M, et al. Sharing data to better understand one of the world\u2019s most significant shared experiences: data resource profile of the longitudinal COVID-19 psychological research consortium (C19PRC) study. Int J Popul Data Sci. 2020;5. Available from: https:\/\/ijpds.org\/article\/view\/1704.","DOI":"10.23889\/ijpds.v5i4.1704"},{"key":"3953_CR24","doi-asserted-by":"publisher","DOI":"10.1002\/mpr.1949","volume":"32","author":"O McBride","year":"2022","unstructured":"McBride O, Butter S, Martinez AP, Shevlin M, Murphy J, Hartman TK, et al. An 18-month follow-up of the Covid-19 psychology research consortium study panel: survey design and fieldwork procedures for Wave 6. Int J Methods Psychiatr Res. 2022;32: e1949.","journal-title":"Int J Methods Psychiatr Res"},{"key":"3953_CR25","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1038\/nmeth.4642","volume":"15","author":"D Bzdok","year":"2018","unstructured":"Bzdok D, Altman N, Krzywinski M. Statistics versus machine learning. Nat Methods. 2018;15:233\u20134.","journal-title":"Nat Methods"},{"key":"3953_CR26","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1186\/s12874-022-01540-w","volume":"22","author":"E Stenwig","year":"2022","unstructured":"Stenwig E, Salvi G, Rossi PS, Skj\u00e6rvold NK. Comparative analysis of explainable machine learning prediction models for hospital mortality. BMC Med Res Methodol. 2022;22:53.","journal-title":"BMC Med Res Methodol"},{"key":"3953_CR27","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1177\/15586898211049847","volume":"17","author":"FC Mukumbang","year":"2023","unstructured":"Mukumbang FC. Retroductive theorizing: a contribution of critical realism to mixed methods research. J Mix Methods Res. 2023;17:93\u2013114.","journal-title":"J Mix Methods Res"},{"key":"3953_CR28","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1080\/14780887.2014.955224","volume":"12","author":"J Brooks","year":"2015","unstructured":"Brooks J, McCluskey S, Turley E, King N. The utility of template analysis in qualitative psychology research. Qual Res Psychol. 2015;12:202\u201322.","journal-title":"Qual Res Psychol"},{"key":"3953_CR29","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1177\/1745691617734863","volume":"13","author":"SA Power","year":"2018","unstructured":"Power SA, Velez G, Qadafi A, Tennant J. The SAGE model of social psychological research. Perspect Psychol Sci. 2018;13:359\u201372.","journal-title":"Perspect Psychol Sci"},{"key":"3953_CR30","doi-asserted-by":"publisher","first-page":"489","DOI":"10.1177\/2167702621994545","volume":"9","author":"OV Ebrahimi","year":"2021","unstructured":"Ebrahimi OV, Hoffart A, Johnson SU. Physical distancing and mental health during the COVID-19 pandemic: factors associated with psychological symptoms and adherence to pandemic mitigation strategies. Clin Psychol Sci. 2021;9:489\u2013506.","journal-title":"Clin Psychol Sci"},{"key":"3953_CR31","doi-asserted-by":"publisher","first-page":"e406","DOI":"10.1016\/S2468-2667(22)00042-1","volume":"7","author":"I Magn\u00fasd\u00f3ttir","year":"2022","unstructured":"Magn\u00fasd\u00f3ttir I, Lovik A, Unnarsd\u00f3ttir AB, McCartney D, Ask H, K\u00f5iv K, et al. Acute COVID-19 severity and mental health morbidity trajectories in patient populations of six nations: an observational study. Lancet Public Health. 2022;7:e406\u201316.","journal-title":"Lancet Public Health"},{"key":"3953_CR32","unstructured":"Norwegian Institute of Public Health. Folkehelseinstituttet. 2021. Available from: https:\/\/www.fhi.no\/ss\/korona\/koronavirus\/folkehelserapporten-temautgave-2021\/del-1-9\/tillit-og-vaksinasjon-i-norge."},{"key":"3953_CR33","doi-asserted-by":"publisher","DOI":"10.2196\/39488","volume":"6","author":"AL Braitman","year":"2022","unstructured":"Braitman AL, Strowger M, Shipley JL, Ortman J, MacIntyre RI, Bauer EA. Data quality and study compliance among college students across 2 recruitment sources: two study investigation. JMIR Form Res. 2022;6: e39488.","journal-title":"JMIR Form Res"},{"key":"3953_CR34","doi-asserted-by":"publisher","first-page":"1092","DOI":"10.1001\/archinte.166.10.1092","volume":"166","author":"RL Spitzer","year":"2006","unstructured":"Spitzer RL, Kroenke K, Williams JBW, L\u00f6we B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166:1092\u20137.","journal-title":"Arch Intern Med"},{"key":"3953_CR35","doi-asserted-by":"publisher","first-page":"691","DOI":"10.2466\/pms.107.3.691-706","volume":"107","author":"S Pallesen","year":"2008","unstructured":"Pallesen S, Bjorvatn B, Nordhus IH, Sivertsen B, Hj\u00f8rnevik M, Morin CM. A new scale for measuring insomnia: the bergen insomnia scale. Percept Mot Skills. 2008;107:691\u2013706.","journal-title":"Percept Mot Skills"},{"key":"3953_CR36","doi-asserted-by":"publisher","first-page":"1379","DOI":"10.1037\/pas0000254","volume":"28","author":"MJ Bovin","year":"2016","unstructured":"Bovin MJ, Marx BP, Weathers FW, Gallagher MW, Rodriguez P, Schnurr PP, et al. Psychometric properties of the PTSD checklist for diagnostic and statistical manual of mental disorders-fifth edition (PCL-5) in veterans. Psychol Assess. 2016;28:1379\u201391.","journal-title":"Psychol Assess"},{"key":"3953_CR37","doi-asserted-by":"publisher","first-page":"606","DOI":"10.1046\/j.1525-1497.2001.016009606.x","volume":"16","author":"K Kroenke","year":"2001","unstructured":"Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606\u201313.","journal-title":"J Gen Intern Med"},{"key":"3953_CR38","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1080\/08870446.2021.1960987","volume":"38","author":"OV Ebrahimi","year":"2023","unstructured":"Ebrahimi OV, Hoffart A, Johnson SU. Viral mitigation and the COVID-19 pandemic: factors associated with adherence to social distancing protocols and hygienic behaviour. Psychol Health. 2023;38:283\u2013306.","journal-title":"Psychol Health"},{"key":"3953_CR39","doi-asserted-by":"publisher","first-page":"1220","DOI":"10.1016\/j.eswa.2006.12.030","volume":"34","author":"S Piramuthu","year":"2008","unstructured":"Piramuthu S. Input data for decision trees. Expert Syst Appl. 2008;34:1220\u20136.","journal-title":"Expert Syst Appl"},{"key":"3953_CR40","doi-asserted-by":"publisher","DOI":"10.1016\/j.lanepe.2023.100756","volume":"35","author":"Q Shen","year":"2023","unstructured":"Shen Q, Joyce EE, Ebrahimi OV, Didriksen M, Lovik A, S\u00e6varsd\u00f3ttir KS, et al. COVID-19 illness severity and 2-year prevalence of physical symptoms: an observational study in Iceland, Sweden, Norway and Denmark. Lancet Reg Health \u2013 Eur. 2023;35: 100756.","journal-title":"Lancet Reg Health \u2013 Eur."},{"key":"3953_CR41","doi-asserted-by":"publisher","first-page":"1189","DOI":"10.1214\/aos\/1013203451","volume":"29","author":"JH Friedman","year":"2001","unstructured":"Friedman JH. Greedy function approximation: a gradient boosting machine. Ann Stat. 2001;29:1189\u2013232.","journal-title":"Ann Stat"},{"key":"3953_CR42","doi-asserted-by":"publisher","unstructured":"Chen T, Guestrin C. XGBoost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York, NY, USA: Association for Computing Machinery; 2016:785\u201394. (KDD \u201916). https:\/\/doi.org\/10.1145\/2939672.2939785.","DOI":"10.1145\/2939672.2939785"},{"key":"3953_CR43","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-7-91","volume":"7","author":"S Varma","year":"2006","unstructured":"Varma S, Simon R. Bias in error estimation when using cross-validation for model selection. BMC Bioinformatics. 2006;7: 91.","journal-title":"BMC Bioinformatics"},{"key":"3953_CR44","doi-asserted-by":"crossref","unstructured":"Dinga R, Penninx BWJH, Veltman DJ, Schmaal L, Marquand AF. Beyond accuracy: measures for assessing machine learning models, pitfalls and guidelines. bioRxiv; 2019. Available from: https:\/\/www.biorxiv.org\/content\/10.1101\/743138v1.","DOI":"10.1101\/743138"},{"key":"3953_CR45","doi-asserted-by":"publisher","unstructured":"Varoquaux G, Colliot O. Evaluating machine learning models and their diagnostic value. In: Colliot O, editor. Machine learning for brain disorders. New York, NY: Springer US; 2023:601\u201330. https:\/\/doi.org\/10.1007\/978-1-0716-3195-9_20.","DOI":"10.1007\/978-1-0716-3195-9_20"},{"key":"3953_CR46","unstructured":"Provost F. Machine learning from imbalanced data sets 101. In Proceedings of the AAAI\u20192000 workshop on imbalanced data sets 2000 Jul 31 (Vol. 68. AAAI Press; 2000. p. 1-3. https:\/\/aaai.org\/papers\/ws00-05-001-machine-learning-from-imbalanced-data-sets-101\/."},{"key":"3953_CR47","doi-asserted-by":"crossref","unstructured":"Calvert CL, Khoshgoftaar TM. Threshold based optimization of performance metrics with severely imbalanced big security data. 2019 IEEE 31st Int Conf Tools Artif Intell ICTAI. 2019:1328\u201334.","DOI":"10.1109\/ICTAI.2019.00184"},{"key":"3953_CR48","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1186\/s40537-023-00738-z","volume":"10","author":"JL Leevy","year":"2023","unstructured":"Leevy JL, Johnson JM, Hancock J, Khoshgoftaar TM. Threshold optimization and random undersampling for imbalanced credit card data. J Big Data. 2023;10:58.","journal-title":"J Big Data"},{"key":"3953_CR49","doi-asserted-by":"crossref","unstructured":"King N. Doing template analysis. In: Qualitative organizational research: core methods and current challenges. 55 City Road: SAGE Publications, Inc.; 2012:426\u201350. Available from: https:\/\/sk.sagepub.com\/books\/qualitative-organizational-research-core-methods-and-current-challenges\/i1774.xml.","DOI":"10.4135\/9781526435620.n24"},{"key":"3953_CR50","doi-asserted-by":"crossref","unstructured":"Wiltshire G, Ronkainen N. A realist approach to thematic analysis: making sense of qualitative data through experiential, inferential and dispositional themes. J Crit Realism. 2021;20:159\u201380.","DOI":"10.1080\/14767430.2021.1894909"},{"key":"3953_CR51","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1186\/1471-2288-13-117","volume":"13","author":"NK Gale","year":"2013","unstructured":"Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13: 117.","journal-title":"BMC Med Res Methodol"},{"key":"3953_CR52","doi-asserted-by":"crossref","unstructured":"Steltenpohl CN, Lustick H, Meyer MS, Lee LE, Stegenga SM, Reyes LS, et al. Rethinking transparency and rigor from a qualitative open science perspective. J Trial Error. 2024;4. Available from: https:\/\/journal.trialanderror.org\/pub\/rethinking-transparency\/release\/1.","DOI":"10.36850\/mr7"},{"key":"3953_CR53","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1037\/qup0000196","volume":"9","author":"V Braun","year":"2022","unstructured":"Braun V, Clarke V. Conceptual and design thinking for thematic analysis. Qual Psychol. 2022;9:3\u201326.","journal-title":"Qual Psychol"},{"key":"3953_CR54","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1037\/amp0000151","volume":"73","author":"HM Levitt","year":"2018","unstructured":"Levitt HM, Bamberg M, Creswell JW, Frost DM, Josselson R, Su\u00e1rez-Orozco C. Journal article reporting standards for qualitative primary, qualitative meta-analytic, and mixed methods research in psychology: the APA Publications and Communications Board task force report. Am Psychol. 2018;73:26\u201346.","journal-title":"Am Psychol"},{"key":"3953_CR55","unstructured":"Norwegian Institute of Public Health. Folkehelseinstituttet. Mental illness among adults in Norway. in: Public health report - health status in Norway. 2023. Available from: https:\/\/www.fhi.no\/he\/folkehelserapporten\/psykisk-helse\/psykiske-lidelser-voksne\/."},{"key":"3953_CR56","doi-asserted-by":"publisher","first-page":"1878","DOI":"10.1186\/s12889-022-14261-y","volume":"22","author":"L Steinmetz","year":"2022","unstructured":"Steinmetz L. Sociodemographic predictors of and main reasons for COVID-19 vaccine hesitancy in eastern Oslo: a cross-sectional study. BMC Public Health. 2022;22:1878.","journal-title":"BMC Public Health"},{"key":"3953_CR57","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0259164","volume":"16","author":"AN Poudel","year":"2021","unstructured":"Poudel AN, Zhu S, Cooper N, Roderick P, Alwan N, Tarrant C, et al. Impact of Covid-19 on health-related quality of life of patients: a structured review. PLoS ONE. 2021;16: e0259164.","journal-title":"PLoS ONE"},{"key":"3953_CR58","unstructured":"Tenforde MW. Symptom Duration and Risk Factors for Delayed Return to Usual Health Among Outpatients with COVID-19 in a Multistate Health Care Systems Network \u2014 United States, March\u2013June 2020. MMWR Morb Mortal Wkly Rep. 2020;69. Available from: https:\/\/www.cdc.gov\/mmwr\/volumes\/69\/wr\/mm6930e1.htm."},{"key":"3953_CR59","doi-asserted-by":"publisher","first-page":"4473","DOI":"10.1016\/j.vaccine.2022.06.015","volume":"40","author":"H Zhang","year":"2022","unstructured":"Zhang H, Li Y, Peng S, Jiang Y, Jin H, Zhang F. The effect of health literacy on COVID-19 vaccine hesitancy among community population in China: the moderating role of stress. Vaccine. 2022;40:4473\u20138.","journal-title":"Vaccine"},{"key":"3953_CR60","doi-asserted-by":"publisher","DOI":"10.3390\/vaccines10081256","volume":"10","author":"JC Wong","year":"2022","unstructured":"Wong JC, Lao CT, Yousif MM, Luga JM. Fast tracking\u2014vaccine safety, efficacy, and lessons learned: a narrative review. Vaccines. 2022;10: 1256.","journal-title":"Vaccines"},{"key":"3953_CR61","doi-asserted-by":"publisher","first-page":"1354","DOI":"10.1111\/bjhp.12606","volume":"27","author":"R Phillips","year":"2022","unstructured":"Phillips R, Gillespie D, Hallingberg B, Evans J, Taiyari K, Torrens-Burton A, et al. Perceived threat of COVID-19, attitudes towards vaccination, and vaccine hesitancy: a prospective longitudinal study in the UK. Br J Health Psychol. 2022;27:1354\u201381.","journal-title":"Br J Health Psychol"},{"key":"3953_CR62","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.puhe.2021.02.025","volume":"194","author":"G Troiano","year":"2021","unstructured":"Troiano G, Nardi A. Vaccine hesitancy in the era of COVID-19. Public Health. 2021;194:245\u201351.","journal-title":"Public Health"},{"key":"3953_CR63","doi-asserted-by":"publisher","first-page":"140","DOI":"10.2471\/BLT.07.040089","volume":"86","author":"FE Andre","year":"2008","unstructured":"Andre FE, Booy R, Bock HL, Clemens J, Datta SK, John TJ, et al. Vaccination greatly reduces disease, disability, death and inequity worldwide. Bull World Health Organ. 2008;86:140\u20136.","journal-title":"Bull World Health Organ"},{"key":"3953_CR64","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1016\/S1473-3099(21)00566-1","volume":"22","author":"EJ Haas","year":"2022","unstructured":"Haas EJ, McLaughlin JM, Khan F, Angulo FJ, Anis E, Lipsitch M, et al. Infections, hospitalisations, and deaths averted via a nationwide vaccination campaign using the Pfizer\u2013BioNTech BNT162b2 mRNA COVID-19 vaccine in Israel: a retrospective surveillance study. Lancet Infect Dis. 2022;22:357\u201366.","journal-title":"Lancet Infect Dis"},{"key":"3953_CR65","doi-asserted-by":"publisher","first-page":"846","DOI":"10.1186\/s12889-022-13265-y","volume":"22","author":"J Fieselmann","year":"2022","unstructured":"Fieselmann J, Annac K, Erdsiek F, Yilmaz-Aslan Y, Brzoska P. What are the reasons for refusing a COVID-19 vaccine? A qualitative analysis of social media in Germany. BMC Public Health. 2022;22:846.","journal-title":"BMC Public Health"},{"key":"3953_CR66","doi-asserted-by":"publisher","first-page":"456","DOI":"10.1038\/s41591-022-01728-z","volume":"28","author":"E Pertwee","year":"2022","unstructured":"Pertwee E, Simas C, Larson HJ. An epidemic of uncertainty: rumors, conspiracy theories and vaccine hesitancy. Nat Med. 2022;28:456\u20139.","journal-title":"Nat Med"},{"key":"3953_CR67","doi-asserted-by":"publisher","first-page":"460","DOI":"10.1038\/s41562-020-0884-z","volume":"4","author":"JJV Bavel","year":"2020","unstructured":"Bavel JJV, Baicker K, Boggio PS, Capraro V, Cichocka A, Cikara M, et al. Using social and behavioural science to support COVID-19 pandemic response. Nat Hum Behav. 2020;4:460\u201371.","journal-title":"Nat Hum Behav"},{"key":"3953_CR68","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/S0140-6736(20)32642-8","volume":"397","author":"RA Burgess","year":"2021","unstructured":"Burgess RA, Osborne RH, Yongabi KA, Greenhalgh T, Gurdasani D, Kang G, et al. The COVID-19 vaccines rush: participatory community engagement matters more than ever. The Lancet. 2021;397:8\u201310.","journal-title":"The Lancet"},{"key":"3953_CR69","doi-asserted-by":"publisher","first-page":"366","DOI":"10.2105\/AJPH.2020.306087","volume":"111","author":"BO Ojikutu","year":"2021","unstructured":"Ojikutu BO, Stephenson KE, Mayer KH, Emmons KM. Building trust in COVID-19 vaccines and beyond through authentic community investment. Am J Public Health. 2021;111:366\u20138.","journal-title":"Am J Public Health"},{"key":"3953_CR70","doi-asserted-by":"publisher","first-page":"900","DOI":"10.3390\/vaccines9080900","volume":"9","author":"J Aw","year":"2021","unstructured":"Aw J, Seng JJB, Seah SSY, Low LL. COVID-19 vaccine hesitancy\u2014a scoping review of literature in high-income countries. Vaccines. 2021;9:900.","journal-title":"Vaccines."},{"key":"3953_CR71","doi-asserted-by":"publisher","first-page":"e416","DOI":"10.1016\/S2468-2667(21)00096-7","volume":"6","author":"D Freeman","year":"2021","unstructured":"Freeman D, Loe BS, Yu LM, Freeman J, Chadwick A, Vaccari C, et al. Effects of different types of written vaccination information on COVID-19 vaccine hesitancy in the UK (OCEANS-III): a single-blind, parallel-group, randomised controlled trial. Lancet Public Health. 2021;6:e416\u201327.","journal-title":"Lancet Public Health"},{"key":"3953_CR72","doi-asserted-by":"publisher","first-page":"1686","DOI":"10.1186\/s12889-021-11745-1","volume":"21","author":"H Azarpanah","year":"2021","unstructured":"Azarpanah H, Farhadloo M, Vahidov R, Pilote L. Vaccine hesitancy: evidence from an adverse events following immunization database, and the role of cognitive biases. BMC Public Health. 2021;21:1686.","journal-title":"BMC Public Health"},{"key":"3953_CR73","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1590\/S0100-72032013000300004","volume":"35","author":"ACR Feitosa","year":"2013","unstructured":"Feitosa ACR, Sampaio LN, Batista AGL, Pinheiro CB. Frequency of fear of needles and impact of a multidisciplinary educational approach towards pregnant women with diabetes. Rev Bras Ginecol E Obstet. 2013;35:111\u20136.","journal-title":"Rev Bras Ginecol E Obstet"},{"issue":"Sup14","key":"3953_CR74","doi-asserted-by":"publisher","first-page":"S18","DOI":"10.12968\/bjon.2012.21.Sup14.S18","volume":"21","author":"P Mackereth","year":"2012","unstructured":"Mackereth P, Hackman E, Tomlinson L, Manifold J, Orrett L. \u2018Needle with ease\u2019: rapid stress management techniques. Br J Nurs. 2012;21(Sup14):S18-22.","journal-title":"Br J Nurs"},{"key":"3953_CR75","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2021.107176","volume":"130","author":"A Honora","year":"2022","unstructured":"Honora A, Wang KY, Chih WH. How does information overload about COVID-19 vaccines influence individuals\u2019 vaccination intentions? The roles of cyberchondria, perceived risk, and vaccine skepticism. Comput Hum Behav. 2022;130: 107176.","journal-title":"Comput Hum Behav"},{"key":"3953_CR76","doi-asserted-by":"publisher","first-page":"392","DOI":"10.1007\/s12160-014-9618-7","volume":"48","author":"CI Voils","year":"2014","unstructured":"Voils CI, King HA, Maciejewski ML, Allen KD, Yancy WS Jr, Shaffer JA. Approaches for informing optimal dose of behavioral interventions. Ann Behav Med. 2014;48:392\u2013401.","journal-title":"Ann Behav Med"},{"key":"3953_CR77","doi-asserted-by":"publisher","first-page":"2361943","DOI":"10.1080\/21645515.2024.2361943","volume":"20","author":"JH Marh\u00e1nkov\u00e1","year":"2024","unstructured":"Marh\u00e1nkov\u00e1 JH, Kotherov\u00e1 Z, Numerato D. Navigating vaccine hesitancy: strategies and dynamics in healthcare professional-parent communication. Hum Vaccines Immunother. 2024;20:2361943.","journal-title":"Hum Vaccines Immunother"},{"key":"3953_CR78","doi-asserted-by":"publisher","first-page":"10860","DOI":"10.1038\/s41598-024-61205-0","volume":"14","author":"K Unfried","year":"2024","unstructured":"Unfried K, Priebe J. Vaccine hesitancy and trust in sub-Saharan Africa. Sci Rep. 2024;14:10860.","journal-title":"Sci Rep"},{"key":"3953_CR79","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1016\/S2215-0366(21)00025-0","volume":"8","author":"L Kola","year":"2021","unstructured":"Kola L, Kohrt BA, Hanlon C, Naslund JA, Sikander S, Balaji M, et al. COVID-19 mental health impact and responses in low-income and middle-income countries: reimagining global mental health. Lancet Psychiatry. 2021;8:535\u201350.","journal-title":"Lancet Psychiatry"}],"container-title":["BMC Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12916-025-03953-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12916-025-03953-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12916-025-03953-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,13]],"date-time":"2025-03-13T10:49:25Z","timestamp":1741862965000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedicine.biomedcentral.com\/articles\/10.1186\/s12916-025-03953-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,12]]},"references-count":79,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["3953"],"URL":"https:\/\/doi.org\/10.1186\/s12916-025-03953-y","relation":{},"ISSN":["1741-7015"],"issn-type":[{"value":"1741-7015","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,12]]},"assertion":[{"value":"13 August 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 February 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 March 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study was ethically approved by The Norwegian Regional Committee for Medical and Health Research Ethics (REK; reference: 125510) and the Norwegian Centre for Research Data (NSD; reference: 802810). All participants provided their consent for their data to be used in this research.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"155"}}