{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T18:24:23Z","timestamp":1777487063237,"version":"3.51.4"},"reference-count":41,"publisher":"Aboutscience Srl","issue":"1","license":[{"start":{"date-parts":[[2026,4,27]],"date-time":"2026-04-27T00:00:00Z","timestamp":1777248000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Grhta"],"abstract":"<jats:p>Introduction: Influenza vaccines are formulated each year to prevent serious illness in at-risk individuals, includingelderly people. Healthcare decision-making is mainly based on the economic evaluations (EEs) (i.e., costeffectivenessanalysis [CEA]) of vaccines; however, understanding the limitations of these models and correctlyinterpreting the results may be challenging. Here, we provide a practical Guide that will help readers who are notexperts in the field of health economics or influenza to critically review influenza vaccine EEs.Methods: This Guide is based on the findings of a systematic review of the literature, a critical analysis of theavailable EEs published for influenza vaccines for older adults in Spain, and applicable national and internationalguidelines on EE and influenza modeling. It has been developed by a multidisciplinary board of experts in influenza,vaccines, and health economics.Results: The guide provides tips to help the reader assess whether an EE design is fit for its purpose in terms ofcomparators, time horizon, perspective of the analysis, population analyzed, and whether appropriate modelingmethods were applied. It detects the uncertainty arising from input data and the implications of this uncertaintyon the results.Conclusions: Ultimately, this resource aims to empower decision-makers, particularly those without expertise inhealth economics or vaccinology, to critically read and interpret EEs, thus favoring evidence-based informed decisionsthat will improve the efficiency of influenza vaccination programs.<\/jats:p>","DOI":"10.33393\/grhta.2026.3619","type":"journal-article","created":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T14:34:09Z","timestamp":1777386849000},"page":"95-108","source":"Crossref","is-referenced-by-count":0,"title":["A guide to critical reading of influenza vaccine cost-effectiveness analyses"],"prefix":"10.33393","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4117-1186","authenticated-orcid":false,"given":"Ra\u00fal","family":"Ortiz de Lejarazu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2791-979X","authenticated-orcid":false,"given":"Esther","family":"Redondo Marg\u00fcello","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Angel","family":"Gil de Miguel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9023-581X","authenticated-orcid":false,"given":"Federico","family":"Martinon Torres","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Javier","family":"Diez Domingo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juan L.","family":"L\u00f3pez-Belmonte Claver","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ariadna","family":"Diaz-Aguilo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-6345-1656","authenticated-orcid":false,"given":"J. Manel","family":"Farr\u00e9 Avell\u00e0","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paloma I.","family":"Palomo Jim\u00e9nez","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5656-4567","authenticated-orcid":false,"given":"Jose Maria","family":"Abella Perpi\u00f1an","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"18642","published-online":{"date-parts":[[2026,4,27]]},"reference":[{"key":"19357","unstructured":"World Health Organization. Influenza (Seasonal). 2023. Online https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/influenza-(seasonal) (Accessed August 2025)."},{"key":"19358","unstructured":"Grupo de Trabajo Criterios 2011 de la Ponencia de Programa y Registro de Vacunaciones. Criterios de Evaluaci\u00f3n para Fundamentar Modificaciones en el Programa de Vacunaci\u00f3n en Espa\u00f1a. Ministerio de Sanidad; 2011. https:\/\/www.sanidad.gob.es\/ciudadanos\/proteccionSalud\/vacunaciones\/docs\/Criterios_ProgramaVacunas.pdf"},{"key":"19359","doi-asserted-by":"crossref","unstructured":"Caro JJ, Briggs AH, Siebert U, et al.; ISPOR-SMDM Modeling Good Research Practices Task Force. Modeling good research practices--overview: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--1. Value Health. 2012;15(6):796-803. https:\/\/doi.org\/10.1016\/j.jval.2012.06.012 PMID:22999128","DOI":"10.1016\/j.jval.2012.06.012"},{"key":"19360","doi-asserted-by":"crossref","unstructured":"L\u00f3pez Bastida J, Oliva J, Anto\u00f1anzas F, et al. A proposed guideline for economic evaluation of health technologies. Gac Sanit. 2010;24(2):154-170. https:\/\/doi.org\/10.1016\/j.gaceta.2009.07.011 PMID:19959258","DOI":"10.1016\/j.gaceta.2009.07.011"},{"key":"19361","unstructured":"World Health Organization. WHO guide for standardization of economic evaluations of immunization programmes. 2019. Online https:\/\/www.who.int\/publications\/i\/item\/who-guide-for-standardization-of-economic-evaluations-of-immunization-programmes-2nd-ed (Accessed August 2025)"},{"key":"19362","doi-asserted-by":"crossref","unstructured":"Newall AT, Chaiyakunapruk N, Lambach P, et al. WHO guide on the economic evaluation of influenza vaccination. Influenza Other Respir Viruses. 2018;12(2):211-219. https:\/\/doi.org\/10.1111\/irv.12510 PMID:29024434","DOI":"10.1111\/irv.12510"},{"key":"19363","doi-asserted-by":"crossref","unstructured":"Ortiz-de-Lejarazu Leonardo R, D\u00edez Domingo J, de Miguel \u00c1G, et al. Critical assessment of uncertainty in economic evaluations on influenza vaccines for the elderly population in Spain. BMC Infect Dis. 2025;25(1):152. https:\/\/doi.org\/10.1186\/s12879-025-10442-3 PMID:39893473","DOI":"10.1186\/s12879-025-10442-3"},{"key":"19364","doi-asserted-by":"crossref","unstructured":"Grimm SE, Pouwels X, Ramaekers BLT, et al. Development and validation of the TRansparent Uncertainty ASsessmenT (TRUST) Tool for assessing uncertainties in health economic decision models. PharmacoEconomics. 2020;38(2):205-216. https:\/\/doi.org\/10.1007\/s40273-019-00855-9 PMID:31709496","DOI":"10.1007\/s40273-019-00855-9"},{"key":"19365","doi-asserted-by":"crossref","unstructured":"Briggs AH, Weinstein MC, Fenwick EA, et al.; ISPOR-SMDM Modeling Good Research Practices Task Force. Model parameter estimation and uncertainty analysis: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force Working Group-6. Med Decis Making. 2012;32(5):722-732. https:\/\/doi.org\/10.1177\/0272989X12458348 PMID:22990087","DOI":"10.1177\/0272989X12458348"},{"key":"19366","doi-asserted-by":"crossref","unstructured":"Rubio-Terr\u00e9s C, Cobo E, Sacrist\u00e1n JA, et al.; Grupo ECOMED. [Analysis of uncertainty in the economic assessment of health interventions]. Med Clin (Barc). 2004;122(17):668-674. https:\/\/doi.org\/10.1016\/S0025-7753(04)74346-8 PMID:15153348","DOI":"10.1157\/13061390"},{"key":"19367","doi-asserted-by":"crossref","unstructured":"Briggs AH. Handling uncertainty in cost-effectiveness models. PharmacoEconomics. 2000;17(5):479-500. https:\/\/doi.org\/10.2165\/00019053-200017050-00006 PMID:10977389","DOI":"10.2165\/00019053-200017050-00006"},{"key":"19368","doi-asserted-by":"crossref","unstructured":"Briggs AH, Gray AM. Handling uncertainty when performing economic evaluation of healthcare interventions. Health Technol Assess. 1999;3(2):1-134. https:\/\/doi.org\/10.3310\/hta3020 PMID:10448202","DOI":"10.3310\/hta3020"},{"key":"19369","doi-asserted-by":"crossref","unstructured":"Brisson M, Edmunds WJ. Impact of model, methodological, and parameter uncertainty in the economic analysis of vaccination programs. Med Decis Making. 2006;26(5):434-446. https:\/\/doi.org\/10.1177\/0272989X06290485 PMID:16997923","DOI":"10.1177\/0272989X06290485"},{"key":"19370","unstructured":"Soto J, Casado M, Oyag\u00fcez I. Modelos anal\u00edticos de decisi\u00f3n en evaluaci\u00f3n econ\u00f3mica: tipos, metodolog\u00eda, an\u00e1lisis y comunicaci\u00f3n de los resultados. Online https:\/\/fundacionporib.org\/wp-content\/uploads\/2024\/05\/Libro-Fundacion-PORIB-Modelos-Analiticos-de-Decision-en-Evaluacion-Economica.pdf (Accessed August 2025)."},{"key":"19371","doi-asserted-by":"crossref","unstructured":"Pitman R, Fisman D, Zaric GS, et al.; ISPOR-SMDM Modeling Good Research Practices Task Force. Dynamic transmission modeling: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force Working Group-5. Med Decis Making. 2012;32(5):712-721. https:\/\/doi.org\/10.1177\/0272989X12454578 PMID:22990086","DOI":"10.1177\/0272989X12454578"},{"key":"19372","doi-asserted-by":"crossref","unstructured":"Roberts M, Russell LB, Paltiel AD, et al.; ISPOR-SMDM Modeling Good Research Practices Task Force. Conceptualizing a model: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force-2. Med Decis Making. 2012;32(5):678-689. https:\/\/doi.org\/10.1177\/0272989X12454941 PMID:22990083","DOI":"10.1177\/0272989X12454941"},{"key":"19373","doi-asserted-by":"crossref","unstructured":"Siebert U, Alagoz O, Bayoumi AM, et al.; ISPOR-SMDM Modeling Good Research Practices Task Force. State-transition modeling: a report of the ISPOR-SMDM modeling good research practices task force-3. Value Health. 2012;15(6):812-820. https:\/\/doi.org\/10.1016\/j.jval.2012.06.014 PMID:22999130","DOI":"10.1016\/j.jval.2012.06.014"},{"key":"19374","unstructured":"Drummond MF, Sculpher MJ, Claxton K, et al. Methods for the economic evaluation of health care programmes. Oxford University Press; 2015."},{"key":"19375","unstructured":"Ministerio de Sanidad. Gu\u00eda de Evaluaci\u00f3n Econ\u00f3mica de Medicamentos. Online https:\/\/www.sanidad.gob.es\/areas\/farmacia\/comitesAdscritos\/prestacionFarmaceutica\/docs\/20240227_CAPF_Guia_EE_definitiva.pdf (Accessed August 2025)."},{"key":"19376","doi-asserted-by":"crossref","unstructured":"Brouwer WB, Niessen LW, Postma MJ, et al. Need for differential discounting of costs and health effects in cost effectiveness analyses. BMJ. 2005;331(7514):446-448. https:\/\/doi.org\/10.1136\/bmj.331.7514.446 PMID:16110075","DOI":"10.1136\/bmj.331.7514.446"},{"key":"19377","doi-asserted-by":"crossref","unstructured":"John J, Koerber F, Schad M. Differential discounting in the economic evaluation of healthcare programs. Cost Eff Resour Alloc. 2019;17(1):29. https:\/\/doi.org\/10.1186\/s12962-019-0196-1 PMID:31866768","DOI":"10.1186\/s12962-019-0196-1"},{"key":"19378","doi-asserted-by":"crossref","unstructured":"Sharma D, Aggarwal AK, Downey LE, et al. National healthcare economic evaluation guidelines: a cross-country comparison. PharmacoEconom Open. 2021;5(3):349-364. https:\/\/doi.org\/10.1007\/s41669-020-00250-7 PMID:33423205","DOI":"10.1007\/s41669-020-00250-7"},{"key":"19379","unstructured":"Consejo Interterritorial del Sistema Nacional de Salud. Recomendaciones de vacunaci\u00f3n frente a la gripe. 2022. Online https:\/\/www.sanidad.gob.es\/profesionales\/saludPublica\/prevPromocion\/vacunaciones\/programasDeVacunacion\/docs\/Recomendaciones_vacunacion_gripe.pdf (Accessed December 2025)."},{"key":"19380","unstructured":"Sistema Nacional de Salud. Calendario com\u00fan de vacunaci\u00f3n a lo largo de toda la vida. Calendario recomendado a\u00f1o 2023. Online https:\/\/www.sanidad.gob.es\/areas\/promocionPrevencion\/vacunaciones\/calendario-y-coberturas\/docs\/CalendarioVacunacion_Todalavida.pdf (Accessed August 2025)."},{"key":"19381","doi-asserted-by":"crossref","unstructured":"Walker WE, Harremo\u00ebs P, Rotmans J, et al. Defining uncertainty: a conceptual basis for uncertainty management in model-based decision support. Integrated Assess. 2003;4(1):5-17. https:\/\/doi.org\/10.1076\/iaij.4.1.5.16466","DOI":"10.1076\/iaij.4.1.5.16466"},{"key":"19382","unstructured":"World Health Organization. A manual for estimating disease burden associated with seasonal influenza. Online https:\/\/iris.who.int\/server\/api\/core\/bitstreams\/36c693b2-0e4f-4f93-b09f-7266d0f3ccb0\/content (Accessed August 2025)."},{"key":"19383","doi-asserted-by":"crossref","unstructured":"Eddy DM, Hollingworth W, Caro JJ, et al.; ISPOR-SMDM Modeling Good Research Practices Task Force. Model transparency and validation: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force-7. Med Decis Making. 2012;32(5):733-743. https:\/\/doi.org\/10.1177\/0272989X12454579 PMID:22990088","DOI":"10.1177\/0272989X12454579"},{"key":"19384","doi-asserted-by":"crossref","unstructured":"Shea BJ, Reeves BC, Wells G, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomized or non-randomized studies of healthcare interventions, or both. BMJ. 2017;358:j4008. https:\/\/doi.org\/10.1136\/bmj.j4008 PMID:28935701","DOI":"10.1136\/bmj.j4008"},{"key":"19385","doi-asserted-by":"crossref","unstructured":"Djulbegovic B, Guyatt GH. Progress in evidence-based medicine: a quarter century on. Lancet. 2017;390(10092):415-423. https:\/\/doi.org\/10.1016\/S0140-6736(16)31592-6 PMID:28215660","DOI":"10.1016\/S0140-6736(16)31592-6"},{"key":"19386","doi-asserted-by":"crossref","unstructured":"Balshem H, Helfand M, Sch\u00fcnemann HJ, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol. 2011;64(4):401-406. https:\/\/doi.org\/10.1016\/j.jclinepi.2010.07.015 PMID:21208779","DOI":"10.1016\/j.jclinepi.2010.07.015"},{"key":"19387","doi-asserted-by":"crossref","unstructured":"Murad MH, Asi N, Alsawas M, et al. New evidence pyramid. Evid Based Med. 2016;21(4):125-127. https:\/\/doi.org\/10.1136\/ebmed-2016-110401 PMID:27339128","DOI":"10.1136\/ebmed-2016-110401"},{"key":"19388","doi-asserted-by":"crossref","unstructured":"Guyatt G, Oxman AD, Akl EA, et al. GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383-394. https:\/\/doi.org\/10.1016\/j.jclinepi.2010.04.026 PMID:21195583","DOI":"10.1016\/j.jclinepi.2010.04.026"},{"key":"19389","doi-asserted-by":"crossref","unstructured":"Demicheli V, Jefferson T, Di Pietrantonj C, et al. Vaccines for preventing influenza in the elderly. Cochrane Database Syst Rev. 2018;2(2):CD004876. https:\/\/doi.org\/10.1002\/14651858.CD004876.pub4 PMID:29388197","DOI":"10.1002\/14651858.CD004879.pub5"},{"key":"19390","doi-asserted-by":"crossref","unstructured":"Sterne JAC, Savovi\u0107 J, Page MJ, et al. RoB 2: a revised tool for assessing risk of bias in randomized trials. BMJ. 2019;366:l4898. https:\/\/doi.org\/10.1136\/bmj.l4898 PMID:31462531","DOI":"10.1136\/bmj.l4898"},{"key":"19391","doi-asserted-by":"crossref","unstructured":"Sterne JA, Hern\u00e1n MA, Reeves BC, et al. ROBINS-I: a tool for assessing risk of bias in non-randomized studies of interventions. BMJ. 2016;355:i4919. https:\/\/doi.org\/10.1136\/bmj.i4919 PMID:27733354","DOI":"10.1136\/bmj.i4919"},{"key":"19392","unstructured":"Wells GA, Shea B, O'Connell D, et al. The Newcastle Ottawa Scale (NOS) for assessing the quality of nonrandomized studies in meta analyses. Ottawa: Ottawa Hospital Research Institute; 2000. Online https:\/\/www.ohri.ca\/programs\/clinical_epidemiology\/oxford.asp (Accessed August 2025)"},{"key":"19393","unstructured":"NICE. NICE technology appraisal and highly specialized technologies guidance: the manual. 2022. Online https:\/\/www.nice.org.uk\/process\/pmg36 (Accessed August 2025)."},{"key":"19394","doi-asserted-by":"crossref","unstructured":"Claxton K, Sculpher M, McCabe C, et al. Probabilistic sensitivity analysis for NICE technology assessment: not an optional extra. Health Econ. 2005;14(4):339-347. https:\/\/doi.org\/10.1002\/hec.985 PMID:15736142","DOI":"10.1002\/hec.985"},{"key":"19395","doi-asserted-by":"crossref","unstructured":"Trueman P, Drummond M, Hutton J. Developing guidance for budget impact analysis. PharmacoEconomics. 2001;19(6):609-621. https:\/\/doi.org\/10.2165\/00019053-200119060-00001 PMID:11456210","DOI":"10.2165\/00019053-200119060-00001"},{"key":"19396","doi-asserted-by":"crossref","unstructured":"Husereau D, Drummond M, Augustovski F, et al.; CHEERS 2022 ISPOR Good Research Practices Task Force. Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 2022) Statement: updated reporting guidance for health economic evaluations. Value Health. 2022;25(1):3-9. https:\/\/doi.org\/10.1016\/j.jval.2021.11.1351 PMID:35031096","DOI":"10.1016\/j.jval.2021.11.1351"},{"key":"19397","doi-asserted-by":"crossref","unstructured":"Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372(371):n71. https:\/\/doi.org\/10.1136\/bmj.n71 PMID:33782057","DOI":"10.1136\/bmj.n71"}],"container-title":["Global and Regional Health Technology Assessment"],"original-title":[],"link":[{"URL":"https:\/\/journals.aboutscience.eu\/index.php\/grhta\/article\/download\/3619\/4307","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.aboutscience.eu\/index.php\/grhta\/article\/download\/3619\/4309","content-type":"application\/epub+zip","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.aboutscience.eu\/index.php\/grhta\/article\/download\/3619\/4307","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T14:34:53Z","timestamp":1777386893000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.aboutscience.eu\/index.php\/grhta\/article\/view\/3619"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,27]]},"references-count":41,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,3,4]]}},"URL":"https:\/\/doi.org\/10.33393\/grhta.2026.3619","relation":{},"ISSN":["2283-5733","2284-2403"],"issn-type":[{"value":"2283-5733","type":"electronic"},{"value":"2284-2403","type":"print"}],"subject":[],"published":{"date-parts":[[2026,4,27]]}}}