{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T11:48:46Z","timestamp":1770724126983,"version":"3.49.0"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2026,2,9]],"date-time":"2026-02-09T00:00:00Z","timestamp":1770595200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,2,9]],"date-time":"2026-02-09T00:00:00Z","timestamp":1770595200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010676","name":"H2020 Societal Challenges","doi-asserted-by":"publisher","award":["965280"],"award-info":[{"award-number":["965280"]}],"id":[{"id":"10.13039\/100010676","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005855","name":"Universidade Nova de Lisboa","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005855","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Can J Public Health"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>\n                      Evaluability assessment (EA), conducted independently or as part of a broader evaluation process, is performed to determine whether a program, policy, or intervention is ready and suitable for evaluation. This study explores the innovative application of EA as a design-stage tool for guiding complex health interventions. It focuses on the VAX-TRUST\u00a0\n                      <jats:italic>- Addressing Vaccine Hesitancy in Europe<\/jats:italic>\n                      project, where EA was employed to design and refine interventions addressing vaccine hesitancy across seven European regions.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      EA was applied in a qualitative approach using an\n                      <jats:italic>evaluability checklist<\/jats:italic>\n                      . This tool facilitated iterative improvements in intervention design, implementation planning, and evaluation readiness, ensuring interventions were robust and contextually relevant. Additionally, efforts were made to qualitatively measure the impact of the evaluability assessment through an\n                      <jats:italic>evaluability impact matrix<\/jats:italic>\n                      .\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results and discussion<\/jats:title>\n                    <jats:p>EA significantly influenced intervention design by identifying gaps and guiding real-time adjustments. Six of the seven interventions were successfully implemented with enhanced planning for unforeseen events, showcasing the iterative benefits of EA in the design phase. The iterative nature of EA allowed for real-time adjustments that enhanced program robustness and adaptability. Insights into the checklist\u2019s gaps, such as underdeveloped resource allocation metrics, are discussed to improve future applications.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>This work advances EA literature by demonstrating its utility in the design stage and, by reinforcing the early alignment of different components and multiple contexts, provides a replicable framework for planning complex health interventions. Future evaluators are encouraged to adopt this proactive approach for more effective public health strategies.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.17269\/s41997-026-01148-3","type":"journal-article","created":{"date-parts":[[2026,2,9]],"date-time":"2026-02-09T16:36:47Z","timestamp":1770655007000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Evaluability assessment as a design tool for complex health interventions: Insights from an EU-project on vaccine hesitancy"],"prefix":"10.17269","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6135-0747","authenticated-orcid":false,"given":"Andr\u00e9","family":"Beja","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0043-8785","authenticated-orcid":false,"given":"Rita","family":"Morais","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0505-2155","authenticated-orcid":false,"given":"C\u00e1tia","family":"S\u00e1 Guerreiro","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6015-3314","authenticated-orcid":false,"given":"Tiago","family":"Correia","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2026,2,9]]},"reference":[{"issue":"44","key":"1148_CR1","doi-asserted-by":"publisher","first-page":"6556","DOI":"10.1016\/j.vaccine.2017.08.004","volume":"36","author":"H Bedford","year":"2018","unstructured":"Bedford, H., Attwell, K., & Danchin, M. et al. (2018). Vaccine hesitancy, refusal and access barriers: The need for clarity in terminology. Vaccine, 36(44), 6556\u20136558.","journal-title":"Vaccine"},{"key":"1148_CR2","unstructured":"Bichelmeyer, B. A. (2003). Checklist for formatting checklists. The Evaluation Center, Western Michigan University. https:\/\/wmich.edu\/sites\/default\/files\/attachments\/u350\/2014\/formattingchecklist.pdf.\u00a0Accessed 24 Apr 2024."},{"issue":"3","key":"1148_CR3","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1177\/1356389019852126","volume":"25","author":"R Brunner","year":"2019","unstructured":"Brunner, R., Craig, P., & Watson, N. (2019). Evaluability assessment: An application in a complex community improvement setting. Evaluation, 25(3), 349\u2013365. https:\/\/doi.org\/10.1177\/1356389019852126","journal-title":"Evaluation"},{"key":"1148_CR4","volume-title":"Are we all scientific experts now?","author":"HM Collins","year":"2014","unstructured":"Collins, H. M. (2014). Are we all scientific experts now? Polity."},{"key":"1148_CR5","volume-title":"Evaluation and Aid Effectiveness No. 6\u2014Glossary of Key Terms in Evaluation and Results Based Management","author":"DAC-OCDE: Development Assistance Committee of the Organization for Economic Cooperation and Development","year":"2010","unstructured":"DAC-OCDE: Development Assistance Committee of the Organization for Economic Cooperation and Development. (2010). Evaluation and Aid Effectiveness No. 6\u2014Glossary of Key Terms in Evaluation and Results Based Management. OCDE publishing."},{"key":"1148_CR6","doi-asserted-by":"publisher","unstructured":"Davidson, R., Randhawa, G., & Cash, S. (2019). Identification of complex health interventions suitable for evaluation: Development and validation of the 8-Step Scoping Framework. JMIR Research Protocols, 8(3). https:\/\/doi.org\/10.2196\/10075","DOI":"10.2196\/10075"},{"key":"1148_CR7","unstructured":"Davies, R. (2013, November 18). Planning evaluability assessments: A synthesis of the literature with recommendations - Working paper 40. UK Department for International Development. https:\/\/gsdrc.org\/document-library\/planning-evaluability-assessments-a-synthesis-of-the-literature-with-recommendations\/.\u00a0Accessed 8 Feb 2023."},{"issue":"2","key":"1148_CR8","doi-asserted-by":"publisher","first-page":"216","DOI":"10.1177\/1356389015577465","volume":"21","author":"R Davies","year":"2015","unstructured":"Davies, R., & Payne, L. (2015). Evaluability assessments: Reflections on a review of the literature. Evaluation, 21(2), 216\u2013231. https:\/\/doi.org\/10.1177\/1356389015577465","journal-title":"Evaluation"},{"key":"1148_CR9","unstructured":"de Vito, E., Esposito, M., Sannella, A., Ferrara, M., Langiano, E., & Lombardi, R. (2023). Country reports on the intervention developed and implemented in target regions (VAX-TRUST deliverable 5.3). https:\/\/cordis.europa.eu\/project\/id\/965280\/results.\u00a0Accessed 29 Apr 2024."},{"key":"1148_CR10","unstructured":"de Vito, E., Esposito, M., Sannella, A., Ferrara, M., Langiano, E., Lombardi, R., & Sbaragli, S. (2022a). Guideline for intervention methodologies (Vax-Trust project Deliverable 5.2) (VAX-TRUST Deliverable No. 5.2.). https:\/\/cordis.europa.eu\/project\/id\/965280\/results.\u00a0Accessed 14 Feb 2023."},{"key":"1148_CR11","unstructured":"de Vito, E., Esposito, M., Sannella, A., Ferrara, M., Langiano, E., Lombardi, R., & Sbaragli, S. (2022b). Guidelines for the implementation of the intervention targeted at healthcare professionals agreed upon by members of the consortium (Vax-Trust project Deliverable 5.1) (VAX-TRUST Deliverable No. 5.1.). https:\/\/cordis.europa.eu\/project\/id\/965280\/results.\u00a0Accessed 14 Feb 2023."},{"key":"1148_CR12","unstructured":"ILO. (2020). Guidance Note 1.3: Procedure and Tools for Evaluability. ILO - International Labour Organization. https:\/\/www.ilo.org\/wcmsp5\/groups\/public\/---ed_mas\/---eval\/documents\/publication\/wcms_746707.pdf.\u00a0Accessed 24 Apr 2024."},{"issue":"4","key":"1148_CR13","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1177\/1098214020936769","volume":"42","author":"S Lam","year":"2021","unstructured":"Lam, S., & Skinner, K. (2021). The use of evaluability assessments in improving future evaluations: A scoping review of 10 years of literature (2008\u20132018). American Journal of Evaluation, 42(4), 523\u2013540. https:\/\/doi.org\/10.1177\/1098214020936769","journal-title":"American Journal of Evaluation"},{"key":"1148_CR14","unstructured":"Evaluation Office. (2019). Guidance note for conducting evaluability assessments in UNICEF. UNICEF. https:\/\/www.unicef.org\/evaluation.\u00a0Accessed 24 Apr 2024."},{"key":"1148_CR15","unstructured":"Ruben, R. (2012). Evaluability assessment\u2014Preparatory steps before starting an evaluation (ppt presentation). Policy and Operations Evaluation Dept. , Development Cooperation, Ministry of Foreign Affairs of the Netherlands. http:\/\/www.oecd.org\/development\/evaluationofdevelopmentprogrammes\/dcdndep\/46436210.ppt.\u00a0Accessed 8 Feb 2023."},{"key":"1148_CR16","unstructured":"S\u00e1 Guerreiro, C. S., Morais, R., Beja, A., & Correia, T. (2022). Evaluability assessment report. (Vax-Trust project Deliverable 6.1). https:\/\/cordis.europa.eu\/project\/id\/965280\/results.\u00a0Accessed 8 Feb 2023."},{"key":"1148_CR17","unstructured":"S\u00e1 Guerreiro, C. S., Morais, R., Beja, A., & Correia, T. (2024). Implementation analysis report (Vax-Trust project Deliverable 6.3). https:\/\/cordis.europa.eu\/project\/id\/965280\/results.\u00a0Accessed 3 Jan 2024."},{"key":"1148_CR18","unstructured":"SAGE: Strategic Advisory Group of Experts on Immunization. (2014). Report of SAGE working group revised report vaccine hesitancy. WHO - World Health Organization. https:\/\/www.asset-scienceinsociety.eu\/sites\/default\/files\/sage_working_group_revised_report_vaccine_hesitancy.pdf.\u00a0Accessed 8 Feb 2023."},{"key":"1148_CR19","unstructured":"Scriven, M. (2007). The logic and methodology of checklists. The Evaluation Center, Western Michigan University. https:\/\/wmich.edu\/sites\/default\/files\/attachments\/u350\/2014\/logic%26methodology_dec07.pdf.\u00a0Accessed 24 Feb 2024."},{"key":"1148_CR20","doi-asserted-by":"publisher","unstructured":"Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K. A., Craig, N., French, D. P., McIntosh, E., Petticrew, M., Rycroft-Malone, J., White, M., & Moore, L. (2021). A new framework for developing and evaluating complex interventions: Update of Medical Research Council guidance. BMJ, 374. https:\/\/doi.org\/10.1136\/bmj.n2061","DOI":"10.1136\/bmj.n2061"},{"key":"1148_CR21","unstructured":"Stufflebeam, D. L. (2000a). Guidelines for developing evaluation checklists: The checklists development checklist (CDC). The Evaluation Center, Western Michigan University. https:\/\/wmich.edu\/sites\/default\/files\/attachments\/u350\/2014\/guidelines_cdc.pdf.\u00a0Accessed\u00a024 Feb 2024."},{"key":"1148_CR22","unstructured":"Stufflebeam, D. L. (2000b). The ten commandments, constitutional amendments, and other evaluation checklists. Annual Meeting of the American Evaluation Association, Honolulu. https:\/\/www.wmich.edu\/evalctr\/checklists\/checklistpaperAEA.pdf.\u00a0Accessed 24 Feb 2024."},{"issue":"3","key":"1148_CR23","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1177\/1098214007304589","volume":"28","author":"MS Trevisan","year":"2007","unstructured":"Trevisan, M. S. (2007). Evaluability assessment from 1986 to 2006. American Journal of Evaluation, 28(3), 290\u2013303. https:\/\/doi.org\/10.1177\/1098214007304589","journal-title":"American Journal of Evaluation"},{"key":"1148_CR24","doi-asserted-by":"publisher","DOI":"10.4135\/9781483384634","volume-title":"Evaluability Assessment: Improving Evaluation Quality and Use","author":"MS Trevisan","year":"2015","unstructured":"Trevisan, M. S., & Walser, T. M. (2015). Evaluability Assessment: Improving Evaluation Quality and Use. SAGE Publications, Inc. https:\/\/doi.org\/10.4135\/9781483384634"},{"key":"1148_CR25","unstructured":"UNFPA Evaluation Office. (2019). Evaluation handbook: How to design and conduct a country programme evaluation at UNFPA. United Nations Population Fund. https:\/\/www.unfpa.org\/admin-resource\/evaluation-handbook-how-design-and-conduct-country-programme-evaluation-unfpa-2019.\u00a0Accessed 24 Feb 2024."},{"key":"1148_CR26","unstructured":"UNDOC: United Nations Office on Drugs and Crime. (2017). Evaluation Handbook Guidance for designing, conducting and using independent evaluation at UNODC. United Nations. https:\/\/www.unodc.org\/unodc\/en\/evaluation\/guidelines-and-templates.html.\u00a0Accessed 24 Feb 2024."},{"key":"1148_CR27","doi-asserted-by":"publisher","unstructured":"Vuolanto, P., Almeida, A. N., Anderson, A., Auvinen, P., Beja, A., Bracke, P., Cardano, M., Ceuterick, M., Correia, T., Vito, E. D., Delaruelle, K., Delicado, A., Esposito, M., Ferrara, M., Gariglio, L., Guerreiro, C., Marh\u00e1nkov\u00e1, J. H., Hil\u00e1rio, A. P., Hobson-West, P., \u2026 & Wagner, A. (2024). Trust matters: The Addressing Vaccine Hesitancy in Europe Study. Scandinavian Journal of Public Health. https:\/\/doi.org\/10.1177\/14034948231223791","DOI":"10.1177\/14034948231223791"},{"key":"1148_CR28","unstructured":"WHO. (2019). Ten threats to global health in 2019. World Health Organization. https:\/\/www.who.int\/news-room\/spotlight\/ten-threats-to-global-health-in-2019.\u00a0Accessed 2 May 2024."},{"key":"1148_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.socscimed.2014.04.018","volume":"112","author":"O Yaqub","year":"2014","unstructured":"Yaqub, O., Castle-Clarke, S., Sevdalis, N., & Chataway, J. (2014). Attitudes to vaccination: A critical review. Social Science & Medicine, 112, 1\u201311. https:\/\/doi.org\/10.1016\/j.socscimed.2014.04.018","journal-title":"Social Science & Medicine"},{"key":"1148_CR30","doi-asserted-by":"publisher","unstructured":"Youker, B. W., & Ballard, A. (2024). Goal-free evaluation: An orientation for foundations\u2019 evaluations \u2013 Updated 2024. The Foundation Review, 16(1).\u00a0 https:\/\/doi.org\/10.9707\/1944-5660.1697. Original work published 2014.","DOI":"10.9707\/1944-5660.1697"}],"container-title":["Canadian Journal of Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.17269\/s41997-026-01148-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.17269\/s41997-026-01148-3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.17269\/s41997-026-01148-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,9]],"date-time":"2026-02-09T16:36:50Z","timestamp":1770655010000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.17269\/s41997-026-01148-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,9]]},"references-count":30,"alternative-id":["1148"],"URL":"https:\/\/doi.org\/10.17269\/s41997-026-01148-3","relation":{},"ISSN":["0008-4263","1920-7476"],"issn-type":[{"value":"0008-4263","type":"print"},{"value":"1920-7476","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,9]]},"assertion":[{"value":"27 March 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 January 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 February 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}