{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,13]],"date-time":"2026-07-13T14:20:59Z","timestamp":1783952459558,"version":"3.55.0"},"reference-count":35,"publisher":"Pan American Health Organization","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,7,13]]},"abstract":"<title>ABSTRACT<\/title>\n                  <p>The World Health Organization (WHO) and Pan American Health Organization (PAHO) make statistical software scripts freely available to conduct standardized analysis of vaccination coverage surveys. The software and accompanying documentation are named the Vaccination Coverage Quality Indicators (VCQI). The software examines data from child vaccination records and caregiver recall to calculate indicators of vaccination access, coverage, continuity, and quality. VCQI produces output tables and figures that may be copied directly into reports and presentations, as well as survey response data sets augmented with child-level outcome indicator variables calculated according to WHO guidance. It can analyze data from routine immunization surveys, post-campaign coverage surveys, and maternal tetanus coverage surveys. VCQI may be used for either the primary analysis of data from new surveys or secondary analysis of earlier surveys. It can analyze data from USAID Demographic and Health Surveys, UNICEF Multiple-Indicator Cluster Surveys, or WHO Expanded Programme on Immunization surveys. Future versions of VCQI may be extended to analyze data from electronic immunization registries.<\/p>\n                  <p>VCQI has been available as a set of Stata scripts since 2015, and as of 2025, the core routine immunization indicators are also available as a new R package named vcqiR.<\/p>\n                  <p>To publicize VCQI\u2019s features and capabilities and to celebrate the milestone of R package availability, the authors share this special report to describe the VCQI vision and design, discuss analyses and insights available from it, and map our vision of what the future may hold for flexible standardized analysis of vaccination coverage data.<\/p>","DOI":"10.26633\/rpsp.2026.60","type":"journal-article","created":{"date-parts":[[2026,7,13]],"date-time":"2026-07-13T13:39:08Z","timestamp":1783949948000},"page":"1","source":"Crossref","is-referenced-by-count":0,"title":["Vaccination Coverage Quality Indicators (VCQI): a flexible open-source tool for survey data analysis"],"prefix":"10.26633","volume":"50","author":[{"given":"Dale A.","family":"Rhoda","sequence":"first","affiliation":[{"name":"https:\/\/orcid.org\/0000-0003-0948-1368"},{"name":"Biostat Global Consulting, Worthington, Ohio, United States of America."},{"name":"Dale.Rhoda@biostatglobal.com"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Caitlin B.","family":"Clary","sequence":"additional","affiliation":[{"name":"https:\/\/orcid.org\/0000-0001-7283-749X"},{"name":"Biostat Global Consulting, Worthington, Ohio, United States of America."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mary Kay","family":"Trimner","sequence":"additional","affiliation":[{"name":"https:\/\/orcid.org\/0000-0003-3591-1579"},{"name":"Biostat Global Consulting, Worthington, Ohio, United States of America."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mia","family":"Yu","sequence":"additional","affiliation":[{"name":"https:\/\/orcid.org\/0000-0003-1030-7092"},{"name":"Biostat Global Consulting, Worthington, Ohio, United States of America."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer","family":"Brustrom","sequence":"additional","affiliation":[{"name":"https:\/\/orcid.org\/0000-0002-5865-3595"},{"name":"Biostat Global Consulting, Worthington, Ohio, United States of America."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marcela","family":"Contreras","sequence":"additional","affiliation":[{"name":"https:\/\/orcid.org\/0009-0001-0620-9740"},{"name":"Pan American Health Organization, Comprehensive Immunization Program, Washington, DC, United States of America."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"M. Carolina","family":"Danovaro-Holliday","sequence":"additional","affiliation":[{"name":"https:\/\/orcid.org\/0000-0001-7324-9198"},{"name":"Department of Immunization, Vaccines and Biologicals, World Health Organization, Geneva, Switzerland."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martha","family":"Velandia-Gonz\u00e1lez","sequence":"additional","affiliation":[{"name":"https:\/\/orcid.org\/0000-0002-7636-3604"},{"name":"Pan American Health Organization, Comprehensive Immunization Program, Washington, DC, United States of America."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"11167","reference":[{"key":"ref1","unstructured":"Biostat Global Consulting. Vaccination Coverage Quality Indicators (VCQI) Resources [Internet]; 2017 [cited 2025 Dec 4]. Available from: http:\/\/www.biostatglobal.com\/VCQI_resources.html"},{"key":"ref2","doi-asserted-by":"crossref","unstructured":"Danovaro-Holliday MC, Rhoda DA, Lacoul M, Prier ML, Gautam JS, Pokhrel TN, et al. Who gets vaccinated in a measles-rubella campaign in Nepal?: results from a post-campaign coverage survey. BMC Public Health. 2022 Dec;22(1):221. https:\/\/doi.org\/10.1186\/s12889-021-12475-0","DOI":"10.1186\/s12889-021-12475-0"},{"key":"ref3","doi-asserted-by":"crossref","unstructured":"Rhoda D, Soofi SB, Hussain I, Khan A, Umer M, Ahmad I, et al. Third-Party Verification Immunization Coverage Survey (TPVICS) Round 2 vaccination coverage quality indicators (VCQI) analyses survey report [Internet]. Gates Open Research; 2023 [cited 2025 Oct 27]. Available from: https:\/\/gatesopenresearch.org\/documents\/9-87 https:\/\/doi.org\/10.21955\/GATESOPENRES.1117237.1","DOI":"10.21955\/gatesopenres.1117237.1"},{"key":"ref4","unstructured":"National Bureau of Statistics, United Nations Children\u2019s Fund. Nigeria Multiple Indicator Cluster Survey 2021, Survey Findings Report [Internet]; 2022 [cited 2025 Nov 25]. Available from: https:\/\/www.unicef.org\/nigeria\/reports\/2021-multiple-indicator-cluster-survey-national-immunization-coverage-survey-report"},{"key":"ref5","unstructured":"Clary CB, Yu M, Rhoda DA. vcqiR: an R package to analyze data from vaccination coverage surveys [Internet]; 2025 [cited 2025 Dec 4]. Available from: https:\/\/github.com\/BiostatGlobalConsulting\/vcqiR"},{"key":"ref6","unstructured":"World Health Organization. Vaccination coverage cluster surveys: reference manual [Internet]. 2018 [cited 2022 Aug 29]. Available from: https:\/\/apps.who.int\/iris\/handle\/10665\/272820"},{"key":"ref7","unstructured":"Cushnie A, Rhoda DA, Clary CB, Brustrom J, Trimner MK, Bertacchini F, Ojeda P, Martha Velandia-Gonz\u00e1lez. Assessing vaccination coverage quality in Jamaica during COVID-19 using vcqiR: insights from the 2022 MICS. Rev Panam Salud Publica. 2026;50:49. https:\/\/doi.org\/10.26633\/RPSP.2026"},{"key":"ref8","unstructured":"World Health Organization, UNICEF. WHO\/UNICEF estimates of national immunization coverage [Internet]; 2025 [cited 2025 Oct 23]. Available from: https:\/\/www.who.int\/teams\/immunization-vaccines-and-biologicals\/immunization-analysis-and-insights\/global-monitoring\/immunization-coverage\/who-unicef-estimates-of-national-immunization-coverage"},{"key":"ref9","unstructured":"World Health Organization. Training for mid-level managers - evaluate vaccination coverage. Geneva: World Health Organization Expanded Programme on Immunization in cooperation with US Department of Health and Human Services, Public Health Service, Centers for Disease Control; 1979."},{"key":"ref10","unstructured":"World Health Organization (WHO). Training for mid-level managers: the EPI coverage survey. Geneva: WHO; 1991."},{"key":"ref11","unstructured":"World Health Organization. Immunization coverage cluster survey: reference manual [Internet]; 2005 [cited 2025 Sep 8]. Available from: https:\/\/iris.who.int\/handle\/10665\/69087"},{"key":"ref12","unstructured":"Pan American Health Organization. Tools for monitoring the coverage of integrated public health interventions. Vaccination and deworming of soil-transmitted helminthiasis [Internet]. Module 6. Analysis of data from surveys and nominal registries; 2017. Available from: https:\/\/iris.paho.org\/handle\/10665.2\/34510"},{"key":"ref13","doi-asserted-by":"crossref","unstructured":"Danovaro-Holliday MC, Dansereau E, Rhoda DA, Brown DW, Cutts FT, Gacic-Dobo M. Collecting and using reliable vaccination coverage survey estimates: Summary and recommendations from the \u201cMeeting to share lessons learnt from the roll-out of the updated WHO Vaccination Coverage Cluster Survey Reference Manual and to set an operational research agenda around vaccination coverage surveys\u201d, Geneva, 18\u201321 April 2017. Vaccine. 2018 Aug;36(34):5150\u20139. doi:10.1016\/j.vaccine.2018.07.019","DOI":"10.1016\/j.vaccine.2018.07.019"},{"key":"ref14","unstructured":"Henderson RH, Sundaresan T. Cluster sampling to assess immunization coverage: a review of experience with a simplified sampling method. Bull World Health Organ. 1982;60(2):253."},{"key":"ref15","unstructured":"Bennett S, Woods T, Liyanage WM, Smith DL. A simplified general method for cluster-sample surveys of health in developing countries. World Health Stat Q 1991;44(3):98\u2013106."},{"key":"ref16","doi-asserted-by":"crossref","unstructured":"Brogan D, Flagg EW, Deming M, Waldman R. Increasing the accuracy of the Expanded Programme on Immunization\u2019s cluster survey design. Ann Epidemiol. 1994 Jul;14(4):302\u201311.","DOI":"10.1016\/1047-2797(94)90086-8"},{"key":"ref17","doi-asserted-by":"crossref","unstructured":"Grais RF, Rose AM, Guthmann JP. Don\u2019t spin the pen: two alternative methods for second-stage sampling in urban cluster surveys. Emerg Themes Epidemiol. 2007;4(1):8. https:\/\/doi.org\/10.1186\/1742-7622-4-8","DOI":"10.1186\/1742-7622-4-8"},{"key":"ref18","doi-asserted-by":"crossref","unstructured":"Turner AG, Magnani RJ, Shuaib M. A not quite as quick but much cleaner alternative to the Expanded Programme on Immunization (EPI) cluster survey design. Int J Epidemiol. 1996;25(1):198\u2013203. https:\/\/doi.org\/10.1093\/ije\/25.1.198","DOI":"10.1093\/ije\/25.1.198"},{"key":"ref19","unstructured":"Henderson RH. Immunising the children of the world. Hyderabad: Orient Blackswan Private Limited; 2016."},{"key":"ref20","doi-asserted-by":"crossref","unstructured":"Rhoda DA, Prier ML, Clary CB, Trimner MK, Velandia-Gonzalez M, Danovaro-Holliday MC, et al. Using household surveys to assess missed opportunities for simultaneous vaccination: longitudinal examples from Colombia and Nigeria. Vaccines. 2021 Jul 16;9(7):795. https:\/\/doi.org\/10\/gn3ngj","DOI":"10.3390\/vaccines9070795"},{"key":"ref21","unstructured":"Desv\u00e9 G, Havreng JF, Brenner E. Coverage Survey Analysis System (COSAS) 4.3 - Software for EPI 30 cluster coverage surveys. EPICENTRE; 1991."},{"key":"ref22","unstructured":"Rhoda DA. VCQI indicator list with specifications, draft version 2.2 [Internet]. Biostat Global Consulting; 2021 [cited 2021 May 31]. 104 p. Available from: http:\/\/www.biostatglobal.com\/downloads\/VCQI%20Indicator%20List%20with%20Specifications.pdf"},{"key":"ref23","doi-asserted-by":"crossref","unstructured":"Dean N, Pagano M. Evaluating confidence interval methods for binomial proportions in clustered surveys. J Surv Stat Methodol. 2015 Dec;3(4):484\u2013503. https:\/\/doi.org\/10.1093\/jssam\/smv024","DOI":"10.1093\/jssam\/smv024"},{"key":"ref24","unstructured":"Rhoda DA, Prier ML, Trimner MK. VCQI forms and variable list (FVL) document, draft version 1.7 [Internet]. Biostat Global Consulting; 2021 [cited 2021 May 26]. Available from: http:\/\/www.biostatglobal.com\/downloads\/VCQI%20Forms%20and%20Variable%20List%20(FVL)%20Document.pdf"},{"key":"ref25","unstructured":"Rhoda DA, Trimner MK, Albani T. VCQI interpretation quick reference, draft version 1.5 [Internet]. Biostat Global Consulting; 2021 [cited 2020 Apr 16]. 28 p. Available from: http:\/\/www.biostatglobal.com\/downloads\/VCQI%20Interpretation%20Quick%20Reference.pdf"},{"key":"ref26","unstructured":"Rhoda DA, Trimner MK, Prier ML, Clary, Caitlin B. VCQI user\u2019s guide, draft version 2.9 [Internet]. Biostat Global Consulting; 2021 [cited 2021 May 26]. 239 p. Available from: http:\/\/www.biostatglobal.com\/downloads\/VCQI%20User\u2019s%20Guide.pdf"},{"key":"ref27","unstructured":"Rhoda DA, Trimner MK, Prier ML, Clary CB, Yu M. VCQI R user\u2019s guide, draft version 1.01 [Internet]. Biostat Global Consulting; 2023 [cited 2024 Jul 4]. 158 p. Available from: https:\/\/www.biostatglobal.com\/downloads\/VCQI%20R%20User\u2019s%20Guide.pdf"},{"key":"ref28","unstructured":"GitHub. Pull requests documentation [Internet]; 2025 [cited 2025 Oct 27]. Available from: https:\/\/docs.github.com\/en\/pull-requests"},{"key":"ref29","doi-asserted-by":"crossref","unstructured":"Wagai JN, Rhoda DA, Prier ML, Trimner MK, Clary CB, Oteri J, et al. Implementing WHO guidance on conducting and analysing vaccination coverage cluster surveys: two examples from Nigeria. PLOS ONE. 2021 Feb 26;16(2):e0247415. https:\/\/doi.org\/10\/gn3ngf","DOI":"10.1371\/journal.pone.0247415"},{"key":"ref30","doi-asserted-by":"crossref","unstructured":"Tamuzi JL, Katoto PDMC, Ndwandwe DE, Wiysonge CS, Nyasulu PS. Prevalence of missed opportunities for vaccination (MOV) indicators among children aged 12\u201323 months in Sub-Saharan African countries: an individual-level meta-analysis of DHS and MICS national household data surveys. Hum Vaccines Immunother. 2025 Dec 31;21(1):2510714. https:\/\/doi.org\/10.1080\/21645515.2025.2510714","DOI":"10.1080\/21645515.2025.2510714"},{"key":"ref31","unstructured":"IPUMS Center for Data Integration. IPUMS global health [Internet]; 2025 [cited 2025 Nov 25]. Available from: https:\/\/globalhealth.ipums.org\/"},{"key":"ref32","doi-asserted-by":"crossref","unstructured":"Danovaro-Holliday MC, Koh M, Steulet C, Rhoda DA, Trimner MK. Lessons from recent measles post-campaign coverage surveys worldwide. Vaccines. 2024 Nov 6;12(11):1257. https:\/\/doi.org\/10.3390\/vaccines12111257","DOI":"10.3390\/vaccines12111257"},{"key":"ref33","unstructured":"Gavi. Vaccine Funding Guidelines [Internet]. Gavi, The Vaccine Alliance; 2024 [cited 2025 Nov 5]. Available from: https:\/\/www.gavi.org\/sites\/default\/files\/support\/guidelines-2024\/GAVI-Vaccine-Funding-Guidelines-aug2024.pdf"},{"key":"ref34","unstructured":"Rhoda DA. Making good use of VCQI supplemental immunization activity (SIA) or post campaign coverage survey (PCCS) output [Internet]. Biostat Global Consulting; 2025 [cited 2025 Nov 25]. Available from: https:\/\/www.biostatglobal.com\/downloads\/Making%20Good%20Use%20of%20VCQI%20SIA%20(PCCS)%20Output%20-%20Public.pdf"},{"key":"ref35","unstructured":"Clary CB, Rhoda DA. Missed opportunities for vaccination - VCQI - R Shiny Tool [R Shiny Tool] [Internet]. 2020 [cited 2020 Sep 25]. Available from: https:\/\/biostat-global-consulting.shinyapps.io\/MOV_Tool_Public\/"}],"container-title":["Revista Panamericana de Salud P\u00fablica"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/iris.paho.org\/bitstreams\/ba04cd7d-399c-4188-bb37-607054d6c24a\/download","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,13]],"date-time":"2026-07-13T13:39:13Z","timestamp":1783949953000},"score":1,"resource":{"primary":{"URL":"https:\/\/iris.paho.org\/handle\/10665.2\/71760"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,13]]},"references-count":35,"alternative-id":["RPSP.2026.60"],"URL":"https:\/\/doi.org\/10.26633\/rpsp.2026.60","relation":{},"ISSN":["1020-4989","1680-5348"],"issn-type":[{"value":"1020-4989","type":"print"},{"value":"1680-5348","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,13]]}}}