{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T07:16:09Z","timestamp":1767856569696,"version":"3.49.0"},"reference-count":27,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,6,24]],"date-time":"2022-06-24T00:00:00Z","timestamp":1656028800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Chinese Center for Disease Control and Prevention","award":["131031001000200001"],"award-info":[{"award-number":["131031001000200001"]}]},{"name":"Chinese Center for Disease Control and Prevention","award":["OPP 1193638"],"award-info":[{"award-number":["OPP 1193638"]}]},{"name":"Bill &amp; Melinda Gates Foundation","award":["131031001000200001"],"award-info":[{"award-number":["131031001000200001"]}]},{"name":"Bill &amp; Melinda Gates Foundation","award":["OPP 1193638"],"award-info":[{"award-number":["OPP 1193638"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Vaccines"],"abstract":"<jats:p>Background: Vaccine developers in China have made an increasing number of infectious diseases preventable through vaccination. An appropriate decision-making procedure is necessary for making wise decisions on whether to introduce new vaccines into the Expanded Program on Immunization (EPI). When there are several vaccines that could potentially be considered, a scientifically justifiable mechanism is needed for prioritizing and sequencing vaccines for consideration. Methods: We used a modified Delphi technique (MDT) to develop and refine an indicator system to prioritize vaccines and make policy recommendations concerning their introduction into China\u2019s EPI system. From January through May 2021, thirty-nine experts were recruited and participated in a two-round Delphi survey that was based on a set of candidate indicators obtained through a literature review and reference to the WHO vaccine introduction recommendations. Using the resulting indicator system, we conducted a third consultation with a multi-disciplinary group of experts who scored five program-eligible candidate vaccines to determine prioritization and sequencing for consideration of inclusion into the EPI. Results: Response rates of the thirty-nine experts were 100% and 97.4% across the two rounds. Authority coefficients from rounds one to three were over 0.70, reflecting the high accuracy and reliability of the consultation. Coordination coefficients of importance scores for primary, secondary, and tertiary indicators were 0.486, 0.356, 0.275 in round one, and 0.405, 0.340, and 0.236 in round two. According to the scores from 30 experts using our indicator system, the sequence and scores (1\u201310 scale, 10 highest) of 5 candidate vaccines were varicella (6.91), meningococcal conjugate AC (6.83), Hib (6.74), influenza (6.56), and EV71 (6.17) vaccines. Conclusions: A modified Delphi technique effectively built a scientific, rational, comprehensive, and systematic indicator system for prioritizing vaccine candidates for consideration of inclusion into the EPI. The rank order will be used by the technical working groups of China\u2019s National Immunization Advisory Committee to sequentially develop and present Evidence-to-Recommendation tables for making policy recommendations.<\/jats:p>","DOI":"10.3390\/vaccines10071010","type":"journal-article","created":{"date-parts":[[2022,6,26]],"date-time":"2022-06-26T22:50:23Z","timestamp":1656283823000},"page":"1010","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Prioritization of Vaccines for Inclusion into China\u2019s Expanded Program on Immunization: Evidence from Experts\u2019 Knowledge and Opinions"],"prefix":"10.3390","volume":"10","author":[{"given":"Chao","family":"Ma","sequence":"first","affiliation":[{"name":"National Immunization Program, Chinese Center for Disease Control and Prevention, Beijing 100050, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8678-0666","authenticated-orcid":false,"given":"Junhong","family":"Li","sequence":"additional","affiliation":[{"name":"National Immunization Program, Chinese Center for Disease Control and Prevention, Beijing 100050, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nan","family":"Wang","sequence":"additional","affiliation":[{"name":"Shanghai Municipal Center for Disease Control and Prevention, Shanghai 201204, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yamin","family":"Wang","sequence":"additional","affiliation":[{"name":"National Immunization Program, Chinese Center for Disease Control and Prevention, Beijing 100050, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yudan","family":"Song","sequence":"additional","affiliation":[{"name":"National Immunization Program, Chinese Center for Disease Control and Prevention, Beijing 100050, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiang","family":"Zeng","sequence":"additional","affiliation":[{"name":"Zhuhai Center for Disease Control and Prevention, Zhuhai 519000, China"},{"name":"Chinese Field Epidemiology Training Program (CFETP), Chinese Center for Disease Control and Prevention, Beijing 100050, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6822-8755","authenticated-orcid":false,"given":"Canjun","family":"Zheng","sequence":"additional","affiliation":[{"name":"Division of Infectious Disease, Chinese Center for Disease Control and Prevention, Beijing 100050, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhijie","family":"An","sequence":"additional","affiliation":[{"name":"National Immunization Program, Chinese Center for Disease Control and Prevention, Beijing 100050, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2593-542X","authenticated-orcid":false,"given":"Lance","family":"Rodewald","sequence":"additional","affiliation":[{"name":"National Immunization Program, Chinese Center for Disease Control and Prevention, Beijing 100050, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zundong","family":"Yin","sequence":"additional","affiliation":[{"name":"National Immunization Program, Chinese Center for Disease Control and Prevention, Beijing 100050, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,24]]},"reference":[{"key":"ref_1","first-page":"359","article-title":"Achievements in prevention and control of seven infectious diseases targeted by the National Immunization Program in China across 70 years","volume":"25","author":"Wang","year":"2019","journal-title":"Chin. J. Vaccines Immun."},{"key":"ref_2","unstructured":"NPCC (2022, April 21). Vaccine Administration Law of the People\u2019s Republic of China. Available online: http:\/\/enmojgovcn\/2021-06\/26\/c_636456htm."},{"key":"ref_3","first-page":"601","article-title":"Reported coverage of vaccines in the National Immunization Program of China, 2015","volume":"23","author":"Cui","year":"2017","journal-title":"Chin. J. Vaccines Immun."},{"key":"ref_4","first-page":"242","article-title":"Comparison of mumps incidence in areas of China with different immunization strategies, 2012\u20132019","volume":"27","author":"Hong","year":"2021","journal-title":"Chin. J. Vaccines Immun."},{"key":"ref_5","first-page":"403","article-title":"Epidemiological characteristics of varicella in China, 2016\u20132019","volume":"26","author":"Pumei","year":"2020","journal-title":"Chin. J. Vaccines Immun."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1209","DOI":"10.1016\/j.vaccine.2018.01.019","article-title":"Recipient vaccine-associated paralytic poliomyelitis in China, 2010\u20132015","volume":"36","author":"Wu","year":"2018","journal-title":"Vaccine"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1016\/j.vaccine.2014.12.026","article-title":"Supporting countries in establishing and strengthening NITAGs: Lessons learned from 5 years of the SIVAC initiative","volume":"33","author":"Adjagba","year":"2015","journal-title":"Vaccine"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"28","DOI":"10.46234\/ccdcw2019.010","article-title":"The National Immunization Advisory Committee in China: Roles of National Experts in Making Evidence-Based Recommendations for Immunization","volume":"1","author":"Ma","year":"2019","journal-title":"China CDC Wkly."},{"key":"ref_9","unstructured":"WHO (2014). Principles and Considerations for Adding a Vaccine to a National Immunization Programme\u2014Firm Decision to Implementation and Monitoring, WHO."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"116","DOI":"10.5662\/wjm.v11.i4.116","article-title":"Delphi methodology in healthcare research: How to decide its appropriateness","volume":"11","author":"Nasa","year":"2021","journal-title":"World J. Methodol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"522","DOI":"10.5694\/j.1326-5377.1990.tb126191.x","article-title":"Prevalence of chronic fatigue syndrome in an Australian population","volume":"153","author":"Lloyd","year":"1990","journal-title":"Med. J. Aust."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"217","DOI":"10.11622\/smedj.2014190","article-title":"Development and validation of algorithms for heart failure patient care: A Delphi study","volume":"56","author":"Gopal","year":"2015","journal-title":"Singap. Med. J."},{"key":"ref_13","first-page":"2036","article-title":"Construction of nursing quality evaluation system in pediatrics outpatient department","volume":"34","author":"Wang","year":"2019","journal-title":"J. Nurses Train."},{"key":"ref_14","first-page":"18","article-title":"Study on the combination of delphi method and analytic hierarchy process to construct the evaluation index system of discipline construction in an affiliated hospital","volume":"9","author":"Liu","year":"2019","journal-title":"China Med. Pharm."},{"key":"ref_15","first-page":"993","article-title":"To construct an evaluation system of mental health service accessibility based on improved Delphi method","volume":"47","author":"He","year":"2018","journal-title":"Chongqing Univ."},{"key":"ref_16","first-page":"92","article-title":"Research on data statistical processing method and its application in Delphi method","volume":"9","author":"Chunzhi","year":"2011","journal-title":"Coll. J. Inn. Mong. Univ. Financ. Econ."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"9521313","DOI":"10.1155\/2016\/9521313","article-title":"The Development of Criteria for the Selection of Chinese Peer Educators in HIV Management: A Delphi Study","volume":"2016","author":"Qiu","year":"2016","journal-title":"Scientifica"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Li, Y., Ehiri, J., Hu, D., Zhang, Y., Wang, Q., Zhang, S., and Cao, J. (2014). Framework of behavioral indicators for outcome evaluation of TB health promotion: A Delphi study of TB suspects and Tb patients. BMC Infect. Dis., 14.","DOI":"10.1186\/1471-2334-14-268"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/j.physio.2012.03.002","article-title":"Chartered Society of Physiotherapy\u2019s identification of national research priorities for physiotherapy using a modified Delphi technique","volume":"98","author":"Rankin","year":"2012","journal-title":"Physiotherapy"},{"key":"ref_20","unstructured":"Guang, Z., and Hui, L. (1994). Modern Epidemiological Method and Application, Peking Union Medical College Press."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.im.2003.11.002","article-title":"The Delphi method as a research tool: An example, design considerations and applications","volume":"42","author":"Okoli","year":"2004","journal-title":"Inf. Manag."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"4379","DOI":"10.1111\/jocn.15020","article-title":"Construction of an index system for qualitative evaluation of undergraduate nursing students innovative ability: A Delphi study","volume":"28","author":"Dai","year":"2019","journal-title":"J. Clin. Nurs."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"S147","DOI":"10.1086\/507556","article-title":"Universal influenza vaccination in the United States: Are we ready? Report of a meeting","volume":"194","author":"Schwartz","year":"2006","journal-title":"J. Infect. Dis."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"A28","DOI":"10.1016\/j.vaccine.2014.10.090","article-title":"Evidence-based decision-making for vaccine introductions: Overview of the ProVac International Working Group\u2019s experience","volume":"33","author":"Jauregui","year":"2015","journal-title":"Vaccine"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"A21","DOI":"10.1016\/j.vaccine.2014.12.080","article-title":"ProVac Global Initiative: A vision shaped by ten years of supporting evidence-based policy decisions","volume":"33","author":"Jauregui","year":"2015","journal-title":"Vaccine"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"A43","DOI":"10.1016\/j.vaccine.2016.10.086","article-title":"Informing vaccine decision-making: A strategic multi-attribute ranking tool for vaccines-SMART Vaccines 2.0","volume":"35","author":"Knobler","year":"2017","journal-title":"Vaccine"},{"key":"ref_27","unstructured":"WHO (2022, May 15). Guidelines for the Development of Evidence-Based Vaccination-Related Recommendations. Available online: https:\/\/cdn.who.int\/media\/docs\/default-source\/immunization\/sage\/general\/guidelines-development-recommendations.pdf?sfvrsn=e455fd4b_2&download=true."}],"container-title":["Vaccines"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-393X\/10\/7\/1010\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:39:05Z","timestamp":1760139545000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-393X\/10\/7\/1010"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,24]]},"references-count":27,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["vaccines10071010"],"URL":"https:\/\/doi.org\/10.3390\/vaccines10071010","relation":{},"ISSN":["2076-393X"],"issn-type":[{"value":"2076-393X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,24]]}}}