{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,17]],"date-time":"2026-10-17T20:28:13Z","timestamp":1792268893666,"version":"4.4.0"},"reference-count":35,"publisher":"American Academy of Pediatrics (AAP)","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2012,4,1]]},"abstract":"<jats:sec><jats:title>OBJECTIVE:<\/jats:title><jats:p>With the use of Centers for Disease Control and Prevention (CDC) immunization recommendations as the gold standard, our objectives were to measure the accuracy (\u201cis this child up-to-date on immunizations?\u201d) and usefulness (\u201cis this child due for catch-up immunizations?\u201d) of the Healthcare Effectiveness Data and Information Set (HEDIS) childhood immunization measures.<\/jats:p><\/jats:sec><jats:sec><jats:title>METHODS:<\/jats:title><jats:p>For children aged 24 to 35 months from the 2009 National Immunization Survey, we assessed the accuracy and usefulness of the HEDIS childhood immunization measures for 6 individual immunizations and a composite.<\/jats:p><\/jats:sec><jats:sec><jats:title>RESULTS:<\/jats:title><jats:p>A total of 12\u2009096 children met all inclusion criteria and composed the study sample. The HEDIS measures had &amp;gt;90% accuracy when compared with the CDC gold standard for each of the 6 immunizations (range, 94.3%\u201399.7%) and the composite (93.8%). The HEDIS measure was least accurate for hepatitis B and pneumococcal conjugate immunizations. The proportion of children for which the HEDIS measure yielded a nonuseful result (ie, an incorrect answer to the question, \u201cis this child due for catch-up immunization?\u201d) ranged from 0.33% (varicella) to 5.96% (pneumococcal conjugate). The most important predictor of HEDIS measure accuracy and usefulness was the CDC-recommended number of immunizations due at age 2 years; children with zero or all immunizations due were the most likely to be correctly classified.<\/jats:p><\/jats:sec><jats:sec><jats:title>CONCLUSIONS:<\/jats:title><jats:p>HEDIS childhood immunization measures are, on the whole, accurate and useful. Certain immunizations (eg, hepatitis B, pneumococcal conjugate) and children (eg, those with a single overdue immunization), however, are more prone to HEDIS misclassification.<\/jats:p><\/jats:sec>","DOI":"10.1542\/peds.2011-3073","type":"journal-article","created":{"date-parts":[[2012,3,27]],"date-time":"2012-03-27T01:01:25Z","timestamp":1332810085000},"page":"648-656","source":"Crossref","is-referenced-by-count":7,"title":["Accuracy and Usefulness of the HEDIS Childhood Immunization Measures"],"prefix":"10.1542","volume":"129","author":[{"given":"David G.","family":"Bundy","sequence":"first","affiliation":[{"name":"Divisions of Quality and Safety and"},{"name":"Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Barry S.","family":"Solomon","sequence":"additional","affiliation":[{"name":"General Pediatrics and Adolescent Medicine, Department of Pediatrics, Johns Hopkins University School of Medicine, Baltimore, Maryland; and"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julia M.","family":"Kim","sequence":"additional","affiliation":[{"name":"General Pediatrics and Adolescent Medicine, Department of Pediatrics, Johns Hopkins University School of Medicine, Baltimore, Maryland; and"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marlene R.","family":"Miller","sequence":"additional","affiliation":[{"name":"Divisions of Quality and Safety and"},{"name":"Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"417","published-online":{"date-parts":[[2012,4,1]]},"reference":[{"issue":"4","key":"2021120903543373800_B1","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1097\/MLR.0b013e3181a14b65","article-title":"Improving the quality of quality measurement: the tinkerer, the tailor and the candlestick maker.","volume":"47","author":"Safford","year":"2009","journal-title":"Med Care"},{"issue":"7","key":"2021120903543373800_B2","first-page":"358","article-title":"The approaching revolution in quality measurement.","volume":"35","author":"Bates","year":"2009","journal-title":"Jt Comm J Qual Patient Saf"},{"key":"2021120903543373800_B3","unstructured":"The ABCs of measurement. National Quality Forum. Available at: www.qualityforum.org\/Measuring_Performance\/ABCs_of_Measurement.aspx. Accessed October 11, 2011"},{"issue":"4 pt 2","key":"2021120903543373800_B4","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1542\/peds.103.S1.889","article-title":"Immunization performance measurement in a changing immunization environment.","volume":"103","author":"Rodewald","year":"1999","journal-title":"Pediatrics"},{"issue":"1","key":"2021120903543373800_B5","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.amepre.2006.03.012","article-title":"Priorities among effective clinical preventive services: results of a systematic review and analysis.","volume":"31","author":"Maciosek","year":"2006","journal-title":"Am J Prev Med"},{"key":"2021120903543373800_B6","unstructured":"The National Committee for Quality Assurance. HEDIS and quality measurement. Available at: www.ncqa.org\/tabid\/59\/Default.aspx. Accessed October 11, 2011"},{"key":"2021120903543373800_B7","volume-title":"HEDIS 2009","year":"2008"},{"key":"2021120903543373800_B8","unstructured":"Centers for Medicare and Medicaid Services. Electronic health record (EHR) incentive programs. Available at: www.cms.gov\/ehrincentiveprograms\/. Accessed October 11, 2011"},{"key":"2021120903543373800_B9","unstructured":"American Academy of Pediatrics. Child Health Informatics Center. Meaningful use of electronic health records (EHRs). Available at: www.aap.org\/informatics\/aapoverview.html. Accessed October 11, 2011"},{"issue":"51&52","key":"2021120903543373800_B10","first-page":"Q1","article-title":"Recommended immunization schedules for persons aged 0 through 18 years\u2013United States, 2009.","volume":"57","author":"Centers for Disease Control and Prevention","year":"2009","journal-title":"MMWR Morb Mortal Wkly Rep"},{"key":"2021120903543373800_B11","unstructured":"U.S. Department of Health and Human Services (DHHS). National Center for Health Statistics. The 2009 National Immunization Survey. Hyattsville, MD: Centers for Disease Control and Prevention, 2010. Available at: www.cdc.gov\/nchs\/nis\/data_files.htm. Accessed October 11, 2011"},{"key":"2021120903543373800_B12","unstructured":"Centers for Disease Control and Prevention, National Center for Immunization and Respiratory Diseases, National Center for Health Statistics. National Immunization Survey: A user\u2019s guide for the 2009 Public-Use Data File. Available at: ftp:\/\/ftp.cdc.gov\/pub\/Health_Statistics\/NCHS\/Dataset_Documentation\/NIS\/NISPUF09_DUG.pdf. Accessed October 11, 2011"},{"issue":"50","key":"2021120903543373800_B13","first-page":"1318","article-title":"Interim recommendations for the use of Haemophilus influenzae type b (Hib) conjugate vaccines related to the recall of certain lots of Hib-containing vaccines (PedvaxHIB and Comvax).","volume":"56","author":"Centers for Disease Control and Prevention (CDC)","year":"2007","journal-title":"MMWR Morb Mortal Wkly Rep"},{"issue":"24","key":"2021120903543373800_B14","first-page":"673","article-title":"Updated recommendations for use of Haemophilus influenzae type b (Hib) vaccine: reinstatement of the booster dose at ages 12-15 months.","volume":"58","author":"Centers for Disease Control and Prevention (CDC)","year":"2009","journal-title":"MMWR Morb Mortal Wkly Rep"},{"key":"2021120903543373800_B15","first-page":"1","article-title":"General recommendations on immunization: recommendations of the Advisory Committee on Immunization Practices (ACIP).","volume":"55","author":"Kroger","year":"2006","journal-title":"MMWR Recomm Rep"},{"issue":"5","key":"2021120903543373800_B16","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1542\/peds.110.5.935","article-title":"Timeliness of childhood immunizations.","volume":"110","author":"Luman","year":"2002","journal-title":"Pediatrics"},{"issue":"3","key":"2021120903543373800_B17","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/S0749-3797(00)00208-7","article-title":"Measuring immunization coverage.","volume":"19","author":"Fairbrother","year":"2000","journal-title":"Am J Prev Med"},{"key":"2021120903543373800_B18"},{"issue":"9","key":"2021120903543373800_B19","doi-asserted-by":"crossref","first-page":"783","DOI":"10.1097\/00006454-199909000-00008","article-title":"Immunization status of children enrolled in a hospital-based medicaid managed care practice: the importance of the timing of vaccine administration.","volume":"18","author":"Vivier","year":"1999","journal-title":"Pediatr Infect Dis J"},{"issue":"1","key":"2021120903543373800_B20","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1093\/intqhc\/mzi005","article-title":"How patients' sociodemographic characteristics affect comparisons of competing health plans in California on HEDIS quality measures","volume":"17","author":"Zaslavsky","year":"2005","journal-title":"Int J Qual Health Care"},{"issue":"10","key":"2021120903543373800_B21","doi-asserted-by":"crossref","first-page":"981","DOI":"10.1097\/00005650-200010000-00002","article-title":"Impact of sociodemographic case mix on the HEDIS measures of health plan quality.","volume":"38","author":"Zaslavsky","year":"2000","journal-title":"Med Care"},{"issue":"2","key":"2021120903543373800_B22","doi-asserted-by":"crossref","first-page":"171","DOI":"10.2105\/AJPH.89.2.171","article-title":"The impact of physician bonuses, enhanced fees, and feedback on childhood immunization coverage rates.","volume":"89","author":"Fairbrother","year":"1999","journal-title":"Am J Public Health"},{"issue":"4 pt 1","key":"2021120903543373800_B23","doi-asserted-by":"crossref","first-page":"931","DOI":"10.1542\/peds.104.4.931","article-title":"The use of physician financial incentives and feedback to improve pediatric preventive care in Medicaid managed care.","volume":"104","author":"Hillman","year":"1999","journal-title":"Pediatrics"},{"issue":"4","key":"2021120903543373800_B24","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1367\/1539-4409(2001)001<0206:IOFIOD>2.0.CO;2","article-title":"Impact of financial incentives on documented immunization rates in the inner city: results of a randomized controlled trial.","volume":"1","author":"Fairbrother","year":"2001","journal-title":"Ambul Pediatr."},{"issue":"6 pt 2","key":"2021120903543373800_B25","doi-asserted-by":"crossref","first-page":"1934","DOI":"10.1111\/j.1475-6773.2010.01168.x","article-title":"Improving timely childhood immunizations through pay for performance in Medicaid-managed care.","volume":"45","author":"Chien","year":"2010","journal-title":"Health Serv Res"},{"issue":"5","key":"2021120903543373800_B26","doi-asserted-by":"crossref","first-page":"622","DOI":"10.3122\/jabfm.2010.05.070187","article-title":"Effect of financial incentives on improvement in medical quality indicators for primary care.","volume":"23","author":"Gavagan","year":"2010","journal-title":"J Am Board Fam Med"},{"issue":"6","key":"2021120903543373800_B27","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1097\/MOP.0b013e3282f1eb70","article-title":"A pediatric-focused review of the performance incentive literature.","volume":"19","author":"Chien","year":"2007","journal-title":"Curr Opin Pediatr"},{"issue":"1","key":"2021120903543373800_B28","first-page":"21","article-title":"Incentivising appropriate care: the case of immunizations.","volume":"27","author":"Forgione","year":"2000","journal-title":"J Health Care Finance"},{"issue":"6","key":"2021120903543373800_B29","doi-asserted-by":"crossref","first-page":"620","DOI":"10.1097\/MLR.0b013e3181618ec9","article-title":"Are performance measures based on automated medical records valid for physician\/practice profiling of asthma care?","volume":"46","author":"Fuhlbrigge","year":"2008","journal-title":"Med Care"},{"issue":"3","key":"2021120903543373800_B30","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1016\/S1081-1206(10)60793-4","article-title":"Use of the health plan employer data and information set for measuring and improving the quality of asthma care.","volume":"97","author":"Gelfand","year":"2006","journal-title":"Ann Allergy Asthma Immunol"},{"key":"2021120903543373800_B31","first-page":"745","article-title":"Implementing broad scale childhood immunization decision support as a web service","volume-title":"AMIA Annu Symp Proc","author":"Zhu","year":"2009"},{"issue":"1 pt 2","key":"2021120903543373800_B32","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1542\/peds.106.S1.171","article-title":"Effect of method of defining the active patient population on measured immunization rates in predominantly Medicaid and non-Medicaid practices.","volume":"106","author":"Morrow","year":"2000","journal-title":"Pediatrics"},{"issue":"8","key":"2021120903543373800_B33","doi-asserted-by":"crossref","first-page":"1273","DOI":"10.2105\/AJPH.91.8.1273","article-title":"The effect of different definitions of a patient on immunization assessment.","volume":"91","author":"O\u2019Connor","year":"2001","journal-title":"Am J Public Health"},{"issue":"3","key":"2021120903543373800_B34","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1177\/0009922807308743","article-title":"How should immunization rates be measured in the office setting? A study from PROS and NMA PedsNet.","volume":"47","author":"Darden","year":"2008","journal-title":"Clin Pediatr (Phila)"},{"issue":"2","key":"2021120903543373800_B35","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1093\/jurban\/79.2.219","article-title":"Assessing immunization rates in an ambulatory care setting.","volume":"79","author":"Smith","year":"2002","journal-title":"J Urban Health"}],"container-title":["Pediatrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/publications.aap.org\/pediatrics\/article-pdf\/129\/4\/648\/1056816\/peds_2011-3073.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/publications.aap.org\/pediatrics\/article-pdf\/129\/4\/648\/1056816\/peds_2011-3073.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,7]],"date-time":"2022-01-07T18:44:17Z","timestamp":1641581057000},"score":1,"resource":{"primary":{"URL":"https:\/\/publications.aap.org\/pediatrics\/article\/129\/4\/648\/32362\/Accuracy-and-Usefulness-of-the-HEDIS-Childhood"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,4,1]]},"references-count":35,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2012,4,1]]},"published-print":{"date-parts":[[2012,4,1]]}},"URL":"https:\/\/doi.org\/10.1542\/peds.2011-3073","relation":{},"ISSN":["0031-4005","1098-4275"],"issn-type":[{"value":"0031-4005","type":"print"},{"value":"1098-4275","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,4,1]]}}}