{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T21:32:38Z","timestamp":1778189558903,"version":"3.51.4"},"reference-count":25,"publisher":"American Academy of Pediatrics (AAP)","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2006,7,1]]},"abstract":"<jats:p>BACKGROUND. Performance measures are essential components of public reporting and quality improvement. To date, few such measures exist to provide a comprehensive assessment of the quality of emergency department services for children.<\/jats:p>\n               <jats:p>OBJECTIVES. Our goal was to use a systematic process to develop measures of emergency department care for children (0\u201319 years) that are (1) based on research evidence and expert opinion, (2) representative of a range of conditions treated in most emergency departments, (3) related to links between processes and outcomes, and (4) feasible to measure.<\/jats:p>\n               <jats:p>METHODS. We presented a panel of providers and managers data from emergency department use to identify common conditions across levels of patient acuity, which could be targets for quality improvement. We used a structured panel process informed by a literature review to (1) identify condition-specific links between processes of care and defined outcomes and (2) select indicators to assess these process-outcome links. We determined the feasibility of calculating these indicators using an administrative data set of emergency department visits for Ontario, Canada.<\/jats:p>\n               <jats:p>RESULTS. The panel identified 18 clinical conditions for indicator development and 61 condition-specific links between processes of care and outcomes. After 2 rounds of ratings, the panel defined 68 specific clinical indicators for the following conditions: adolescent mental health problems, ankle injury, asthma, bronchiolitis, croup, diabetes, fever, gastroenteritis, minor head injury, neonatal jaundice, seizures, and urinary tract infections. Visits for these conditions account for 23% of all pediatric emergency department use. Using an administrative data set, we were able to calculate 19 indicators, covering 9 conditions, representing 20% of all emergency department visits by children.<\/jats:p>\n               <jats:p>CONCLUSIONS. Using a structured panel process, data on emergency department use, and literature review, it was possible to define indicators of emergency department care for children. The feasibility of these indicators will depend on the availability of high-quality data.<\/jats:p>","DOI":"10.1542\/peds.2005-3029","type":"journal-article","created":{"date-parts":[[2006,7,6]],"date-time":"2006-07-06T16:42:48Z","timestamp":1152204168000},"page":"114-123","source":"Crossref","is-referenced-by-count":96,"title":["Development of Measures of the Quality of Emergency Department Care for Children Using a Structured Panel Process"],"prefix":"10.1542","volume":"118","author":[{"given":"Astrid","family":"Guttmann","sequence":"first","affiliation":[{"name":"Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada"},{"name":"Divisions of Pediatric and Emergency Medicine, Hospital for Sick Children, Toronto, Ontario, Canada"},{"name":"Department of Health Policy, Management and Evaluation, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Asma","family":"Razzaq","sequence":"additional","affiliation":[{"name":"Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Patty","family":"Lindsay","sequence":"additional","affiliation":[{"name":"Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada"},{"name":"Department of Health Policy, Management and Evaluation, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brandon","family":"Zagorski","sequence":"additional","affiliation":[{"name":"Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Geoffrey M.","family":"Anderson","sequence":"additional","affiliation":[{"name":"Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada"},{"name":"Department of Health Policy, Management and Evaluation, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"417","published-online":{"date-parts":[[2006,7,1]]},"reference":[{"key":"2021120823073186900_R1","doi-asserted-by":"crossref","unstructured":"Seidel JS, Henderson D, Tittle S, et al. Priorities for research in Emergency Medical Services for Children: results of a consensus conference. EMSC Research Agenda Consensus Committee, National EMSC Resource Alliance. J Emerg Nurs.\u20081999;25:12\u201316","DOI":"10.1016\/S0099-1767(99)70122-4"},{"key":"2021120823073186900_R2","doi-asserted-by":"crossref","unstructured":"Clancy CM, Dougherty D, Walker E. The importance of outcomes research in pediatric emergency medicine. Ambul Pediatr.\u20082002;2:293\u2013300","DOI":"10.1367\/1539-4409(2002)002<0293:TIOORI>2.0.CO;2"},{"key":"2021120823073186900_R3","doi-asserted-by":"crossref","unstructured":"Bordley WC. Outcomes research and emergency medical services for children: domains, challenges, and opportunities. Ambul Pediatr.\u20082002;2:306\u2013310","DOI":"10.1367\/1539-4409(2002)002<0306:ORAEMS>2.0.CO;2"},{"key":"2021120823073186900_R4","doi-asserted-by":"crossref","unstructured":"Moody-Williams JD, Krug S, O'Connor R, Shook JE, Athey JL, Holleran RS. Practice guidelines and performance measures in emergency medical services for children. Ann Emerg Med.\u20082002;39:404\u2013412","DOI":"10.1067\/mem.2002.122784"},{"key":"2021120823073186900_R5","doi-asserted-by":"crossref","unstructured":"Shaw KN, Ruddy RM, Gorelick MH. Pediatric emergency department directors' benchmarking survey: fiscal year 2001. Pediatr Emerg Care.\u20082003;19:143\u2013147","DOI":"10.1097\/01.pec.0000081233.20228.fd"},{"key":"2021120823073186900_R6","doi-asserted-by":"crossref","unstructured":"Flores G, Lee M, Bauchner H, Kastner B. Pediatricians' attitudes, beliefs, and practices regarding clinical practice guidelines: a national survey. Pediatrics.\u20082000;105:496\u2013501","DOI":"10.1542\/peds.105.3.496"},{"key":"2021120823073186900_R7","doi-asserted-by":"crossref","unstructured":"Brook RH, Chassin MR, Fink A, Solomon DH, Kosecoff J, Park RE. A method for the detailed assessment of the appropriateness of medical technologies. Int J Technol Assess Health Care.\u20081986;2:53\u201363","DOI":"10.1017\/S0266462300002774"},{"key":"2021120823073186900_R8","doi-asserted-by":"crossref","unstructured":"Park RE, Fink A, Brook RH, et al. Physician ratings of appropriate indications for six medical and surgical procedures. Am J Public Health.\u20081986;76:766\u2013772","DOI":"10.2105\/AJPH.76.7.766"},{"key":"2021120823073186900_R9","doi-asserted-by":"crossref","unstructured":"Anderson GM, Brown AD. Appropriateness ratings: overuse, underuse, or misuse?Lancet.\u20082001;358:1475\u20131476","DOI":"10.1016\/S0140-6736(01)06569-2"},{"key":"2021120823073186900_R10","doi-asserted-by":"crossref","unstructured":"Lindsay P, Schull M, Bronskill S, Anderson G. The development of indicators to measure the quality of clinical care in emergency departments following a modified-Delphi approach. Acad Emerg Med.\u20082002;9:1131\u20131139","DOI":"10.1197\/aemj.9.11.1131"},{"key":"2021120823073186900_R11","unstructured":"Razzaq A, Lindsay P., Guttmann A., Schull, M., Anderson, G. Clinical Utilization and Outcomes, Hospital Report: Emergency Department Hospital Report Research Collaborative ICES Executive Report. Toronto, Ontario, Canada: Institute for Clinical Evaluative Sciences; 2005"},{"key":"2021120823073186900_R12","doi-asserted-by":"crossref","unstructured":"Campbell SM, Braspenning J, Hutchinson A, Marshall MN. Research methods used in developing and applying quality indicators in primary care. BMJ.\u20082003;326:816\u2013819","DOI":"10.1136\/bmj.326.7393.816"},{"key":"2021120823073186900_R13","unstructured":"Rowe BH, Spooner C, Ducharme FM, Bretzlaff JA, Bota GW. Early emergency department treatment of acute asthma with systemic corticosteroids [Cochrane review]. In: The Cochrane Library. Oxford, United Kingdom: Update Software;2003"},{"key":"2021120823073186900_R14","doi-asserted-by":"crossref","unstructured":"Jones J, Hunter D. Consensus methods for medical and health services research. BMJ.\u20081995;311:376\u2013380","DOI":"10.1136\/bmj.311.7001.376"},{"key":"2021120823073186900_R15","unstructured":"Canadian Council on Health Services Accreditation. A guide for the development and use of performance indicators. Ottawa, Ontario, Canada: Canadian Council on Health Services Accreditation;1996"},{"key":"2021120823073186900_R16","unstructured":"Canadian Association of Emergency Physicians. The Canadian Triage and Acuity Scale (CTAS) for Emergency Departments. Available at: www.caep.ca\/002.policies\/002-02.ctas.htm. Accessed May 12, 2006"},{"key":"2021120823073186900_R17","doi-asserted-by":"crossref","unstructured":"Schutzman SA, Barnes P, Duhaime AC, et al. Evaluation and management of children younger than two years old with apparently minor head trauma: proposed guidelines. Pediatrics.\u20082001;107:983\u2013993","DOI":"10.1542\/peds.107.5.983"},{"key":"2021120823073186900_R18","doi-asserted-by":"crossref","unstructured":"Committee on Quality Improvement, American Academy of Pediatrics. Commission on Clinical Policies and Research, American Academy of Family Physicians. The management of minor closed head injury in children. Pediatrics.\u20081999;104:1407\u20131415","DOI":"10.1542\/peds.104.6.1407"},{"key":"2021120823073186900_R19","doi-asserted-by":"crossref","unstructured":"Boutis K, Komar L, Jaramillo D, et al. Sensitivity of a clinical examination to predict need for radiography in children with ankle injuries: a prospective study. Lancet.\u20082001;358:2118\u20132121","DOI":"10.1016\/S0140-6736(01)07218-X"},{"key":"2021120823073186900_R20","doi-asserted-by":"crossref","unstructured":"Plint AC, Bulloch B, Osmond MH, et al. Validation of the Ottawa Ankle Rules in children with ankle injuries. Acad Emerg Med.\u20081999;6:1005\u20131009","DOI":"10.1111\/j.1553-2712.1999.tb01183.x"},{"key":"2021120823073186900_R21","doi-asserted-by":"crossref","unstructured":"Clark KD, Tanner S. Evaluation of the Ottawa ankle rules in children. Pediatr Emerg Care.\u20082003;19:73\u201378","DOI":"10.1097\/00006565-200304000-00003"},{"key":"2021120823073186900_R22","unstructured":"McCaig LF, Burt CW. National Hospital Ambulatory Medical Care Survey: 2003 Emergency Department Summary Advance data from vital and health statistics. No. 358. Hyattsville, MD: National Center for Health Statistics; 2005"},{"key":"2021120823073186900_R23","doi-asserted-by":"crossref","unstructured":"Shekelle PG, Kahan JP, Bernstein SJ, Leape LL, Kamberg CJ, Park RE. The reproducibility of a method to identify the overuse and underuse of medical procedures. N Engl J Med.\u20081998;338:1888\u20131895","DOI":"10.1056\/NEJM199806253382607"},{"key":"2021120823073186900_R24","doi-asserted-by":"crossref","unstructured":"Naylor CD. What is appropriate care?N Engl J Med.\u20081998;338:1918\u20131920","DOI":"10.1056\/NEJM199806253382612"},{"key":"2021120823073186900_R25","doi-asserted-by":"crossref","unstructured":"Ayanian JZ, Landrum MB, Normand SL, Guadagnoli E, McNeil BJ. Rating the appropriateness of coronary angiography\u2013do practicing physicians agree with an expert panel and with each other?N Engl J Med.\u20081998;338:1896\u20131904","DOI":"10.1056\/NEJM199806253382608"}],"container-title":["Pediatrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/publications.aap.org\/pediatrics\/article-pdf\/118\/1\/114\/1011233\/zpe00706000114.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/publications.aap.org\/pediatrics\/article-pdf\/118\/1\/114\/1011233\/zpe00706000114.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,9]],"date-time":"2021-12-09T03:13:34Z","timestamp":1639019614000},"score":1,"resource":{"primary":{"URL":"https:\/\/publications.aap.org\/pediatrics\/article\/118\/1\/114\/69618\/Development-of-Measures-of-the-Quality-of"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,7,1]]},"references-count":25,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2006,7,1]]},"published-print":{"date-parts":[[2006,7,1]]}},"URL":"https:\/\/doi.org\/10.1542\/peds.2005-3029","relation":{},"ISSN":["0031-4005","1098-4275"],"issn-type":[{"value":"0031-4005","type":"print"},{"value":"1098-4275","type":"electronic"}],"subject":[],"published":{"date-parts":[[2006,7,1]]}}}