{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T16:08:21Z","timestamp":1784736501000,"version":"3.55.0"},"reference-count":42,"publisher":"Georg Thieme Verlag KG","issue":"02","funder":[{"name":"U.S. Department of Health and Human Services, Agency for Healthcare Research and Quality","award":["1F32HS027075-01A1"],"award-info":[{"award-number":["1F32HS027075-01A1"]}]},{"DOI":"10.13039\/100005627","name":"Thrasher Research Fund","doi-asserted-by":"crossref","award":["15024"],"award-info":[{"award-number":["15024"]}],"id":[{"id":"10.13039\/100005627","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Appl Clin Inform"],"published-print":{"date-parts":[[2022,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>\n          Background\u2003The Kids Intracranial Injury Decision Support tool for Traumatic Brain Injury (KIIDS-TBI) tool is a validated risk prediction model for managing children with mild traumatic brain injuries (mTBI) and intracranial injuries. Electronic clinical decision support (CDS) may facilitate the clinical implementation of this evidence-based guidance.<\/jats:p><jats:p>\n          Objective\u2003Our objective was to evaluate the acceptability and usability of an electronic CDS tool for managing children with mTBI and intracranial injuries.<\/jats:p><jats:p>\n          Methods\u2003Emergency medicine and neurosurgery physicians (10 each) from 10 hospitals in the United States were recruited to participate in usability testing of a novel CDS prototype in a simulated electronic health record environment. Testing included a think-aloud protocol, an acceptability and usability survey, and a semi-structured interview. The prototype was updated twice during testing to reflect user feedback. Usability problems recorded in the videos were categorized using content analysis. Interview transcripts were analyzed using thematic analysis.<\/jats:p><jats:p>\n          Results\u2003Among the 20 participants, most worked at teaching hospitals (80%), freestanding children's hospitals (95%), and level-1 trauma centers (75%). During the two prototype updates, problems with clarity of terminology and navigating through the CDS interface were identified and corrected. Corresponding to these changes, the number of usability problems decreased from 35 in phase 1 to 8 in phase 3 and the number of mistakes made decreased from 18 (phase 1) to 2 (phase 3). Through the survey, participants found the tool easy to use (90%), useful for determining a patient's level of care (95%), and likely to improve resource use (90%) and patient safety (79%). Interview themes related to the CDS's ability to support evidence-based decision-making and improve clinical workflow proposed implementation strategies and potential pitfalls.<\/jats:p><jats:p>\n          Conclusion\u2003After iterative evaluation and refinement, the KIIDS-TBI CDS tool was found to be highly usable and useful for aiding the management of children with mTBI and intracranial injuries.<\/jats:p>","DOI":"10.1055\/s-0042-1745829","type":"journal-article","created":{"date-parts":[[2022,4,27]],"date-time":"2022-04-27T23:31:59Z","timestamp":1651102319000},"page":"456-467","source":"Crossref","is-referenced-by-count":12,"title":["Usability and Acceptability of Clinical Decision Support Based on the KIIDS-TBI Tool for Children with Mild Traumatic Brain Injuries and Intracranial Injuries"],"prefix":"10.1055","volume":"13","author":[{"given":"Jacob K.","family":"Greenberg","sequence":"additional","affiliation":[{"name":"Department of Neurological Surgery, Washington University School of Medicine in St. Louis, St. Louis, Missouri, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ayodamola","family":"Otun","sequence":"additional","affiliation":[{"name":"Department of Neurological Surgery, Washington University School of Medicine in St. Louis, St. Louis, Missouri, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pyi Theim","family":"Kyaw","sequence":"additional","affiliation":[{"name":"McKelvey School of Engineering, Washington University School of Medicine in St. Louis, St. Louis, Missouri, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher R.","family":"Carpenter","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Washington University School of Medicine in St. Louis, St. Louis, Missouri, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ross C.","family":"Brownson","sequence":"additional","affiliation":[{"name":"Brown School of Social Work, Washington University School of Medicine in St. Louis, St. Louis, Missouri, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nathan","family":"Kuppermann","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, University of California Davis, Davis, California, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"suffix":"Jr.","given":"David D","family":"Limbrick","sequence":"additional","affiliation":[{"name":"Department of Neurological Surgery, Washington University School of Medicine in St. Louis, St. Louis, Missouri, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Randi E.","family":"Foraker","sequence":"additional","affiliation":[{"name":"Institute for Informatics, Washington University School of Medicine in St. Louis, St. Louis, Missouri, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Po-Yin","family":"Yen","sequence":"additional","affiliation":[{"name":"Institute for Informatics, Washington University School of Medicine in St. Louis, St. Louis, Missouri, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"194","published-online":{"date-parts":[[2022,4,27]]},"reference":[{"key":"ref1","volume-title":"Report to Congress on mild traumatic brain injury in the United States: steps to prevent a serious public health problem","author":"National Center for Injury Prevention and Control (US).","year":"2003"},{"issue":"02","key":"ref2","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1080\/02699050801888824","article-title":"Prevalence of traumatic brain injury among children, adolescents and young adults: prospective evidence from a birth cohort","volume":"22","author":"A McKinlay","year":"2008","journal-title":"Brain Inj"},{"issue":"02","key":"ref3","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1542\/peds.2005-2588","article-title":"Incidence of pediatric traumatic brain injury and associated hospital resource utilization in the United States","volume":"118","author":"A J Schneier","year":"2006","journal-title":"Pediatrics"},{"issue":"05","key":"ref4","doi-asserted-by":"crossref","first-page":"946","DOI":"10.1542\/peds.2010-2259","article-title":"Incidence and descriptive epidemiologic features of traumatic brain injury in King County, Washington","volume":"128","author":"T D Koepsell","year":"2011","journal-title":"Pediatrics"},{"issue":"05","key":"ref5","doi-asserted-by":"crossref","first-page":"988","DOI":"10.1542\/peds.2007-3511","article-title":"Trends in hospitalizations associated with pediatric traumatic brain injuries","volume":"122","author":"S M Bowman","year":"2008","journal-title":"Pediatrics"},{"issue":"11","key":"ref6","doi-asserted-by":"crossref","first-page":"e182853","DOI":"10.1001\/jamapediatrics.2018.2853","article-title":"Centers for Disease Control and Prevention Guideline on the Diagnosis and Management of Mild Traumatic Brain Injury Among Children","volume":"172","author":"A Lumba-Brown","year":"2018","journal-title":"JAMA Pediatr"},{"key":"ref7","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.1016\/S0140-6736(09)61558-0","article-title":"Identification of children at very low risk of clinically-important brain injuries after head trauma: a prospective cohort study","volume":"374","author":"N Kuppermann","year":"2009","journal-title":"Lancet"},{"key":"ref8","doi-asserted-by":"crossref","first-page":"2393","DOI":"10.1016\/S0140-6736(17)30555-X","article-title":"Accuracy of PECARN, CATCH, and CHALICE head injury decision rules in children: a prospective cohort study","volume":"389","author":"F E Babl","year":"2017","journal-title":"Lancet"},{"issue":"02","key":"ref9","doi-asserted-by":"crossref","first-page":"227","DOI":"10.3171\/2018.7.PEDS18263","article-title":"North American survey on the post-neuroimaging management of children with mild head injuries","volume":"23","author":"J K Greenberg","year":"2018","journal-title":"J Neurosurg Pediatr"},{"issue":"04","key":"ref10","doi-asserted-by":"crossref","first-page":"1089","DOI":"10.1097\/TA.0000000000000155","article-title":"Management of children with mild traumatic brain injury and intracranial hemorrhage","volume":"76","author":"J K Greenberg","year":"2014","journal-title":"J Trauma Acute Care Surg"},{"issue":"04","key":"ref11","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1001\/jamapediatrics.2016.4520","article-title":"Development and internal validation of a clinical risk score for treating children with mild head trauma and intracranial injury","volume":"171","author":"J K Greenberg","year":"2017","journal-title":"JAMA Pediatr"},{"issue":"07","key":"ref12","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1016\/j.jpedsurg.2019.09.027","article-title":"Validation of the \u201cCHIIDA\u201d and application for PICU triage in children with complicated mild traumatic brain injury","volume":"55","author":"K E Neumayer","year":"2020","journal-title":"J Pediatr Surg"},{"issue":"12","key":"ref13","doi-asserted-by":"crossref","first-page":"1409","DOI":"10.1111\/acem.14333","article-title":"Development and external validation of the KIIDS-TBI tool for managing children with mild traumatic brain injury and intracranial injuries","volume":"28","author":"J K Greenberg","year":"2021","journal-title":"Acad Emerg Med"},{"issue":"11","key":"ref14","doi-asserted-by":"crossref","first-page":"955","DOI":"10.1197\/j.aem.2007.06.039","article-title":"Implementation of clinical decision rules in the emergency department","volume":"14","author":"I G Stiell","year":"2007","journal-title":"Acad Emerg Med"},{"issue":"02","key":"ref15","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.annemergmed.2013.02.006","article-title":"When do clinical decision rules improve patient care?","volume":"62","author":"S M Green","year":"2013","journal-title":"Ann Emerg Med"},{"issue":"S 03","key":"ref16","doi-asserted-by":"crossref","first-page":"i68","DOI":"10.1136\/qshc.2010.042085","article-title":"A new sociotechnical model for studying health information technology in complex adaptive healthcare systems","volume":"19","author":"D F Sittig","year":"2010","journal-title":"Qual Saf Health Care"},{"issue":"01","key":"ref17","first-page":"80","article-title":"Development and feasibility of a real-time clinical decision support system for traumatic brain injury anesthesia care","volume":"8","author":"T Kiatchai","year":"2017","journal-title":"Appl Clin Inform"},{"issue":"01","key":"ref18","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1186\/s12911-021-01522-w","article-title":"Electronic clinical decision support for children with minor head trauma and intracranial injuries: a sociotechnical analysis","volume":"21","author":"J K Greenberg","year":"2021","journal-title":"BMC Med Inform Decis Mak"},{"key":"ref20","first-page":"714","article-title":"A comparison of usability evaluation methods: heuristic evaluation versus end-user think-aloud protocol\u2014an example from a web-based communication tool for nurse scheduling","volume":"2009","author":"P Y Yen","year":"2009","journal-title":"AMIA Annu Symp Proc"},{"issue":"02","key":"ref21","first-page":"1133","article-title":"Integrating patient-reported outcomes into spine surgical care through visual dashboards: lessons learned from human-centered design","volume":"3","author":"A L Hartzler","year":"2015","journal-title":"EGEMS (Wash DC)"},{"issue":"06","key":"ref22","doi-asserted-by":"crossref","first-page":"1202","DOI":"10.1016\/j.jbi.2012.09.002","article-title":"Interface design principles for usable decision support: a targeted review of best practices for clinical prescribing interventions","volume":"45","author":"J Horsky","year":"2012","journal-title":"J Biomed Inform"},{"key":"ref23","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1016\/j.ijmedinf.2004.08.003","article-title":"The think aloud method: a guide to user interface design","volume":"73","author":"M W Jaspers","year":"2004","journal-title":"Int J Med Inform"},{"issue":"05","key":"ref24","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1016\/j.ijmedinf.2008.10.002","article-title":"A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence","volume":"78","author":"M W Jaspers","year":"2009","journal-title":"Int J Med Inform"},{"issue":"05","key":"ref25","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1080\/0044929031000","article-title":"Retrospective vs. concurrent think-aloud protocols: testing the usability of an online library catalogue","volume":"22","author":"M van den Haak","year":"2003","journal-title":"Behav Inf Technol"},{"issue":"03","key":"ref26","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1177\/0272989X09344747","article-title":"Measuring acceptability of clinical decision rules: validation of the Ottawa acceptability of decision rules instrument (OADRI) in four countries","volume":"30","author":"J C Brehaut","year":"2010","journal-title":"Med Decis Making"},{"key":"ref27","doi-asserted-by":"crossref","first-page":"e241","DOI":"10.1136\/amiajnl-2013-001811","article-title":"Examining construct and predictive validity of the Health-IT Usability Evaluation Scale: confirmatory factor analysis and structural equation modeling results","volume":"21","author":"P-Y Yen","year":"2014","journal-title":"J Am Med Inform Assoc"},{"issue":"01","key":"ref28","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1177\/1541931213571043","article-title":"Validation of the System Usability Scale (SUS):SUS in the Wild","volume":"57","author":"S C Peres","year":"2013","journal-title":"Proc Hum Factors Ergon Soc Annu Meet"},{"issue":"03","key":"ref29","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1136\/amiajnl-2010-000020","article-title":"Review of health information technology usability study methodologies","volume":"19","author":"P Y Yen","year":"2012","journal-title":"J Am Med Inform Assoc"},{"key":"ref30","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.ijmedinf.2017.11.007","article-title":"Usability evaluation of a commercial inpatient portal","volume":"110","author":"P Y Yen","year":"2018","journal-title":"Int J Med Inform"},{"key":"ref31","first-page":"68","article-title":"Development of a video coding scheme for analyzing the usability and usefulness of health information systems","volume":"218","author":"A W Kushniruk","year":"2015","journal-title":"Stud Health Technol Inform"},{"issue":"01","key":"ref32","doi-asserted-by":"crossref","first-page":"1609406917733847","DOI":"10.1177\/1609406917733847","article-title":"Thematic analysis: striving to meet the trustworthiness criteria","volume":"16","author":"L S Nowell","year":"2017","journal-title":"Int J Qual Methods"},{"issue":"10","key":"ref33","doi-asserted-by":"crossref","first-page":"1442","DOI":"10.1161\/CIRCULATIONAHA.107.742775","article-title":"Qualitative and mixed methods provide unique contributions to outcomes research","volume":"119","author":"L A Curry","year":"2009","journal-title":"Circulation"},{"issue":"02","key":"ref34","doi-asserted-by":"crossref","first-page":"534","DOI":"10.4338\/ACI-2015-10-CR-0144","article-title":"Clinical decision support for a multicenter trial of pediatric head trauma: development, implementation, and lessons learned","volume":"7","author":"E Tham","year":"2016","journal-title":"Appl Clin Inform"},{"issue":"02","key":"ref35","doi-asserted-by":"crossref","first-page":"380","DOI":"10.4338\/ACI-2015-12-RA-0177","article-title":"Guiding Principles for a Pediatric Neurology ICU (neuroPICU) Bedside Multimodal Monitor: findings from an International Working Group","volume":"7","author":"Z M Grinspan","year":"2016","journal-title":"Appl Clin Inform"},{"issue":"02","key":"ref36","first-page":"5","article-title":"Human-centered vs. user-centered approaches to information system design","volume":"5","author":"S Gasson","year":"2003","journal-title":"J Inf Technol Theory Appl"},{"issue":"03","key":"ref37","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1055\/s-0038-1669460","article-title":"Applying the RE-AIM framework for the evaluation of a clinical decision support tool for pediatric head trauma: a mixed-methods study","volume":"9","author":"R M Masterson Creber","year":"2018","journal-title":"Appl Clin Inform"},{"issue":"15","key":"ref38","doi-asserted-by":"crossref","first-page":"1458","DOI":"10.1001\/jama.282.15.1458","article-title":"Why don't physicians follow clinical practice guidelines? A framework for improvement","volume":"282","author":"M D Cabana","year":"1999","journal-title":"JAMA"},{"key":"ref39","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1007\/s10459-009-9182-2","article-title":"Clinical cognition and diagnostic error: applications of a dual process model of reasoning","volume":"14","author":"P Croskerry","year":"2009","journal-title":"Adv Health Sci Educ Theory Pract"},{"issue":"04","key":"ref40","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1055\/s-0040-1715893","article-title":"Considerations for designing EHR-embedded clinical decision support systems for antimicrobial stewardship in pediatric emergency departments","volume":"11","author":"M Ozkaynak","year":"2020","journal-title":"Appl Clin Inform"},{"key":"ref41","first-page":"195","volume-title":"Cognition and decision making","author":"B Kane","year":"2016"},{"issue":"02","key":"ref42","doi-asserted-by":"crossref","first-page":"290","DOI":"10.4338\/ACI-2015-12-LE-0176","article-title":"The quantified brain: a framework for mobile device-based assessment of behavior and neurological function","volume":"7","author":"D E Stark","year":"2016","journal-title":"Appl Clin Inform"},{"issue":"01","key":"ref43","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1186\/s12911-018-0602-1","article-title":"Effect of clinical decision rules, patient cost and malpractice information on clinician brain CT image ordering: a randomized controlled trial","volume":"18","author":"R W Gimbel","year":"2018","journal-title":"BMC Med Inform Decis Mak"}],"container-title":["Applied Clinical Informatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.1055\/s-0042-1745829.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,28]],"date-time":"2022-10-28T14:05:50Z","timestamp":1666965950000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/s-0042-1745829"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3]]},"references-count":42,"journal-issue":{"issue":"02","published-online":{"date-parts":[[2022,3,16]]},"published-print":{"date-parts":[[2022,3]]}},"URL":"https:\/\/doi.org\/10.1055\/s-0042-1745829","archive":["Portico","CLOCKSS"],"relation":{},"ISSN":["1869-0327"],"issn-type":[{"value":"1869-0327","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3]]}}}