{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T16:31:26Z","timestamp":1788280286905,"version":"build-2803163510"},"reference-count":46,"publisher":"Georg Thieme Verlag KG","issue":"03","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Appl Clin Inform"],"published-print":{"date-parts":[[2025,5]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>To review pediatric artificial intelligence (AI) implementation studies from 2010 to 2021 and analyze reported performance measures.<\/jats:p><jats:p>We searched PubMed\/Medline, Embase CINHAL, Cochrane Library CENTRAL, IEEE, and Web of Science with controlled vocabulary. Inclusion criteria: AI intervention in a pediatric clinical setting that learns from data (i.e., data-driven, as opposed to rule-based) and takes actions to make patient-specific recommendations; published between 01\/2010 and 10\/2021; must have agency (AI must provide guidance that affects clinical care, not merely running in the background). We extracted study characteristics, target users, implementation setting, time span, and performance measures.<\/jats:p><jats:p>Of 126 articles reviewed as full text, 17 met inclusion criteria. Eight studies (47%) reported both clinical outcomes and process measures, six (35%) reported only process measures and two (12%) reported only clinical outcomes. Five studies (30%) reported no difference in clinical outcomes with AI, four (24%) reported improvement in clinical outcomes compared with controls, two (12%) reported positive effects on clinical outcomes with use of AI but had no formal comparison or controls, and one (6%) reported poor clinical outcomes with AI. Twelve studies (71%) reported improvement in process measures, while two (12%) reported no improvement. Five (30%) studies reported on at least 1 human performance measure.<\/jats:p><jats:p>While there are many published pediatric AI models, the number of AI implementations is minimal with no standardized reporting of outcomes, care processes, or human performance measures. More comprehensive evaluations will help elucidate mechanisms of impact.<\/jats:p>","DOI":"10.1055\/a-2521-1508","type":"journal-article","created":{"date-parts":[[2025,1,22]],"date-time":"2025-01-22T00:30:21Z","timestamp":1737505821000},"page":"477-487","source":"Crossref","is-referenced-by-count":6,"title":["Pediatric Predictive Artificial Intelligence Implemented in Clinical Practice from 2010 to 2021: A Systematic Review"],"prefix":"10.1055","volume":"16","author":[{"given":"Swaminathan","family":"Kandaswamy","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Emory University School of Medicine, Atlanta, Georgia, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lindsey A.","family":"Knake","sequence":"additional","affiliation":[{"name":"Division of Neonatology, Department of Pediatrics, University of Iowa, Iowa City, Iowa, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adam C.","family":"Dziorny","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, University of Rochester, Rochester, New York, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sean M.","family":"Hernandez","sequence":"additional","affiliation":[{"name":"Primary Care, Miami Veteran's Affairs, Miami, Florida, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Allison B.","family":"McCoy","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lauren M.","family":"Hess","sequence":"additional","affiliation":[{"name":"Pediatric Hospital Medicine, Texas Children's Hospital, Houston, Texas, United States"},{"name":"Division of Pediatric Hospital Medicine, Department of Pediatrics, Baylor College of Medicine, Houston, Texas, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Evan","family":"Orenstein","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Emory University School of Medicine, Atlanta, Georgia, United States"},{"name":"Division of Hospital Medicine, Children's Healthcare of Atlanta, Atlanta, Georgia, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mia S.","family":"White","sequence":"additional","affiliation":[{"name":"Woodruff Health Sciences Center Library, Emory University, Atlanta, Georgia, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eric S.","family":"Kirkendall","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Wake Forest University School of Medicine, Center for Healthcare Innovation, Winston-Salem, North Carolina, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew J.","family":"Molloy","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Cincinnati Children's Hospital Medical Center and the University of Cincinnati College of Medicine, Cincinnati, Ohio, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Philip A.","family":"Hagedorn","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Cincinnati Children's Hospital Medical Center and the University of Cincinnati College of Medicine, Cincinnati, Ohio, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Naveen","family":"Muthu","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Emory University School of Medicine, Atlanta, Georgia, United States"},{"name":"Division of Hospital Medicine, Children's Healthcare of Atlanta, Atlanta, Georgia, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Avinash","family":"Murugan","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, Yale New Haven Hospital, New Haven, Connecticut, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan M.","family":"Beus","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Emory University School of Medicine, Atlanta, Georgia, United States"},{"name":"Division of Hospital Medicine, Children's Healthcare of Atlanta, Atlanta, Georgia, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark","family":"Mai","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Emory University School of Medicine, Atlanta, Georgia, United States"},{"name":"Division of Hospital Medicine, Children's Healthcare of Atlanta, Atlanta, Georgia, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brooke","family":"Luo","sequence":"additional","affiliation":[{"name":"Department of Biomedical and Health Informatics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, United States"},{"name":"Department of Pediatrics, University of Pennsylvania, Perelman School of Medicine, Philadelphia, Pennsylvania, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juan D.","family":"Chaparro","sequence":"additional","affiliation":[{"name":"Division of Clinical Informatics, Department of Pediatrics, Nationwide Children's Hospital\/Ohio State University College of Medicine, Columbus, Ohio, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"194","published-online":{"date-parts":[[2025,5,28]]},"reference":[{"issue":"01","key":"ref1","doi-asserted-by":"crossref","first-page":"e2020011833","DOI":"10.1542\/peds.2020-011833","article-title":"Machine learning for child and adolescent health: a systematic review","volume":"147","author":"Z Hoodbhoy","year":"2021","journal-title":"Pediatrics"},{"issue":"05","key":"ref2","doi-asserted-by":"crossref","first-page":"101346","DOI":"10.1016\/j.siny.2022.101346","article-title":"Application and potential of artificial intelligence in neonatal medicine","volume":"27","author":"T C Kwok","year":"2022","journal-title":"Semin Fetal Neonatal Med"},{"issue":"10","key":"ref3","doi-asserted-by":"crossref","first-page":"e40238","DOI":"10.2196\/40238","article-title":"Artificial intelligence applications in health care practice: scoping review","volume":"24","author":"M Sharma","year":"2022","journal-title":"J Med Internet Res"},{"key":"ref4","doi-asserted-by":"crossref","first-page":"105241","DOI":"10.1016\/j.ijmedinf.2023.105241","article-title":"Machine learning in medication prescription: a systematic review","volume":"180","author":"A Iancu","year":"2023","journal-title":"Int J Med Inform"},{"key":"ref5","doi-asserted-by":"crossref","first-page":"100137","DOI":"10.1016\/j.glmedi.2024.100137","article-title":"Artificial intelligence for pediatric emergency medicine","volume":"3","author":"M Alsabri","year":"2024","journal-title":"J Med Surg Public Health"},{"issue":"01","key":"ref6","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1097\/00130478-200007000-00008","article-title":"Predicting pediatric length of stay and acuity of care in the first ten minutes with artificial neural networks","volume":"1","author":"S Walczak","year":"2000","journal-title":"Pediatr Crit Care Med"},{"issue":"01","key":"ref7","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.acap.2021.07.015","article-title":"Comparing artificial intelligence and traditional methods to identify factors associated with pediatric asthma readmission","volume":"22","author":"A H Hogan","year":"2022","journal-title":"Acad Pediatr"},{"issue":"12","key":"ref8","doi-asserted-by":"crossref","first-page":"1600","DOI":"10.1093\/jamia\/ocy122","article-title":"Predicting individual physiologically acceptable states at discharge from a pediatric intensive care unit","volume":"25","author":"C S Carlin","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"06","key":"ref9","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1097\/PCC.0000000000002682","article-title":"Continuous prediction of mortality in the PICU: a recurrent neural network model in a single-center dataset","volume":"22","author":"M D Aczon","year":"2021","journal-title":"Pediatr Crit Care Med"},{"issue":"01","key":"ref10","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1186\/s12887-018-1082-2","article-title":"Development and validation of a diagnostic model for early differentiation of sepsis and non-infectious SIRS in critically ill children - a data-driven approach using machine-learning algorithms","volume":"18","author":"F Lamping","year":"2018","journal-title":"BMC Pediatr"},{"key":"ref11","doi-asserted-by":"crossref","first-page":"413","DOI":"10.3389\/fped.2019.00413","article-title":"Pediatric severe sepsis prediction using machine learning","volume":"7","author":"S Le","year":"2019","journal-title":"Front Pediatr"},{"issue":"07","key":"ref12","doi-asserted-by":"crossref","first-page":"514","DOI":"10.1097\/PCC.0000000000002965","article-title":"Development and external validation of a machine learning model for prediction of potential transfer to the PICU","volume":"23","author":"A Mayampurath","year":"2022","journal-title":"Pediatr Crit Care Med"},{"key":"ref13","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.resuscitation.2018.09.019","article-title":"Predicting cardiac arrests in pediatric intensive care units","volume":"133","author":"M M Pollack","year":"2018","journal-title":"Resuscitation"},{"issue":"17","key":"ref14","doi-asserted-by":"crossref","first-page":"2407","DOI":"10.1089\/neu.2020.7514","article-title":"Magnetic resonance imaging findings are associated with long-term global neurological function or death after traumatic brain injury in critically ill children","volume":"38","author":"C McInnis","year":"2021","journal-title":"J Neurotrauma"},{"issue":"06","key":"ref15","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1016\/j.cjtee.2021.06.003","article-title":"Application of machine learning to predict the outcome of pediatric traumatic brain injury","volume":"24","author":"T Tunthanathip","year":"2021","journal-title":"Chin J Traumatol"},{"issue":"03","key":"ref16","doi-asserted-by":"crossref","first-page":"R133","DOI":"10.1186\/cc13951","article-title":"Decision tree model for predicting long-term outcomes in children with out-of-hospital cardiac arrest: a nationwide, population-based observational study","volume":"18","author":"Y Goto","year":"2014","journal-title":"Crit Care"},{"issue":"05","key":"ref17","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1097\/WNP.0000000000000591","article-title":"Early EEG features for outcome prediction after cardiac arrest in children","volume":"36","author":"F W Fung","year":"2019","journal-title":"J Clin Neurophysiol"},{"issue":"02","key":"ref18","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1097\/PCC.0000000000002612","article-title":"Machine learning to predict cardiac death within 1\u2009hour after terminal extubation","volume":"22","author":"M C Winter","year":"2021","journal-title":"Pediatr Crit Care Med"},{"issue":"01","key":"ref19","doi-asserted-by":"crossref","first-page":"100516","DOI":"10.1136\/bmjhci-2021-100516","article-title":"Eight human factors and ergonomics principles for healthcare artificial intelligence","volume":"29","author":"M Sujan","year":"2022","journal-title":"BMJ Health Care Inform"},{"issue":"71","key":"ref20","doi-asserted-by":"crossref","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement: an updated guideline for reporting systematic reviews","volume":"372","author":"M J Page","year":"2021","journal-title":"BMJ"},{"issue":"10","key":"ref21","doi-asserted-by":"crossref","first-page":"1799","DOI":"10.1007\/s00467-018-4015-2","article-title":"Artificial intelligence outperforms experienced nephrologists to assess dry weight in pediatric patients on chronic hemodialysis","volume":"33","author":"O Niel","year":"2018","journal-title":"Pediatr Nephrol"},{"key":"ref22","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1016\/j.eswa.2017.06.035","article-title":"Identifying child abuse through text mining and machine learning. Expert systems with applications","volume":"88","author":"C Amrit","year":"2017","journal-title":"Expert Syst Appl"},{"issue":"05","key":"ref23","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1007\/s00431-018-3113-2","article-title":"Sepsis calculator implementation reduces empiric antibiotics for suspected early-onset sepsis","volume":"177","author":"N B Achten","year":"2018","journal-title":"Eur J Pediatr"},{"issue":"11","key":"ref24","doi-asserted-by":"crossref","first-page":"1026","DOI":"10.1097\/INF.0000000000002794","article-title":"Cost study of a cluster randomized trial on a clinical decision rule guiding antibiotic treatment in children with suspected lower respiratory tract infections in the emergency department","volume":"39","author":"J van de Maat","year":"2020","journal-title":"Pediatr Infect Dis J"},{"issue":"03","key":"ref25","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1093\/tbm\/ibz043","article-title":"Feasibility of pediatric obesity and prediabetes treatment support through Tess, the AI behavioral coaching chatbot","volume":"9","author":"T N Stephens","year":"2019","journal-title":"Transl Behav Med"},{"issue":"489","key":"ref26","doi-asserted-by":"crossref","first-page":"eaat6177","DOI":"10.1126\/scitranslmed.aat6177","article-title":"Diagnosis of genetic diseases in seriously ill children by rapid whole-genome sequencing and automated phenotyping and interpretation","volume":"11","author":"M M Clark","year":"2019","journal-title":"Sci Transl Med"},{"key":"ref27","first-page":"1130","article-title":"Natural language processing and machine learning to enable clinical decision support for treatment of pediatric pneumonia","volume":"2020","author":"J C Smith","year":"2021","journal-title":"AMIA Annu Symp Proc"},{"issue":"01","key":"ref28","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1186\/s13073-021-00965-0","article-title":"Artificial intelligence enables comprehensive genome interpretation and nomination of candidate diagnoses for rare genetic diseases","volume":"13","author":"F M De La Vega","year":"2021","journal-title":"Genome Med"},{"issue":"01","key":"ref29","doi-asserted-by":"crossref","first-page":"e1003034","DOI":"10.1371\/journal.pmed.1003034","article-title":"Evaluation of a clinical decision rule to guide antibiotic prescription in children with suspected lower respiratory tract infection in The Netherlands: a stepped-wedge cluster randomised trial","volume":"17","author":"J S van de Maat","year":"2020","journal-title":"PLoS Med"},{"key":"ref30","doi-asserted-by":"crossref","first-page":"551","DOI":"10.3389\/fphar.2020.00551","article-title":"Model-informed precision dosing of vancomycin in hospitalized children: implementation and adoption at an academic children's hospital","volume":"11","author":"A Frymoyer","year":"2020","journal-title":"Front Pharmacol"},{"issue":"03","key":"ref31","doi-asserted-by":"crossref","first-page":"e14185","DOI":"10.2196\/14185","article-title":"A real-time automated patient screening system for clinical trials eligibility in an emergency department: design and evaluation","volume":"7","author":"Y Ni","year":"2019","journal-title":"JMIR Med Inform"},{"issue":"01","key":"ref32","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1186\/s12913-021-06248-z","article-title":"Artificial intelligence-assisted reduction in patients' waiting time for outpatient process: a retrospective cohort study","volume":"21","author":"X Li","year":"2021","journal-title":"BMC Health Serv Res"},{"issue":"11","key":"ref33","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1016\/j.ijmedinf.2014.07.008","article-title":"Implementation and evaluation of an integrated computerized asthma management system in a pediatric emergency department: a randomized clinical trial","volume":"83","author":"J W Dexheimer","year":"2014","journal-title":"Int J Med Inform"},{"issue":"08","key":"ref34","doi-asserted-by":"crossref","first-page":"e0255261","DOI":"10.1371\/journal.pone.0255261","article-title":"Artificial intelligence-assisted clinical decision support for childhood asthma management: A randomized clinical trial","volume":"16","author":"H Y Seol","year":"2021","journal-title":"PLoS One"},{"issue":"05","key":"ref35","doi-asserted-by":"crossref","first-page":"e0127620","DOI":"10.1371\/journal.pone.0127620","article-title":"Impact of a clinical decision model for febrile children at risk for serious bacterial infections at the emergency department: a randomized controlled trial","volume":"10","author":"E de Vos-Kerkhof","year":"2015","journal-title":"PLoS One"},{"key":"ref36","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.eclinm.2019.03.001","article-title":"Diagnostic efficacy and therapeutic decision-making capacity of an artificial intelligence platform for childhood cataracts in eye clinics: a multicentre randomized controlled trial","volume":"9","author":"H Lin","year":"2019","journal-title":"EClinicalMedicine"},{"issue":"09","key":"ref37","doi-asserted-by":"crossref","first-page":"1380","DOI":"10.1038\/s41591-020-1045-7","article-title":"Insulin dose optimization using an automated artificial intelligence-based decision support system in youths with type 1 diabetes","volume":"26","author":"R Nimri","year":"2020","journal-title":"Nat Med"},{"issue":"08","key":"ref38","doi-asserted-by":"crossref","first-page":"AIp2400223","DOI":"10.1056\/AIp2400223","article-title":"A call for artificial intelligence implementation science centers to evaluate clinical effectiveness","volume":"1","author":"C A Longhurst","year":"2024","journal-title":"NEJM AI"},{"issue":"01","key":"ref39","doi-asserted-by":"crossref","first-page":"29","DOI":"10.7326\/0003-4819-157-1-201207030-00450","article-title":"Effect of clinical decision-support systems: a systematic review","volume":"157","author":"T J Bright","year":"2012","journal-title":"Ann Intern Med"},{"issue":"08","key":"ref40","doi-asserted-by":"crossref","first-page":"e392","DOI":"10.1097\/PCC.0000000000002973","article-title":"Clinical decision support in the PICU: implications for design and evaluation","volume":"23","author":"A C Dziorny","year":"2022","journal-title":"Pediatr Crit Care Med"},{"key":"ref41","volume-title":"A Unified Approach to Interpreting Model Predictions","author":"S Lundberg"},{"key":"ref42","doi-asserted-by":"crossref","first-page":"1577","DOI":"10.1016\/S0140-6736(19)30037-6","article-title":"Reporting of artificial intelligence prediction models","volume":"393","author":"G S Collins","year":"2019","journal-title":"Lancet"},{"issue":"06","key":"ref43","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1038\/s41591-020-0941-1","article-title":"Developing specific reporting guidelines for diagnostic accuracy studies assessing AI interventions: the STARD-AI steering group","volume":"26","author":"V Sounderajah","year":"2020","journal-title":"Nat Med"},{"key":"ref45","doi-asserted-by":"crossref","first-page":"m3164","DOI":"10.1136\/bmj.m3164","article-title":"Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension","volume":"370","author":"X Liu","year":"2020","journal-title":"BMJ"},{"issue":"01","key":"ref46","first-page":"1","article-title":"Recommendations for the use of pediatric data in artificial intelligence and machine learning ACCEPT-AI. npj","volume":"6","author":"V Muralidharan","year":"2023","journal-title":"Digit Med"},{"key":"ref47","doi-asserted-by":"crossref","first-page":"104510","DOI":"10.1016\/j.ijmedinf.2021.104510","article-title":"The need to separate the wheat from the chaff in medical informatics: Introducing a comprehensive checklist for the (self)-assessment of medical AI studies","volume":"153","author":"F Cabitza","year":"2021","journal-title":"Int J Med Inform"}],"container-title":["Applied Clinical Informatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.1055\/a-2521-1508.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,28]],"date-time":"2025-05-28T23:10:15Z","timestamp":1748473815000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/a-2521-1508"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,21]]},"references-count":46,"journal-issue":{"issue":"03","published-online":{"date-parts":[[2025,5,28]]},"published-print":{"date-parts":[[2025,5]]}},"URL":"https:\/\/doi.org\/10.1055\/a-2521-1508","archive":["Portico","CLOCKSS"],"relation":{},"ISSN":["1869-0327"],"issn-type":[{"value":"1869-0327","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2025,1,21]]},"published":{"date-parts":[[2025,1,21]]}}}