{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,29]],"date-time":"2026-10-29T17:35:08Z","timestamp":1793295308115,"version":"4.5.0"},"reference-count":50,"publisher":"American Medical Association (AMA)","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JAMA Netw Open"],"abstract":"\n Importance<\/jats:title>\n Accurate identification of hospital readmission risk during a current hospitalization may enhance decision-making, facilitate targeted systems-level interventions, and avoid preventable readmissions.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n To temporally and externally validate a suite of readmission risk prediction models across 48 children\u2019s hospitals to assess their generalizability and feasibility for future clinical implementation.<\/jats:p>\n <\/jats:sec>\n \n Design, Setting, and Participants<\/jats:title>\n This prognostic study analyzed data from the Pediatric Health Information System (PHIS) database, which contains billing and resource use data from 48 US children\u2019s hospitals, including the derivation hospital (DH) and 47 hospitals participating in the PHIS database (hereafter other PHIS hospitals). Children aged 18 years or younger discharged from these hospitals between January 1, 2016, to December 31, 2019, were included. This cohort was divided as specified into the 3 prediction models at the DH: 6 months or older with no recent hospitalizations (new admission model [NAM]), 6 months or older with 1 or more prior hospitalizations within the last 6 months (recent admission model [RAM]), and 6 months or younger (young infant model [YIM]). Data were analyzed from August 9 to December 1, 2023.<\/jats:p>\n <\/jats:sec>\n \n Main Outcomes and Measures<\/jats:title>\n The primary validation outcome was hospital-level discrimination measured with area under the receiver operating characteristic curve (AUROC). Predictors included demographic, clinical, and utilization variables. All-cause 30-day readmission was modeled for each hospital using logistic regression and parameter estimates from the DH. Calibration plots examined observed vs predicted outcome frequencies for each hospital.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n In external validation, a total of 851\u202f499 children were discharged from 48 hospitals (16 330 DH discharges and 835 169 other PHIS hospital discharges). The largest group of children was aged 5 to 14 years (281 193 [33.0%]). In temporal validation, the DH PHIS 2016-2018 cohort included 45 682 discharges. All-cause 30-day readmission rates were 7.2% for NAM, 35.5% for RAM, and 11.7% for YIM. The 2019 DH PHIS cohort included 16 330 discharges. All cause 30-day readmision rates were 7.2% for NAM, 35.1% for RAM, and 11.1% for YIM. Temporal validation demonstrated reduced discrimination across all 3 models (median AUROC, 0.65 [95% CI 0.62-0.67] for the NAM; 0.73 [95% CI 0.72-0.75) for RAM; 0.67 [95% CI 0.63-0.70) for the YIM compared with the original estimates (median AUROC 0.76 [95% CI 0.85-0.78] for the NAM; 0.84 [95% CI 0.83-0.84] for the RAM; 0.79 [95% CI 0.77-0.80] for the YIM). Overall readmission rates were 5.9% for NAM, 30.1% for RAM, and 7.6% for YIM. External validation yielded similiar findings as the temporal validation, although with demonstrable variation in performance across hospitals (median [range] AUROC, 0.64 [0.60-0.68] for the NAM; 0.73 [0.64-0.80] for the RAM; 0.65 [0.53-0.74] for the YIM). Most hospitals were poorly calibrated, with both significant overestimation and underestimation of observed risk. Of 47 other PHIS hospitals, only 3 for the RAM (6.4%) and 9 for both the NAM and YIM (19.1%) were adequately calibrated.<\/jats:p>\n <\/jats:sec>\n \n Conclusions and Relevance<\/jats:title>\n This prognostic study found that the readmission risk prediction models had reduced predictive accuracy across time and variability in hospital-level performance. These findings stress the importance of local validation prior to clinical implementation and suggest opportunities to improve generalizability, including multicenter derivation and expansion of candidate predictors.<\/jats:p>\n <\/jats:sec>","DOI":"10.1001\/jamanetworkopen.2024.59684","type":"journal-article","created":{"date-parts":[[2025,2,13]],"date-time":"2025-02-13T11:15:02Z","timestamp":1739445302000},"page":"e2459684","source":"Crossref","is-referenced-by-count":4,"title":["Validation of 30-Day Pediatric Hospital Readmission Risk Prediction Models"],"prefix":"10.1001","volume":"8","author":[{"given":"Alison R.","family":"Carroll","sequence":"first","affiliation":[{"name":"Division of Pediatric Hospital Medicine, Department of Pediatrics, Vanderbilt University School of Medicine, Nashville, Tennessee"},{"name":"Monroe Carell Jr. Children\u2019s Hospital at Vanderbilt, Nashville, Tennessee"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew","family":"Hall","sequence":"additional","affiliation":[{"name":"Children\u2019s Hospital Association, Lenexa, Kansas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mitch","family":"Harris","sequence":"additional","affiliation":[{"name":"Children\u2019s Hospital Association, Lenexa, Kansas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael S.","family":"Carroll","sequence":"additional","affiliation":[{"name":"Quantitative Science Pillar, Stanley Manne Children\u2019s Research Institute of Chicago, Chicago, Illinois"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katherine A.","family":"Auger","sequence":"additional","affiliation":[{"name":"Division of Hospital Medicine, Department of Pediatrics, Cincinnati Children\u2019s Hospital Medical Center, Cincinnati, Ohio"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew M.","family":"Davis","sequence":"additional","affiliation":[{"name":"Nemours Children\u2019s Health, Wilmington, Delaware"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Denise M.","family":"Goodman","sequence":"additional","affiliation":[{"name":"Division of Critical Care Medicine, Ann & Robert H. Lurie Children\u2019s Hospital of Chicago, Chicago, Illinois"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Derek J.","family":"Williams","sequence":"additional","affiliation":[{"name":"Division of Pediatric Hospital Medicine, Department of Pediatrics, Vanderbilt University School of Medicine, Nashville, Tennessee"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10","published-online":{"date-parts":[[2025,2,13]]},"reference":[{"issue":"3","key":"zoi241666r1","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1001\/jamapediatrics.2021.5171","article-title":"Common diagnoses and costs in pediatric hospitalization in the US.","volume":"176","author":"Kaiser","year":"2022","journal-title":"JAMA Pediatr"},{"issue":"4","key":"zoi241666r8","doi-asserted-by":"publisher","first-page":"372","DOI":"10.1001\/jama.2012.188351","article-title":"Pediatric readmission prevalence and variability across hospitals.","volume":"309","author":"Berry","year":"2013","journal-title":"JAMA"},{"issue":"2","key":"zoi241666r9","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2015-4182","article-title":"Potentially preventable 30-day hospital readmissions at a children\u2019s hospital.","volume":"138","author":"Toomey","year":"2016","journal-title":"Pediatrics"},{"issue":"5","key":"zoi241666r10","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2018-0442","article-title":"Hospital-to-home interventions, use, and satisfaction: a meta-analysis.","volume":"142","author":"Hamline","year":"2018","journal-title":"Pediatrics"},{"issue":"4","key":"zoi241666r11","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1002\/jhm.2134","article-title":"Pediatric hospital discharge interventions to reduce subsequent utilization: a systematic review.","volume":"9","author":"Auger","year":"2014","journal-title":"J Hosp Med"},{"issue":"2","key":"zoi241666r12","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2017-4278","article-title":"Complex care hospital use and postdischarge coaching: a randomized controlled trial.","volume":"142","author":"Coller","year":"2018","journal-title":"Pediatrics"},{"issue":"2","key":"zoi241666r13","doi-asserted-by":"publisher","DOI":"10.1097\/pq9.0000000000000264","article-title":"A quality improvement intervention bundle to reduce 30-day pediatric readmissions.","volume":"5","author":"deJong","year":"2020","journal-title":"Pediatr Qual Saf"},{"issue":"9","key":"zoi241666r14","doi-asserted-by":"publisher","DOI":"10.1001\/jamapediatrics.2018.1482","article-title":"Effects of a 1-time nurse-led telephone call after pediatric discharge: the H2O II randomized clinical trial.","volume":"172","author":"Auger","year":"2018","journal-title":"JAMA Pediatr"},{"issue":"1","key":"zoi241666r15","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2017-3919","article-title":"Postdischarge nurse home visits and reuse: the Hospital to Home Outcomes (H2O) trial.","volume":"142","author":"Auger","year":"2018","journal-title":"Pediatrics"},{"issue":"3","key":"zoi241666r16","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1542\/hpeds.2018-0174","article-title":"Developing prediction models for 30-day unplanned readmission among children with medical complexity.","volume":"9","author":"Leary","year":"2019","journal-title":"Hosp Pediatr"},{"issue":"10","key":"zoi241666r17","doi-asserted-by":"publisher","first-page":"1151","DOI":"10.1542\/hpeds.2020-005786","article-title":"Targeted clinical interventions for reducing pediatric readmissions.","volume":"11","author":"Pugh","year":"2021","journal-title":"Hosp Pediatr"},{"issue":"9","key":"zoi241666r18","doi-asserted-by":"publisher","first-page":"578","DOI":"10.1542\/hpeds.2017-0220","article-title":"A novel model for enhanced prediction and understanding of unplanned 30-day pediatric readmission.","volume":"8","author":"Ehwerhemuepha","year":"2018","journal-title":"Hosp Pediatr"},{"issue":"11","key":"zoi241666r19","doi-asserted-by":"publisher","first-page":"779","DOI":"10.12788\/jhm.3043","article-title":"An electronic health record tool designed to improve pediatric hospital discharge has low predictive utility for readmissions.","volume":"13","author":"Brittan","year":"2018","journal-title":"J Hosp Med"},{"issue":"11","key":"zoi241666r20","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2022.41513","article-title":"Development and validation of an integrated suite of prediction models for all-cause 30-day readmissions of children and adolescents aged 0 to 18 years.","volume":"5","author":"Goodman","year":"2022","journal-title":"JAMA Netw Open"},{"issue":"3","key":"zoi241666r21","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1542\/hpeds.2019-0241","article-title":"Development and validation of a web-based pediatric readmission risk assessment tool.","volume":"10","author":"Taylor","year":"2020","journal-title":"Hosp Pediatr"},{"key":"zoi241666r22","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.artmed.2016.07.003","article-title":"Building interpretable predictive models for pediatric hospital readmission using Tree-Lasso logistic regression.","volume":"72","author":"Jovanovic","year":"2016","journal-title":"Artif Intell Med"},{"issue":"5","key":"zoi241666r23","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1016\/j.acap.2018.09.006","article-title":"Potential impact of initial clinical data on adjustment of pediatric readmission rates.","volume":"19","author":"Nakamura","year":"2019","journal-title":"Acad Pediatr"},{"key":"zoi241666r24","doi-asserted-by":"publisher","DOI":"10.1136\/bmj-2023-074820","article-title":"Evaluation of clinical prediction models (part 2): how to undertake an external validation study.","volume":"384","author":"Riley","year":"2024","journal-title":"BMJ"},{"key":"zoi241666r25","doi-asserted-by":"publisher","DOI":"10.1136\/bmj-2023-074819","article-title":"Evaluation of clinical prediction models (part 1): from development to external validation.","volume":"384","author":"Collins","year":"2024","journal-title":"BMJ"},{"issue":"1","key":"zoi241666r26","doi-asserted-by":"publisher","first-page":"W1-73","DOI":"10.7326\/M14-0698","article-title":"Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD): explanation and elaboration.","volume":"162","author":"Moons","year":"2015","journal-title":"Ann Intern Med"},{"issue":"8","key":"zoi241666r27","doi-asserted-by":"publisher","first-page":"632","DOI":"10.1001\/jamainternmed.2013.3023","article-title":"Potentially avoidable 30-day hospital readmissions in medical patients: derivation and validation of a prediction model.","volume":"173","author":"Donz\u00e9","year":"2013","journal-title":"JAMA Intern Med"},{"issue":"4","key":"zoi241666r28","doi-asserted-by":"publisher","first-page":"496","DOI":"10.1001\/jamainternmed.2015.8462","article-title":"International validity of the hospital score to predict 30-day potentially avoidable hospital readmissions.","volume":"176","author":"Donz\u00e9","year":"2016","journal-title":"JAMA Intern Med"},{"issue":"6","key":"zoi241666r29","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1503\/cmaj.091117","article-title":"Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community.","volume":"182","author":"van Walraven","year":"2010","journal-title":"CMAJ"},{"issue":"1","key":"zoi241666r30","doi-asserted-by":"publisher","first-page":"286","DOI":"10.1542\/peds.2007-3395","article-title":"How well can hospital readmission be predicted in a cohort of hospitalized children? a retrospective, multicenter study.","volume":"123","author":"Feudtner","year":"2009","journal-title":"Pediatrics"},{"issue":"5","key":"zoi241666r32","doi-asserted-by":"publisher","first-page":"294","DOI":"10.12788\/jhm.3608","article-title":"The COVID-19 pandemic and changes in healthcare utilization for pediatric respiratory and nonrespiratory illnesses in the United States.","volume":"16","author":"Antoon","year":"2021","journal-title":"J Hosp Med"},{"issue":"9","key":"zoi241666r33","doi-asserted-by":"publisher","first-page":"1315","DOI":"10.1097\/JTO.0b013e3181ec173d","article-title":"Receiver operating characteristic curve in diagnostic test assessment.","volume":"5","author":"Mandrekar","year":"2010","journal-title":"J Thorac Oncol"},{"issue":"1","key":"zoi241666r36","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1111\/jpc.14492","article-title":"Risk factors associated with 30-day all-cause unplanned hospital readmissions at a tertiary children\u2019s hospital in Western Australia.","volume":"56","author":"Zhou","year":"2020","journal-title":"J Paediatr Child Health"},{"issue":"3","key":"zoi241666r37","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2021-055956","article-title":"Applicability of predictive models for 30-day unplanned hospital readmission risk in paediatrics: a systematic review.","volume":"12","author":"Niehaus","year":"2022","journal-title":"BMJ Open"},{"issue":"7","key":"zoi241666r38","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1002\/jhm.2568","article-title":"Predicting all-cause readmissions using electronic health record data from the entire hospitalization: model development and comparison.","volume":"11","author":"Nguyen","year":"2016","journal-title":"J Hosp Med"},{"key":"zoi241666r39","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1016\/j.jclinane.2019.04.039","article-title":"Validation of the LACE readmission and mortality prediction model in a large surgical cohort: comparison of performance at preoperative assessment and discharge time points.","volume":"58","author":"Shaffer","year":"2019","journal-title":"J Clin Anesth"},{"issue":"1","key":"zoi241666r41","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2017-020554","article-title":"Risk factors associated with paediatric unplanned hospital readmissions: a systematic review.","volume":"9","author":"Zhou","year":"2019","journal-title":"BMJ Open"},{"issue":"2","key":"zoi241666r42","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1001\/jamapediatrics.2013.432","article-title":"Inpatient growth and resource use in 28 children\u2019s hospitals: a longitudinal, multi-institutional study.","volume":"167","author":"Berry","year":"2013","journal-title":"JAMA Pediatr"},{"key":"zoi241666r43","doi-asserted-by":"publisher","first-page":"51","DOI":"10.2147\/CLEP.S149574","article-title":"Performance of the LACE index to predict 30-day hospital readmissions in patients with chronic obstructive pulmonary disease.","volume":"10","author":"Hakim","year":"2017","journal-title":"Clin Epidemiol"},{"issue":"1","key":"zoi241666r44","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1186\/s12911-020-01153-7","article-title":"HealtheDataLab - a cloud computing solution for data science and advanced analytics in healthcare with application to predicting multi-center pediatric readmissions.","volume":"20","author":"Ehwerhemuepha","year":"2020","journal-title":"BMC Med Inform Decis Mak"},{"issue":"2","key":"zoi241666r45","doi-asserted-by":"publisher","first-page":"9","DOI":"10.7812\/TPP\/23.114","article-title":"Predictive value of LACE scores for pediatric readmissions.","volume":"28","author":"Douillard","year":"2024","journal-title":"Perm J"},{"issue":"7","key":"zoi241666r46","doi-asserted-by":"publisher","first-page":"682","DOI":"10.1001\/jama.2011.122","article-title":"Hospital utilization and characteristics of patients experiencing recurrent readmissions within children\u2019s hospitals.","volume":"305","author":"Berry","year":"2011","journal-title":"JAMA"},{"issue":"1","key":"zoi241666r47","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1186\/1471-2431-14-199","article-title":"Pediatric Complex Chronic Conditions Classification System version 2: updated for ICD-10 and complex medical technology dependence and transplantation.","volume":"14","author":"Feudtner","year":"2014","journal-title":"BMC Pediatr"},{"issue":"5","key":"zoi241666r48","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1016\/j.acap.2018.02.010","article-title":"Development and validation of the Pediatric Medical Complexity Algorithm (PMCA) version 3.0.","volume":"18","author":"Simon","year":"2018","journal-title":"Acad Pediatr"},{"issue":"7969","key":"zoi241666r49","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1038\/s41586-023-06160-y","article-title":"Health system-scale language models are all-purpose prediction engines.","volume":"619","author":"Jiang","year":"2023","journal-title":"Nature"},{"issue":"10","key":"zoi241666r50","doi-asserted-by":"publisher","first-page":"905","DOI":"10.1001\/jamapediatrics.2015.1129","article-title":"Same-hospital readmission rates as a measure of pediatric quality of care.","volume":"169","author":"Khan","year":"2015","journal-title":"JAMA Pediatr"},{"key":"zoi241666r34","doi-asserted-by":"crossref","DOI":"10.1002\/0471722146","volume-title":"Applied Logistic Regression","author":"Hosmer","year":"2000","edition":"2nd ed"},{"key":"zoi241666r35","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-77244-8","volume-title":"Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating","author":"Steyerberg","year":"2009"},{"key":"zoi241666r40","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-19425-7","volume-title":"Regression Modeling Strategies: With Applications to Linear Models, Logistic and Ordinal Regression, and Survival Analysis","author":"Harrell","year":"2015"},{"key":"zoi241666r2","unstructured":"Agency for Healthcare Research and Quality. HCUP, Healthcare Cost and Utilization Project. Accessed March 4, 2024. https:\/\/datatools.ahrq.gov\/hcupnet\/"},{"key":"zoi241666r3","unstructured":"Oklahoma Health Care Authority. Hospital Potentially Preventable Readmissions (PPR) program. April 30, 2019. Accessed May 7, 2024. https:\/\/oklahoma.gov\/content\/dam\/ok\/en\/okhca\/documents\/a0302\/23350.pdf"},{"key":"zoi241666r4","unstructured":"New York State Health Foundation. Reducing hospital readmissions in New York State: a simulation analysis of alternative payment incentives. September 2011. Accessed May 7, 2024. https:\/\/nyhealthfoundation.org\/wp-content\/uploads\/2017\/12\/reducing-hospital-readmissions-payment-incentives-september-2011.pdf"},{"key":"zoi241666r5","unstructured":"Texas Medicaid and Healthcare Partnership. Potentially preventable events. August 18, 2023. Accessed May 7, 2024. https:\/\/www.hhs.texas.gov\/about\/process-improvement\/improving-services-texans\/medicaid-chip-quality-efficiency-improvement\/potentially-preventable-events"},{"key":"zoi241666r6","unstructured":"Illinois Department of Healthcare and Family Services. Potentially preventable readmissions policy. 2016. Accessed May 7, 2024. https:\/\/hfs.illinois.gov\/medicalproviders\/hospitals\/pprreports.html"},{"key":"zoi241666r7","unstructured":"National Quality Forum. All-cause admissions and readmissions measures. Accessed February 1, 2023. https:\/\/www.qualityforum.org\/Publications\/2015\/04\/All-Cause_Admissions_and_Readmissions_Measures_-_Final_Report.aspx"},{"key":"zoi241666r31","unstructured":"World Health Organization. ICD-10: International Statistical Classification of Diseases and Related Health Problems, Tenth Revision. 2nd ed. World Health Organization; 2004. Accessed January 1, 2024. https:\/\/iris.who.int\/handle\/10665\/42980"}],"container-title":["JAMA Network Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/articlepdf\/2830224\/carroll_2025_oi_241666_1738862584.46002.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,13]],"date-time":"2025-02-13T11:15:08Z","timestamp":1739445308000},"score":1,"resource":{"primary":{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2830224"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,13]]},"references-count":50,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,2,3]]}},"URL":"https:\/\/doi.org\/10.1001\/jamanetworkopen.2024.59684","relation":{},"ISSN":["2574-3805"],"issn-type":[{"value":"2574-3805","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,13]]}}}