{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T15:04:00Z","timestamp":1763996640383,"version":"3.45.0"},"reference-count":12,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"12","license":[{"start":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T00:00:00Z","timestamp":1763942400000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"abstract":"<jats:sec>\n                    <jats:title>OBJECTIVE:<\/jats:title>\n                    <jats:p>To determine the accuracy of a custom version of the generative pretrained transformer (GPT)-4o large language model (LLM) in identifying PICU admissions with vs. without bacterial pneumonia using clinical notes.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>DESIGN:<\/jats:title>\n                    <jats:p>In this retrospective cohort study, the GPT-4o model was provided guidance on our institution\u2019s pneumonia diagnosis practices through a custom prompt and instructed to analyze PICU provider notes from the first 2 calendar days of PICU admission to identify bacterial pneumonia diagnoses. Diagnoses from the manually curated Virtual Pediatric Systems (VPS) Registry were used as the gold standard.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>SETTING:<\/jats:title>\n                    <jats:p>A 48-bed, academic, quaternary care PICU.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>PATIENTS:<\/jats:title>\n                    <jats:p>Children 3 months old to 18 years old admitted to the PICU from January 1, 2023, to December 31, 2023.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>INTERVENTIONS:<\/jats:title>\n                    <jats:p>None.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>MEASUREMENTS AND MAIN RESULTS:<\/jats:title>\n                    <jats:p>GPT-4o analyzed 10,081 notes from 3,317 PICU admissions over 5.0 minutes (mean 0.03\u2009s per note). Of the 3317 study encounters, 481(14.5%) had a VPS admission pneumonia diagnosis. GPT-4o accurately classified 3143 of 3317 (94.8%) encounters. In a post hoc adjudication analysis, a blinded PICU attending reviewed patient charts with VPS-GPT discordant classifications. The GPT-4o classification matched that of the blinded PICU attending in 125 of 174 (71.8%) of such encounters. The most common reason for incorrect classification by GPT-4o was that a pneumonia diagnosis was listed in the initial notes but later rescinded when a different diagnosis was identified.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>CONCLUSIONS:<\/jats:title>\n                    <jats:p>The GPT-4o LLM was able to accurately and rapidly identify critically ill children with vs. without bacterial pneumonia. This study suggests similar tools could be developed to automate and accelerate processes typically requiring manual chart review.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1097\/cce.0000000000001350","type":"journal-article","created":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T15:00:10Z","timestamp":1763996410000},"page":"e1350","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":0,"title":["Fast, Accurate Assignment of Clinical Diagnoses From Patient Notes by a Large Language Model: Critical Pediatric Pneumonia as a Use Case"],"prefix":"10.1097","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5683-8310","authenticated-orcid":false,"given":"Blake","family":"Martin","sequence":"first","affiliation":[{"name":"Section of Critical Care Medicine, Department of Pediatrics, University of Colorado School of Medicine, Aurora, CO."},{"name":"Department of Biomedical Informatics, University of Colorado School of Medicine, Aurora, CO."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marisa","family":"Payan","sequence":"additional","affiliation":[{"name":"Research Informatics and Data Science, Children\u2019s Hospital Colorado, Aurora, CO."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jaime","family":"LaVelle","sequence":"additional","affiliation":[{"name":"Division of Pediatric Critical Care, Children\u2019s Hospital Colorado, Aurora, CO."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter E.","family":"DeWitt","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Colorado School of Medicine, Aurora, CO."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Seth","family":"Russell","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Colorado School of Medicine, Aurora, CO."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Mitchell","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Colorado School of Medicine, Aurora, CO."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sara J.","family":"Deakyne Davies","sequence":"additional","affiliation":[{"name":"Research Informatics and Data Science, Children\u2019s Hospital Colorado, Aurora, CO."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tellen D.","family":"Bennett","sequence":"additional","affiliation":[{"name":"Section of Critical Care Medicine, Department of Pediatrics, University of Colorado School of Medicine, Aurora, CO."},{"name":"Department of Biomedical Informatics, University of Colorado School of Medicine, Aurora, CO."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"276","published-online":{"date-parts":[[2025,11,24]]},"reference":[{"key":"R1-20251124","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1001\/jamapediatrics.2013.186","article-title":"Identifying pediatric community-acquired pneumonia hospitalizations: Accuracy of administrative billing codes.","volume":"167","author":"Williams","year":"2013","journal-title":"JAMA Pediatr"},{"key":"R2-20251124","doi-asserted-by":"crossref","first-page":"1295","DOI":"10.1016\/j.jpeds.2015.09.027","article-title":"Identifying pediatric severe sepsis and septic shock: Accuracy of diagnosis codes.","volume":"167","author":"Balamuth","year":"2015","journal-title":"J Pediatr"},{"key":"R3-20251124","doi-asserted-by":"crossref","first-page":"e129","DOI":"10.1097\/CCM.0000000000003541","article-title":"Comparison of methods for identification of pediatric severe sepsis and septic shock in the virtual pediatric systems database.","volume":"47","author":"Lindell","year":"2019","journal-title":"Crit Care Med"},{"key":"R4-20251124","first-page":"10","article-title":"Measuring the delivery of complex interventions through electronic medical records: Challenges and lessons learned.","volume":"6","author":"Prusaczyk","year":"2018","journal-title":"EGEMS (Wash DC)"},{"key":"R5-20251124","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.jpeds.2016.07.045","article-title":"Value of procalcitonin measurement for early evidence of severe bacterial infections in the pediatric intensive care unit.","volume":"179","author":"Lautz","year":"2016","journal-title":"J Pediatr"},{"key":"R6-20251124","doi-asserted-by":"crossref","first-page":"590","DOI":"10.1542\/hpeds.2021-005998","article-title":"Machine learning approach to predicting absence of serious bacterial infection at PICU admission.","volume":"12","author":"Martin","year":"2022","journal-title":"Hosp Pediatr"},{"key":"R7-20251124","first-page":"1238","article-title":"Clinical and microbiological profile of nosocomial infections in the pediatric intensive care unit (PICU).","volume":"41","author":"Deep","year":"2004","journal-title":"Indian Pediatr"},{"key":"R8-20251124","doi-asserted-by":"crossref","first-page":"e2023062246","DOI":"10.1542\/peds.2023-062246","article-title":"A National Quality Improvement Collaborative to improve antibiotic use in pediatric infections.","volume":"153","author":"McCulloh","year":"2024","journal-title":"Pediatrics"},{"key":"R9-20251124","doi-asserted-by":"crossref","first-page":"e20161411","DOI":"10.1542\/peds.2016-1411","article-title":"Value in inpatient pediatrics network quality collaborative for improving care in Community Acquired P. A Multicenter Collaborative to improve care of community acquired pneumonia in hospitalized children.","volume":"139","author":"Parikh","year":"2017","journal-title":"Pediatrics"},{"key":"R10-20251124","doi-asserted-by":"crossref","DOI":"10.1542\/peds.2022-059201","article-title":"Improving use of antibiotics for pediatric pneumonia in Community Hospital Emergency Departments.","volume":"152","author":"Sundberg","year":"2023","journal-title":"Pediatrics"},{"key":"R12-20251124","doi-asserted-by":"crossref","first-page":"e2434997","DOI":"10.1001\/jamanetworkopen.2024.34997","article-title":"Gender representation of health care professionals in large language model-generated stories.","volume":"7","author":"Menz","year":"2024","journal-title":"JAMA Netw Open"},{"key":"R13-20251124","first-page":"e69541","article-title":"Fairness in AI-driven oncology: investigating racial and gender biases in large language models.","volume":"16","author":"Agrawal","year":"2024","journal-title":"Cureus"}],"container-title":["Critical Care Explorations"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/10.1097\/CCE.0000000000001350","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T15:00:11Z","timestamp":1763996411000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/10.1097\/CCE.0000000000001350"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,24]]},"references-count":12,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2025]]}},"URL":"https:\/\/doi.org\/10.1097\/cce.0000000000001350","relation":{},"ISSN":["2639-8028"],"issn-type":[{"value":"2639-8028","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,24]]}}}