{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T14:00:40Z","timestamp":1784815240336,"version":"3.55.0"},"reference-count":32,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T00:00:00Z","timestamp":1778716800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Washington University\/BJC Healthcare Big Ideas Healthcare Innovation Competition"},{"name":"Patient Safety Technology Challenge"},{"DOI":"10.13039\/100010379","name":"Jewish Healthcare Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100010379","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,7,23]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Catheter-associated urinary tract infection (CAUTI) surveillance is critical for patient safety. Many healthcare systems use electronic algorithms to flag candidate infection events but still require manual chart review to confirm CAUTI cases. We evaluated the use of a large language model (LLM) to enhance CAUTI surveillance.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We analyzed 919 potential CAUTI cases flagged by the electronic surveillance algorithm at Barnes-Jewish Hospital from 2021 to 2024. These cases were previously classified as 291 CAUTIs and 628 non-CAUTIs by trained infection preventionists (IPs). Several approaches for applying the National Healthcare Safety Network (NHSN) CAUTI definition after extracting clinical data from the electronic medical record (EMR) were compared.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Most patients were female (61.6%) with a median age 68 years (IQR 58, 77). Combining rule-based logic with Clinical Entity Augmented Retrieval (CLEAR) input into an LLM achieved the highest sensitivity (90.0%) and specificity (93.5%). Adjustment of false negatives and false positives after expert adjudication showed sensitivity of 93.6% and specificity of 98.6%. Chart review of false negatives revealed that disagreement with the gold standard mainly occurred due to missing symptom information in clinical documentation provided to the model.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Augmenting the existing algorithmic approach with LLM capabilities significantly enhances CAUTI surveillance and may improve efficiency by reducing the amount of time IPs spend performing manual chart review. Further improvements could be made by optimizing the clinical information presented to the model.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/cid\/ciag301","type":"journal-article","created":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T11:44:03Z","timestamp":1778067843000},"page":"e120-e126","source":"Crossref","is-referenced-by-count":3,"title":["The Best of Both Worlds: How Combining a Large Language Model and a Rule-Based Algorithm Makes Catheter-Associated Urinary Tract Infection Surveillance More Efficient"],"prefix":"10.1093","volume":"83","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9644-501X","authenticated-orcid":false,"given":"Joshua","family":"Nordman","sequence":"first","affiliation":[{"name":"Division of Infectious Diseases, Washington University School of Medicine , St.Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-1911-0508","authenticated-orcid":false,"given":"Claire","family":"Najjuuko","sequence":"additional","affiliation":[{"name":"Division of Computational and Data Sciences, Washington University in St.Louis , St. Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-0198-9581","authenticated-orcid":false,"given":"Nicholas","family":"Jeschke","sequence":"additional","affiliation":[{"name":"Institute for Informatics, Data Science, and Biostatistics, Washington University School of Medicine , St.Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rachael E","family":"Snyders","sequence":"additional","affiliation":[{"name":"Division of Infectious Diseases, Washington University School of Medicine , St.Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4280-9804","authenticated-orcid":false,"given":"Maria Cristina","family":"Vazquez Guillamet","sequence":"additional","affiliation":[{"name":"Division of Infectious Diseases, Washington University School of Medicine , St.Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jordan","family":"Shapiro","sequence":"additional","affiliation":[{"name":"BJC Healthcare Center for Clinical Excellence, , St.Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-7763-0259","authenticated-orcid":false,"given":"Carole","family":"Leone","sequence":"additional","affiliation":[{"name":"BJC Healthcare Center for Clinical Excellence, , St.Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-3043-0340","authenticated-orcid":false,"given":"Megan","family":"Dethloff","sequence":"additional","affiliation":[{"name":"BJC Healthcare Center for Clinical Excellence, , St.Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hilary","family":"Babcock","sequence":"additional","affiliation":[{"name":"Division of Infectious Diseases, Washington University School of Medicine , St.Louis, Missouri ,","place":["USA"]},{"name":"BJC Healthcare Center for Clinical Excellence, , St.Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patrick","family":"Reich","sequence":"additional","affiliation":[{"name":"Division of Infectious Diseases, Washington University School of Medicine , St.Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kenneth","family":"Whalen","sequence":"additional","affiliation":[{"name":"BJC Healthcare Center for Clinical Excellence, , St.Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lucy","family":"Zhang","sequence":"additional","affiliation":[{"name":"BJC Healthcare Center for Clinical Excellence, , St.Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lan","family":"Luong","sequence":"additional","affiliation":[{"name":"BJC Healthcare Center for Clinical Excellence, , St.Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenyang","family":"Lu","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Washington University in St.Louis , St. Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Atkinson","sequence":"additional","affiliation":[{"name":"Division of Infectious Diseases, Washington University School of Medicine , St.Louis, Missouri ,","place":["USA"]},{"name":"Institute for Informatics, Data Science, and Biostatistics, Washington University School of Medicine , St.Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0052-3210","authenticated-orcid":false,"given":"Jonas","family":"Marschall","sequence":"additional","affiliation":[{"name":"Division of Infectious Diseases, Washington University School of Medicine , St.Louis, Missouri ,","place":["USA"]},{"name":"BJC Healthcare Center for Clinical Excellence, , St.Louis, Missouri ,","place":["USA"]},{"name":"Division of Infectious Diseases, University of Arizona College of Medicine , Phoenix, Arizona ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-7627-1255","authenticated-orcid":false,"given":"Abby","family":"Sung","sequence":"additional","affiliation":[{"name":"Division of Infectious Diseases, Washington University School of Medicine , St.Louis, Missouri ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,5,14]]},"reference":[{"key":"2026072309022580000_ciag301-B1"},{"key":"2026072309022580000_ciag301-B2","author":"CDC"},{"key":"2026072309022580000_ciag301-B3","author":"Scott"},{"key":"2026072309022580000_ciag301-B4","doi-asserted-by":"crossref","first-page":"e25","DOI":"10.1017\/ash.2022.312","article-title":"Automating surveillance for healthcare-associated infections: rationale and current realities (part I\/III)","volume":"3","author":"Shenoy","year":"2023","journal-title":"Antimicrob Steward Healthc Epidemiol"},{"key":"2026072309022580000_ciag301-B5","doi-asserted-by":"crossref","first-page":"1268","DOI":"10.1086\/597591","article-title":"Automated surveillance of health care\u2013associated infections","volume":"48","author":"Klompas","year":"2009","journal-title":"Clin Infect Dis"},{"key":"2026072309022580000_ciag301-B6","doi-asserted-by":"crossref","first-page":"S50","DOI":"10.1016\/j.ajic.2016.04.044","article-title":"Catheter associated urinary tract infection algorithm performance for ICU and non-ICU surveillance","volume":"44","author":"Leone","year":"2016","journal-title":"Am J Infect Control"},{"key":"2026072309022580000_ciag301-B7","first-page":"411","article-title":"A comparison of methods to detect urinary tract infections using electronic data","volume":"36","author":"Landers","year":"2010","journal-title":"Jt Comm J Qual. Patient Saf"},{"key":"2026072309022580000_ciag301-B8","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.1016\/j.ajic.2013.03.295","article-title":"Identification of device-associated infections utilizing administrative data","volume":"41","author":"Cass","year":"2013","journal-title":"Am J Infect Control"},{"key":"2026072309022580000_ciag301-B9","doi-asserted-by":"crossref","first-page":"9923","DOI":"10.1007\/s10916-012-9923-2","article-title":"Utilization of electronic medical records to build a detection model for surveillance of healthcare-associated urinary tract infections","volume":"37","author":"Lo","year":"2013","journal-title":"J Med Syst"},{"key":"2026072309022580000_ciag301-B10","doi-asserted-by":"crossref","first-page":"e33","DOI":"10.1016\/j.ajic.2013.12.005","article-title":"Using electronic medical records to increase the efficiency of catheter-associated urinary tract infection surveillance for national health and safety network reporting","volume":"42","author":"Shepard","year":"2014","journal-title":"Am J Infect Control"},{"key":"2026072309022580000_ciag301-B11","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1017\/ice.2015.122","article-title":"Natural language processing for real-time catheter-associated urinary tract infection surveillance: results of a pilot implementation trial","volume":"36","author":"Branch-Elliman","year":"2015","journal-title":"Infect Control Hosp Epidemiol"},{"key":"2026072309022580000_ciag301-B12","first-page":"1507","article-title":"Electronic surveillance for catheter-associated urinary tract infection using natural language processing","volume":"2017","author":"Sanger","year":"2018","journal-title":"AMIA Annu Symp Proc"},{"key":"2026072309022580000_ciag301-B13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1017\/ice.2025.20","article-title":"Chatting new territory: large language models for infection surveillance from pilot to deployment","volume":"46","author":"Wu","year":"2025","journal-title":"Infect Control Hosp Epidemiol"},{"key":"2026072309022580000_ciag301-B14","doi-asserted-by":"crossref","first-page":"625","DOI":"10.1016\/j.ajic.2024.02.007","article-title":"Assisting the infection preventionist: use of artificial intelligence for health care\u2013associated infection surveillance","volume":"52","author":"Wiemken","year":"2024","journal-title":"Am J Infect Control"},{"key":"2026072309022580000_ciag301-B15","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1038\/s41746-024-01377-1","article-title":"Clinical entity augmented retrieval for clinical information extraction","volume":"8","author":"Lopez","year":"2025","journal-title":"npj Digit Med"},{"key":"2026072309022580000_ciag301-B16"},{"key":"2026072309022580000_ciag301-B17","doi-asserted-by":"crossref","first-page":"72","DOI":"10.18653\/v1\/W19-1909","volume-title":"Proceedings of the 2nd clinical natural language processing workshop","author":"Alsentzer","year":"2019"},{"key":"2026072309022580000_ciag301-B18"},{"key":"2026072309022580000_ciag301-B19","doi-asserted-by":"crossref","first-page":"D267","DOI":"10.1093\/nar\/gkh061","article-title":"The unified medical language system (UMLS): integrating biomedical terminology","volume":"32","author":"Bodenreider","year":"2004","journal-title":"Nucleic Acids Res"},{"key":"2026072309022580000_ciag301-B20","doi-asserted-by":"publisher","author":"Deka","DOI":"10.1145\/3487664.3487701"},{"key":"2026072309022580000_ciag301-B21"},{"key":"2026072309022580000_ciag301-B22","doi-asserted-by":"publisher","first-page":"641","DOI":"10.1145\/3626772.3657878","article-title":"C-pack: packed resources for general Chinese embeddings","author":"Xiao","year":"2024"},{"key":"2026072309022580000_ciag301-B23","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.ajic.2023.06.017","article-title":"A narrative review of how infection preventionist (IP) staffing and outcome metrics are assessed by health care organizations and factors to consider","volume":"52","author":"Knighton","year":"2024","journal-title":"Am J Infect Control"},{"key":"2026072309022580000_ciag301-B24","doi-asserted-by":"crossref","first-page":"592","DOI":"10.1016\/j.ajic.2015.02.019","article-title":"An electronic surveillance tool for catheter-associated urinary tract infection in intensive care units","volume":"43","author":"Hsu","year":"2015","journal-title":"Am J Infect Control"},{"key":"2026072309022580000_ciag301-B25","author":"Lewis"},{"key":"2026072309022580000_ciag301-B26","doi-asserted-by":"crossref","first-page":"AIoa2300068","DOI":"10.1056\/AIoa2300068","article-title":"Almanac\u2014retrieval-augmented language models for clinical medicine","volume":"1","author":"Zakka","year":"2024","journal-title":"NEJM AI"},{"key":"2026072309022580000_ciag301-B27","author":"Adejumo"},{"key":"2026072309022580000_ciag301-B28","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1162\/tacl_a_00638","article-title":"Lost in the middle: how language models use long contexts","volume":"12","author":"Liu","year":"2024","journal-title":"Trans Assoc Comput Linguist"},{"key":"2026072309022580000_ciag301-B29","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1111\/joim.20100","article-title":"The future of healthcare-associated infection surveillance: automated surveillance and using the potential of artificial intelligence","volume":"298","author":"van der Werff","year":"2025","journal-title":"J Intern Med"},{"key":"2026072309022580000_ciag301-B30","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1093\/cid\/ciaf486","article-title":"Comparing generative artificial intelligence vs experts for detection of catheter-associated urinary tract infection (CAUTI)","volume":"82","author":"Alshanqeeti","year":"2025","journal-title":"Clin Infect Dis"},{"key":"2026072309022580000_ciag301-B31","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1017\/ice.2024.164","article-title":"Performance of a large language model for identifying central line-associated bloodstream infections (CLABSI) using real clinical notes","volume":"46","author":"Rodriguez-Nava","year":"2025","journal-title":"Infect Control Hosp Epidemiol"},{"key":"2026072309022580000_ciag301-B32","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1016\/j.jhin.2023.03.025","article-title":"Development of machine learning models for the surveillance of colon surgical site infections","volume":"146","author":"Cho","year":"2024","journal-title":"J Hosp Infect"}],"container-title":["Clinical Infectious Diseases"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/cid\/advance-article-pdf\/doi\/10.1093\/cid\/ciag301\/68284571\/ciag301.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/cid\/article-pdf\/83\/1\/e120\/68284571\/ciag301.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/cid\/article-pdf\/83\/1\/e120\/68284571\/ciag301.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T13:02:34Z","timestamp":1784811754000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/cid\/article\/83\/1\/e120\/8678022"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,14]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,5,14]]},"published-print":{"date-parts":[[2026,7,23]]}},"URL":"https:\/\/doi.org\/10.1093\/cid\/ciag301","relation":{},"ISSN":["1058-4838","1537-6591"],"issn-type":[{"value":"1058-4838","type":"print"},{"value":"1537-6591","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,7,15]]},"published":{"date-parts":[[2026,5,14]]}}}