{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,29]],"date-time":"2026-10-29T01:14:23Z","timestamp":1793236463807,"version":"4.5.0"},"reference-count":14,"publisher":"BMJ","issue":"6","content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Qual Saf"],"accepted":{"date-parts":[[2025,12,10]]},"published-print":{"date-parts":[[2026,6]]},"abstract":"<jats:p>Surgical site infections (SSIs), particularly intra-abdominal (IAB) infections, are challenging to identify and remain a resource-intensive focus of infection prevention programmes. Current automated screening measures rely on discrete data from the electronic health record (EHR), such as microbiology results, diagnosis codes and\/or return to the operating room. This approach has poor specificity, and therefore surveillance methods depend heavily on additional manual chart review by trained infection preventionists. Large language models (LLMs) offer an opportunity to improve surveillance by synthesising complex clinical documentation alongside structured data elements.<\/jats:p>\n                  <jats:p>We evaluated the performance of a locally hosted LLM (gpt-35-turbo-16k) to improve IAB SSI screening using perioperative clinical notes and microbiology results. The model analysed documentation across the perioperative period (3\u2009days before through 30 days after surgery) to generate case-level SSI summaries and likelihood assessments. We compared the performance of this tool against the current EHR-based screening workflow.<\/jats:p>\n                  <jats:p>Among 1977 abdominal surgical cases, including 56 with confirmed IAB SSIs, the LLM screened 104\u2009cases as high risk, identifying all infections (negative predictive value (NPV) 100%) and achieving a positive predictive value (PPV) of 53.8%. In contrast, the EHR-based workflow identified 288 cases for further review, with a PPV of only 19.4% and the same NPV of 100%. Analysis of 57\u2009224 notes required ~107\u2009million tokens, translating to approximately USD 0.05 per case.<\/jats:p>\n                  <jats:p>An LLM-based approach to SSI surveillance has the potential to substantially improve efficiency while remaining highly accurate and cost-effective. By reducing reliance on manual chart review, this strategy could allow infection preventionists to shift their attention from surveillance toward quality improvement and patient safety initiatives.<\/jats:p>","DOI":"10.1136\/bmjqs-2025-019493","type":"journal-article","created":{"date-parts":[[2025,12,21]],"date-time":"2025-12-21T18:20:29Z","timestamp":1766341229000},"page":"424-427","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":4,"title":["Retrospective validation study of a large language model approach to screening for intraabdominal surgical site infections for quality and safety reporting"],"prefix":"10.1136","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7123-3501","authenticated-orcid":false,"given":"Logan","family":"Pierce","sequence":"first","affiliation":[{"name":"Hospital Medicine, UCSF, San Francisco, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christy","family":"Pak","sequence":"additional","affiliation":[{"name":"Department of Quality and Patient Safety, University of California San Francisco, San Francisco, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kim","family":"Stanley","sequence":"additional","affiliation":[{"name":"Department of Quality and Patient Safety, University of California San Francisco, San Francisco, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lusha","family":"Wang","sequence":"additional","affiliation":[{"name":"Enterprise Information Analytics Health Quality, University of California San Francisco, San Francisco, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Caroline","family":"Erickson","sequence":"additional","affiliation":[{"name":"General Surgery Residency, University of California San Francisco, San Francisco, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Deborah S","family":"Yokoe","sequence":"additional","affiliation":[{"name":"Division of Infectious Diseases, University of California San Francisco, San Francisco, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elizabeth","family":"Wick","sequence":"additional","affiliation":[{"name":"Division of Surgical Oncology, Department of Surgery, University of California San Francisco, San Francisco, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2025,12,21]]},"reference":[{"key":"2026051802150673000_35.6.424.1","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1016\/j.ajic.2018.01.018","article-title":"Update to the Centers for Disease Control and Prevention and the Healthcare Infection Control Practices Advisory Committee Guideline for the Prevention of Surgical Site Infection (2017): A summary, review, and strategies for implementation","volume":"46","author":"O\u2019Hara","year":"2018","journal-title":"Am J Infect Control"},{"key":"2026051802150673000_35.6.424.2","unstructured":"Scott RD . The direct costs of healthcare-associated infections in us hospitals and the benefits of prevention. Centers for disease control and prevention; 2009. Available: http:\/\/www.cdc.gov\/hai\/pdfs\/hai\/scott_costpaper.pdf"},{"key":"2026051802150673000_35.6.424.3","doi-asserted-by":"publisher","DOI":"10.1017\/ice.2023.67"},{"key":"2026051802150673000_35.6.424.4","doi-asserted-by":"crossref","first-page":"784","DOI":"10.1001\/jamasurg.2017.0904","article-title":"Centers for Disease Control and Prevention Guideline for the Prevention of Surgical Site Infection, 2017","volume":"152","author":"Berr\u00edos-Torres","year":"2017","journal-title":"JAMA Surg"},{"key":"2026051802150673000_35.6.424.5","doi-asserted-by":"crossref","DOI":"10.1017\/ash.2022.312","article-title":"Automating surveillance for healthcare-associated infections: Rationale and current realities (Part I\/III)","volume":"3","author":"Shenoy","year":"2023","journal-title":"Antimicrob Steward Healthc Epidemiol"},{"key":"2026051802150673000_35.6.424.6","unstructured":"Procedure-associated module - SSI events. Surgical Site Infection Event (SSI), National Healthcare Safety Network (NHSN); 2025. Available: https:\/\/www.cdc.gov\/nhsn\/pdfs\/pscmanual\/9pscssicurrent.pdf"},{"key":"2026051802150673000_35.6.424.7","unstructured":"Center for Disease Control and Prevention (CDC) & National Healthcare Safety Network (NHSN) . CDC\/NHSN surveillance definitions for specific types of infections. CDC.gov; 2025. Available: https:\/\/www.cdc.gov\/nhsn\/pdfs\/pscmanual\/17pscnosinfdef_current.pdf"},{"key":"2026051802150673000_35.6.424.8","unstructured":"Healthcare-associated infections (HAI) program, use of icd-10-cm diagnosis codes to \u201cflag\u201d post-operative patients for further evaluation of possible ssi. California Department of Public Health; 2024. Available: https:\/\/www.cdph.ca.gov\/Programs\/CHCQ\/HAI\/Pages\/UseOfICD-CMDiagnosisCodesToFlagPost-operativePatientsForFurtherEvaluationOfPossibleSSI-.aspx#:~:text=%E2%80%8B%E2%80%8BUse%20of%20ICD,part%20of%20routine%20SSI%20surveillance"},{"key":"2026051802150673000_35.6.424.9","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1017\/ice.2023.139","article-title":"Healthcare-associated infections and conditions in the era of digital measurement","volume":"45","author":"Classen","year":"2024","journal-title":"Infect Control Hosp Epidemiol"},{"key":"2026051802150673000_35.6.424.10","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2011.822"},{"key":"2026051802150673000_35.6.424.11","doi-asserted-by":"crossref","first-page":"s157","DOI":"10.1017\/ash.2024.340","article-title":"An \u201cEpic\u201d Journey to Improve Antimicrobial Stewardship","volume":"4","author":"Smith","year":"2024","journal-title":"ASHE"},{"key":"2026051802150673000_35.6.424.12","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1001\/jamasurg.2014.2891","article-title":"A comparison of 2 surgical site infection monitoring systems","volume":"150","author":"Ju","year":"2015","journal-title":"JAMA Surg"},{"key":"2026051802150673000_35.6.424.13","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1016\/j.ajic.2017.02.002","article-title":"Validation of surgical site infection surveillance data in colon procedures reported to the Connecticut Department of Public Health","volume":"45","author":"Backman","year":"2017","journal-title":"Am J Infect Control"},{"key":"2026051802150673000_35.6.424.14","unstructured":"ZipRecruiter . Entry level infection preventionist salary: hourly rate. 2025. Available: https:\/\/www.ziprecruiter.com\/Salaries\/Entry-Level-Infection-Preventionist-Salary"}],"container-title":["BMJ Quality &amp; Safety"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjqs-2025-019493","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T09:16:32Z","timestamp":1779095792000},"score":1,"resource":{"primary":{"URL":"https:\/\/qualitysafety.bmj.com\/lookup\/doi\/10.1136\/bmjqs-2025-019493"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,21]]},"references-count":14,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2026,5,18]]},"published-print":{"date-parts":[[2026,6]]}},"alternative-id":["10.1136\/bmjqs-2025-019493"],"URL":"https:\/\/doi.org\/10.1136\/bmjqs-2025-019493","relation":{},"ISSN":["2044-5415","2044-5423"],"issn-type":[{"value":"2044-5415","type":"print"},{"value":"2044-5423","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,21]]}}}