{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T00:13:33Z","timestamp":1792023213041,"version":"4.4.0"},"reference-count":21,"publisher":"BMJ","issue":"3","content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Qual Saf"],"accepted":{"date-parts":[[2019,8,7]]},"published-print":{"date-parts":[[2020,3]]},"abstract":"<jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Administrative data systems are used to identify hospital-based patient safety events; few studies evaluate their accuracy. We assessed the accuracy of a new set of patient safety indicators (PSIs; designed to identify in hospital complications).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Study design<\/jats:title>\n                  <jats:p>Prospectively defined analysis of registry data (1 April 2010\u201329 February 2016) in a Canadian hospital network. Assignment of complications was by two methods independently. The National Surgical Quality Improvement Programme (NSQIP) database was the clinical reference standard (primary outcome=any in-hospital NSQIP complication); PSI clusters were assigned using International Classification of Disease (ICD-10) codes in the discharge abstract. Our primary analysis assessed the accuracy of any PSI condition compared with any complication in the NSQIP; secondary analysis evaluated accuracy of complication-specific PSIs.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Patients<\/jats:title>\n                  <jats:p>All inpatient surgical cases captured in NSQIP data.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Analysis<\/jats:title>\n                  <jats:p>We assessed the accuracy of PSIs (with NSQIP as reference standard) using positive and negative predictive values (PPV\/NPV), as well as positive and negative likelihood ratios (\u00b1LR).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We identified 12 898 linked episodes of care. Complications were identified by PSIs and NSQIP in 2415 (18.7%) and 2885 (22.4%) episodes, respectively. The presence of any PSI code had a PPV of 0.55 (95% CI 0.53 to 0.57) and NPV of 0.93 (95% CI 0.92 to 0.93); +LR 6.41 (95% CI 6.01 to 6.84) and \u2212LR 0.40 (95% CI 0.37 to 0.42). Subgroup analyses (by surgery type and urgency) showed similar performance. Complication-specific PSIs had high NPVs (95% CI 0.92 to 0.99), but low to moderate PPVs (0.13\u20130.61).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>Validation of the ICD-10 PSI system suggests applicability as a first screening step, integrated with data from other sources, to produce an adverse event detection pathway that informs learning healthcare systems. However, accuracy was insufficient to directly identify or rule out individual-level complications.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1136\/bmjqs-2018-008852","type":"journal-article","created":{"date-parts":[[2019,8,22]],"date-time":"2019-08-22T17:19:52Z","timestamp":1566494392000},"page":"209-216","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":55,"title":["Validation of new ICD-10-based patient safety indicators for identification of in-hospital complications in surgical patients: a study of diagnostic accuracy"],"prefix":"10.1136","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8543-1859","authenticated-orcid":false,"given":"Daniel I","family":"McIsaac","sequence":"first","affiliation":[{"name":"Departments of Anesthesiology and Pain Medicine, University of Ottawa, The Ottawa Hospital, Ottawa, Ontario, Canada"},{"name":"Clinical Epidemiology, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada"},{"name":"School of Epidemiology & Public Health, University of Ottawa, Ottawa, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gavin M","family":"Hamilton","sequence":"additional","affiliation":[{"name":"Departments of Anesthesiology and Pain Medicine, University of Ottawa, The Ottawa Hospital, Ottawa, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Karim","family":"Abdulla","sequence":"additional","affiliation":[{"name":"Departments of Anesthesiology and Pain Medicine, University of Ottawa, The Ottawa Hospital, Ottawa, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luke T","family":"Lavall\u00e9e","sequence":"additional","affiliation":[{"name":"Clinical Epidemiology, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada"},{"name":"Department of Surgery, Division of Urology, University of Ottawa, Ottawa, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Husien","family":"Moloo","sequence":"additional","affiliation":[{"name":"Clinical Epidemiology, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada"},{"name":"Department of Surgery, Division of General Surgery, University of Ottawa, Ottawa, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chris","family":"Pysyk","sequence":"additional","affiliation":[{"name":"Departments of Anesthesiology and Pain Medicine, University of Ottawa, The Ottawa Hospital, Ottawa, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jocelyn","family":"Tufts","sequence":"additional","affiliation":[{"name":"Performance Measurement, The Ottawa Hospital, Ottawa, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"William A","family":"Ghali","sequence":"additional","affiliation":[{"name":"Department of Community Health Sciences, Calgary Institute for Population and Public Health, University of Calgary, Calgary, Alberta, Canada"},{"name":"Department of Medicine, Calgary Institute for Population and Public Health, University of Calgary, Calgary, Alberta, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alan J","family":"Forster","sequence":"additional","affiliation":[{"name":"Clinical Epidemiology, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada"},{"name":"School of Epidemiology & Public Health, University of Ottawa, Ottawa, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2019,8,22]]},"reference":[{"key":"2025090409251593000_29.3.209.1","doi-asserted-by":"publisher","DOI":"10.1097\/01.sla.0000133083.54934.ae"},{"key":"2025090409251593000_29.3.209.2","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1097\/01.sla.0000179621.33268.83","article-title":"Determinants of long-term survival after major surgery and the adverse effect of postoperative complications","volume":"242","author":"Khuri","year":"2005","journal-title":"Ann Surg"},{"key":"2025090409251593000_29.3.209.3","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1001\/jamasurg.2016.0773","article-title":"Hospital and payer costs associated with surgical complications","volume":"151","author":"Healy","year":"2016","journal-title":"JAMA Surg"},{"key":"2025090409251593000_29.3.209.4","doi-asserted-by":"crossref","first-page":"1103","DOI":"10.1001\/jamasurg.2014.1338","article-title":"Identification of patients with postoperative complications who are at risk for failure to rescue","volume":"149","author":"Ferraris","year":"2014","journal-title":"JAMA Surg"},{"key":"2025090409251593000_29.3.209.5","doi-asserted-by":"crossref","first-page":"910","DOI":"10.1097\/SLA.0000000000001792","article-title":"Investigating adverse event free admissions in Medicare inpatients as a patient safety indicator","volume":"265","author":"King","year":"2017","journal-title":"Ann Surg"},{"key":"2025090409251593000_29.3.209.6","article-title":"Administrative data based patient safety research: a critical review","volume":"12 Suppl 2","author":"Zhan","year":"2003","journal-title":"Qual Saf Health Care"},{"key":"2025090409251593000_29.3.209.7","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2011.06.020"},{"key":"2025090409251593000_29.3.209.8","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2013-003716","article-title":"Validity of AHRQ patient safety indicators derived from ICD-10 hospital discharge abstract data (chart review study)","volume":"3","author":"Quan","year":"2013","journal-title":"BMJ Open"},{"key":"2025090409251593000_29.3.209.9","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1097\/MLR.0000000000000649","article-title":"Deriving ICD-10 codes for patient safety indicators for large-scale surveillance using administrative hospital data","volume":"55","author":"Southern","year":"2017","journal-title":"Med Care"},{"key":"2025090409251593000_29.3.209.10","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.326.7379.41"},{"key":"2025090409251593000_29.3.209.11","doi-asserted-by":"publisher","DOI":"10.1097\/01.mlr.0000182534.19832.83"},{"key":"2025090409251593000_29.3.209.12","doi-asserted-by":"publisher","DOI":"10.1097\/MLR.0b013e31819432e5"},{"key":"2025090409251593000_29.3.209.13","unstructured":"NSQIP in the literature. Available: https:\/\/www.facs.org\/quality-programs\/acs-nsqip\/joinnow\/bibliography [Accessed 14 Feb 2018]."},{"key":"2025090409251593000_29.3.209.14","doi-asserted-by":"publisher","DOI":"10.1001\/jama.1994.03510330081039"},{"key":"2025090409251593000_29.3.209.15","doi-asserted-by":"publisher","DOI":"10.1016\/0895-4356(91)90128-V"},{"key":"2025090409251593000_29.3.209.16","doi-asserted-by":"publisher","DOI":"10.1111\/j.1475-6773.2008.00905.x"},{"key":"2025090409251593000_29.3.209.17","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2011.08.002"},{"key":"2025090409251593000_29.3.209.18","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2015-008424","article-title":"Accuracy of administrative data for surveillance of healthcare-associated infections: a systematic review","volume":"5","author":"van Mourik","year":"2015","journal-title":"BMJ Open"},{"key":"2025090409251593000_29.3.209.19","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2010.01.016"},{"key":"2025090409251593000_29.3.209.20","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1056\/NEJM198802113180604","article-title":"Accuracy of diagnostic coding for Medicare patients under the prospective-payment system","volume":"318","author":"Hsia","year":"1988","journal-title":"N Engl J Med Overseas Ed"},{"key":"2025090409251593000_29.3.209.21","doi-asserted-by":"publisher","DOI":"10.1111\/1475-6773.12398"}],"container-title":["BMJ Quality &amp; Safety"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjqs-2018-008852","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,4]],"date-time":"2025-09-04T16:25:24Z","timestamp":1757003124000},"score":1,"resource":{"primary":{"URL":"https:\/\/qualitysafety.bmj.com\/lookup\/doi\/10.1136\/bmjqs-2018-008852"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,22]]},"references-count":21,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,2,25]]},"published-print":{"date-parts":[[2020,3]]}},"alternative-id":["10.1136\/bmjqs-2018-008852"],"URL":"https:\/\/doi.org\/10.1136\/bmjqs-2018-008852","relation":{},"ISSN":["2044-5415","2044-5423"],"issn-type":[{"value":"2044-5415","type":"print"},{"value":"2044-5423","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,8,22]]}}}