{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,5]],"date-time":"2026-10-05T00:24:26Z","timestamp":1791159866637,"version":"4.1.0"},"reference-count":41,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2008,9,24]],"date-time":"2008-09-24T00:00:00Z","timestamp":1222214400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Health Services Research"],"published-print":{"date-parts":[[2009,2]]},"abstract":"<jats:p><jats:bold>Objectives. <\/jats:bold> To examine the criterion validity of the Agency for Health Care Research and Quality (AHRQ) Patient Safety Indicators (PSIs) using clinical data from the Veterans Health Administration (VA) National Surgical Quality Improvement Program (NSQIP).<\/jats:p><jats:p><jats:bold>Data Sources. <\/jats:bold> Fifty five thousand seven hundred and fifty two matched hospitalizations from 2001 VA inpatient surgical discharge data and NSQIP chart\u2010abstracted data.<\/jats:p><jats:p><jats:bold>Study Design. <\/jats:bold> We examined the sensitivities, specificities, positive predictive values (PPVs), and positive likelihood ratios of five surgical PSIs that corresponded to NSQIP adverse events. We created and tested alternative definitions of each PSI.<\/jats:p><jats:p><jats:bold>Data Collection. <\/jats:bold> FY01 inpatient discharge data were merged with 2001 NSQIP data abstracted from medical records for major noncardiac surgeries.<\/jats:p><jats:p><jats:bold>Principal Findings. <\/jats:bold> Sensitivities were 19\u201356 percent for original PSI definitions; and 37\u201363 percent using alternative PSI definitions. PPVs were 22\u201374 percent and did not improve with modifications. Positive likelihood ratios were 65\u2013524 using original definitions, and 64\u2013744 using alternative definitions. \u201cPostoperative respiratory failure\u201d and \u201cpostoperative wound dehiscence\u201d exhibited significant increases in sensitivity after modifications.<\/jats:p><jats:p><jats:bold>Conclusions. <\/jats:bold> PSI sensitivities and PPVs were moderate. For three of the five PSIs, AHRQ has incorporated our alternative, higher sensitivity definitions into current PSI algorithms. Further validation should be considered before most of the PSIs evaluated herein are used to publicly compare or reward hospital performance.<\/jats:p>","DOI":"10.1111\/j.1475-6773.2008.00905.x","type":"journal-article","created":{"date-parts":[[2008,9,24]],"date-time":"2008-09-24T13:06:31Z","timestamp":1222261591000},"page":"182-204","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":135,"title":["Validity of Selected AHRQ Patient Safety Indicators Based on VA National Surgical Quality Improvement Program Data"],"prefix":"10.1111","volume":"44","author":[{"given":"Patrick S.","family":"Romano","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hillary J.","family":"Mull","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter E.","family":"Rivard","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shibei","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"William G.","family":"Henderson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Susan","family":"Loveland","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dennis","family":"Tsilimingras","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cindy L.","family":"Christiansen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amy K.","family":"Rosen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2009,1,15]]},"reference":[{"key":"e_1_2_6_2_1","volume-title":"Guide to Patient Safety Indicators Version 3.1 (Revised March 2007)","author":"AHRQ","year":"2007"},{"key":"e_1_2_6_3_1","unstructured":"AHRQ.2007b. \u201cThe AHRQ Quality Indicators in 2007\u201d. AHRQ Quality Indicators eNewsletter [accessed on May 8 2008]. Available athttp:\/\/qualityindicators.ahrq.gov\/newsletter\/2007\u2010February\u2010AHRQ\u2010QI\u2010Newsletter.htm"},{"key":"e_1_2_6_4_1","volume-title":"Patient Safety Indicators Technical Specifications Version 3.2 (Revised March 2008)","author":"AHRQ","year":"2008"},{"key":"e_1_2_6_5_1","doi-asserted-by":"publisher","DOI":"10.1097\/MLR.0b013e31815f537f"},{"key":"e_1_2_6_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1072-7515(01)01183-8"},{"key":"e_1_2_6_7_1","unstructured":"Centers for Disease Control and Prevention.2008. \u201cICD\u20109\u2010CM Coordination and Maintenance Committee 2008 Summary\u201d [accessed on May 13 2008]. Available athttp:\/\/www.cdc.gov\/nchs\/classifications_of_diseses_and_f.htm"},{"issue":"4","key":"e_1_2_6_8_1","first-page":"341","article-title":"Validating Risk\u2010adjusted Surgical Outcomes","volume":"185","author":"Daley J.","year":"1997","journal-title":"Journal of the American College of Surgeons"},{"key":"e_1_2_6_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jamcollsurg.2007.01.012"},{"key":"e_1_2_6_10_1","volume-title":"The RAND\/UCLA Appropriateness Method User's Manual","author":"Fitch K.","year":"2001"},{"key":"e_1_2_6_11_1","first-page":"39","volume-title":"Advances in Patient Safety: From Research to Implementation","author":"Gallagher B.","year":"2005"},{"key":"e_1_2_6_12_1","first-page":"27","volume-title":"Advances in Patient Safety: From Research to Implementation","author":"Gallagher B.","year":"2005"},{"key":"e_1_2_6_13_1","unstructured":"HealthGrades.2008. \u201cThe Fifth Annual HealthGrades Patient Safety in American Hospitals Study\u201d [accessed on May 13 2008]. Available athttp:\/\/www.healthgrades.com\/media\/dms\/pdf\/patientsafetyinamericanhospitalsstudy2008.pdf"},{"key":"e_1_2_6_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1553-7250(08)34018-5"},{"key":"e_1_2_6_15_1","doi-asserted-by":"publisher","DOI":"10.1097\/00005650-199407000-00004"},{"issue":"1","key":"e_1_2_6_16_1","first-page":"40","article-title":"Using Administrative Data to Screen Hospitals for High Complication Rates","volume":"31","author":"Iezzoni L. I.","year":"1994","journal-title":"Inquiry"},{"key":"e_1_2_6_17_1","doi-asserted-by":"publisher","DOI":"10.1097\/00005650-199809000-00005"},{"issue":"5","key":"e_1_2_6_18_1","first-page":"519","article-title":"The National Veterans Administration Surgical Risk Study","volume":"180","author":"Khuri S. F.","year":"1995","journal-title":"Journal of the American College of Surgeons"},{"key":"e_1_2_6_19_1","doi-asserted-by":"publisher","DOI":"10.1097\/00000658-199810000-00006"},{"key":"e_1_2_6_20_1","volume-title":"To Err is Human: Building A Safer Health System","author":"Kohn L. T.","year":"2000"},{"key":"e_1_2_6_21_1","doi-asserted-by":"publisher","DOI":"10.1097\/00005650-200008000-00003"},{"key":"e_1_2_6_22_1","first-page":"1","volume-title":"Advances in Patient Safety: From Research to Implementation","author":"Leape L. L.","year":"2005"},{"key":"e_1_2_6_23_1","doi-asserted-by":"publisher","DOI":"10.1097\/00005650-200008000-00010"},{"key":"e_1_2_6_24_1","volume-title":"Measures of Patient Safety Based on Hospital Administrative Data: The Patient Safety Indicators","author":"McDonald K. M.","year":"2002"},{"issue":"6","key":"e_1_2_6_25_1","first-page":"110","article-title":"Patient Safety Indicators","volume":"36","author":"Miller M. R.","year":"2001","journal-title":"Health Services Research"},{"key":"e_1_2_6_26_1","doi-asserted-by":"publisher","DOI":"10.1097\/MLR.0b013e3180618b7f"},{"key":"e_1_2_6_27_1","unstructured":"National Quality Forum.2008. \u201cNational Quality Forum Endorses Consensus Standards for Quality of Hospital Care\u201d [accessed on May 15 2008]. Available athttp:\/\/www.qualityforum.org\/news\/releases\/051508\u2010endorsed\u2010measures.asp"},{"issue":"8","key":"e_1_2_6_28_1","doi-asserted-by":"crossref","first-page":"857","DOI":"10.1002\/(SICI)1097-0258(19980430)17:8<857::AID-SIM777>3.0.CO;2-E","article-title":"Two\u2010sided Confidence Intervals for the Single Proportion","volume":"17","author":"Newcombe R. G.","year":"1998","journal-title":"Statistics in Medicine"},{"issue":"20","key":"e_1_2_6_29_1","doi-asserted-by":"crossref","first-page":"2753","DOI":"10.1001\/jama.1990.03440200057023","article-title":"Value of the Ventilation\/Perfusion Scan in Acute Pulmonary Embolism. Results of the Prospective Investigation of Pulmonary Embolism Diagnosis (PIOPED)","volume":"263","author":"PIOPED Investigators","year":"1990","journal-title":"Journal of the American Medical Association"},{"key":"e_1_2_6_30_1","doi-asserted-by":"publisher","DOI":"10.1177\/1062860606288244"},{"key":"e_1_2_6_31_1","unstructured":"Premier Inc.2008. \u201cCMS\/Premier Hospital Quality Incentive Demonstration\u201d [accessed on May 8 2008]. Available athttp:\/\/www.premierinc.com\/all\/quality\/hqi\/"},{"key":"e_1_2_6_32_1","first-page":"7","volume-title":"Advances in Patient Safety: From Research to Implementation","author":"Rivard P.","year":"2005"},{"key":"e_1_2_6_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1072-7515(02)01761-1"},{"key":"e_1_2_6_34_1","doi-asserted-by":"publisher","DOI":"10.1377\/hlthaff.22.2.154"},{"key":"e_1_2_6_35_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.mlr.0000173561.79742.fb"},{"key":"e_1_2_6_36_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.mlr.0000220686.82472.9c"},{"key":"e_1_2_6_37_1","doi-asserted-by":"publisher","DOI":"10.1177\/1062860605276941"},{"key":"e_1_2_6_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/0895-4356(91)90128-V"},{"key":"e_1_2_6_39_1","doi-asserted-by":"publisher","DOI":"10.1097\/00005650-200008000-00004"},{"issue":"9","key":"e_1_2_6_40_1","first-page":"497","article-title":"Readmissions for Venous Thromboembolism","volume":"30","author":"Weller W. E.","year":"2004","journal-title":"Joint Commission Journal on Quality and Patient Safety"},{"issue":"6","key":"e_1_2_6_41_1","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1016\/S1553-7250(07)33037-7","article-title":"The Validity of ICD\u20109\u2010CM Codes in Identifying Postoperative Deep Vein Thrombosis and Pulmonary Embolism","volume":"33","author":"Zhan C.","year":"2007","journal-title":"Joint Commission Journal on Quality and Patient Safety"},{"key":"e_1_2_6_42_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.290.14.1868"}],"container-title":["Health Services Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fj.1475-6773.2008.00905.x","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/j.1475-6773.2008.00905.x","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T22:44:07Z","timestamp":1695941047000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1475-6773.2008.00905.x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,1,15]]},"references-count":41,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2009,2]]}},"alternative-id":["10.1111\/j.1475-6773.2008.00905.x"],"URL":"https:\/\/doi.org\/10.1111\/j.1475-6773.2008.00905.x","archive":["Portico"],"relation":{},"ISSN":["0017-9124","1475-6773"],"issn-type":[{"value":"0017-9124","type":"print"},{"value":"1475-6773","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,1,15]]},"assertion":[{"value":"2009-01-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}