{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T23:27:05Z","timestamp":1769124425409,"version":"3.49.0"},"reference-count":25,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2021,8,1]],"date-time":"2021-08-01T00:00:00Z","timestamp":1627776000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000133","name":"Agency for Healthcare Research and Quality","doi-asserted-by":"publisher","award":["R01HS023696"],"award-info":[{"award-number":["R01HS023696"]}],"id":[{"id":"10.13039\/100000133","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,9,18]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Little is known regarding variation among electronic health record (EHR) vendors in quality performance. This issue is compounded by selection effects in which high-quality hospitals coalesce to a subset of market leading vendors. We measured hospital performance, stratified by EHR vendor, across 4 quality metrics.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We used data on 1272 hospitals in 2018 across 4 quality measures: Leapfrog Computerized Provider Order Entry\/EHR Evaluation, Centers for Medicare and Medicaid Services Hospital Compare Star Ratings, Hospital-Acquired Condition (HAC) score, and Hospital Readmission Reduction Program (HRRP) ratio. We examined score distributions and used multivariable regression to evaluate the association between vendor and score, recovering partial R2 to assess the proportion of quality variation explained by vendor.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We found significant variation across and within EHR vendors. The largest vendor, vendor A, had the highest mean score on the Leapfrog Computerized Provider Order Entry\/EHR Evaluation and HRRP ratio, vendor G had the highest Hospital Compare score, and vendor F had the highest HAC score. In adjusted models, no vendor was significantly associated with higher performance on more than 2 measures. EHR vendor explained between 1.2% (HAC) and 7.6 (HRRP) of the variation in quality performance.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>No EHR vendor was associated with higher quality across all measures, and the 2 largest vendors were not associated with the highest scores. Only a small fraction of quality variation was explained by EHR vendor choice.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>Top performance on quality measures can be achieved with any EHR vendor; much of quality performance is driven by the hospital and how it uses the EHR.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocab120","type":"journal-article","created":{"date-parts":[[2021,5,28]],"date-time":"2021-05-28T19:46:14Z","timestamp":1622231174000},"page":"2101-2107","source":"Crossref","is-referenced-by-count":4,"title":["Assessing hospital electronic health record vendor performance across publicly reported quality measures"],"prefix":"10.1093","volume":"28","author":[{"given":"A Jay","family":"Holmgren","sequence":"first","affiliation":[{"name":"School of Medicine, University of California, San Francisco, San Francisco, California, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6710-526X","authenticated-orcid":false,"given":"Masha","family":"Kuznetsova","sequence":"additional","affiliation":[{"name":"Harvard Business School, Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Classen","sequence":"additional","affiliation":[{"name":"Division of Clinical Epidemiology, University of Utah School of Medicine, Salt Lake City, Utah, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David W","family":"Bates","sequence":"additional","affiliation":[{"name":"Department of General Internal Medicine, Brigham and Women\u2019s Hospital, Boston, Massachusetts, USA"},{"name":"Harvard Medical School, Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2021,8,1]]},"reference":[{"issue":"5","key":"2021091817522403400_ocab120-B1","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1056\/NEJMp0912825","article-title":"Launching HITECH","volume":"362","author":"Blumenthal","year":"2010","journal-title":"N Engl J Med"},{"issue":"8","key":"2021091817522403400_ocab120-B2","doi-asserted-by":"crossref","first-page":"1416","DOI":"10.1377\/hlthaff.2016.1651","article-title":"HITECH Act drove large gains in hospital electronic health record adoption","volume":"36","author":"Adler-Milstein","year":"2017","journal-title":"Health Aff (Millwood)"},{"issue":"25","key":"2021091817522403400_ocab120-B3","doi-asserted-by":"crossref","first-page":"2526","DOI":"10.1056\/NEJMsa020847","article-title":"Improving safety with information technology","volume":"348","author":"Bates","year":"2003","journal-title":"N Engl J Med"},{"issue":"1","key":"2021091817522403400_ocab120-B4","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1197\/jamia.M2170","article-title":"Medication-related clinical decision support in computerized provider order entry systems: a review","volume":"14","author":"Kuperman","year":"2007","journal-title":"J Am Med Inform Assoc"},{"issue":"7","key":"2021091817522403400_ocab120-B5","doi-asserted-by":"crossref","first-page":"1128","DOI":"10.1377\/hlthaff.2017.1658","article-title":"Electronic health records associated with lower hospital mortality after systems have time to mature","volume":"37","author":"Lin","year":"2018","journal-title":"Health Aff (Millwood)"},{"issue":"5","key":"2021091817522403400_ocab120-B6","doi-asserted-by":"crossref","first-page":"e205547","DOI":"10.1001\/jamanetworkopen.2020.5547","article-title":"National trends in the safety performance of electronic health record systems from 2009 to 2018","volume":"3","author":"Classen","year":"2020","journal-title":"JAMA Netw Open"},{"issue":"1","key":"2021091817522403400_ocab120-B7","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1136\/bmjqs-2019-009609","article-title":"Assessing the safety of electronic health records: a national longitudinal study of medication-related decision support","volume":"29","author":"Holmgren","year":"2020","journal-title":"BMJ Qual Saf"},{"issue":"e1","key":"2021091817522403400_ocab120-B8","doi-asserted-by":"crossref","first-page":"e85\u201390","DOI":"10.1136\/amiajnl-2012-001549","article-title":"Relationship between medication event rates and the Leapfrog computerized physician order entry evaluation tool","volume":"20","author":"Leung","year":"2013","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"2021091817522403400_ocab120-B9","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1377\/hlthaff.2010.0160","article-title":"Mixed results in the safety performance of computerized physician order entry","volume":"29","author":"Metzger","year":"2010","journal-title":"Health Aff (Millwood)"},{"key":"2021091817522403400_ocab120-B10","author":"Monegain","year":"2018"},{"issue":"6","key":"2021091817522403400_ocab120-B11","doi-asserted-by":"crossref","first-page":"654","DOI":"10.1093\/jamia\/ocx135","article-title":"Are all certified EHRs created equal? Assessing the relationship between EHR vendor and hospital meaningful use performance","volume":"25","author":"Holmgren","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"7","key":"2021091817522403400_ocab120-B12","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1093\/jamia\/ocz021","article-title":"The complex case of EHRs: examining the factors impacting the EHR user experience","volume":"26","author":"Tutty","year":"2019","journal-title":"J Am Med Inform Assoc"},{"key":"2021091817522403400_ocab120-B13","year":"2019"},{"issue":"6","key":"2021091817522403400_ocab120-B14","first-page":"318","article-title":"Does the Leapfrog program help identify high-quality hospitals?","volume":"34","author":"Jha","year":"2008","journal-title":"Jt Comm J Qual Patient Saf"},{"issue":"2","key":"2021091817522403400_ocab120-B15","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1136\/qshc.2005.014969","article-title":"Development of the Leapfrog methodology for evaluating hospital implemented inpatient computerized physician order entry systems","volume":"15","author":"Kilbridge","year":"2006","journal-title":"Qual Saf Health Care"},{"key":"2021091817522403400_ocab120-B16","year":"2021"},{"issue":"2","key":"2021091817522403400_ocab120-B17","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1177\/1062860608331241","article-title":"CMS\u2019s hospital-acquired condition lists link hospital payment, patient safety","volume":"24","author":"Clancy","year":"2009","journal-title":"Am J Med Qual"},{"key":"2021091817522403400_ocab120-B18","year":"2021"},{"key":"2021091817522403400_ocab120-B19","author":"Gupta"},{"key":"2021091817522403400_ocab120-B20","year":"2021"},{"issue":"6","key":"2021091817522403400_ocab120-B21","doi-asserted-by":"crossref","first-page":"1142","DOI":"10.1093\/jamia\/ocx080","article-title":"Electronic health record adoption in US hospitals: the emergence of a digital \u201cadvanced use\u201d divide","volume":"24","author":"Adler-Milstein","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2021091817522403400_ocab120-B22","doi-asserted-by":"crossref","first-page":"166","DOI":"10.2307\/3348969","article-title":"Evaluating the quality of medical care","volume":"44","author":"Donabedian","year":"1966","journal-title":"Milbank Q"},{"issue":"2","key":"2021091817522403400_ocab120-B23","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1136\/qhc.12.2.112","article-title":"The culture of safety: results of an organization-wide survey in 15 California hospitals","volume":"12","author":"Singer","year":"2003","journal-title":"Qual Saf Health Care"},{"issue":"8","key":"2021091817522403400_ocab120-B24","doi-asserted-by":"crossref","first-page":"1304","DOI":"10.1377\/hlthaff.2014.1282","article-title":"Hospital board and management practices are strongly related to hospital performance on clinical quality metrics","volume":"34","author":"Tsai","year":"2015","journal-title":"Health Aff (Millwood)"},{"issue":"2","key":"2021091817522403400_ocab120-B25","doi-asserted-by":"crossref","first-page":"55","DOI":"10.2307\/41166165","article-title":"Why hospitals don\u2019t learn from failures: organizational and psychological dynamics that inhibit system change","volume":"45","author":"Tucker","year":"2003","journal-title":"Calif Manag Rev"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/10\/2101\/40408817\/ocab120.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/10\/2101\/40408817\/ocab120.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,18]],"date-time":"2021-09-18T17:52:48Z","timestamp":1631987568000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/10\/2101\/6333357"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,1]]},"references-count":25,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,8,1]]},"published-print":{"date-parts":[[2021,9,18]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocab120","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,10,1]]},"published":{"date-parts":[[2021,8,1]]}}}