{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T00:26:39Z","timestamp":1767918399607,"version":"3.49.0"},"reference-count":38,"publisher":"Oxford University Press (OUP)","issue":"11","license":[{"start":{"date-parts":[[2019,6,24]],"date-time":"2019-06-24T00:00:00Z","timestamp":1561334400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100006093","name":"Patient-Centered Outcomes Research Institute","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006093","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Case management programs for high-need high-cost patients are spreading rapidly among health systems. PCORNet has substantial potential to support learning health systems in rapidly evaluating these programs, but access to complete patient data on health care utilization is limited as PCORNet is based on electronic health records not health insurance claims data. Because matching cases to comparison patients on baseline utilization is often a critical component of high-quality observational comparative effectiveness research for high-need high-cost patients, limited access to claims may negatively affect the quality of the matching process. We sought to determine whether the evaluation of programs for high-need high-cost patients required claims data to match cases to comparison patients.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>A retrospective cohort study design with multiple measures of before-and-after health care utilization for 1935 case management patients and 3833 matched comparison patients aged 18 years and older from 2011 to 2015. EHR and claims data were extracted from 3 health systems participating in PCORNet.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Without matching on claims-based health care utilization, the case management programs at 2 of 3 health systems were associated with fewer hospital admissions and emergency visits over the subsequent 12 months. With matching on claims-based health care utilization, case management was no longer associated with admissions and emergency visits at those 2 programs.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>The results of a PCORNet-facilitated evaluation of 3 programs for high-need high-cost patients differed substantially depending on whether claims data were available for matching cases to comparison patients.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>Partnering with learning health systems to rapidly evaluate programs for high-need high-cost patients will require that PCORNet facilitates comprehensive and timely access to both electronic health records and health insurance claims data.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocz097","type":"journal-article","created":{"date-parts":[[2019,5,20]],"date-time":"2019-05-20T19:18:05Z","timestamp":1558379885000},"page":"1305-1313","source":"Crossref","is-referenced-by-count":11,"title":["The importance of health insurance claims data in creating learning health systems: evaluating care for high-need high-cost patients using the National Patient-Centered Clinical Research Network (PCORNet)"],"prefix":"10.1093","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4370-000X","authenticated-orcid":false,"given":"Maureen A","family":"Smith","sequence":"first","affiliation":[{"name":"Department of Population Health Sciences, University of Wisconsin-Madison School of Medicine and Public Health, Madison, Wisconsin, USA"},{"name":"Department of Family Medicine and Community Health, University of Wisconsin-Madison School of Medicine and Public Health, Madison, Wisconsin, USA"},{"name":"Health Innovation Program, University of Wisconsin-Madison School of Medicine and Public Health, Madison, Wisconsin, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mary S","family":"Vaughan-Sarrazin","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, College of Medicine, University of Iowa, Iowa City, Iowa, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Menggang","family":"Yu","sequence":"additional","affiliation":[{"name":"Department of Biostatistics and Medical Informatics, University of Wisconsin-Madison School of Medicine and Public Health, Madison, Wisconsin, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinyi","family":"Wang","sequence":"additional","affiliation":[{"name":"Health Innovation Program, University of Wisconsin-Madison School of Medicine and Public Health, Madison, Wisconsin, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter A","family":"Nordby","sequence":"additional","affiliation":[{"name":"Health Innovation Program, University of Wisconsin-Madison School of Medicine and Public Health, Madison, Wisconsin, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christine","family":"Vogeli","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Harvard University, Boston, Massachusetts, USA"},{"name":"Department of Medicine, Massachusetts General Hospital, Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonathan","family":"Jaffery","sequence":"additional","affiliation":[{"name":"Office of Population Health, UW Health, Madison, Wisconsin, USA"},{"name":"Department of Medicine, University of Wisconsin-Madison School of Medicine and Public Health, Madison, Wisconsin, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joshua P","family":"Metlay","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Harvard University, Boston, Massachusetts, USA"},{"name":"Department of Medicine, Massachusetts General Hospital, Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2019,6,24]]},"reference":[{"issue":"10","key":"2021012411200482600_ocz097-B1","doi-asserted-by":"crossref","first-page":"909","DOI":"10.1056\/NEJMp1608511","article-title":"Caring for high-need, high-cost patients: an urgent priority","volume":"375","author":"Blumenthal","year":"2016","journal-title":"N Engl J Med"},{"key":"2021012411200482600_ocz097-B2","author":"Hickam","year":"2013"},{"issue":"7","key":"2021012411200482600_ocz097-B3","doi-asserted-by":"crossref","first-page":"e0132340.","DOI":"10.1371\/journal.pone.0132340","article-title":"Effectiveness of case management for \u201cat risk\u201d patients in primary care: a systematic review and meta-analysis","volume":"10","author":"Stokes","year":"2015","journal-title":"PLoS One"},{"issue":"12","key":"2021012411200482600_ocz097-B4","doi-asserted-by":"crossref","first-page":"2043","DOI":"10.1007\/s11606-018-4609-1","article-title":"Variability in care management programs in medicare ACOs: a survey of medical directors","volume":"33","author":"Donelan","year":"2018","journal-title":"J Gen Intern Med"},{"issue":"2","key":"2021012411200482600_ocz097-B5","doi-asserted-by":"crossref","first-page":"w107","DOI":"10.1377\/hlthaff.26.2.w107","article-title":"A rapid-learning health system","volume":"26","author":"Etheredge","year":"2007","journal-title":"Health Aff (Millwood)"},{"issue":"2-3","key":"2021012411200482600_ocz097-B6","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.healthpol.2013.01.019","article-title":"Reported barriers to evaluation in chronic care: experiences in six European countries","volume":"110","author":"Knai","year":"2013","journal-title":"Health Policy"},{"issue":"2","key":"2021012411200482600_ocz097-B7","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1177\/0163278710376824","article-title":"Designing a prospective study when randomization is not feasible","volume":"34","author":"Linden","year":"2011","journal-title":"Eval Health Prof"},{"issue":"1","key":"2021012411200482600_ocz097-B8","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1111\/j.1365-2753.2009.01361.x","article-title":"Evaluating health management programmes over time: application of propensity score-based weighting to longitudinal data","volume":"16","author":"Linden","year":"2010","journal-title":"J Eval Clin Pract"},{"issue":"1","key":"2021012411200482600_ocz097-B9","doi-asserted-by":"crossref","first-page":"26","DOI":"10.2174\/1874924001104010026","article-title":"How healthcare studies use claims data","volume":"4","author":"Burton","year":"2011","journal-title":"Open Health Serv Policy J"},{"key":"2021012411200482600_ocz097-B10","doi-asserted-by":"crossref","first-page":"S30","DOI":"10.1097\/MLR.0b013e31829b1dbd","article-title":"Caveats for the use of operational electronic health record data in comparative effectiveness research","volume":"51(8, Suppl 3)","author":"Hersh","year":"2013","journal-title":"Med Care"},{"issue":"6","key":"2021012411200482600_ocz097-B11","doi-asserted-by":"crossref","first-page":"1143","DOI":"10.1093\/jamia\/ocw021","article-title":"Missing clinical and behavioral health data in a large electronic health record (EHR) system","volume":"23","author":"Madden","year":"2016","journal-title":"J Am Med Inform Assoc"},{"key":"2021012411200482600_ocz097-B12","volume-title":"Sharing Clinical Research Data: Workshop Summary","author":"Institute of Medicine","year":"2013"},{"key":"2021012411200482600_ocz097-B13","doi-asserted-by":"crossref","first-page":"S51","DOI":"10.1097\/MLR.0b013e31819c95aa","article-title":"Administrative and claims records as sources of health care cost data","volume":"47(Supplement)","author":"Riley","year":"2009","journal-title":"Med Care"},{"key":"2021012411200482600_ocz097-B14","doi-asserted-by":"crossref","first-page":"1144.","DOI":"10.1186\/1471-2458-14-1144","article-title":"A systematic review of barriers to data sharing in public health","volume":"14","author":"van Panhuis","year":"2014","journal-title":"BMC Public Health"},{"issue":"10","key":"2021012411200482600_ocz097-B15","doi-asserted-by":"crossref","first-page":"1826","DOI":"10.1377\/hlthaff.2010.0630","article-title":"The critical role of observational evidence in comparative effectiveness research","volume":"29","author":"Fleurence","year":"2010","journal-title":"Health Aff (Millwood)"},{"issue":"4","key":"2021012411200482600_ocz097-B16","doi-asserted-by":"crossref","first-page":"341","DOI":"10.2217\/cer.15.16","article-title":"The role of matching when adjusting for baseline differences in the outcome variable of comparative effectiveness studies","volume":"4","author":"Grijalva","year":"2015","journal-title":"J Comp Eff Res"},{"key":"2021012411200482600_ocz097-B17","article-title":"Are publicly funded health databases geographically detailed and timely enough to support patient-centered outcomes research?","author":"Min","journal-title":"J Gen Intern Med"},{"issue":"3","key":"2021012411200482600_ocz097-B18","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1200\/JOP.2014.003194","article-title":"Building data infrastructure to evaluate and improve quality: PCORNet","volume":"11","author":"Corley","year":"2015","journal-title":"J Oncol Pract"},{"key":"2021012411200482600_ocz097-B19","author":"Patient-Centered Outcomes Research Institute","year":"2016"},{"issue":"7","key":"2021012411200482600_ocz097-B20","first-page":"1519","article-title":"A controlled time-series trial of clinical reminders: using computerized firm systems to make quality improvement research a routine part of mainstream practice","volume":"34","author":"Goldberg","year":"2000","journal-title":"Health Serv Res"},{"issue":"1","key":"2021012411200482600_ocz097-B21","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1136\/qhc.12.1.47","article-title":"Research designs for studies evaluating the effectiveness of change and improvement strategies","volume":"12","author":"Eccles","year":"2003","journal-title":"Qual Saf Health Care"},{"issue":"2","key":"2021012411200482600_ocz097-B22","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1111\/j..2002.384.doc.x","article-title":"Design and analysis of pilot studies: recommendations for good practice","volume":"10","author":"Lancaster","year":"2004","journal-title":"J Eval Clin Pract"},{"issue":"1","key":"2021012411200482600_ocz097-B23","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1097\/00005650-199801000-00004","article-title":"Comorbidity measures for use with administrative data","volume":"36","author":"Elixhauser","year":"1998","journal-title":"Med Care"},{"issue":"4","key":"2021012411200482600_ocz097-B24","first-page":"119","article-title":"Risk adjustment of medicare capitation payments using the CMS-HCC model","volume":"25","author":"Pope","year":"2004","journal-title":"Health Care Financ Rev"},{"key":"2021012411200482600_ocz097-B25","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1002\/pds.3263","article-title":"One-to-many propensity score matching in cohort studies","volume":"21(Suppl 2)","author":"Rassen","year":"2012","journal-title":"Pharmacoepidemiol Drug Saf"},{"issue":"1","key":"2021012411200482600_ocz097-B26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1214\/09-STS313","article-title":"Matching methods for causal inference: a review and a look forward","volume":"25","author":"Stuart","year":"2010","journal-title":"Stat Sci"},{"issue":"8","key":"2021012411200482600_ocz097-B27","doi-asserted-by":"crossref","first-page":"S84","DOI":"10.1016\/j.jclinepi.2013.01.013","article-title":"Prognostic score-based balance measures can be a useful diagnostic for propensity score methods in comparative effectiveness research","volume":"66","author":"Stuart","year":"2013","journal-title":"J Clin Epidemiol"},{"issue":"5","key":"2021012411200482600_ocz097-B28","doi-asserted-by":"crossref","first-page":"830","DOI":"10.1016\/j.jbi.2013.06.010","article-title":"Defining and measuring completeness of electronic health records for secondary use","volume":"46","author":"Weiskopf","year":"2013","journal-title":"J Biomed Inform"},{"issue":"1","key":"2021012411200482600_ocz097-B29","first-page":"11","article-title":"The use of claims data in healthcare research","volume":"2","author":"Ferver","year":"2009","journal-title":"Open Health Serv Policy J"},{"issue":"3","key":"2021012411200482600_ocz097-B30","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1093\/pan\/mpl013","article-title":"Matching as nonparametric preprocessing for reducing model dependence in parametric causal inference","volume":"15","author":"Ho","year":"2007","journal-title":"Polit Anal"},{"issue":"11","key":"2021012411200482600_ocz097-B31","first-page":"e597","article-title":"Attributes common to programs that successfully treat high-need, high-cost individuals","volume":"21","author":"Anderson","year":"2015","journal-title":"Am J Manag Care"},{"key":"2021012411200482600_ocz097-B32","article-title":"Care management of patients with complex health care needs","volume":"19","author":"Berry-Millett","year":"2009","journal-title":"Synth Proj Res Synth Rep"},{"issue":"10","key":"2021012411200482600_ocz097-B33","doi-asserted-by":"crossref","first-page":"e017762.","DOI":"10.1136\/bmjopen-2017-017762","article-title":"Key factors of case management interventions for frequent users of healthcare services: a thematic analysis review","volume":"7","author":"Hudon","year":"2017","journal-title":"BMJ Open"},{"issue":"24","key":"2021012411200482600_ocz097-B34","doi-asserted-by":"crossref","first-page":"2395","DOI":"10.1056\/NEJMsb1610128","article-title":"Transforming evidence generation to support health and health care decisions","volume":"375","author":"Califf","year":"2016","journal-title":"N Engl J Med"},{"issue":"3","key":"2021012411200482600_ocz097-B35","doi-asserted-by":"crossref","first-page":"320","DOI":"10.1177\/1098214014557009","article-title":"Using indices of fidelity to intervention core components to identify program active ingredients","volume":"36","author":"Abry","year":"2015","journal-title":"Am J Eval"},{"key":"2021012411200482600_ocz097-B36","doi-asserted-by":"crossref","first-page":"S23","DOI":"10.1097\/MLR.0000000000000060","article-title":"Approaches to comparative effectiveness research in multimorbid populations","volume":"52(Suppl 3)","author":"Maciejewski","year":"2014","journal-title":"Med Care"},{"issue":"22","key":"2021012411200482600_ocz097-B37","doi-asserted-by":"crossref","first-page":"2623","DOI":"10.1001\/jama.298.22.2623","article-title":"Geriatric care management for low-income seniors: a randomized controlled trial","volume":"298","author":"Counsell","year":"2007","journal-title":"JAMA"},{"issue":"8","key":"2021012411200482600_ocz097-B38","first-page":"546","article-title":"Medicare shared savings program: public reporting and shared savings distributions","volume":"21","author":"Schulz","year":"2015","journal-title":"Am J Manag Care"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/11\/1305\/36089020\/ocz097.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/11\/1305\/36089020\/ocz097.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,1,24]],"date-time":"2021-01-24T16:20:18Z","timestamp":1611505218000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/26\/11\/1305\/5522431"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,24]]},"references-count":38,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2019,6,24]]},"published-print":{"date-parts":[[2019,11,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocz097","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,11]]},"published":{"date-parts":[[2019,6,24]]}}}