{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T11:42:28Z","timestamp":1772019748760,"version":"3.50.1"},"reference-count":53,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2022,2,15]],"date-time":"2022-02-15T00:00:00Z","timestamp":1644883200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"name":"The National Institute on Aging of the National Institutes of Health award","award":["R01AG061386"],"award-info":[{"award-number":["R01AG061386"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,4,13]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>To assess and compare electronic health record (EHR) documentation of chronic disease in problem lists and encounter diagnosis records among Community Health Center (CHC) patients.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and methods<\/jats:title><jats:p>We assessed patient EHR data in a large clinical research network during 2012\u20132019. We included CHCs who provided outpatient, older adult primary care to patients age \u226545 years, with \u22652 office visits during the study. Our study sample included 1 180 290 patients from 545 CHCs across 22 states. We used diagnosis codes from 39 Chronic Condition Warehouse algorithms to identify chronic conditions from encounter diagnoses only and compared against problem list records. We measured correspondence including agreement, kappa, prevalence index, bias index, and prevalence-adjusted bias-adjusted kappa.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Overlap of encounter diagnosis and problem list ascertainment was 59.4% among chronic conditions identified, with 12.2% of conditions identified only in encounters and 28.4% identified only in problem lists. Rates of coidentification varied by condition from 7.1% to 84.4%. Greatest agreement was found in diabetes (84.4%), HIV (78.1%), and hypertension (74.7%). Sixteen conditions had &amp;lt;50% agreement, including cancers and substance use disorders. Overlap for mental health conditions ranged from 47.4% for anxiety to 59.8% for depression.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>Agreement between the 2 sources varied substantially. Conditions requiring regular management in primary care settings may have a higher agreement than those diagnosed and treated in specialty care.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>Relying on EHR encounter data to identify chronic conditions without reference to patient problem lists may under-capture conditions among CHC patients in the United States.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jamia\/ocac016","type":"journal-article","created":{"date-parts":[[2022,1,28]],"date-time":"2022-01-28T04:13:26Z","timestamp":1643343206000},"page":"770-778","source":"Crossref","is-referenced-by-count":22,"title":["Comparing ascertainment of chronic condition status with problem lists versus encounter diagnoses from electronic health records"],"prefix":"10.1093","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3575-5529","authenticated-orcid":false,"given":"Robert W","family":"Voss","sequence":"first","affiliation":[{"name":"OCHIN, Inc, Portland, Oregon, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2434-8223","authenticated-orcid":false,"given":"Teresa D","family":"Schmidt","sequence":"additional","affiliation":[{"name":"OCHIN, Inc, Portland, Oregon, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0365-909X","authenticated-orcid":false,"given":"Nicole","family":"Weiskopf","sequence":"additional","affiliation":[{"name":"Department of Medical Informatics and Clinical Epidemiology, Oregon Health & Science University, Portland, Oregon, USA"}]},{"given":"Miguel","family":"Marino","sequence":"additional","affiliation":[{"name":"Department of Family Medicine, Oregon Health & Science University, Portland, Oregon, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2318-7261","authenticated-orcid":false,"given":"David A","family":"Dorr","sequence":"additional","affiliation":[{"name":"Department of Medical Informatics and Clinical Epidemiology, Oregon Health & Science University, Portland, Oregon, USA"}]},{"given":"Nathalie","family":"Huguet","sequence":"additional","affiliation":[{"name":"Department of Family Medicine, Oregon Health & Science University, Portland, Oregon, USA"}]},{"given":"Nate","family":"Warren","sequence":"additional","affiliation":[{"name":"OCHIN, Inc, Portland, Oregon, USA"}]},{"given":"Steele","family":"Valenzuela","sequence":"additional","affiliation":[{"name":"Department of Family Medicine, Oregon Health & Science University, Portland, Oregon, USA"}]},{"given":"Jean","family":"O\u2019Malley","sequence":"additional","affiliation":[{"name":"OCHIN, Inc, Portland, Oregon, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6554-7734","authenticated-orcid":false,"given":"Ana R","family":"Qui\u00f1ones","sequence":"additional","affiliation":[{"name":"Department of Family Medicine, Oregon Health & Science University, Portland, Oregon, USA"},{"name":"OHSU-PSU School of Public Health, Oregon Health & Science University, Portland, Oregon, USA"}]}],"member":"286","published-online":{"date-parts":[[2022,2,15]]},"reference":[{"key":"2022041311574256500_ocac016-B1","doi-asserted-by":"crossref","first-page":"3","DOI":"10.5600\/mmrr.003.03.b02","article-title":"Multiple chronic conditions among Medicare beneficiaries: state-level variations in prevalence, utilization, and cost, 2011","volume":"3","author":"Lochner","year":"2013","journal-title":"Medicare Medicaid Res Rev"},{"issue":"S3","key":"2022041311574256500_ocac016-B2","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1007\/s11606-007-0322-1","article-title":"Multiple chronic conditions: prevalence, health consequences, and implications for quality, care management, and costs","volume":"22","author":"Vogeli","year":"2007","journal-title":"J Gen Intern Med"},{"key":"2022041311574256500_ocac016-B3","first-page":"215","volume-title":"Multimorbidity Patterns in the United States: Implications for Research and Clinical Practice","author":"Goodman","year":"2016"},{"key":"2022041311574256500_ocac016-B4","author":"Shin","year":"2013"},{"key":"2022041311574256500_ocac016-B5","year":"2019"},{"key":"2022041311574256500_ocac016-B6","volume-title":"Multiple Chronic Conditions - A Strategic Framework: Optimum Health and Quality of Life for Individuals with Multiple Chronic Conditions","year":"2010"},{"key":"2022041311574256500_ocac016-B7","year":"2019"},{"issue":"4","key":"2022041311574256500_ocac016-B8","doi-asserted-by":"crossref","first-page":"e14325","DOI":"10.2196\/14325","article-title":"Mapping ICD-10 and ICD-10-CM codes to phecodes: workflow development and initial evaluation","volume":"7","author":"Wu","year":"2019","journal-title":"JMIR Med Inform"},{"issue":"6","key":"2022041311574256500_ocac016-B9","doi-asserted-by":"crossref","first-page":"1046","DOI":"10.1093\/jamia\/ocv202","article-title":"PheKB: a catalog and workflow for creating electronic phenotype algorithms for transportability","volume":"23","author":"Kirby","year":"2016","journal-title":"J Am Med Inform Assoc"},{"issue":"6 Pt 1","key":"2022041311574256500_ocac016-B10","doi-asserted-by":"crossref","first-page":"1839","DOI":"10.1111\/j.1475-6773.2004.00321.x","article-title":"Specificity and sensitivity of claims-based algorithms for identifying members of Medicare+ Choice health plans that have chronic medical conditions","volume":"39","author":"Rector","year":"2004","journal-title":"Health Serv Res"},{"issue":"5","key":"2022041311574256500_ocac016-B11","doi-asserted-by":"crossref","first-page":"1610","DOI":"10.1111\/j.1475-6773.2011.01277.x","article-title":"Identifying chronic conditions in Medicare claims data: evaluating the Chronic Condition Data Warehouse algorithm","volume":"46","author":"Gorina","year":"2011","journal-title":"Health Serv Res"},{"issue":"8","key":"2022041311574256500_ocac016-B12","doi-asserted-by":"crossref","first-page":"782","DOI":"10.1097\/MLR.0000000000000753","article-title":"Using self-reports or claims to assess disease prevalence: it's complicated","volume":"55","author":"Clair","year":"2017","journal-title":"Med Care"},{"key":"2022041311574256500_ocac016-B13","year":"2016"},{"issue":"8","key":"2022041311574256500_ocac016-B14","doi-asserted-by":"crossref","first-page":"789","DOI":"10.1097\/MLR.0000000000000754","article-title":"Comparing population-based risk-stratification model performance using demographic, diagnosis and medication data extracted from outpatient electronic health records versus administrative claims","volume":"55","author":"Kharrazi","year":"2017","journal-title":"Med Care"},{"key":"2022041311574256500_ocac016-B15","article-title":"The benefit of using both claims data and electronic medical record data in health care analysis","author":"Wilson","year":"2012","journal-title":"Optum Insight."},{"issue":"Supplement","key":"2022041311574256500_ocac016-B16","doi-asserted-by":"crossref","first-page":"IV","DOI":"10.1097\/00005650-200208001-00004","article-title":"Assessing comorbidity using claims data: an overview","volume":"40","author":"Klabunde","year":"2002","journal-title":"Med Care"},{"issue":"2","key":"2022041311574256500_ocac016-B17","doi-asserted-by":"crossref","first-page":"243","DOI":"10.2105\/AJPH.82.2.243","article-title":"The accuracy of Medicare's hospital claims data: progress has been made, but problems remain","volume":"82","author":"Fisher","year":"1992","journal-title":"Am J Public Health"},{"issue":"2","key":"2022041311574256500_ocac016-B18","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/S0895-4356(98)00154-1","article-title":"A comparison of the Charlson comorbidity index derived from medical record data and administrative billing data","volume":"52","author":"Kieszak","year":"1999","journal-title":"J Clin Epidemiol"},{"issue":"e2","key":"2022041311574256500_ocac016-B19","doi-asserted-by":"crossref","first-page":"e319","DOI":"10.1136\/amiajnl-2013-001952","article-title":"A comparison of phenotype definitions for diabetes mellitus","volume":"20","author":"Richesson","year":"2013","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2022041311574256500_ocac016-B20","first-page":"100","article-title":"Automated diabetes case identification using electronic health record data at a tertiary care facility","volume":"1","author":"Upadhyaya","year":"2017","journal-title":"Mayo Clin Proc"},{"issue":"4","key":"2022041311574256500_ocac016-B21","doi-asserted-by":"crossref","first-page":"10246","DOI":"10.1002\/lrh2.10246","article-title":"Data-driven discovery of probable Alzheimer's disease and related dementia subphenotypes using electronic health records","volume":"4","author":"Xu","year":"2020","journal-title":"Learn Health Syst"},{"issue":"4","key":"2022041311574256500_ocac016-B22","doi-asserted-by":"crossref","first-page":"10241","DOI":"10.1002\/lrh2.10241","article-title":"Subphenotyping depression using machine learning and electronic health records","volume":"4","author":"Xu","year":"2020","journal-title":"Learn Health Sys"},{"issue":"4","key":"2022041311574256500_ocac016-B23","doi-asserted-by":"crossref","first-page":"e137","DOI":"10.2196\/jmir.8961","article-title":"Prevalence of multiple chronic conditions among older adults in Florida and the United States: comparative analysis of the OneFlorida data trust and national inpatient sample","volume":"20","author":"He","year":"2018","journal-title":"J Med Internet Res"},{"key":"2022041311574256500_ocac016-B24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12911-021-01416-x","article-title":"Temporal relationship of computed and structured diagnoses in electronic health record data","volume":"21","author":"Schulz","year":"2021","journal-title":"BMC Medical Inform Decis Mak"},{"issue":"5","key":"2022041311574256500_ocac016-B25","doi-asserted-by":"crossref","first-page":"752","DOI":"10.1016\/j.amepre.2016.07.004","article-title":"Measuring preventive care delivery: comparing rates across three data sources","volume":"51","author":"Bailey","year":"2016","journal-title":"Am J Prev Med"},{"issue":"4","key":"2022041311574256500_ocac016-B26","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1093\/fampra\/cmr039","article-title":"The use of electronic databases in primary care research","volume":"28","author":"Shephard","year":"2011","journal-title":"Fam Pract"},{"issue":"6","key":"2022041311574256500_ocac016-B27","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.1093\/jamia\/ocw013","article-title":"Data quality of electronic medical records in Manitoba: do problem lists accurately reflect chronic disease billing diagnoses?","volume":"23","author":"Singer","year":"2016","journal-title":"J Am Med Inform Assoc"},{"key":"2022041311574256500_ocac016-B28","first-page":"903","author":"Weiskopf","year":"2019"},{"issue":"4","key":"2022041311574256500_ocac016-B29","doi-asserted-by":"crossref","first-page":"720","DOI":"10.1136\/amiajnl-2013-002333","article-title":"Agreement of Medicaid claims and electronic health records for assessing preventive care quality among adults","volume":"21","author":"Heintzman","year":"2014","journal-title":"J Am Med Inform Assoc"},{"issue":"10","key":"2022041311574256500_ocac016-B30","doi-asserted-by":"crossref","first-page":"784","DOI":"10.1016\/j.ijmedinf.2015.06.011","article-title":"Problem list completeness in electronic health records: a multi-site study and assessment of success factors","volume":"84","author":"Wright","year":"2015","journal-title":"Int J Med Inform"},{"key":"2022041311574256500_ocac016-B31","doi-asserted-by":"crossref","first-page":"1342","DOI":"10.1016\/j.protcy.2014.10.151","article-title":"Improving quality of electronic health records with SNOMED","volume":"16","author":"Duarte","year":"2014","journal-title":"Proc Technol"},{"issue":"2","key":"2022041311574256500_ocac016-B32","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1111\/j.1525-1497.2005.40206.x","article-title":"Clinical implications of an accurate problem list on heart failure treatment","volume":"20","author":"Hartung","year":"2005","journal-title":"J Gen Intern Med"},{"issue":"3","key":"2022041311574256500_ocac016-B33","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1055\/s-0040-1712466","article-title":"Factors influencing problem list use in electronic health records\u2014application of the unified theory of acceptance and use of technology","volume":"11","author":"Klappe","year":"2020","journal-title":"Appl Clin Inform"},{"issue":"8","key":"2022041311574256500_ocac016-B34","doi-asserted-by":"crossref","first-page":"968","DOI":"10.1007\/s11606-012-2033-5","article-title":"Use of an electronic problem list by primary care providers and specialists","volume":"27","author":"Wright","year":"2012","journal-title":"J Gen Intern Med"},{"issue":"3","key":"2022041311574256500_ocac016-B35","doi-asserted-by":"crossref","first-page":"794","DOI":"10.4338\/ACI-2016-12-RA-0210","article-title":"Comparison of EHR-based diagnosis documentation locations to a gold standard for risk stratification in patients with multiple chronic conditions","volume":"8","author":"Martin","year":"2017","journal-title":"Appl Clin Inform"},{"issue":"8","key":"2022041311574256500_ocac016-B36","doi-asserted-by":"crossref","first-page":"1190","DOI":"10.1093\/jamia\/ocaa125","article-title":"Characterizing outpatient problem list completeness and duplications in the electronic health record","volume":"27","author":"Wang","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"2022041311574256500_ocac016-B37","first-page":"1","article-title":"Defining and measuring chronic conditions: imperatives for research, policy, program, and practice","volume":"10","author":"Goodman","year":"2013","journal-title":"Prev Chronic Dis"},{"issue":"11","key":"2022041311574256500_ocac016-B38","doi-asserted-by":"crossref","first-page":"1567","DOI":"10.1093\/jamia\/ocy094","article-title":"Identification of validated case definitions for medical conditions used in primary care electronic medical record databases: a systematic review","volume":"25","author":"McBrien","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2022041311574256500_ocac016-B39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12913-020-05207-4","article-title":"Comprehensive review of ICD-9 code accuracies to measure multimorbidity in administrative data","volume":"20","author":"Wei","year":"2020","journal-title":"BMC Health Serv Res"},{"issue":"8","key":"2022041311574256500_ocac016-B40","doi-asserted-by":"crossref","first-page":"874","DOI":"10.1001\/jama.298.8.874","article-title":"Underdiagnosis of hypertension in children and adolescents","volume":"298","author":"Hansen","year":"2007","journal-title":"JAMA"},{"key":"2022041311574256500_ocac016-B41","year":"2017"},{"issue":"25","key":"2022041311574256500_ocac016-B42","doi-asserted-by":"crossref","first-page":"3083","DOI":"10.1002\/sim.3697","article-title":"Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples","volume":"28","author":"Austin","year":"2009","journal-title":"Stat Med"},{"issue":"6","key":"2022041311574256500_ocac016-B43","doi-asserted-by":"crossref","first-page":"1228","DOI":"10.1080\/03610910902859574","article-title":"Using the standardized difference to compare the prevalence of a binary variable between two groups in observational research","volume":"38","author":"Austin","year":"2009","journal-title":"Commun Stat"},{"issue":"5","key":"2022041311574256500_ocac016-B44","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1097\/MLR.0000000000000120","article-title":"The concordance of survey reports and Medicare claims in a nationally representative longitudinal cohort of older adults","volume":"52","author":"Wolinsky","year":"2014","journal-title":"Med Care"},{"issue":"5","key":"2022041311574256500_ocac016-B45","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1016\/0895-4356(93)90018-V","article-title":"Bias, prevalence and kappa","volume":"46","author":"Byrt","year":"1993","journal-title":"J Clin Epidemiol"},{"issue":"3","key":"2022041311574256500_ocac016-B46","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1093\/ptj\/85.3.257","article-title":"The kappa statistic in reliability studies: use, interpretation, and sample size requirements","volume":"85","author":"Sim","year":"2005","journal-title":"Phys Ther"},{"issue":"1","key":"2022041311574256500_ocac016-B47","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1471-2288-9-5","article-title":"Measuring agreement of administrative data with chart data using prevalence unadjusted and adjusted kappa","volume":"9","author":"Chen","year":"2009","journal-title":"BMC Med Res Methodol"},{"issue":"5","key":"2022041311574256500_ocac016-B48","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1093\/jamia\/ocy011","article-title":"Electronic problem lists: a thematic analysis of a systematic literature review to identify aspects critical to success","volume":"25","author":"Hodge","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"7","key":"2022041311574256500_ocac016-B49","doi-asserted-by":"crossref","first-page":"1774","DOI":"10.1111\/jgs.17345","article-title":"Impact of dementia: Health disparities, population trends, care interventions, and economic costs","volume":"69","author":"Aranda","year":"2021","journal-title":"J Am Geriatr Soc"},{"issue":"2","key":"2022041311574256500_ocac016-B50","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1016\/j.jalz.2018.09.009","article-title":"Perspectives on ethnic and racial disparities in Alzheimer's disease and related dementias: update and areas of immediate need","volume":"15","author":"Babulal","year":"2019","journal-title":"Alzheimers Dement"},{"issue":"8","key":"2022041311574256500_ocac016-B51","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1097\/MLR.0000000000001566","article-title":"Measuring multimorbidity: selecting the right instrument for the purpose and the data source","volume":"59","author":"Suls","year":"2021","journal-title":"Med Care"},{"issue":"1","key":"2022041311574256500_ocac016-B52","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1183\/20734735.0344-2018","article-title":"How to validate a diagnosis recorded in electronic health records","volume":"15","author":"Nissen","year":"2019","journal-title":"Breathe (Sheff)"},{"issue":"8","key":"2022041311574256500_ocac016-B53","doi-asserted-by":"crossref","first-page":"797","DOI":"10.1016\/j.jclinepi.2009.02.005","article-title":"A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard","volume":"62","author":"Reitsma","year":"2009","journal-title":"J Clin Epidemiol"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/5\/770\/43372308\/ocac016.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/5\/770\/43372308\/ocac016.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,16]],"date-time":"2023-11-16T11:36:44Z","timestamp":1700134604000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/29\/5\/770\/6528599"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,15]]},"references-count":53,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,2,15]]},"published-print":{"date-parts":[[2022,4,13]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocac016","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,5,1]]},"published":{"date-parts":[[2022,2,15]]}}}