{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T21:09:40Z","timestamp":1776114580071,"version":"3.50.1"},"reference-count":123,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2023,6,30]],"date-time":"2023-06-30T00:00:00Z","timestamp":1688083200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,9,25]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>We extended a 2013 literature review on electronic health record (EHR) data quality assessment approaches and tools to determine recent improvements or changes in EHR data quality assessment methodologies.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We completed a systematic review of PubMed articles from 2013 to April 2023 that discussed the quality assessment of EHR data. We screened and reviewed papers for the dimensions and methods defined in the original 2013 manuscript. We categorized papers as data quality outcomes of interest, tools, or opinion pieces. We abstracted and defined additional themes and methods though an iterative review process.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We included 103 papers in the review, of which 73 were data quality outcomes of interest papers, 22 were tools, and 8 were opinion pieces. The most common dimension of data quality assessed was completeness, followed by correctness, concordance, plausibility, and currency. We abstracted conformance and bias as 2 additional dimensions of data quality and structural agreement as an additional methodology.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>There has been an increase in EHR data quality assessment publications since the original 2013 review. Consistent dimensions of EHR data quality continue to be assessed across applications. Despite consistent patterns of assessment, there still does not exist a standard approach for assessing EHR data quality.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>Guidelines are needed for EHR data quality assessment to improve the efficiency, transparency, comparability, and interoperability of data quality assessment. These guidelines must be both scalable and flexible. Automation could be helpful in generalizing this process.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocad120","type":"journal-article","created":{"date-parts":[[2023,6,30]],"date-time":"2023-06-30T22:23:35Z","timestamp":1688163815000},"page":"1730-1740","source":"Crossref","is-referenced-by-count":114,"title":["Electronic health record data quality assessment and tools: a systematic review"],"prefix":"10.1093","volume":"30","author":[{"given":"Abigail E","family":"Lewis","sequence":"first","affiliation":[{"name":"Division of Computational and Data Sciences, Washington University in St. Louis , St. Louis, Missouri, USA"},{"name":"Institute for Informatics, Data Science and Biostatistics, Washington University in St. Louis , St. Louis, Missouri, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0365-909X","authenticated-orcid":false,"given":"Nicole","family":"Weiskopf","sequence":"additional","affiliation":[{"name":"Department of Medical Informatics and Clinical Epidemiology, Oregon Health & Science University , Portland, Oregon, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5219-9996","authenticated-orcid":false,"given":"Zachary B","family":"Abrams","sequence":"additional","affiliation":[{"name":"Institute for Informatics, Data Science and Biostatistics, Washington University in St. Louis , St. Louis, Missouri, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9255-9394","authenticated-orcid":false,"given":"Randi","family":"Foraker","sequence":"additional","affiliation":[{"name":"Institute for Informatics, Data Science and Biostatistics, Washington University in St. Louis , St. Louis, Missouri, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9241-2656","authenticated-orcid":false,"given":"Albert M","family":"Lai","sequence":"additional","affiliation":[{"name":"Institute for Informatics, Data Science and Biostatistics, Washington University in St. Louis , St. Louis, Missouri, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9532-2998","authenticated-orcid":false,"given":"Philip R O","family":"Payne","sequence":"additional","affiliation":[{"name":"Institute for Informatics, Data Science and Biostatistics, Washington University in St. Louis , St. Louis, Missouri, USA"}]},{"given":"Aditi","family":"Gupta","sequence":"additional","affiliation":[{"name":"Institute for Informatics, Data Science and Biostatistics, Washington University in St. Louis , St. Louis, Missouri, USA"}]}],"member":"286","published-online":{"date-parts":[[2023,6,30]]},"reference":[{"issue":"1","key":"2023092720000950200_ocad120-B1","doi-asserted-by":"crossref","first-page":"e10076","DOI":"10.1002\/lrh2.10076","article-title":"Use of EHRs data for clinical research: historical progress and current applications","volume":"3","author":"Nordo","year":"2019","journal-title":"Learn Health Syst"},{"issue":"1","key":"2023092720000950200_ocad120-B2","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1001\/jama.2018.18932","article-title":"Questions for artificial intelligence in health care","volume":"321","author":"Maddox","year":"2019","journal-title":"JAMA"},{"key":"2023092720000950200_ocad120-B3","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.cct.2015.11.011","article-title":"Cost-benefit assessment of using electronic health records data for clinical research versus current practices: contribution of the Electronic Health Records for Clinical Research (EHR4CR) European Project","volume":"46","author":"Beresniak","year":"2016","journal-title":"Contemp Clin Trials"},{"issue":"2","key":"2023092720000950200_ocad120-B4","doi-asserted-by":"crossref","first-page":"812","DOI":"10.1093\/bib\/bbaa418","article-title":"Health informatics and EHR to support clinical research in the COVID-19 pandemic: an overview","volume":"22","author":"Dagliati","year":"2021","journal-title":"Brief Bioinform"},{"key":"2023092720000950200_ocad120-B5","doi-asserted-by":"crossref","first-page":"104028","DOI":"10.1016\/j.jbi.2022.104028","article-title":"Novel informatics approaches to COVID-19 research: from methods to applications","volume":"129","author":"Xu","year":"2022","journal-title":"J Biomed Inform"},{"issue":"7","key":"2023092720000950200_ocad120-B6","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1097\/CIN.0000000000000609","article-title":"Challenges frequently encountered in the secondary use of electronic medical record data for research","volume":"38","author":"Edmondson","year":"2020","journal-title":"Comput Inform Nurs"},{"issue":"4","key":"2023092720000950200_ocad120-B7","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1080\/07421222.1996.11518099","article-title":"Beyond accuracy: what data quality means to data consumers","volume":"12","author":"Wang","year":"1996","journal-title":"J Manag Inform Syst"},{"issue":"1","key":"2023092720000950200_ocad120-B8","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1136\/amiajnl-2011-000681","article-title":"Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research","volume":"20","author":"Weiskopf","year":"2013","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2023092720000950200_ocad120-B9","first-page":"1244","article-title":"A harmonized data quality assessment terminology and framework for the secondary use of electronic health record data","volume":"4","author":"Kahn","year":"2016","journal-title":"EGEMS (Wash DC)"},{"issue":"1","key":"2023092720000950200_ocad120-B10","first-page":"3","article-title":"Evaluating foundational data quality in the national patient-centered clinical research network (PCORnet\u00ae)","volume":"6","author":"Qualls","year":"2018","journal-title":"EGEMS (Wash DC)"},{"key":"2023092720000950200_ocad120-B11","first-page":"186","article-title":"EHR data quality assessment tools and issue reporting workflows for the \u2018All of Us\u2019 research program clinical data research network","volume":"2022","author":"Engel","year":"2022","journal-title":"AMIA Annu Symp Proc"},{"issue":"4","key":"2023092720000950200_ocad120-B12","doi-asserted-by":"crossref","first-page":"622","DOI":"10.1055\/s-0040-1715567","article-title":"A rule-based data quality assessment system for electronic health record data","volume":"11","author":"Wang","year":"2020","journal-title":"Appl Clin Inform"},{"key":"2023092720000950200_ocad120-B13","first-page":"574","article-title":"Observational Health Data Sciences and Informatics (OHDSI): opportunities for observational researchers","volume":"216","author":"Hripcsak","year":"2015","journal-title":"Stud Health Technol Inform"},{"issue":"1","key":"2023092720000950200_ocad120-B14","first-page":"1239","article-title":"Multisite evaluation of a data quality tool for patient-level clinical data sets","volume":"4","author":"Huser","year":"2016","journal-title":"EGEMS (Wash DC)"},{"issue":"4","key":"2023092720000950200_ocad120-B15","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1093\/jamia\/ocab217","article-title":"Synergies between centralized and federated approaches to data quality: a report from the national COVID cohort collaborative","volume":"29","author":"Pfaff","year":"2022","journal-title":"J Am Med Inform Assoc"},{"key":"2023092720000950200_ocad120-B16","doi-asserted-by":"publisher","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement: an updated guideline for reporting systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"BMJ"},{"key":"2023092720000950200_ocad120-B17","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.ijmedinf.2016.03.006","article-title":"Data quality assessment framework to assess electronic medical record data for use in research","volume":"90","author":"Reimer","year":"2016","journal-title":"Int J Med Inform"},{"issue":"5","key":"2023092720000950200_ocad120-B18","doi-asserted-by":"crossref","first-page":"753","DOI":"10.1177\/0193945916689084","article-title":"Data quality in electronic health records research: quality domains and assessment methods","volume":"40","author":"Feder","year":"2018","journal-title":"West J Nurs Res"},{"issue":"11","key":"2023092720000950200_ocad120-B19","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1093\/jamia\/ocz119","article-title":"Real world evidence in cardiovascular medicine: ensuring data validity in electronic health record-based studies","volume":"26","author":"Hernandez-Boussard","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2023092720000950200_ocad120-B20","doi-asserted-by":"crossref","first-page":"1072","DOI":"10.1093\/jamia\/ocx033","article-title":"A longitudinal analysis of data quality in a large pediatric data research network","volume":"24","author":"Khare","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2023092720000950200_ocad120-B21","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.1093\/jamia\/ocw013","article-title":"Data quality of electronic medical records in Manitoba: do problem lists accurately reflect chronic disease billing diagnoses?","volume":"23","author":"Singer","year":"2016","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2023092720000950200_ocad120-B22","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1186\/s12911-019-0740-0","article-title":"A basic model for assessing primary health care electronic medical record data quality","volume":"19","author":"Terry","year":"2019","journal-title":"BMC Med Inform Decis Mak"},{"key":"2023092720000950200_ocad120-B23","first-page":"293","article-title":"Clinical data cohort quality improvement: the case of the medication data in the University of Minnesota\u2019s clinical data repository","volume":"2022","author":"Kiogou","year":"2022","journal-title":"AMIA Annu Symp Proc"},{"issue":"6","key":"2023092720000950200_ocad120-B24","doi-asserted-by":"crossref","first-page":"546","DOI":"10.1177\/003335491312800614","article-title":"Electronic health information quality challenges and interventions to improve public health surveillance data and practice","volume":"128","author":"Dixon","year":"2013","journal-title":"Public Health Rep"},{"key":"2023092720000950200_ocad120-B25","first-page":"1937","article-title":"A data quality ontology for the secondary use of EHR data","volume":"2015","author":"Johnson","year":"2015","journal-title":"AMIA Annu Symp Proc"},{"key":"2023092720000950200_ocad120-B26","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.ijmedinf.2018.02.007","article-title":"Validation of the ICU-DaMa tool for automatically extracting variables for minimum dataset and quality indicators: The importance of data quality assessment","volume":"112","author":"Sirgo","year":"2018","journal-title":"Int J Med Inform"},{"key":"2023092720000950200_ocad120-B27","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1186\/1471-2369-15-70","article-title":"Electronic problem list documentation of chronic kidney disease and quality of care","volume":"15","author":"Samal","year":"2014","journal-title":"BMC Nephrol"},{"issue":"10","key":"2023092720000950200_ocad120-B28","doi-asserted-by":"crossref","first-page":"784","DOI":"10.1016\/j.ijmedinf.2015.06.011","article-title":"Problem list completeness in electronic health records: a multi-site study and assessment of success factors","volume":"84","author":"Wright","year":"2015","journal-title":"Int J Med Inform"},{"key":"2023092720000950200_ocad120-B29","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.ijmedinf.2015.11.003","article-title":"An assessment of data quality in a multi-site electronic medical record system in Haiti","volume":"86","author":"Puttkammer","year":"2016","journal-title":"Int J Med Inform"},{"issue":"3","key":"2023092720000950200_ocad120-B30","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1093\/jamia\/ocy170","article-title":"Measuring the rate of manual transcription error in outpatient point-of-care testing","volume":"26","author":"Mays","year":"2019","journal-title":"J Am Med Inform Assoc"},{"key":"2023092720000950200_ocad120-B31","doi-asserted-by":"crossref","first-page":"145","DOI":"10.2147\/CLEP.S189989","article-title":"The internal validation of weight and weight change coding using weight measurement data within the UK primary care electronic health record","volume":"11","author":"Nicholson","year":"2019","journal-title":"Clin Epidemiol"},{"issue":"1","key":"2023092720000950200_ocad120-B32","first-page":"14","article-title":"A data quality assessment guideline for electronic health record data reuse","volume":"5","author":"Weiskopf","year":"2017","journal-title":"EGEMS (Wash DC)"},{"key":"2023092720000950200_ocad120-B33","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1016\/j.jbi.2014.07.016","article-title":"Integrating electronic health record information to support integrated care: practical application of ontologies to improve the accuracy of diabetes disease registers","volume":"52","author":"Liaw","year":"2014","journal-title":"J Biomed Inform"},{"issue":"1","key":"2023092720000950200_ocad120-B34","first-page":"e24","article-title":"Electronic health record problem lists: accurate enough for risk adjustment?","volume":"24","author":"Daskivich","year":"2018","journal-title":"Am J Manag Care"},{"issue":"3","key":"2023092720000950200_ocad120-B35","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1016\/j.ahj.2012.12.009","article-title":"Data quality of an electronic health record tool to support VA cardiac catheterization laboratory quality improvement: the VA Clinical Assessment, Reporting, and Tracking System for Cath Labs (CART) program","volume":"165","author":"Byrd","year":"2013","journal-title":"Am Heart J"},{"issue":"3","key":"2023092720000950200_ocad120-B36","doi-asserted-by":"crossref","first-page":"e22219","DOI":"10.2196\/22219","article-title":"What every reader should know about studies using electronic health record data but may be afraid to ask","volume":"23","author":"Kohane","year":"2021","journal-title":"J Med Internet Res"},{"issue":"3","key":"2023092720000950200_ocad120-B37","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1093\/jamiaopen\/ooz020","article-title":"A tale of three subspecialties: diagnosis recording patterns are internally consistent but specialty-dependent","volume":"2","author":"Diaz-Garelli","year":"2019","journal-title":"JAMIA Open"},{"key":"2023092720000950200_ocad120-B38","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1186\/1472-6947-14-32","article-title":"Influence of data quality on computed Dutch hospital quality indicators: a case study in colorectal cancer surgery","volume":"14","author":"Dentler","year":"2014","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"2023092720000950200_ocad120-B39","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1186\/s12911-016-0382-4","article-title":"Data extraction from electronic health records (EHRs) for quality measurement of the physical therapy process: comparison between EHR data and survey data","volume":"16","author":"Scholte","year":"2016","journal-title":"BMC Med Inform Decis Mak"},{"key":"2023092720000950200_ocad120-B40","first-page":"325","article-title":"Lost in translation: diagnosis records show more inaccuracies after biopsy in oncology care EHRs","volume":"2019","author":"Diaz-Garelli","year":"2019","journal-title":"AMIA Jt Summits Transl Sci Proc"},{"key":"2023092720000950200_ocad120-B41","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1186\/s12875-015-0223-z","article-title":"From patient care to research: a validation study examining the factors contributing to data quality in a primary care electronic medical record database","volume":"16","author":"Coleman","year":"2015","journal-title":"BMC Fam Pract"},{"issue":"3","key":"2023092720000950200_ocad120-B42","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1093\/jamia\/ocaa225","article-title":"Assessing the quality of clinical and administrative data extracted from hospitals: the General Medicine Inpatient Initiative (GEMINI) experience","volume":"28","author":"Verma","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2023092720000950200_ocad120-B43","doi-asserted-by":"crossref","first-page":"794","DOI":"10.4338\/ACI-2016-12-RA-0210","article-title":"Comparison of EHR-based diagnosis documentation locations to a gold standard for risk stratification in patients with multiple chronic conditions","volume":"8","author":"Martin","year":"2017","journal-title":"Appl Clin Inform"},{"key":"2023092720000950200_ocad120-B44","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.jbi.2014.10.010","article-title":"Secondary use of electronic health records for building cohort studies through top-down information extraction","volume":"53","author":"Kreuzthaler","year":"2015","journal-title":"J Biomed Inform"},{"key":"2023092720000950200_ocad120-B45","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1200\/CCI.19.00114","article-title":"Workflow differences affect data accuracy in oncologic EHRs: a first step toward detangling the diagnosis data Babel","volume":"4","author":"Diaz-Garelli","year":"2020","journal-title":"JCO Clin Cancer Inform"},{"issue":"10","key":"2023092720000950200_ocad120-B46","first-page":"e474","article-title":"S. Identifying patients with asthma in primary care electronic medical record systems chart analysis-based electronic algorithm validation study","volume":"61","author":"Xi","year":"2015","journal-title":"Can Fam Phys"},{"issue":"10","key":"2023092720000950200_ocad120-B47","doi-asserted-by":"crossref","first-page":"768","DOI":"10.1016\/j.ijmedinf.2014.06.002","article-title":"Validating an ontology-based algorithm to identify patients with type 2 diabetes mellitus in electronic health records","volume":"83","author":"Rahimi","year":"2014","journal-title":"Int J Med Inform"},{"key":"2023092720000950200_ocad120-B48","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1186\/s12887-016-0592-z","article-title":"Quality of EHR data extractions for studies of preterm birth in a tertiary care center: guidelines for obtaining reliable data","volume":"16","author":"Knake","year":"2016","journal-title":"BMC Pediatr"},{"issue":"1","key":"2023092720000950200_ocad120-B49","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1093\/jamia\/ocw067","article-title":"Comparison of accuracy of physical examination findings in initial progress notes between paper charts and a newly implemented electronic health record","volume":"24","author":"Yadav","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"12","key":"2023092720000950200_ocad120-B50","doi-asserted-by":"crossref","first-page":"1648","DOI":"10.3390\/healthcare9121648","article-title":"Real-world evidence of COVID-19 patients\u2019 data quality in the electronic health records","volume":"9","author":"Binkheder","year":"2021","journal-title":"Healthcare (Basel)"},{"issue":"29","key":"2023092720000950200_ocad120-B51","doi-asserted-by":"crossref","first-page":"e16438","DOI":"10.1097\/MD.0000000000016438","article-title":"Assessment of obesity prevalence and validity of obesity diagnoses coded in claims data for selected surgical populations: a retrospective, observational study","volume":"98","author":"Ammann","year":"2019","journal-title":"Medicine (Baltimore)"},{"issue":"6","key":"2023092720000950200_ocad120-B52","doi-asserted-by":"crossref","first-page":"e1676","DOI":"10.1542\/peds.2013-4277","article-title":"Variation in outcomes of quality measurement by data source","volume":"133","author":"Angier","year":"2014","journal-title":"Pediatrics"},{"issue":"8 Suppl 3","key":"2023092720000950200_ocad120-B53","doi-asserted-by":"crossref","first-page":"S22","DOI":"10.1097\/MLR.0b013e31829b1e2c","article-title":"Data quality assessment for comparative effectiveness research in distributed data networks","volume":"51","author":"Brown","year":"2013","journal-title":"Med Care"},{"issue":"1","key":"2023092720000950200_ocad120-B54","first-page":"1201","article-title":"Using a data quality framework to clean data extracted from the electronic health record: a case study","volume":"4","author":"Dziadkowiec","year":"2016","journal-title":"EGEMS (Wash DC)"},{"key":"2023092720000950200_ocad120-B55","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.jclinepi.2019.11.006","article-title":"Data mining information from electronic health records produced high yield and accuracy for current smoking status","volume":"118","author":"Groenhof","year":"2020","journal-title":"J Clin Epidemiol"},{"issue":"4","key":"2023092720000950200_ocad120-B56","doi-asserted-by":"crossref","first-page":"692","DOI":"10.1136\/amiajnl-2012-001479","article-title":"Is the quality of data in an electronic medical record sufficient for assessing the quality of primary care?","volume":"21","author":"Barkhuysen","year":"2014","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"2023092720000950200_ocad120-B57","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1158\/1055-9965.EPI-19-0882","article-title":"Population-based registry linkages to improve validity of electronic health record-based cancer research","volume":"29","author":"Thompson","year":"2020","journal-title":"Cancer Epidemiol Biomarkers Prev"},{"key":"2023092720000950200_ocad120-B58","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.ijmedinf.2016.08.004","article-title":"Reusability of coded data in the primary care electronic medical record: a dynamic cohort study concerning cancer diagnoses","volume":"99","author":"Sollie","year":"2017","journal-title":"Int J Med Inform"},{"issue":"e2","key":"2023092720000950200_ocad120-B59","doi-asserted-by":"crossref","first-page":"e226","DOI":"10.1136\/amiajnl-2013-001926","article-title":"Electronic health records based phenotyping in next-generation clinical trials: a perspective from the NIH Health Care Systems Collaboratory","volume":"20","author":"Richesson","year":"2013","journal-title":"J Am Med Inform Assoc"},{"issue":"8\u20139","key":"2023092720000950200_ocad120-B60","doi-asserted-by":"crossref","first-page":"730","DOI":"10.1093\/jamia\/ocz113","article-title":"Challenges with quality of race and ethnicity data in observational databases","volume":"26","author":"Polubriaginof","year":"2019","journal-title":"J Am Med Inform Assoc"},{"key":"2023092720000950200_ocad120-B61","first-page":"164","article-title":"Making EHRs trustable: a quality analysis of EHR-derived datasets for COVID-19 research","volume":"294","author":"Pedrera-Jimenez","year":"2022","journal-title":"Stud Health Technol Inform"},{"issue":"1","key":"2023092720000950200_ocad120-B62","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1186\/s12911-021-01669-6","article-title":"Assessing the suitability of general practice electronic health records for clinical prediction model development: a data quality assessment","volume":"21","author":"Thuraisingam","year":"2021","journal-title":"BMC Med Inform Decis Mak"},{"key":"2023092720000950200_ocad120-B63","first-page":"1392","article-title":"Challenges with collecting smoking status in electronic health records","volume":"2017","author":"Polubriaginof","year":"2017","journal-title":"AMIA Annu Symp Proc"},{"issue":"Spring","key":"2023092720000950200_ocad120-B64","first-page":"1e","article-title":"Why patient matching is a challenge: research on master patient index (MPI) data discrepancies in key identifying fields","volume":"13","author":"Just","year":"2016","journal-title":"Perspect Health Inf Manag"},{"issue":"1","key":"2023092720000950200_ocad120-B65","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1002\/pds.3368","article-title":"Identifying periods of acceptable computer usage in primary care research databases","volume":"22","author":"Horsfall","year":"2013","journal-title":"Pharmacoepidemiol Drug Saf"},{"issue":"5","key":"2023092720000950200_ocad120-B66","doi-asserted-by":"crossref","first-page":"794","DOI":"10.1055\/s-0039-1697598","article-title":"Incrementally transforming electronic medical records into the observational medical outcomes partnership common data model: a multidimensional quality assurance approach","volume":"10","author":"Lynch","year":"2019","journal-title":"Appl Clin Inform"},{"issue":"1","key":"2023092720000950200_ocad120-B67","first-page":"963","article-title":"Completeness and accuracy of anthropometric measurements in electronic medical records for children attending primary care","volume":"25","author":"Carsley","year":"2018","journal-title":"J Innov Health Inform"},{"key":"2023092720000950200_ocad120-B68","doi-asserted-by":"crossref","first-page":"103363","DOI":"10.1016\/j.jbi.2019.103363","article-title":"Adapting electronic health records-derived phenotypes to claims data: lessons learned in using limited clinical data for phenotyping","volume":"102","author":"Ostropolets","year":"2020","journal-title":"J Biomed Inform"},{"issue":"5","key":"2023092720000950200_ocad120-B69","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1055\/s-0040-1718756","article-title":"A method to improve availability and quality of patient race data in an electronic health record system","volume":"11","author":"Cusick","year":"2020","journal-title":"Appl Clin Inform"},{"key":"2023092720000950200_ocad120-B70","first-page":"366","article-title":"Examining the use, contents, and quality of free-text tobacco use documentation in the electronic health record","volume":"2014","author":"Chen","year":"2014","journal-title":"AMIA Annu Symp Proc"},{"issue":"6","key":"2023092720000950200_ocad120-B71","doi-asserted-by":"crossref","first-page":"e010393","DOI":"10.1136\/bmjopen-2015-010393","article-title":"What evidence is there for a delay in diagnostic coding of RA in UK general practice records? An observational study of free text","volume":"6","author":"Ford","year":"2016","journal-title":"BMJ Open"},{"issue":"8\u20139","key":"2023092720000950200_ocad120-B72","doi-asserted-by":"crossref","first-page":"722","DOI":"10.1093\/jamia\/ocz040","article-title":"Underserved populations with missing race ethnicity data differ significantly from those with structured race\/ethnicity documentation","volume":"26","author":"Sholle","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"9","key":"2023092720000950200_ocad120-B73","doi-asserted-by":"crossref","first-page":"1687","DOI":"10.1016\/j.injury.2018.05.010","article-title":"Benchmarking emergency department thoracotomy: using trauma video review to generate procedural norms","volume":"49","author":"Dumas","year":"2018","journal-title":"Injury"},{"key":"2023092720000950200_ocad120-B74","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1016\/j.jcrc.2018.07.021","article-title":"Secondary EMR data for quality improvement and research: A comparison of manual and electronic data collection from an integrated critical care electronic medical record system","volume":"47","author":"Brundin-Mather","year":"2018","journal-title":"J Crit Care"},{"issue":"10","key":"2023092720000950200_ocad120-B75","doi-asserted-by":"crossref","first-page":"1292","DOI":"10.1093\/jamia\/ocy110","article-title":"Automated mapping of laboratory tests to LOINC codes using noisy labels in a national electronic health record system database","volume":"25","author":"Parr","year":"2018","journal-title":"J Am Med Inform Assoc"},{"key":"2023092720000950200_ocad120-B76","first-page":"903","article-title":"Towards augmenting structured EHR data: a comparison of manual chart review and patient self-report","volume":"2019","author":"Weiskopf","year":"2019","journal-title":"AMIA Annu Symp Proc"},{"key":"2023092720000950200_ocad120-B77","doi-asserted-by":"crossref","first-page":"441","DOI":"10.2147\/CLEP.S92209","article-title":"Validation of International Classification of Diseases coding for bone metastases in electronic health records using technology-enabled abstraction","volume":"7","author":"Liede","year":"2015","journal-title":"Clin Epidemiol"},{"issue":"4","key":"2023092720000950200_ocad120-B78","doi-asserted-by":"crossref","first-page":"493","DOI":"10.1097\/CCM.0000000000003554","article-title":"Variation in identifying sepsis and organ dysfunction using administrative versus electronic clinical data and impact on hospital outcome comparisons","volume":"47","author":"Rhee","year":"2019","journal-title":"Crit Care Med"},{"issue":"10","key":"2023092720000950200_ocad120-B79","doi-asserted-by":"crossref","first-page":"1092","DOI":"10.1002\/pds.4617","article-title":"Validation of body mass index (BMI)-related ICD-9-CM and ICD-10-CM administrative diagnosis codes recorded in US claims data","volume":"27","author":"Ammann","year":"2018","journal-title":"Pharmacoepidemiol Drug Saf"},{"issue":"6","key":"2023092720000950200_ocad120-B80","doi-asserted-by":"crossref","first-page":"e66192","DOI":"10.1371\/journal.pone.0066192","article-title":"Multi-institutional sharing of electronic health record data to assess childhood obesity","volume":"8","author":"Bailey","year":"2013","journal-title":"PLoS One"},{"issue":"1","key":"2023092720000950200_ocad120-B81","first-page":"1267","article-title":"Can electronic health records be used for population health surveillance? Validating population health metrics against established survey data","volume":"4","author":"McVeigh","year":"2016","journal-title":"EGEMS (Wash DC)"},{"issue":"3","key":"2023092720000950200_ocad120-B82","doi-asserted-by":"crossref","first-page":"627","DOI":"10.1093\/jamia\/ocv156","article-title":"Assessing race and ethnicity data quality across cancer registries and EMRs in two hospitals","volume":"23","author":"Lee","year":"2016","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2023092720000950200_ocad120-B83","doi-asserted-by":"crossref","first-page":"1106","DOI":"10.1186\/s12889-019-7367-z","article-title":"Use of electronic health records from a statewide health information exchange to support public health surveillance of diabetes and hypertension","volume":"19","author":"Horth","year":"2019","journal-title":"BMC Public Health"},{"key":"2023092720000950200_ocad120-B84","first-page":"1080","article-title":"A framework for data quality assessment in clinical research datasets","volume":"2017","author":"Lee","year":"2017","journal-title":"AMIA Annu Symp Proc"},{"key":"2023092720000950200_ocad120-B85","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1016\/j.compbiomed.2019.03.001","article-title":"Medical data quality assessment: on the development of an automated framework for medical data curation","volume":"107","author":"Pezoulas","year":"2019","journal-title":"Comput Biol Med"},{"issue":"6","key":"2023092720000950200_ocad120-B86","doi-asserted-by":"crossref","first-page":"598","DOI":"10.1097\/MLR.0000000000000693","article-title":"Electronic health record data versus the National Health and Nutrition Examination Survey (NHANES): a comparison of overweight and obesity rates","volume":"55","author":"Funk","year":"2017","journal-title":"Med Care"},{"issue":"1","key":"2023092720000950200_ocad120-B87","first-page":"1265","article-title":"Design of the New York City macroscope: innovations in population health surveillance using electronic health records","volume":"4","author":"Newton-Dame","year":"2016","journal-title":"EGEMS (Wash DC)"},{"key":"2023092720000950200_ocad120-B88","first-page":"1472","article-title":"Sick patients have more data: the non-random completeness of electronic health records","volume":"2013","author":"Weiskopf","year":"2013","journal-title":"AMIA Annu Symp Proc"},{"issue":"6","key":"2023092720000950200_ocad120-B89","doi-asserted-by":"crossref","first-page":"1134","DOI":"10.1093\/jamia\/ocx071","article-title":"Biases introduced by filtering electronic health records for patients with \u201ccomplete data\u201d","volume":"24","author":"Weber","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2023092720000950200_ocad120-B90","doi-asserted-by":"crossref","first-page":"69","DOI":"10.4338\/ACI-2015-08-RA-0107","article-title":"Application of an ontology for characterizing data quality for a secondary use of EHR data","volume":"7","author":"Johnson","year":"2016","journal-title":"Appl Clin Inform"},{"issue":"1","key":"2023092720000950200_ocad120-B91","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1093\/jamia\/ocw054","article-title":"Improving the quality of EHR recording in primary care: a data quality feedback tool","volume":"24","author":"van der Bij","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2023092720000950200_ocad120-B92","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1186\/s12911-021-01458-1","article-title":"A method for interoperable knowledge-based data quality assessment","volume":"21","author":"Tute","year":"2021","journal-title":"BMC Med Inform Decis Mak"},{"issue":"3","key":"2023092720000950200_ocad120-B93","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1093\/jamia\/ocaa215","article-title":"Generative transfer learning for measuring plausibility of EHR diagnosis records","volume":"28","author":"Estiri","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2023092720000950200_ocad120-B94","first-page":"247","article-title":"Moving towards an EHR data quality framework: the MIRACUM approach","volume":"267","author":"Kapsner","year":"2019","journal-title":"Stud Health Technol Inform"},{"issue":"1","key":"2023092720000950200_ocad120-B95","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1186\/s12911-019-0852-6","article-title":"A clustering approach for detecting implausible observation values in electronic health records data","volume":"19","author":"Estiri","year":"2019","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"2023092720000950200_ocad120-B96","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1186\/s12911-022-01961-z","article-title":"DQAgui: a graphical user interface for the MIRACUM data quality assessment tool","volume":"22","author":"Mang","year":"2022","journal-title":"BMC Med Inform Decis Mak"},{"key":"2023092720000950200_ocad120-B97","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.jbi.2015.04.008","article-title":"Automated misspelling detection and correction in clinical free-text records","volume":"55","author":"Lai","year":"2015","journal-title":"J Biomed Inform"},{"issue":"1","key":"2023092720000950200_ocad120-B98","first-page":"16","article-title":"Reporting data quality assessment results: identifying individual and organizational barriers and solutions","volume":"5","author":"Callahan","year":"2017","journal-title":"EGEMS (Wash DC)"},{"key":"2023092720000950200_ocad120-B99","first-page":"884","article-title":"A vision for the systematic monitoring and improvement of the quality of electronic health data","volume":"192","author":"Dixon","year":"2013","journal-title":"Stud Health Technol Inform"},{"key":"2023092720000950200_ocad120-B100","doi-asserted-by":"crossref","first-page":"103715","DOI":"10.1016\/j.jbi.2021.103715","article-title":"Mind the clinical-analytic gap: electronic health records and COVID-19 pandemic response","volume":"116","author":"Sudat","year":"2021","journal-title":"J Biomed Inform"},{"issue":"5","key":"2023092720000950200_ocad120-B101","doi-asserted-by":"crossref","first-page":"1133","DOI":"10.1213\/ANE.0000000000004489","article-title":"Considerations for integration of perioperative electronic health records across institutions for research and quality improvement: the approach taken by the multicenter perioperative outcomes group","volume":"130","author":"Colquhoun","year":"2020","journal-title":"Anesth Analg"},{"issue":"4","key":"2023092720000950200_ocad120-B102","doi-asserted-by":"crossref","first-page":"e0195362","DOI":"10.1371\/journal.pone.0195362","article-title":"The impact of routine data quality assessments on electronic medical record data quality in Kenya","volume":"13","author":"Muthee","year":"2018","journal-title":"PLoS One"},{"issue":"2","key":"2023092720000950200_ocad120-B103","doi-asserted-by":"crossref","first-page":"e034396","DOI":"10.1136\/bmjopen-2019-034396","article-title":"Data-driven discovery of changes in clinical code usage over time: a case-study on changes in cardiovascular disease recording in two English electronic health records databases (2001\u20132015)","volume":"10","author":"Rockenschaub","year":"2020","journal-title":"BMJ Open"},{"issue":"1","key":"2023092720000950200_ocad120-B104","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1186\/s12874-023-01839-2","article-title":"Data quality considerations for evaluating COVID-19 treatments using real world data: learnings from the National COVID Cohort Collaborative (N3C)","volume":"23","author":"Sidky","year":"2023","journal-title":"BMC Med Res Methodol"},{"issue":"5","key":"2023092720000950200_ocad120-B105","doi-asserted-by":"crossref","first-page":"830","DOI":"10.1016\/j.jbi.2013.06.010","article-title":"Defining and measuring completeness of electronic health records for secondary use","volume":"46","author":"Weiskopf","year":"2013","journal-title":"J Biomed Inform"},{"key":"2023092720000950200_ocad120-B106","doi-asserted-by":"crossref","first-page":"104804","DOI":"10.1016\/j.cmpb.2018.10.016","article-title":"Initializing a hospital-wide data quality program. The AP-HP experience","volume":"181","author":"Daniel","year":"2019","journal-title":"Comput Methods Programs Biomed"},{"issue":"12","key":"2023092720000950200_ocad120-B107","doi-asserted-by":"crossref","first-page":"1094","DOI":"10.1016\/j.ijmedinf.2015.09.008","article-title":"Structured data quality reports to improve EHR data quality","volume":"84","author":"Taggart","year":"2015","journal-title":"Int J Med Inform"},{"issue":"5","key":"2023092720000950200_ocad120-B108","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1016\/j.ijmedinf.2015.01.005","article-title":"Implementation of a cloud-based electronic medical record for maternal and child health in rural Kenya","volume":"84","author":"Haskew","year":"2015","journal-title":"Int J Med Inform"},{"issue":"Fall","key":"2023092720000950200_ocad120-B109","first-page":"1g","article-title":"Improving the collection of race, ethnicity, and language data to reduce healthcare disparities: a case study from an academic medical center","volume":"13","author":"Lee","year":"2016","journal-title":"Perspect Health Inf Manag"},{"issue":"6","key":"2023092720000950200_ocad120-B110","doi-asserted-by":"crossref","first-page":"1331","DOI":"10.1007\/s11096-017-0556-x","article-title":"Quality of medication information in discharge summaries from hospitals: an audit of electronic patient records","volume":"39","author":"Garcia","year":"2017","journal-title":"Int J Clin Pharm"},{"issue":"5","key":"2023092720000950200_ocad120-B111","doi-asserted-by":"crossref","first-page":"1172","DOI":"10.1055\/s-0042-1758737","article-title":"Quantifying electronic health record data quality in telehealth and office-based diabetes care","volume":"13","author":"Wiley","year":"2022","journal-title":"Appl Clin Inform"},{"issue":"11","key":"2023092720000950200_ocad120-B112","doi-asserted-by":"crossref","first-page":"e064887","DOI":"10.1136\/bmjopen-2022-064887","article-title":"Using set visualisation to find and explain patterns of missing values: a case study with NHS hospital episode statistics data","volume":"12","author":"Ruddle","year":"2022","journal-title":"BMJ Open"},{"key":"2023092720000950200_ocad120-B113","first-page":"196","article-title":"Assessment of data quality variability across two EHR systems through a case study of post-surgical complications","volume":"2022","author":"Fu","year":"2022","journal-title":"AMIA Annu Symp Proc"},{"key":"2023092720000950200_ocad120-B114","first-page":"130","article-title":"Availability of structured data elements in electronic health records for supporting patient recruitment in clinical trials","volume":"290","author":"Vass","year":"2022","journal-title":"Stud Health Technol Inform"},{"key":"2023092720000950200_ocad120-B115","doi-asserted-by":"crossref","DOI":"10.1007\/s40615-022-01445-w","article-title":"Discrepancies in race and ethnicity in the electronic health record compared to self-report [published online ahead of print November 23, 2022]","author":"Samalik","year":"2022","journal-title":"J Racial Ethn Health Disparities"},{"issue":"6","key":"2023092720000950200_ocad120-B116","doi-asserted-by":"crossref","first-page":"1080","DOI":"10.1093\/jamia\/ocx037","article-title":"Automated identification of implausible values in growth data from pediatric electronic health records","volume":"24","author":"Daymont","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2023092720000950200_ocad120-B117","doi-asserted-by":"crossref","first-page":"100215","DOI":"10.1016\/j.xops.2022.100215","article-title":"Visual acuity: assessment of data quality and usability in an electronic health record system","volume":"3","author":"Goldstein","year":"2023","journal-title":"Ophthalmol Sci"},{"issue":"6","key":"2023092720000950200_ocad120-B118","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3457607","article-title":"A survey on bias and fairness in machine learning","volume":"54","author":"Mehrabi","year":"2022","journal-title":"ACM Comput Surv"},{"issue":"3","key":"2023092720000950200_ocad120-B119","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1093\/biomet\/63.3.581","article-title":"Inference and missing data","volume":"63","author":"Rubin","year":"1976","journal-title":"Biometrika"},{"key":"2023092720000950200_ocad120-B120","doi-asserted-by":"crossref","first-page":"n2281","DOI":"10.1136\/bmj.n2281","article-title":"Risk of bias in studies on prediction models developed using supervised machine learning techniques: systematic review","volume":"375","author":"Andaur Navarro","year":"2021","journal-title":"BMJ"},{"issue":"11","key":"2023092720000950200_ocad120-B121","doi-asserted-by":"crossref","first-page":"1544","DOI":"10.1001\/jamainternmed.2018.3763","article-title":"Potential biases in machine learning algorithms using electronic health record data","volume":"178","author":"Gianfrancesco","year":"2018","journal-title":"JAMA Intern Med"},{"issue":"11","key":"2023092720000950200_ocad120-B122","doi-asserted-by":"crossref","first-page":"981","DOI":"10.1056\/NEJMp1714229","article-title":"Implementing machine learning in health care \u2013 addressing ethical challenges","volume":"378","author":"Char","year":"2018","journal-title":"N Engl J Med"},{"issue":"3","key":"2023092720000950200_ocad120-B123","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1136\/bmjqs-2018-008370","article-title":"Artificial intelligence, bias and clinical safety","volume":"28","author":"Challen","year":"2019","journal-title":"BMJ Qual Saf"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/10\/1730\/51770153\/ocad120.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/10\/1730\/51770153\/ocad120.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T20:32:43Z","timestamp":1695846763000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/30\/10\/1730\/7216383"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,30]]},"references-count":123,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,6,30]]},"published-print":{"date-parts":[[2023,9,25]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad120","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,10,1]]},"published":{"date-parts":[[2023,6,30]]}}}