{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,13]],"date-time":"2025-02-13T00:40:34Z","timestamp":1739407234900,"version":"3.37.0"},"reference-count":31,"publisher":"Georg Thieme Verlag KG","issue":"01","license":[{"start":{"date-parts":[[2025,2,12]],"date-time":"2025-02-12T00:00:00Z","timestamp":1739318400000},"content-version":"vor","delay-in-days":42,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Appl Clin Inform"],"published-print":{"date-parts":[[2025,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>\n          Background\u2003Data exploration in modern electronic health records (EHRs) is often aided by user-friendly graphical interfaces providing \u201cself-service\u201d tools for end users to extract data for quality improvement, patient safety, and research without prerequisite training in database querying. Other resources within the same institution, such as Honest Brokers, may extract data sourced from the same EHR but obtain different results leading to questions of data completeness and correctness.<\/jats:p><jats:p>\n          Objectives\u2003Our objectives were to (1) examine the differences in aggregate output generated by a \u201cself-service\u201d graphical interface data extraction tool and our institution's clinical data warehouse (CDW), sourced from the same database, and (2) examine the causative factors that may have contributed to these differences.<\/jats:p><jats:p>\n          Methods\u2003Aggregate demographic data of patients who received influenza vaccines at three static clinics and three drive-through clinics in similar locations between August 2020 and December 2020 was extracted separately from our institution's EHR data exploration tool and our CDW by our organization's Honest Brokers System. We reviewed the aggregate outputs, sliced by demographics and vaccination sites, to determine potential differences between the two outputs. We examined the underlying data model, identifying the source of each database.<\/jats:p><jats:p>\n          Results\u2003We observed discrepancies in patient volumes between the two sources, with variations in demographic information, such as age, race, ethnicity, and primary language. These variations could potentially influence research outcomes and interpretations.<\/jats:p><jats:p>\n          Conclusion\u2003This case study underscores the need for a thorough examination of data quality and the implementation of comprehensive user education to ensure accurate data extraction and interpretation. Enhancing data standardization and validation processes is crucial for supporting reliable research and informed decision-making, particularly if demographic data may be used to support targeted efforts for a specific population in research or quality improvement initiatives.<\/jats:p>","DOI":"10.1055\/a-2441-3677","type":"journal-article","created":{"date-parts":[[2025,2,13]],"date-time":"2025-02-13T00:23:26Z","timestamp":1739406206000},"page":"137-144","source":"Crossref","is-referenced-by-count":0,"title":["Discrepancies in Aggregate Patient Data between Two Sources with Data Originating from the Same Electronic Health Record: A Case Study"],"prefix":"10.1055","volume":"16","author":[{"given":"Allen J.","family":"Yiu","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, University of California, Irvine, California, United States"},{"name":"Department of Pediatrics, Children's National Hospital, Washington, District of Columbia, United States"},{"name":"Department of Pediatrics, George Washington University School of Medicine and Health Sciences, Washington, District of Columbia, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Graham","family":"Stephenson","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, University of California, Irvine, California, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emilie","family":"Chow","sequence":"additional","affiliation":[{"name":"Department of Medicine, University of California, Irvine, California, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ryan","family":"O'Connell","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, University of California, Irvine, California, United States"},{"name":"Department of Pathology, University of California, Irvine, California, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"194","published-online":{"date-parts":[[2025,2,12]]},"reference":[{"key":"ref1","doi-asserted-by":"crossref","first-page":"e51003","DOI":"10.2196\/51003","article-title":"Use of Epic electronic health record system for health care research: scoping review","volume":"25","author":"J Chishtie","year":"2023","journal-title":"J Med Internet Res"},{"key":"ref2","doi-asserted-by":"crossref","first-page":"S414","DOI":"10.1093\/ofid\/ofab466.821","article-title":"623. Exploring \u2018Slicer Dicer\u2019, an extraction tool in EPIC, for clinical and epidemiological analysis","volume":"8","author":"V Saini","year":"2021","journal-title":"Open Forum Infect Dis"},{"issue":"09","key":"ref3","doi-asserted-by":"crossref","first-page":"e2233267","DOI":"10.1001\/jamanetworkopen.2022.33267","article-title":"Comparison of quality performance measures for patients receiving in-person vs telemedicine primary care in a large integrated health system","volume":"5","author":"D J Baughman","year":"2022","journal-title":"JAMA Netw Open"},{"issue":"05","key":"ref4","doi-asserted-by":"crossref","first-page":"1154","DOI":"10.1002\/lio2.1135","article-title":"A retrospective analysis of COVID-19 tracheostomies: early versus late tracheostomy","volume":"8","author":"R Bui","year":"2023","journal-title":"Laryngoscope Investig Otolaryngol"},{"issue":"07","key":"ref5","doi-asserted-by":"crossref","first-page":"1012","DOI":"10.3390\/brainsci13071012","article-title":"Prescription trends in complex regional pain syndrome: a retrospective case-control study","volume":"13","author":"S Shermon","year":"2023","journal-title":"Brain Sci"},{"issue":"02","key":"ref6","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1055\/s-0038-1634831","article-title":"Use and abuse of computer-stored medical records","volume":"30","author":"J van der Lei","year":"1991","journal-title":"Methods Inf Med"},{"issue":"01","key":"ref7","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1136\/amiajnl-2011-000681","article-title":"Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research","volume":"20","author":"N G Weiskopf","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"ref8","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1186\/1472-6947-13-37","article-title":"Evaluation of data completeness in the electronic health record for the purpose of patient recruitment into clinical trials: a retrospective analysis of element presence","volume":"13","author":"F K\u00f6pcke","year":"2013","journal-title":"BMC Med Inform Decis Mak"},{"issue":"01","key":"ref9","first-page":"1244","article-title":"A harmonized data quality assessment terminology and framework for the secondary use of electronic health record data","volume":"4","author":"M G Kahn","year":"2016","journal-title":"EGEMS (Wash DC)"},{"key":"ref10","doi-asserted-by":"crossref","first-page":"871897","DOI":"10.3389\/fdata.2022.871897","article-title":"Improving data quality in clinical research informatics tools","volume":"5","author":"A AbuHalimeh","year":"2022","journal-title":"Front Big Data"},{"issue":"04","key":"ref11","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1055\/s-0042-1756428","article-title":"Uncovering discrepancies in IV vancomycin infusion records between pump logs and EHR documentation","volume":"13","author":"T H Tung","year":"2022","journal-title":"Appl Clin Inform"},{"issue":"03","key":"ref12","doi-asserted-by":"crossref","first-page":"627","DOI":"10.1093\/jamia\/ocv156","article-title":"Assessing race and ethnicity data quality across cancer registries and EMRs in two hospitals","volume":"23","author":"S J Lee","year":"2016","journal-title":"J Am Med Inform Assoc"},{"issue":"01","key":"ref13","doi-asserted-by":"crossref","first-page":"e130","DOI":"10.1017\/cts.2023.548","article-title":"Electronic health record data quality variability across a multistate clinical research network","volume":"7","author":"Y Mohamed","year":"2023","journal-title":"J Clin Transl Sci"},{"issue":"07","key":"ref14","first-page":"338","article-title":"Challenges frequently encountered in the secondary use of electronic medical record data for research","volume":"38","author":"M E Edmondson","year":"2020","journal-title":"Comput Inform Nurs"},{"issue":"05","key":"ref15","doi-asserted-by":"crossref","first-page":"e185","DOI":"10.2196\/jmir.9134","article-title":"Possible sources of bias in primary care electronic health record data use and reuse","volume":"20","author":"R A Verheij","year":"2018","journal-title":"J Med Internet Res"},{"key":"ref16","first-page":"57","article-title":"Root causes underlying challenges to secondary use of data","volume":"2011","author":"J S Ancker","year":"2011","journal-title":"AMIA Annu Symp Proc"},{"key":"ref17","volume-title":"Chapter 8: Selection of Data Sources","author":"C Kornegay","year":"2013"},{"issue":"05","key":"ref18","doi-asserted-by":"crossref","first-page":"1172","DOI":"10.1055\/s-0042-1758737","article-title":"Quantifying electronic health record data quality in telehealth and office-based diabetes care","volume":"13","author":"K K Wiley","year":"2022","journal-title":"Appl Clin Inform"},{"issue":"06","key":"ref19","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1007\/s11606-014-3102-8","article-title":"Accuracy of race, ethnicity, and language preference in an electronic health record","volume":"30","author":"E V Klinger","year":"2015","journal-title":"J Gen Intern Med"},{"issue":"05","key":"ref20","doi-asserted-by":"crossref","first-page":"812","DOI":"10.1007\/s40615-016-0283-3","article-title":"Discrepancies in race and ethnicity documentation: a potential barrier in identifying racial and ethnic disparities","volume":"4","author":"M Maga\u00f1a L\u00f3pez","year":"2016","journal-title":"J Racial Ethn Health Disparities"},{"issue":"06","key":"ref21","doi-asserted-by":"crossref","first-page":"2670","DOI":"10.1007\/s40615-022-01445-w","article-title":"Discrepancies in race and ethnicity in the electronic health record compared to self-report","volume":"10","author":"J M Samalik","year":"2023","journal-title":"J Racial Ethn Health Disparities"},{"issue":"01","key":"ref22","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1093\/jamia\/ocab199","article-title":"The quality of social determinants data in the electronic health record: a systematic review","volume":"29","author":"L A Cook","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"04","key":"ref23","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1016\/j.amjsurg.2023.05.011","article-title":"The accuracy of race & ethnicity data in US based healthcare databases: a systematic review","volume":"226","author":"J A Johnson","year":"2023","journal-title":"Am J Surg"},{"issue":"09","key":"ref24","doi-asserted-by":"crossref","first-page":"e39235","DOI":"10.2196\/39235","article-title":"Issues with variability in electronic health record data about race and ethnicity: descriptive analysis of the National COVID Cohort Collaborative Data Enclave","volume":"10","author":"L Cook","year":"2022","journal-title":"JMIR Med Inform"},{"issue":"07","key":"ref25","doi-asserted-by":"crossref","first-page":"e14591","DOI":"10.2196\/14591","article-title":"Information loss in harmonizing granular race and ethnicity data: descriptive study of standards","volume":"22","author":"K Wang","year":"2020","journal-title":"J Med Internet Res"},{"issue":"03","key":"ref26","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1093\/jamia\/ocu023","article-title":"Feasibility and utility of applications of the common data model to multiple, disparate observational health databases","volume":"22","author":"E A Voss","year":"2015","journal-title":"J Am Med Inform Assoc"},{"key":"ref27","doi-asserted-by":"crossref","first-page":"104622","DOI":"10.1016\/j.ijmedinf.2021.104622","article-title":"Comparing automated vs. manual data collection for COVID-specific medications from electronic health records","volume":"157","author":"A L Yin","year":"2022","journal-title":"Int J Med Inform"},{"issue":"01","key":"ref28","doi-asserted-by":"crossref","first-page":"e18501","DOI":"10.2196\/18501","article-title":"Comparison of the results of manual and automated processes of cross-mapping between nursing terms: quantitative study","volume":"3","author":"F BG Torres","year":"2020","journal-title":"JMIR Nurs"},{"key":"ref29","first-page":"775","article-title":"Tailoring rule-based data quality assessment to the Patient-Centered Outcomes Research Network (PCORnet) Common Data Model (CDM)","volume":"2022","author":"Y Mohamed","year":"2023","journal-title":"AMIA Annu Symp Proc"},{"issue":"01","key":"ref30","doi-asserted-by":"crossref","first-page":"100733","DOI":"10.1016\/j.hjdsi.2023.100733","article-title":"Training pediatric physicians and staff to obtain data from the electronic health record","volume":"12","author":"T Rungvivatjarus","year":"2024","journal-title":"Healthcare (Amst)"},{"issue":"01","key":"ref31","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1186\/s12911-017-0532-3","article-title":"Dynamic-ETL: a hybrid approach for health data extraction, transformation and loading","volume":"17","author":"T C Ong","year":"2017","journal-title":"BMC Med Inform Decis Mak"}],"container-title":["Applied Clinical Informatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.1055\/a-2441-3677.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,13]],"date-time":"2025-02-13T00:23:43Z","timestamp":1739406223000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/a-2441-3677"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1]]},"references-count":31,"journal-issue":{"issue":"01","published-online":{"date-parts":[[2025,1,1]]},"published-print":{"date-parts":[[2025,1]]}},"URL":"https:\/\/doi.org\/10.1055\/a-2441-3677","archive":["Portico","CLOCKSS"],"relation":{},"ISSN":["1869-0327"],"issn-type":[{"value":"1869-0327","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1]]}}}