{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T16:43:56Z","timestamp":1788799436588,"version":"build-2803163510"},"reference-count":48,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n The use of routinely recorded electronic health record (EHR) data is increasingly common, especially in epidemiological research. However, data must be processed and prepared for secondary use, and decisions made during this process could significantly impact research outcomes. A demonstration of the extent of these consequences is necessary.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n The aim of this study was to investigate the influence of data processing steps on research outcomes derived from the secondary use of EHR data.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n \n EHR data from 8 Dutch general practices from 2019 were used. These practices contributed data to 2 research databases: the Academic General Practitioner Development Network registry and the Nivel Primary Care Database. Data were extracted and processed through distinct extraction, transformation, and loading (ETL) pipelines, allowing the evaluation of the impact of different ETL methods by comparing the 2 datasets in three steps: (1) patient demographics, (2) epidemiology of concordant patients, and (3) health service use of patients with 3 diagnoses. A number of similarity indicators, including the number of contacts, regular consultations and visits, prescriptions, and episodes, were compared between the 2 databases. The outcomes were compared by performing paired samples\n t<\/jats:italic>\n tests using 99% CIs. Prevalence, number of prescriptions, and number of regular consultations and visits per 1000 patient years were calculated and compared for 3 diagnoses (diabetes mellitus, urinary tract infection, and cough). These outcomes were compared using the SD.\n <\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Differences were observed between the datasets in the number of enrolled patients (Academic General Practitioner Development Network registry: n=47,517; Nivel Primary Care Database: n=44,247). Despite this, patient demographics were similar. All indicator outcomes of the concordant patients showed significant differences between the databases, that is, the number of contacts, prescriptions, and episodes per patient, and the number of regular consultations and visits. Differences in the indicator outcomes for the 3 diagnosis groups varied greatly in SD, however, none of the differences were deemed significant.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n The findings highlight the importance of routine health data users\u2019 awareness of different ETL steps involved. Transparency and shared knowledge about these processes are critical, and making them available for research is necessary. Data processors should share their knowledge regarding their choices, and researchers and policy makers should invest in their knowledge of this type of metadata. Transparency and shared knowledge are particularly important in light of the European Health Data Space and the ever-increasing secondary use of routinely recorded health data. Future research should focus on the role of transparency, joint decision-making, and the minimization of effects of ETL steps, and on the insight into the individual influence of ETL steps on research outcomes. This could stimulate standardized approaches among data processors and researchers, resulting in increased data interoperability.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/64628","type":"journal-article","created":{"date-parts":[[2025,3,6]],"date-time":"2025-03-06T07:30:10Z","timestamp":1741246210000},"page":"e64628-e64628","source":"Crossref","is-referenced-by-count":2,"title":["Implications of Data Extraction and Processing of Electronic Health Records for Epidemiological Research: Observational Study"],"prefix":"10.2196","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-2299-1091","authenticated-orcid":false,"given":"Melissa H J","family":"van Essen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-0986-300X","authenticated-orcid":false,"given":"Robin","family":"Twickler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-3187-6088","authenticated-orcid":false,"given":"Yvette M","family":"Weesie","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2046-6177","authenticated-orcid":false,"given":"Ilgin G","family":"Arslan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2239-1009","authenticated-orcid":false,"given":"Feikje","family":"Groenhof","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2342-0799","authenticated-orcid":false,"given":"Lilian L","family":"Peters","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9648-6428","authenticated-orcid":false,"given":"Isabelle","family":"Bos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2234-4819","authenticated-orcid":false,"given":"Robert A","family":"Verheij","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,6,11]]},"reference":[{"issue":"5","key":"R1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.9134","article-title":"Possible sources of bias in primary care electronic health record data use and reuse","volume":"20","author":"Verheij","journal-title":"J Med Internet Res"},{"issue":"1","key":"R2","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-022-08096-x","article-title":"The use of out-of-hours primary care during the first year of the COVID-19 pandemic","volume":"22","author":"Ramerman","journal-title":"BMC Health Serv Res"},{"issue":"1","key":"R3","doi-asserted-by":"publisher","DOI":"10.1038\/s41533-023-00340-z","article-title":"Care by general practitioners for patients with asthma or COPD during the COVID-19 pandemic","volume":"33","author":"Rijpkema","journal-title":"NPJ Prim Care Respir Med"},{"issue":"1","key":"R4","doi-asserted-by":"publisher","DOI":"10.23889\/ijpds.v6i1.1718","article-title":"What makes administrative data \u201cresearch-ready\u201d? A systematic review and thematic analysis of published literature","volume":"7","author":"Grath-Lone","journal-title":"Int J Popul Data Sci"},{"issue":"6","key":"R5","doi-asserted-by":"publisher","first-page":"937","DOI":"10.1002\/acr.24861","article-title":"Incidence and prevalence of knee osteoarthritis using codified and narrative data from electronic health records: a population-based study","volume":"74","author":"Arslan","journal-title":"Arthritis Care Res (Hoboken)"},{"key":"R6","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2458-13-251","article-title":"Comparison of the information provided by electronic health records data and a population health survey to estimate prevalence of selected health conditions and multimorbidity","volume":"13","author":"Viol\u00e1n","journal-title":"BMC Public Health"},{"key":"R7","unstructured":"How we collect data. Institute for Health Metrics and Evaluation. 2024. URL: https:\/\/www.healthdata.org\/data-tools-practices\/data-collection [Accessed 20-06-2024]"},{"key":"R8","unstructured":"Health service data. World Health Organization. 2024. URL: https:\/\/www.who.int\/data\/data-collection-tools\/health-service-data [Accessed 20-06-2024]"},{"key":"R9","unstructured":"Poos M Gommer A Nielen M . Gebruik huisartsenregistraties voor schattingen morbiditeit [use of GP registrations for morbidity estimates]. VZinfo website. 2024. URL: https:\/\/www.vzinfo.nl\/bronnen-methoden-en-achtergronden\/huisartsen-registraties-schattingen-morbiditeit#:~:text=Op%20VZinfo.nl%20zijn%20schattingen,prevalentie)%2C%20absoluut%20of%20relatief [Accessed 20-06-2024]"},{"issue":"2","key":"R10","doi-asserted-by":"publisher","DOI":"10.1093\/ije\/dyaf017","article-title":"Data resource profile: nivel primary care database (Nivel-PCD), the Netherlands","volume":"54","author":"Vanhommerig","journal-title":"Int J Epidemiol"},{"issue":"2","key":"R11","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1093\/jamia\/ocaa287","article-title":"Use of electronic health records to support a public health response to the COVID-19 pandemic in the United States: a perspective from 15 academic medical centers","volume":"28","author":"Madhavan","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"R12","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0172639","article-title":"Accuracy of routinely-collected healthcare data for identifying motor neurone disease cases: a systematic review","volume":"12","author":"Horrocks","journal-title":"PLoS ONE"},{"issue":"1","key":"R13","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1186\/s40537-019-0217-0","article-title":"Big data in healthcare: management, analysis and future prospects","volume":"6","author":"Dash","journal-title":"J Big Data"},{"key":"R14","unstructured":"What is the European Health Data Space (EHDS)? The European Health Data Space (EHDS). 2024. URL: https:\/\/www.european-health-data-space.com\/ [Accessed 20-06-2024]"},{"key":"R15","doi-asserted-by":"crossref","unstructured":"Marcus JS Martens B Carugati C Bucher A Godlovitch I . The European Health Data Space. IPOL | Policy Department for Economic, Scientific and Quality of Life Policies, European Parliament Policy Department studies, 2022. 2022. [doi: 10.2139\/ssrn.4300393]","DOI":"10.2139\/ssrn.4300393"},{"issue":"12","key":"R16","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2021.39748","article-title":"Comparison of the accuracy and completeness of records of serious vascular events in routinely collected data vs clinical trial-adjudicated direct follow-up data in the UK: secondary analysis of the ASCEND randomized clinical trial","volume":"4","author":"Harper","journal-title":"JAMA Netw Open"},{"issue":"1","key":"R17","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2018.273","article-title":"Columbia open health data, clinical concept prevalence and co-occurrence from electronic health records","volume":"5","author":"Ta","journal-title":"Sci Data"},{"issue":"12","key":"R18","doi-asserted-by":"publisher","first-page":"1010","DOI":"10.1136\/bmjqs-2020-011247","article-title":"Exploring the actionability of healthcare performance indicators for quality of care: a qualitative analysis of the literature, expert opinion and user experience","volume":"30","author":"Barbazza","journal-title":"BMJ Qual Saf"},{"issue":"1","key":"R19","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1080\/02813430310003660","article-title":"Collection and retrieval of structured clinical data from electronic patient records in general practice. a first-phase study to create a health care database for research and quality assessment","volume":"22","author":"M\u00e5nsson","journal-title":"Scand J Prim Health Care"},{"issue":"6","key":"R20","doi-asserted-by":"publisher","first-page":"843","DOI":"10.1016\/j.joca.2022.03.001","article-title":"Estimating incidence and prevalence of hip osteoarthritis using electronic health records: a population-based cohort study","volume":"30","author":"Arslan","journal-title":"Osteoarthr Cartil"},{"issue":"1","key":"R21","doi-asserted-by":"publisher","DOI":"10.1186\/s12875-014-0176-7","article-title":"Do practice characteristics explain differences in morbidity estimates between electronic health record based general practice registration networks?","volume":"15","author":"van den Dungen","journal-title":"BMC Fam Pract"},{"issue":"1","key":"R22","doi-asserted-by":"publisher","DOI":"10.13063\/2327-9214.1203","article-title":"A general framework for considering selection bias in EHR-based studies: what data are observed and why?","volume":"4","author":"Haneuse","journal-title":"EGEMS (Wash DC)"},{"issue":"3","key":"R23","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1007\/s10654-004-5689-2","article-title":"The Utrecht health project: optimization of routine healthcare data for research","volume":"20","author":"Grobbee","journal-title":"Eur J Epidemiol"},{"issue":"2","key":"R24","doi-asserted-by":"publisher","DOI":"10.3399\/BJGPO.2023.0121","article-title":"Dutch GP healthcare consumption in COVID-19 heterogeneous regions: an interregional time-series approach in 2020-2021","volume":"8","author":"Homburg","journal-title":"BJGP Open"},{"issue":"1","key":"R25","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0318272","article-title":"Comparison of observational methods to identify and characterize post-COVID syndrome in the Netherlands using electronic health records and questionnaires","volume":"20","author":"Bos","journal-title":"PLoS ONE"},{"key":"R26","unstructured":"Blanker MH . General practice research infrastructure pandemic preparedness program (GRIP3). COVID-19 2021. ZonMW project; 2023."},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.2196\/49944","article-title":"A natural language processing model for COVID-19 detection based on Dutch general practice electronic health records by using bidirectional encoder representations from transformers: development and validation study","volume":"25","author":"Homburg","journal-title":"J Med Internet Res"},{"issue":"2","key":"R28","doi-asserted-by":"publisher","DOI":"10.1093\/ije\/dyae021","article-title":"Data resource profile: registry of electronic health records of general practices in the north of the Netherlands (AHON)","volume":"53","author":"Twickler","journal-title":"Int J Epidemiol"},{"key":"R29","unstructured":"Nivel primary care database. Nivel. 2024. URL: https:\/\/www.nivel.nl\/en\/our-databases-and-panels\/nivel-primary-care-database [Accessed 20-06-2024]"},{"issue":"4","key":"R30","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1093\/fampra\/cmn028","article-title":"The coming of age of ICPC: celebrating the 21st birthday of the international classification of primary care","volume":"25","author":"Soler","journal-title":"Fam Pract"},{"key":"R31","doi-asserted-by":"crossref","unstructured":"Nahler G et al. Anatomical therapeutic chemical classification system (ATC). In: Dictionary of Pharmaceutical Medicine. Springer; 2009:8. [doi: 10.1007\/978-3-211-89836-9_64]","DOI":"10.1007\/978-3-211-89836-9_64"},{"issue":"2","key":"R32","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1007\/s10198-011-0302-6","article-title":"Defining care products to finance health care in the Netherlands","volume":"13","author":"Westerdijk","journal-title":"Eur J Health Econ"},{"issue":"3","key":"R33","doi-asserted-by":"publisher","DOI":"10.2196\/11929","article-title":"Estimating morbidity rates based on routine electronic health records in primary care: observational study","volume":"7","author":"Nielen","journal-title":"JMIR Med Inform"},{"issue":"3","key":"R34","doi-asserted-by":"publisher","DOI":"10.3390\/antibiotics11030309","article-title":"Antibiotic prescribing in Dutch daytime and out-of-hours general practice during the COVID-19 pandemic: a retrospective database study","volume":"11","author":"Hek","journal-title":"Antibiotics (Basel)"},{"key":"R35","unstructured":"Farmacotherapeutisch kompas [pharmacotherapeutic compass]. Zorginstituut Nederland. 2024. URL: https:\/\/www.farmacotherapeutischkompas.nl\/ [Accessed 20-06-2024]"},{"issue":"6","key":"R36","doi-asserted-by":"publisher","first-page":"1228","DOI":"10.1080\/03610910902859574","article-title":"Using the standardized difference to compare the prevalence of a binary variable between two groups in observational research","volume":"38","author":"Austin","journal-title":"Commun Stat Simul Comput"},{"key":"R37","doi-asserted-by":"publisher","DOI":"10.2147\/CLEP.S389598","article-title":"Completeness and representativeness of the PHARMO general practitioner (GP) data: a comparison with national statistics","volume":"15","author":"Overbeek","journal-title":"Clin Epidemiol"},{"issue":"1","key":"R38","doi-asserted-by":"publisher","first-page":"160018","DOI":"10.1038\/sdata.2016.18","article-title":"The FAIR guiding principles for scientific data management and stewardship","volume":"3","author":"Wilkinson","journal-title":"Sci Data"},{"issue":"1-2","key":"R39","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1162\/dint_a_00028","article-title":"A generic workflow for the data FAIRification process","volume":"2","author":"Jacobsen","journal-title":"Data Intell"},{"issue":"9","key":"R40","doi-asserted-by":"publisher","first-page":"2017","DOI":"10.1093\/jamia\/ocab084","article-title":"The use of SNOMED CT, 2013-2020: a literature review","volume":"28","author":"Chang","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"R41","doi-asserted-by":"publisher","DOI":"10.1186\/s12874-022-01601-0","article-title":"Opportunities and obstacles in linking large health care registries: the primary secondary cancer care registry - breast cancer","volume":"22","author":"Heins","journal-title":"BMC Med Res Methodol"},{"key":"R42","volume":"2011","author":"Liaw","journal-title":"AMIA Annu Symp Proc"},{"issue":"72","key":"R43","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1016\/j.infsof.2015.12.013","article-title":"Towards pragmatic interoperability to support collaboration: a systematic review and mapping of the literature","volume":"72","author":"Neiva","journal-title":"Inf Softw Technol"},{"issue":"1","key":"R44","doi-asserted-by":"publisher","DOI":"10.13063\/2327-9214.1189","article-title":"Data extraction and management in networks of observational health care databases for scientific research: a comparison of EU-ADR, OMOP, mini-sentinel and MATRICE strategies","volume":"4","author":"Gini","journal-title":"EGEMS (Wash DC)"},{"issue":"1","key":"R45","doi-asserted-by":"publisher","DOI":"10.13063\/2327-9214.1244","article-title":"A harmonized data quality assessment terminology and framework for the secondary use of electronic health record data","volume":"4","author":"Kahn","journal-title":"EGEMS (Wash DC)"},{"issue":"10","key":"R46","doi-asserted-by":"publisher","first-page":"2251","DOI":"10.1093\/jamia\/ocab132","article-title":"Increasing trust in real-world evidence through evaluation of observational data quality","volume":"28","author":"Blacketer","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"R47","doi-asserted-by":"publisher","DOI":"10.1186\/s12875-022-01804-w","article-title":"Detection of primary Sj\u00f6gren\u2019s syndrome in primary care: developing a classification model with the use of routine healthcare data and machine learning","volume":"23","author":"Dros","journal-title":"BMC Prim Care"},{"key":"R48","unstructured":"Introducing ChatGPT. OpenAI. 2022. URL: https:\/\/openai.com\/blog\/chatgpt [Accessed 04-03-2025]"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jmir.org\/2025\/1\/e64628","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T22:30:18Z","timestamp":1785537018000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2025\/1\/e64628"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,11]]},"references-count":48,"URL":"https:\/\/doi.org\/10.2196\/64628","relation":{},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,11]]},"article-number":"v27i5e64628"}}