{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T08:34:31Z","timestamp":1780389271157,"version":"3.54.1"},"reference-count":20,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T00:00:00Z","timestamp":1772409600000},"content-version":"vor","delay-in-days":2,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Task Order","award":["7540119F19002"],"award-info":[{"award-number":["7540119F19002"]}]},{"name":"Task Order","award":["75F40119D10037"],"award-info":[{"award-number":["75F40119D10037"]}]},{"DOI":"10.13039\/100000038","name":"U.S. Food and Drug Administration","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100000038","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,2,28]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Motivation<\/jats:title>\n                    <jats:p>Although common data models for electronic health record (EHR) data can facilitate multi-site data organization and querying, the same medical event may still be coded differently between healthcare systems. In this paper, we present statistical methods to identify and mitigate coding discrepancies using summary-level data, and demonstrate these methods using data from two FDA Sentinel data partners: Kaiser Permanente Washington and Kaiser Permanente Northwest.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We first characterize differences in coding patterns, then compute a code mapping matrix to harmonize data between systems. Our findings reveal significant heterogeneity in coded EHR data, even after adopting a common data model with the same coding system, highlighting the importance of data harmonization before downstream analyses. Our study also demonstrates the effectiveness of the data harmonization approaches, which provide a foundational data quality step to promote semantic interoperability, enhance data integration, and improve the integrity of study conclusions.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Availability and implementation<\/jats:title>\n                    <jats:p>Computation prototypes, including R\/Python codes and examples, are included in Section 7, available as supplementary data at Bioinformatics online and will be posted on GitHub upon publication.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btag107","type":"journal-article","created":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T12:53:21Z","timestamp":1772283201000},"source":"Crossref","is-referenced-by-count":1,"title":["Statistical methods to harmonize electronic health record data across healthcare systems: case study and lessons learned"],"prefix":"10.1093","volume":"42","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8566-9552","authenticated-orcid":false,"given":"Xu","family":"Shi","sequence":"first","affiliation":[{"name":"Department of Biostatistics, University of Michigan School of Public Health , Ann Arbor, MI 48109,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuqi","family":"Zhai","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, University of Michigan School of Public Health , Ann Arbor, MI 48109,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xianshi","family":"Yu","sequence":"additional","affiliation":[{"name":"Department of Computer Sciences, University of Wisconsin, Madison 53706,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7340-2500","authenticated-orcid":false,"given":"Xiaoou","family":"Li","sequence":"additional","affiliation":[{"name":"School of Statistics, University of Minnesota , Minneapolis, MN 55455,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian L","family":"Hazlehurst","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Northwest, Center for Health Research , Portland, OR 97227,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Denis B","family":"Nyongesa","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Northwest, Center for Health Research , Portland, OR 97227,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel S","family":"Sapp","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Northwest, Center for Health Research , Portland, OR 97227,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7024-548X","authenticated-orcid":false,"given":"Brian D","family":"Williamson","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Washington Health Research Institute , Seattle, WA 98101,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David S","family":"Carrell","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Washington Health Research Institute , Seattle, WA 98101,","place":["United States"]},{"name":"Division of Biomedical Health Informatics, Department of Biomedical Informatics and Medical Education, University of Washington School of Medicine , Seattle, WA 98195,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luesa","family":"Healy","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Washington Health Research Institute , Seattle, WA 98101,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kara L","family":"Cushing-Haugen","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Washington Health Research Institute , Seattle, WA 98101,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jenna","family":"Wong","sequence":"additional","affiliation":[{"name":"Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute , Boston, MA 02215,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shirley V","family":"Wang","sequence":"additional","affiliation":[{"name":"Division of Pharmacoepidemiology and Pharmacoeconomics, Brigham and Women\u2019s Hospital , Boston, MA 02115,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James S","family":"Floyd","sequence":"additional","affiliation":[{"name":"Department of Medicine, School of Medicine, University of Washington , Seattle, WA 98195,","place":["United States"]},{"name":"Department of Epidemiology, School of Public Health, University of Washington , Seattle, WA 98195,","place":["United States"]},{"name":"Cardiovascular Health Research Unit, University of Washington , Seattle, WA 98195,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kathleen","family":"Shattuck","sequence":"additional","affiliation":[{"name":"Department of Population Medicine, Harvard Pilgrim Health Care Institute , Boston, MA 02215,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Samuel","family":"McGown","sequence":"additional","affiliation":[{"name":"Department of Population Medicine, Harvard Pilgrim Health Care Institute , Boston, MA 02215,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Alam","sequence":"additional","affiliation":[{"name":"Department of Population Medicine, Harvard Pilgrim Health Care Institute , Boston, MA 02215,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2553-3159","authenticated-orcid":false,"given":"Jos\u00e9 J","family":"Hern\u00e1ndez-Mu\u00f1oz","sequence":"additional","affiliation":[{"name":"Office of Surveillance and Epidemiology, Center for Drug Evaluation and Research, US Food and Drug Administration , Silver Spring, MD 20993,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Li","sequence":"additional","affiliation":[{"name":"Office of Surveillance and Epidemiology, Center for Drug Evaluation and Research, US Food and Drug Administration , Silver Spring, MD 20993,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yong","family":"Ma","sequence":"additional","affiliation":[{"name":"Office of Biostatistics, Office of Translational Sciences, Center for Drug Evaluation and Research, US Food and Drug Administration , Silver Spring, MD 20993,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Danijela","family":"Stojanovic","sequence":"additional","affiliation":[{"name":"Office of Surveillance and Epidemiology, Center for Drug Evaluation and Research, US Food and Drug Administration , Silver Spring, MD 20993,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sudha R","family":"Raman","sequence":"additional","affiliation":[{"name":"Department of Population Health Sciences, Duke University School of Medicine , Durham, NC 27710,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sharon E","family":"Davis","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center , Nashville, TN 37232,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5379-2502","authenticated-orcid":false,"given":"Tianxi","family":"Cai","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, Harvard T.H. Chan School of Public Health , Boston, MA 02115,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer C","family":"Nelson","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Washington Health Research Institute , Seattle, WA 98101,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patrick J","family":"Heagerty","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, University of Washington , Seattle, WA 1415 Washington Heights , Ann Arbor, MI 48109,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,3,2]]},"reference":[{"key":"2026032207070339300_btag107-B1","doi-asserted-by":"publisher","first-page":"e65","DOI":"10.1097\/MLR.0b013e318297429c","article-title":"Why summary comorbidity measures such as the Charlson comorbidity index and Elixhauser score work","volume":"53","author":"Austin","year":"2015","journal-title":"Med Care"},{"key":"2026032207070339300_btag107-B2","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1142\/9789811215636_0027","article-title":"Clinical concept embeddings learned from massive sources of multimodal medical data","volume":"25","author":"Beam","year":"2020","journal-title":"Pac Symp Biocomput"},{"key":"2026032207070339300_btag107-B3","doi-asserted-by":"publisher","first-page":"420","DOI":"10.1016\/j.clinthera.2022.01.012","article-title":"Real-world evidence for regulatory decision-making: guidance from around the world","volume":"44","author":"Burns","year":"2022","journal-title":"Clin Ther"},{"key":"2026032207070339300_btag107-B4","doi-asserted-by":"publisher","first-page":"588","DOI":"10.1089\/wound.2013.0478","article-title":"ICD-9-CM to ICD-10-CM codes: what? why? how?","volume":"2","author":"Cartwright","year":"2013","journal-title":"Adv Wound Care (New Rochelle)"},{"issue":"Suppl 1","key":"2026032207070339300_btag107-B5","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1002\/pds.2336","article-title":"Design considerations, architecture, and use of the mini-sentinel distributed data system","volume":"21","author":"Curtis","year":"2012","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"2026032207070339300_btag107-B6","doi-asserted-by":"publisher","first-page":"1102","DOI":"10.1038\/nbt.2749","article-title":"Systematic comparison of phenome-wide association study of electronic medical record data and genome-wide association study data","volume":"31","author":"Denny","year":"2013","journal-title":"Nat Biotechnol"},{"key":"2026032207070339300_btag107-B7","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1016\/j.jbi.2016.10.016","article-title":"Evaluating common data models for use with a longitudinal community registry","volume":"64","author":"Garza","year":"2016","journal-title":"J Biomed Inform"},{"key":"2026032207070339300_btag107-B8","doi-asserted-by":"publisher","first-page":"717","DOI":"10.1002\/pds.5444","article-title":"Real-world data: assessing electronic health records and medical claims data to support regulatory decision-making for drug and biological products","volume":"31","author":"Girman","year":"2022","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"2026032207070339300_btag107-B9","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1093\/jamia\/ocaa196","article-title":"The national COVID cohort collaborative (N3C): rationale, design, infrastructure, and deployment","volume":"28","author":"Haendel","year":"2021","journal-title":"J Am Med Inf Assoc"},{"key":"2026032207070339300_btag107-B10","doi-asserted-by":"publisher","first-page":"e0212463","DOI":"10.1371\/journal.pone.0212463","article-title":"Data model harmonization for the All of Us Research program: transforming i2b2 data into the OMOP common data model","volume":"14","author":"Klann","year":"2019","journal-title":"PLoS One"},{"key":"2026032207070339300_btag107-B11","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1016\/j.ajhg.2014.06.009","article-title":"Rare-variant association analysis: study designs and statistical tests","volume":"95","author":"Lee","year":"2014","journal-title":"Am J Hum Genet"},{"key":"2026032207070339300_btag107-B12","author":"Mikolov","year":"2013"},{"key":"2026032207070339300_btag107-B13","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1136\/amiajnl-2010-000061","article-title":"Mapping clinical phenotype data elements to standardized metadata repositories and controlled terminologies: the eMERGE network experience","volume":"18","author":"Pathak","year":"2011","journal-title":"J Am Med Inform Assoc"},{"issue":"Suppl 1","key":"2026032207070339300_btag107-B14","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1002\/pds.2313","article-title":"The US Food and Drug Administration\u2019s sentinel initiative: expanding the horizons of medical product safety","volume":"21","author":"Robb","year":"2012","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"2026032207070339300_btag107-B15","doi-asserted-by":"publisher","first-page":"1953","DOI":"10.1080\/01621459.2020.1752219","article-title":"Spherical regression under mismatch corruption with application to automated knowledge translation","volume":"116","author":"Shi","year":"2021","journal-title":"J Am Stat Assoc"},{"key":"2026032207070339300_btag107-B16","doi-asserted-by":"publisher","first-page":"1349","DOI":"10.1214\/17-AOAS1028","article-title":"Comparing healthcare utilization patterns via global differences in the endorsement of current procedural terminology codes","volume":"11","author":"Shi","year":"2017","journal-title":"Ann Appl Stat"},{"key":"2026032207070339300_btag107-B17","doi-asserted-by":"publisher","first-page":"e0175508","DOI":"10.1371\/journal.pone.0175508","article-title":"Evaluating phecodes, clinical classification software, and ICD-9-CM codes for phenome-wide association studies in the electronic health record","volume":"12","author":"Wei","year":"2017","journal-title":"PLoS One"},{"key":"2026032207070339300_btag107-B18","doi-asserted-by":"publisher","author":"Xing","year":"2015","DOI":"10.3115\/v1\/N15-1104"},{"key":"2026032207070339300_btag107-B19","doi-asserted-by":"publisher","first-page":"749","DOI":"10.1007\/s40264-015-0297-5","article-title":"A comparative assessment of observational medical outcomes partnership and mini-sentinel common data models and analytics: implications for active drug safety surveillance","volume":"38","author":"Xu","year":"2015","journal-title":"Drug Saf"},{"key":"2026032207070339300_btag107-B20","doi-asserted-by":"publisher","first-page":"104147","DOI":"10.1016\/j.jbi.2022.104147","article-title":"Multiview incomplete knowledge graph integration with application to cross-institutional EHR data harmonization","volume":"133","author":"Zhou","year":"2022","journal-title":"J Biomed Inform"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btag107\/67197869\/btag107.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/42\/3\/btag107\/67197869\/btag107.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/42\/3\/btag107\/67197869\/btag107.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,22]],"date-time":"2026-03-22T11:07:10Z","timestamp":1774177630000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/doi\/10.1093\/bioinformatics\/btag107\/8503427"}},"subtitle":[],"editor":[{"given":"Jonathan","family":"Wren","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,2,28]]},"references-count":20,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,2,28]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btag107","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,3]]},"published":{"date-parts":[[2026,2,28]]},"article-number":"btag107"}}