{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T12:39:51Z","timestamp":1787315991207,"version":"build-2736575974"},"reference-count":29,"publisher":"Oxford University Press (OUP)","issue":"6","license":[{"start":{"date-parts":[[2023,4,22]],"date-time":"2023-04-22T00:00:00Z","timestamp":1682121600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["OT2HL161847"],"award-info":[{"award-number":["OT2HL161847"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Researching COVID to Enhance Recovery"},{"name":"CD2H\u2014the National COVID Cohort Collaborative","award":["U24TR002306"],"award-info":[{"award-number":["U24TR002306"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,5,19]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>Clinical encounter data are heterogeneous and vary greatly from institution to institution. These problems of variance affect interpretability and usability of clinical encounter data for analysis. These problems are magnified when multisite electronic health record (EHR) data are networked together. This article presents a novel, generalizable method for resolving encounter heterogeneity for analysis by combining related atomic encounters into composite \u201cmacrovisits.\u201d<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>Encounters were composed of data from 75 partner sites harmonized to a common data model as part of the NIH Researching COVID to Enhance Recovery Initiative, a project of the National Covid Cohort Collaborative. Summary statistics were computed for overall and site-level data to assess issues and identify modifications. Two algorithms were developed to refine atomic encounters into cleaner, analyzable longitudinal clinical visits.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Atomic inpatient encounters data were found to be widely disparate between sites in terms of length-of-stay (LOS) and numbers of OMOP CDM measurements per encounter. After aggregating encounters to macrovisits, LOS and measurement variance decreased. A subsequent algorithm to identify hospitalized macrovisits further reduced data variability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>Encounters are a complex and heterogeneous component of EHR data and native data issues are not addressed by existing methods. These types of complex and poorly studied issues contribute to the difficulty of deriving value from EHR data, and these types of foundational, large-scale explorations, and developments are necessary to realize the full potential of modern real-world data.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>This article presents method developments to manipulate and resolve EHR encounter data issues in a generalizable way as a foundation for future research and analysis.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamia\/ocad057","type":"journal-article","created":{"date-parts":[[2023,3,22]],"date-time":"2023-03-22T19:26:33Z","timestamp":1679513193000},"page":"1125-1136","source":"Crossref","is-referenced-by-count":20,"title":["Clinical encounter heterogeneity and methods for resolving in networked EHR data: a study from N3C and RECOVER programs"],"prefix":"10.1093","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9730-1675","authenticated-orcid":false,"given":"Peter","family":"Leese","sequence":"first","affiliation":[{"name":"NC TraCS Institute, UNC-School of Medicine , Chapel Hill, North Carolina, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7310-6848","authenticated-orcid":false,"given":"Adit","family":"Anand","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Stony Brook University , Stony Brook, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2031-9209","authenticated-orcid":false,"given":"Andrew","family":"Girvin","sequence":"additional","affiliation":[{"name":"Palantir Technologies , Denver, Colorado, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4711-2128","authenticated-orcid":false,"given":"Amin","family":"Manna","sequence":"additional","affiliation":[{"name":"Palantir Technologies , Denver, Colorado, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4674-2646","authenticated-orcid":false,"given":"Saaya","family":"Patel","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Stony Brook University , Stony Brook, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2144-8480","authenticated-orcid":false,"given":"Yun Jae","family":"Yoo","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Stony Brook University , Stony Brook, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3108-7324","authenticated-orcid":false,"given":"Rachel","family":"Wong","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Stony Brook University , Stony Brook, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9114-8737","authenticated-orcid":false,"given":"Melissa","family":"Haendel","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Colorado Anschutz Medical Campus , Denver, Colorado, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5437-2545","authenticated-orcid":false,"given":"Christopher G","family":"Chute","sequence":"additional","affiliation":[{"name":"Schools of Medicine, Public Health, and Nursing, Johns Hopkins University , Baltimore, Maryland, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1483-4236","authenticated-orcid":false,"given":"Tellen","family":"Bennett","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, University of Colorado Anschutz Medical Campus , Denver, Colorado, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6251-9586","authenticated-orcid":false,"given":"Janos","family":"Hajagos","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Stony Brook University , Stony Brook, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6840-9756","authenticated-orcid":false,"given":"Emily","family":"Pfaff","sequence":"additional","affiliation":[{"name":"Department of Medicine, UNC Chapel Hill , Chapel Hill, North Carolina, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2723-5902","authenticated-orcid":false,"given":"Richard","family":"Moffitt","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Stony Brook University , Stony Brook, New York, USA"},{"name":"Department of Biomedical Informatics, Emory University , Atlanta, Georgia, USA"},{"name":"Department of Hematology and Medical Oncology, Emory University , Atlanta, Georgia, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,4,22]]},"reference":[{"issue":"11","key":"2023051917293399500_ocad057-B1","doi-asserted-by":"crossref","first-page":"2355","DOI":"10.1007\/s11606-019-05025-3","article-title":"Variation in physicians\u2019 electronic health record documentation and potential patient harm from that variation","volume":"34","author":"Cohen","year":"2019","journal-title":"J Gen Intern Med"},{"issue":"6","key":"2023051917293399500_ocad057-B2","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.1136\/amiajnl-2013-002627","article-title":"How is the electronic health record being used? Use of EHR data to assess physician-level variability in technology use","volume":"21","author":"Ancker","year":"2014","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2023051917293399500_ocad057-B3","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1136\/amiajnl-2012-001377","article-title":"Understanding differences in electronic health record (EHR) use: linking individual physicians\u2019 perceptions of uncertainty and EHR use patterns in ambulatory care","volume":"21","author":"Lanham","year":"2014","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2023051917293399500_ocad057-B4","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.ijmedinf.2012.04.002","article-title":"How physicians document outpatient visit notes in an electronic health record","volume":"82","author":"Pollard","year":"2013","journal-title":"Int J Med Inform"},{"issue":"12","key":"2023051917293399500_ocad057-B5","doi-asserted-by":"crossref","first-page":"1212","DOI":"10.1097\/00005650-199112000-00004","article-title":"Controlling variation in health care: a consultation from Walter Shewhart","volume":"29","author":"Berwick","year":"1991","journal-title":"Med Care"},{"issue":"10","key":"2023051917293399500_ocad057-B6","doi-asserted-by":"crossref","first-page":"866","DOI":"10.7326\/0003-4819-128-10-199805150-00012","article-title":"Variation in the delivery of health care: the stakes are high","volume":"128","author":"Wennberg","year":"1998","journal-title":"Ann Intern Med"},{"issue":"10","key":"2023051917293399500_ocad057-B7","doi-asserted-by":"crossref","first-page":"2787","DOI":"10.1097\/CCM.0b013e318186aec8","article-title":"Variation in critical care services across North America and Western Europe","volume":"36","author":"Wunsch","year":"2008","journal-title":"Crit Care Med"},{"issue":"4","key":"2023051917293399500_ocad057-B8","doi-asserted-by":"crossref","first-page":"554","DOI":"10.1093\/jamiaopen\/ooz035","article-title":"Heterogeneity introduced by EHR system implementation in a de-identified data resource from 100 non-affiliated organizations","volume":"2","author":"Glynn","year":"2019","journal-title":"JAMIA Open"},{"issue":"5","key":"2023051917293399500_ocad057-B9","doi-asserted-by":"crossref","first-page":"770","DOI":"10.1093\/jamia\/ocac016","article-title":"Comparing ascertainment of chronic condition status with problem lists versus encounter diagnoses from electronic health records","volume":"29","author":"Voss","year":"2022","journal-title":"J Am Med Inform Assoc"},{"issue":"9","key":"2023051917293399500_ocad057-B10","doi-asserted-by":"crossref","first-page":"600","DOI":"10.7326\/0003-4819-153-9-201011020-00010","article-title":"Advancing the science for active surveillance: rationale and design for the Observational Medical Outcomes Partnership","volume":"153","author":"Stang","year":"2010","journal-title":"Ann Intern Med"},{"issue":"4","key":"2023051917293399500_ocad057-B11","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1136\/amiajnl-2014-002747","article-title":"Launching PCORnet, a national patient-centered clinical research network","volume":"21","author":"Fleurence","year":"2014","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2023051917293399500_ocad057-B12","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1136\/jamia.2009.000893","article-title":"Serving the enterprise and beyond with informatics for integrating biology and the bedside (i2b2)","volume":"17","author":"Murphy","year":"2010","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2023051917293399500_ocad057-B13","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1093\/jamia\/ocaa196","article-title":"The National COVID Cohort Collaborative (N3C): Rationale, design, infrastructure, and deployment","volume":"28","author":"Haendel","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"7","key":"2023051917293399500_ocad057-B14","doi-asserted-by":"crossref","first-page":"e2116901","DOI":"10.1001\/jamanetworkopen.2021.16901","article-title":"Clinical characterization and prediction of clinical severity of SARS-CoV-2 infection among US adults using data from the US National COVID Cohort Collaborative","volume":"4","author":"Bennett","year":"2021","journal-title":"JAMA Netw Open"},{"issue":"4","key":"2023051917293399500_ocad057-B15","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1093\/jamia\/ocab217","article-title":"Synergies between centralized and federated approaches to data quality: a report from the National COVID Cohort Collaborative","volume":"29","author":"Pfaff","year":"2022","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2023051917293399500_ocad057-B16","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1186\/s12916-020-01726-3","article-title":"COVID-19 length of hospital stay: a systematic review and data synthesis","volume":"18","author":"Rees","year":"2020","journal-title":"BMC Med"},{"key":"2023051917293399500_ocad057-B17","author":"Project (HCUP) HCAU","year":"2011"},{"issue":"4","key":"2023051917293399500_ocad057-B18","doi-asserted-by":"crossref","first-page":"e0195901","DOI":"10.1371\/journal.pone.0195901","article-title":"Analysis of length of hospital stay using electronic health records: a statistical and data mining approach","volume":"13","author":"Baek","year":"2018","journal-title":"PLoS One"},{"key":"2023051917293399500_ocad057-B19","author":"2022 CMS OPPS specs","year":"2022"},{"issue":"4","key":"2023051917293399500_ocad057-B20","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1007\/s41669-021-00272-9","article-title":"Hospital costs of extracorporeal membrane oxygenation in adults: a systematic review","volume":"5","author":"Oude Lansink-Hartgring","year":"2021","journal-title":"Pharmacoecon Open"},{"key":"2023051917293399500_ocad057-B21","author":"Osman","year":"2022"},{"key":"2023051917293399500_ocad057-B22","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1186\/1471-2288-12-133","article-title":"Constructing episodes of inpatient care: data infrastructure for population-based research","volume":"12","author":"Fransoo","year":"2012","journal-title":"BMC Med Res Methodol"},{"key":"2023051917293399500_ocad057-B23","first-page":"326","author":"Bender","year":"2013"},{"key":"2023051917293399500_ocad057-B24","author":"United States Congress, United States House of Representatives, Committee on Energy and Commerce","year":"2017"},{"key":"2023051917293399500_ocad057-B25","year":"2010"},{"issue":"5","key":"2023051917293399500_ocad057-B26","doi-asserted-by":"crossref","first-page":"899","DOI":"10.1002\/cpt.861","article-title":"Identifying patients with high data completeness to improve validity of comparative effectiveness research in electronic health records data","volume":"103","author":"Lin","year":"2018","journal-title":"Clin Pharmacol Ther"},{"key":"2023051917293399500_ocad057-B27","first-page":"1472","article-title":"Sick patients have more data: the non-random completeness of electronic health records","volume":"2013","author":"Weiskopf","year":"2013","journal-title":"AMIA Annu Symp Proc"},{"key":"2023051917293399500_ocad057-B28","doi-asserted-by":"crossref","first-page":"104452","DOI":"10.1016\/j.ijmedinf.2021.104452","article-title":"Data gaps in electronic health record (EHR) systems: An audit of problem list completeness during the COVID-19 pandemic","volume":"150","author":"Poulos","year":"2021","journal-title":"Int J Med Inform"},{"issue":"5","key":"2023051917293399500_ocad057-B29","doi-asserted-by":"crossref","first-page":"830","DOI":"10.1016\/j.jbi.2013.06.010","article-title":"Defining and measuring completeness of electronic health records for secondary use","volume":"46","author":"Weiskopf","year":"2013","journal-title":"J Biomed Inform"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/6\/1125\/50374657\/ocad057.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/6\/1125\/50374657\/ocad057.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,19]],"date-time":"2023-05-19T13:31:47Z","timestamp":1684503107000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/30\/6\/1125\/7136721"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,22]]},"references-count":29,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,4,22]]},"published-print":{"date-parts":[[2023,5,19]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad057","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,6,1]]},"published":{"date-parts":[[2023,4,22]]}}}