{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T01:58:18Z","timestamp":1777600698744,"version":"3.51.4"},"reference-count":130,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2020,8,17]],"date-time":"2020-08-17T00:00:00Z","timestamp":1597622400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Center for Advancing Translational Sciences Institute","award":["U24TR002306"],"award-info":[{"award-number":["U24TR002306"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>Coronavirus disease 2019 (COVID-19) poses societal challenges that require expeditious data and knowledge sharing. Though organizational clinical data are abundant, these are largely inaccessible to outside researchers. Statistical, machine learning, and causal analyses are most successful with large-scale data beyond what is available in any given organization. Here, we introduce the National COVID Cohort Collaborative (N3C), an open science community focused on analyzing patient-level data from many centers.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and Methods<\/jats:title><jats:p>The Clinical and Translational Science Award Program and scientific community created N3C to overcome technical, regulatory, policy, and governance barriers to sharing and harmonizing individual-level clinical data. We developed solutions to extract, aggregate, and harmonize data across organizations and data models, and created a secure data enclave to enable efficient, transparent, and reproducible collaborative analytics.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Organized in inclusive workstreams, we created legal agreements and governance for organizations and researchers; data extraction scripts to identify and ingest positive, negative, and possible COVID-19 cases; a data quality assurance and harmonization pipeline to create a single harmonized dataset; population of the secure data enclave with data, machine learning, and statistical analytics tools; dissemination mechanisms; and a synthetic data pilot to democratize data access.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The N3C has demonstrated that a multisite collaborative learning health network can overcome barriers to rapidly build a scalable infrastructure incorporating multiorganizational clinical data for COVID-19 analytics. We expect this effort to save lives by enabling rapid collaboration among clinicians, researchers, and data scientists to identify treatments and specialized care and thereby reduce the immediate and long-term impacts of COVID-19.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jamia\/ocaa196","type":"journal-article","created":{"date-parts":[[2020,8,14]],"date-time":"2020-08-14T15:00:10Z","timestamp":1597417210000},"page":"427-443","source":"Crossref","is-referenced-by-count":506,"title":["The National COVID Cohort Collaborative (N3C): Rationale, design, infrastructure, and deployment"],"prefix":"10.1093","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9114-8737","authenticated-orcid":false,"given":"Melissa A","family":"Haendel","sequence":"first","affiliation":[{"name":"Oregon Clinical and Translational Research Institute, Oregon Health and Science University, Portland, Oregon, USA"},{"name":"Translational and Integrative Sciences Center, Department of Molecular Toxicology, Oregon State University, Corvallis, Oregon, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5437-2545","authenticated-orcid":false,"given":"Christopher G","family":"Chute","sequence":"additional","affiliation":[{"name":"Schools of Medicine, Public Health, and Nursing, Johns Hopkins University, Baltimore, Maryland, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1483-4236","authenticated-orcid":false,"given":"Tellen D","family":"Bennett","sequence":"additional","affiliation":[{"name":"Section of Informatics and Data Science, Department of Pediatrics, University of Colorado School of Medicine, University of Colorado, Aurora, Colorado, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3150-8758","authenticated-orcid":false,"given":"David A","family":"Eichmann","sequence":"additional","affiliation":[{"name":"School of Library and Information Science, The University of Iowa, Iowa City, Iowa, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1477-1888","authenticated-orcid":false,"given":"Justin","family":"Guinney","sequence":"additional","affiliation":[{"name":"Sage Bionetworks, Seattle, Washington, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5622-7659","authenticated-orcid":false,"given":"Warren A","family":"Kibbe","sequence":"additional","affiliation":[{"name":"Duke University, Durham,North Carolina, USA"}]},{"given":"Philip R O","family":"Payne","sequence":"additional","affiliation":[{"name":"Institute for Informatics, Washington University in St. Louis, Saint Louis,Missouri, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6840-9756","authenticated-orcid":false,"given":"Emily R","family":"Pfaff","sequence":"additional","affiliation":[{"name":"North Carolina Translational and Clinical Sciences Institute (NC TraCS), University of North Carolina at Chapel Hill, Chapel Hill,North Carolina, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0736-9199","authenticated-orcid":false,"given":"Peter N","family":"Robinson","sequence":"additional","affiliation":[{"name":"Jackson Laboratory, Bar Harbor, Maine, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3451-2165","authenticated-orcid":false,"given":"Joel H","family":"Saltz","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Stony Brook University, Stony Brook, New York, USA"}]},{"given":"Heidi","family":"Spratt","sequence":"additional","affiliation":[{"name":"University of Texas Medical Branch, Galveston, Texas, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2986-385X","authenticated-orcid":false,"given":"Christine","family":"Suver","sequence":"additional","affiliation":[{"name":"Sage Bionetworks, Seattle, Washington, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4510-0385","authenticated-orcid":false,"given":"John","family":"Wilbanks","sequence":"additional","affiliation":[{"name":"Sage Bionetworks, Seattle, Washington, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6305-735X","authenticated-orcid":false,"given":"Adam B","family":"Wilcox","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, Washington, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0692-412X","authenticated-orcid":false,"given":"Andrew E","family":"Williams","sequence":"additional","affiliation":[{"name":"Tufts Medical Center Clinical and Translational Science Institute, Tufts Medical Center, Boston,Massachusetts, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2629-6124","authenticated-orcid":false,"given":"Chunlei","family":"Wu","sequence":"additional","affiliation":[{"name":"Department of Integrative Structural and Computational Biology, The Scripps Research Institute, La Jolla, California, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2570-2124","authenticated-orcid":false,"given":"Clair","family":"Blacketer","sequence":"additional","affiliation":[{"name":"Janssen Research and Development, LLC, Raritan, New Jersey, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0908-1428","authenticated-orcid":false,"given":"Robert L","family":"Bradford","sequence":"additional","affiliation":[{"name":"North Carolina Translational and Clinical Sciences Institute (NC TraCS), University of North Carolina at Chapel Hill, Chapel Hill,North Carolina, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4101-1622","authenticated-orcid":false,"given":"James J","family":"Cimino","sequence":"additional","affiliation":[{"name":"University of Alabama-Birmingham, Birmingham, Alabama, USA"}]},{"given":"Marshall","family":"Clark","sequence":"additional","affiliation":[{"name":"North Carolina Translational and Clinical Sciences Institute (NC TraCS), University of North Carolina at Chapel Hill, Chapel Hill,North Carolina, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4993-2269","authenticated-orcid":false,"given":"Evan W","family":"Colmenares","sequence":"additional","affiliation":[{"name":"Department of Pharmaceutical Outcomes and Policy, University of North Carolina at Chapel Hill, Chapel Hill,North Carolina, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9612-5702","authenticated-orcid":false,"given":"Patricia A","family":"Francis","sequence":"additional","affiliation":[{"name":"Johns Hopkins University School of Medicine, Baltimore, Maryland, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9041-4597","authenticated-orcid":false,"given":"Davera","family":"Gabriel","sequence":"additional","affiliation":[{"name":"Johns Hopkins University School of Medicine, Baltimore, Maryland, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2193-9987","authenticated-orcid":false,"given":"Alexis","family":"Graves","sequence":"additional","affiliation":[{"name":"University of Iowa Institute for Clinical and Translational Science, The University of Iowa, Iowa City, Iowa, USA"}]},{"given":"Raju","family":"Hemadri","sequence":"additional","affiliation":[{"name":"National Center for Advancing Translational Science, Bethesda, Maryland, USA"}]},{"given":"Stephanie S","family":"Hong","sequence":"additional","affiliation":[{"name":"Johns Hopkins University School of Medicine, Baltimore, Maryland, USA"}]},{"given":"George","family":"Hripscak","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University, New York, New York, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5052-3836","authenticated-orcid":false,"given":"Dazhi","family":"Jiao","sequence":"additional","affiliation":[{"name":"Johns Hopkins University School of Medicine, Baltimore, Maryland, USA"}]},{"given":"Jeffrey G","family":"Klann","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston,Massachusetts, USA"}]},{"given":"Kristin","family":"Kostka","sequence":"additional","affiliation":[{"name":"IQVIA, Durham, North Carolina, USA"}]},{"given":"Adam M","family":"Lee","sequence":"additional","affiliation":[{"name":"University of North Carolina at Chapel Hill, Chapel Hill,North Carolina, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7698-219X","authenticated-orcid":false,"given":"Harold P","family":"Lehmann","sequence":"additional","affiliation":[{"name":"Johns Hopkins University School of Medicine, Baltimore, Maryland, USA"}]},{"given":"Lora","family":"Lingrey","sequence":"additional","affiliation":[{"name":"TriNetX, Cambridge,Massachusetts, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1787-2855","authenticated-orcid":false,"given":"Robert T","family":"Miller","sequence":"additional","affiliation":[{"name":"Tufts Clinical and Translational Science Institute, Tufts University, Boston,Massachusetts, USA"}]},{"given":"Michele","family":"Morris","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh,Pennsylvania, USA"}]},{"given":"Shawn N","family":"Murphy","sequence":"additional","affiliation":[{"name":"Mass General Brigham, Boston,Massachusetts, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9066-9431","authenticated-orcid":false,"given":"Karthik","family":"Natarajan","sequence":"additional","affiliation":[{"name":"Irving Medical Center, Columbia University, New York, New York, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7737-8752","authenticated-orcid":false,"given":"Matvey B","family":"Palchuk","sequence":"additional","affiliation":[{"name":"TriNetX, Cambridge,Massachusetts, USA"}]},{"given":"Usman","family":"Sheikh","sequence":"additional","affiliation":[{"name":"National Center for Advancing Translational Science, Bethesda, Maryland, USA"}]},{"given":"Harold","family":"Solbrig","sequence":"additional","affiliation":[{"name":"Johns Hopkins University School of Medicine, Baltimore, Maryland, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2079-8684","authenticated-orcid":false,"given":"Shyam","family":"Visweswaran","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh,Pennsylvania, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3327-7423","authenticated-orcid":false,"given":"Anita","family":"Walden","sequence":"additional","affiliation":[{"name":"Oregon Clinical and Translational Research Institute, Oregon Health and Science University, Portland, Oregon, USA"},{"name":"Sage Bionetworks, Seattle, Washington, USA"}]},{"given":"Kellie M","family":"Walters","sequence":"additional","affiliation":[{"name":"North Carolina Translational and Clinical Sciences Institute (NC TraCS), University of North Carolina at Chapel Hill, Chapel Hill,North Carolina, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2597-881X","authenticated-orcid":false,"given":"Griffin M","family":"Weber","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Harvard Medical School, Boston,Massachusetts, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4843-9077","authenticated-orcid":false,"given":"Xiaohan Tanner","family":"Zhang","sequence":"additional","affiliation":[{"name":"Johns Hopkins University School of Medicine, Baltimore, Maryland, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4289-7632","authenticated-orcid":false,"given":"Richard L","family":"Zhu","sequence":"additional","affiliation":[{"name":"Johns Hopkins University School of Medicine, Baltimore, Maryland, USA"}]},{"given":"Benjamin","family":"Amor","sequence":"additional","affiliation":[{"name":"Palantir Technologies, Palo Alto, California, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2031-9209","authenticated-orcid":false,"given":"Andrew T","family":"Girvin","sequence":"additional","affiliation":[{"name":"Palantir Technologies, Palo Alto, California, USA"}]},{"given":"Amin","family":"Manna","sequence":"additional","affiliation":[{"name":"Palantir Technologies, Palo Alto, California, USA"}]},{"given":"Nabeel","family":"Qureshi","sequence":"additional","affiliation":[{"name":"Palantir Technologies, Palo Alto, California, USA"}]},{"given":"Michael G","family":"Kurilla","sequence":"additional","affiliation":[{"name":"Division of Clinical Innovation, National Center for Advancing Translational Science, Bethesda, Maryland, USA"}]},{"given":"Sam G","family":"Michael","sequence":"additional","affiliation":[{"name":"National Center for Advancing Translational Sciences, National Institutes of Health, Bethesda, Maryland, USA"}]},{"given":"Lili M","family":"Portilla","sequence":"additional","affiliation":[{"name":"Office of Strategic Alliances, National Center for Advancing Translational Sciences, National Institutes of Health, Bethesda, Maryland, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6502-2361","authenticated-orcid":false,"given":"Joni L","family":"Rutter","sequence":"additional","affiliation":[{"name":"Office of the Director, National Center for Advancing Translational Science, Bethesda, Maryland, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7770-0708","authenticated-orcid":false,"given":"Christopher P","family":"Austin","sequence":"additional","affiliation":[{"name":"National Center for Advancing Translational Sciences, National Institutes of Health, Bethesda, Maryland, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3897-3409","authenticated-orcid":false,"given":"Ken R","family":"Gersing","sequence":"additional","affiliation":[{"name":"National Center for Advancing Translational Science, Bethesda, Maryland, USA"}]},{"name":"the N3C Consortium","sequence":"additional","affiliation":[]}],"member":"286","published-online":{"date-parts":[[2020,8,17]]},"reference":[{"key":"2021030612310081300_ocaa196-B1","first-page":","},{"issue":"6493","key":"2021030612310081300_ocaa196-B2","doi-asserted-by":"crossref","first-page":"860","DOI":"10.1126\/science.abb5793","article-title":"Projecting the transmission dynamics of SARS-CoV-2 through the postpandemic period","volume":"368","author":"Kissler","year":"2020","journal-title":"Science"},{"key":"2021030612310081300_ocaa196-B3","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1038\/s41586-020-2521-4","article-title":"Factors associated with COVID-19-related death using OpenSAFELY","volume":"584","author":"Williamson","year":"2020","journal-title":"Nature"},{"issue":"2","key":"2021030612310081300_ocaa196-B4","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1093\/jamiaopen\/ooy033","article-title":"Accrual to Clinical Trials (ACT): A Clinical and Translational Science Award Consortium Network","volume":"1","author":"Visweswaran","year":"2018","journal-title":"JAMIA Open"},{"issue":"4","key":"2021030612310081300_ocaa196-B5","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1136\/amiajnl-2014-002747","article-title":"Launching PCORnet, a national patient-centered clinical research network","volume":"21","author":"Fleurence","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"2021030612310081300_ocaa196-B6","first-page":"574","article-title":"Observational Health Data Sciences and Informatics (OHDSI): opportunities for observational researchers","volume":"216","author":"Hripcsak","year":"2015","journal-title":"Stud Health Technol Inform"},{"key":"2021030612310081300_ocaa196-B7","author":"Findlay","year":"2015"},{"issue":"2","key":"2021030612310081300_ocaa196-B8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1200\/CCI.17.00067","article-title":"Using a federated network of real-world data to optimize clinical trials operations","volume":"2","author":"Topaloglu","year":"2018","journal-title":"JCO Clin Cancer Inform"},{"key":"2021030612310081300_ocaa196-B9","doi-asserted-by":"crossref","DOI":"10.1038\/s41746-020-00308-0","article-title":"International electronic health record-derived COVID-19 clinical course profiles: the 4CE consortium","author":"Brat","year":"2020","journal-title":"npj Digit Med"},{"key":"2021030612310081300_ocaa196-B10","author":"Carton","year":"2020","journal-title":"PCORnet COVID-19 common data model design and results. Zenodo"},{"issue":"14","key":"2021030612310081300_ocaa196-B11","doi-asserted-by":"crossref","first-page":"1347","DOI":"10.1056\/NEJMra1814259","article-title":"Machine learning in medicine","volume":"380","author":"Rajkomar","year":"2019","journal-title":"N Engl J Med"},{"issue":"10","key":"2021030612310081300_ocaa196-B12","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1038\/s41551-018-0305-z","article-title":"Artificial intelligence in healthcare","volume":"2","author":"Yu","year":"2018","journal-title":"Nat Biomed Eng"},{"issue":"19","key":"2021030612310081300_ocaa196-B13","doi-asserted-by":"crossref","first-page":"7I","DOI":"10.1016\/0002-9149(89)90121-5","article-title":"Pharmacokinetics of dilevalol in normotensive and hypertensive volunteers","volume":"63","author":"Kramer","year":"1989","journal-title":"Am J Cardiol"},{"issue":"13","key":"2021030612310081300_ocaa196-B14","doi-asserted-by":"crossref","first-page":"1216","DOI":"10.1056\/NEJMp1606181","article-title":"Predicting the future\u2014big data, machine learning, and clinical medicine","volume":"375","author":"Obermeyer","year":"2016","journal-title":"N Engl J Med"},{"key":"2021030612310081300_ocaa196-B15","doi-asserted-by":"crossref","first-page":"103364","DOI":"10.1016\/j.jbi.2019.103364","article-title":"Unsupervised machine learning for the discovery of latent disease clusters and patient subgroups using electronic health records","volume":"102","author":"Wang","year":"2020","journal-title":"J Biomed Inform"},{"issue":"3","key":"2021030612310081300_ocaa196-B16","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1109\/MSP.2020.2975749","article-title":"Federated learning: challenges, methods, and future directions","volume":"37","author":"Li","year":"2020","journal-title":"IEEE Signal Process Mag"},{"issue":"4","key":"2021030612310081300_ocaa196-B17","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1200\/CCI.19.00047","article-title":"Systematic review of privacy-preserving distributed machine learning from federated databases in health care","volume":"4","author":"Zerka","year":"2020","journal-title":"JCO Clin Cancer Inform"},{"issue":"6","key":"2021030612310081300_ocaa196-B18","first-page":"1","article-title":"Federated machine learning: concept and applications","volume":"10","author":"Liu","year":"2019","journal-title":"ACM Trans Intell Syst Technol"},{"key":"2021030612310081300_ocaa196-B19","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.ijmedinf.2018.01.007","article-title":"Federated learning of predictive models from federated Electronic Health Records","volume":"112","author":"Brisimi","year":"2018","journal-title":"Int J Med Inform"},{"key":"2021030612310081300_ocaa196-B20"},{"issue":"25","key":"2021030612310081300_ocaa196-B21","doi-asserted-by":"crossref","first-page":"e102","DOI":"10.1056\/NEJMoa2007621","article-title":"Retraction: cardiovascular disease, drug therapy, and mortality in Covid-19","volume":"382","author":"Mehra","year":"2020","journal-title":"N Engl J Med"},{"issue":"1","key":"2021030612310081300_ocaa196-B22","doi-asserted-by":"crossref","first-page":"160018","DOI":"10.1038\/sdata.2016.18","article-title":"The FAIR Guiding Principles for scientific data management and stewardship","volume":"3","author":"Wilkinson","year":"2016","journal-title":"Sci Data"},{"key":"2021030612310081300_ocaa196-B23","year":"2015"},{"key":"2021030612310081300_ocaa196-B24"},{"key":"2021030612310081300_ocaa196-B25"},{"key":"2021030612310081300_ocaa196-B26"},{"key":"2021030612310081300_ocaa196-B27"},{"key":"2021030612310081300_ocaa196-B28"},{"key":"2021030612310081300_ocaa196-B29","author":"Grayson","year":"2019"},{"key":"2021030612310081300_ocaa196-B30"},{"key":"2021030612310081300_ocaa196-B31"},{"key":"2021030612310081300_ocaa196-B32"},{"key":"2021030612310081300_ocaa196-B33"},{"key":"2021030612310081300_ocaa196-B34"},{"key":"2021030612310081300_ocaa196-B35","year":"2017"},{"issue":"3","key":"2021030612310081300_ocaa196-B36","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1111\/rssa.12358","article-title":"General and specific utility measures for synthetic data","volume":"181","author":"Snoke","year":"2018","journal-title":"J R Stat Soc A"},{"key":"2021030612310081300_ocaa196-B37","year":"2015"},{"key":"2021030612310081300_ocaa196-B38"},{"key":"2021030612310081300_ocaa196-B39","article-title":"The Revised Common Rule\u2019s Cooperative Research Provision (45 CFR 46.114)","year":"2019"},{"key":"2021030612310081300_ocaa196-B40"},{"key":"2021030612310081300_ocaa196-B41","doi-asserted-by":"crossref","first-page":"207","DOI":"10.5195\/jmla.2017.89","volume":"105","author":"Sprague","year":"2017","journal-title":"J Med Libr Assoc"},{"key":"2021030612310081300_ocaa196-B42","author":"Haendel","year":"2016","journal-title":"FAIR-TLC: Metrics to Assess Value of Biomedical Digital Repositories: Response to RFI NOT-OD-16-133"},{"key":"2021030612310081300_ocaa196-B43"},{"key":"2021030612310081300_ocaa196-B44","doi-asserted-by":"crossref","first-page":"14","DOI":"10.5334\/jors.bx","volume":"3","author":"Katz","year":"2015","journal-title":"J Open Res Soft"},{"key":"2021030612310081300_ocaa196-B45"},{"key":"2021030612310081300_ocaa196-B46","year":"2020"},{"key":"2021030612310081300_ocaa196-B47","year":"2020"},{"key":"2021030612310081300_ocaa196-B48","author":"Burn","year":"2020"},{"key":"2021030612310081300_ocaa196-B49"},{"key":"2021030612310081300_ocaa196-B50"},{"issue":"5","key":"2021030612310081300_ocaa196-B51","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1197\/jamia.M3191","article-title":"The Shared Health Research Information Network (SHRINE): a prototype federated query tool for clinical data repositories","volume":"16","author":"Weber","year":"2009","journal-title":"J Am Med Inform Assoc"},{"key":"2021030612310081300_ocaa196-B52"},{"key":"2021030612310081300_ocaa196-B53"},{"key":"2021030612310081300_ocaa196-B54"},{"key":"2021030612310081300_ocaa196-B55","year":"2019"},{"key":"2021030612310081300_ocaa196-B56"},{"key":"2021030612310081300_ocaa196-B57"},{"issue":"3","key":"2021030612310081300_ocaa196-B58","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1136\/jamia.2000.0070298","article-title":"Clinical classification and terminology: some history and current observations","volume":"7","author":"Chute","year":"2000","journal-title":"J Am Med Inform Assoc"},{"issue":"15","key":"2021030612310081300_ocaa196-B59","doi-asserted-by":"crossref","first-page":"1452","DOI":"10.1056\/NEJMra1615014","article-title":"Classification, ontology, and precision medicine","volume":"379","author":"Haendel","year":"2018","journal-title":"N Engl J Med"},{"key":"2021030612310081300_ocaa196-B60"},{"key":"2021030612310081300_ocaa196-B61","first-page":"337","article-title":"The pluripotent rendering of clinical data for precision medicine","volume":"245","author":"Chute","year":"2017","journal-title":"Stud Health Technol Inform"},{"key":"2021030612310081300_ocaa196-B62","first-page":"12,"},{"key":"2021030612310081300_ocaa196-B63"},{"key":"2021030612310081300_ocaa196-B64"},{"key":"2021030612310081300_ocaa196-B65","doi-asserted-by":"crossref","first-page":"S60","DOI":"10.1097\/MLR.0b013e318259bff4","article-title":"Data model considerations for clinical effectiveness researchers","volume":"50","author":"Kahn","year":"2012","journal-title":"Med Care"},{"issue":"8 Suppl 3","key":"2021030612310081300_ocaa196-B66","doi-asserted-by":"crossref","first-page":"S45","DOI":"10.1097\/MLR.0b013e31829b1e0b","article-title":"Identifying appropriate reference data models for comparative effectiveness research (CER) studies based on data from clinical information systems","volume":"51","author":"Ogunyemi","year":"2013","journal-title":"Med Care"},{"key":"2021030612310081300_ocaa196-B67"},{"key":"2021030612310081300_ocaa196-B68"},{"key":"2021030612310081300_ocaa196-B69"},{"key":"2021030612310081300_ocaa196-B70","author":"Banga"},{"issue":"1","key":"2021030612310081300_ocaa196-B71","first-page":"1052","article-title":"Transparent reporting of data quality in distributed data networks","volume":"3","author":"Kahn","year":"2015","journal-title":"EGEMS (Wash DC)"},{"issue":"6","key":"2021030612310081300_ocaa196-B72","doi-asserted-by":"crossref","first-page":"1072","DOI":"10.1093\/jamia\/ocx033","article-title":"A longitudinal analysis of data quality in a large pediatric data research network","volume":"24","author":"Khare","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2021030612310081300_ocaa196-B73","doi-asserted-by":"crossref","first-page":"830","DOI":"10.1016\/j.jbi.2013.06.010","article-title":"Defining and measuring completeness of electronic health records for secondary use","volume":"46","author":"Weiskopf","year":"2013","journal-title":"J Biomed Inform"},{"issue":"1","key":"2021030612310081300_ocaa196-B74","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1136\/amiajnl-2011-000681","article-title":"Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research","volume":"20","author":"Weiskopf","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"2021030612310081300_ocaa196-B75","doi-asserted-by":"crossref","DOI":"10.1201\/9781315151694","volume-title":"The Data Book: Collection and Management of Research Data","author":"Zozus","year":"2017"},{"key":"2021030612310081300_ocaa196-B76","first-page":"356","article-title":"Quantifying clinical data quality using relative gold standards","volume":"2010","author":"Kahn","year":"2010","journal-title":"AMIA Annu Symp Proc"},{"key":"2021030612310081300_ocaa196-B77"},{"key":"2021030612310081300_ocaa196-B78","year":"2020"},{"key":"2021030612310081300_ocaa196-B79","year":"2020"},{"key":"2021030612310081300_ocaa196-B80"},{"key":"2021030612310081300_ocaa196-B81"},{"key":"2021030612310081300_ocaa196-B82"},{"key":"2021030612310081300_ocaa196-B83"},{"issue":"1","key":"2021030612310081300_ocaa196-B84","doi-asserted-by":"crossref","first-page":"e4","DOI":"10.1016\/j.jvs.2020.04.461","article-title":"Introduction","volume":"72","author":"Eagleton","year":"2020","journal-title":"J Vasc Surg"},{"issue":"9","key":"2021030612310081300_ocaa196-B85","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.1093\/jamia\/ocaa145","article-title":"COVID-19 TestNorm\u2014a tool to normalize COVID-19 testing names to LOINC codes","volume":"27","author":"Dong","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"5p2","key":"2021030612310081300_ocaa196-B86","doi-asserted-by":"crossref","first-page":"1456","DOI":"10.1111\/j.1475-6773.2010.01141.x","article-title":"Balancing access to health data and privacy: a review of the issues and approaches for the future","volume":"45","author":"Lane","year":"2010","journal-title":"Health Serv Res"},{"key":"2021030612310081300_ocaa196-B87","doi-asserted-by":"crossref","first-page":"103253","DOI":"10.1016\/j.jbi.2019.103253","article-title":"Facilitating phenotype transfer using a common data model","volume":"96","author":"Hripcsak","year":"2019","journal-title":"J Biomed Inform"},{"key":"2021030612310081300_ocaa196-B88","doi-asserted-by":"crossref","first-page":"103258","DOI":"10.1016\/j.jbi.2019.103258","article-title":"PheValuator: development and evaluation of a phenotype algorithm evaluator","volume":"97","author":"Swerdel","year":"2019","journal-title":"J Biomed Inform"},{"issue":"8","key":"2021030612310081300_ocaa196-B89","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1093\/jamia\/ocy032","article-title":"Design and implementation of a standardized framework to generate and evaluate patient-level prediction models using observational healthcare data","volume":"25","author":"Reps","year":"2018","journal-title":"J Am Med Inform Assoc"},{"key":"2021030612310081300_ocaa196-B90","article-title":"How confident are we about observational findings in health care: a benchmark study","author":"Schuemie","year":"2020","journal-title":"Harv Data Sci Rev"},{"key":"2021030612310081300_ocaa196-B91","first-page":"20170356","article-title":"Improving reproducibility by using high-throughput observational studies with empirical calibration","volume":"376","author":"Schuemie","year":"2018","journal-title":"Philos Trans A Math Phys Eng Sci"},{"issue":"11","key":"2021030612310081300_ocaa196-B92","doi-asserted-by":"crossref","first-page":"2571","DOI":"10.1073\/pnas.1708282114","article-title":"Empirical confidence interval calibration for population-level effect estimation studies in observational healthcare data","volume":"115","author":"Schuemie","year":"2018","journal-title":"Proc Natl Acad Sci U S A"},{"key":"2021030612310081300_ocaa196-B93","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1038\/s41746-019-0110-4","article-title":"Semantic integration of clinical laboratory tests from electronic health records for deep phenotyping and biomarker discovery","volume":"2","author":"Zhang","year":"2019","journal-title":"NPJ Digit Med"},{"key":"2021030612310081300_ocaa196-B94","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1111\/cts.12591","article-title":"Biomedical Data Translator Consortium. Toward a universal biomedical data translator","volume":"12","year":"2019","journal-title":"Clin Transl Sci"},{"issue":"2","key":"2021030612310081300_ocaa196-B95","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1111\/cts.12592","article-title":"Biomedical Data Translator Consortium. The biomedical data translator program: conception, culture, and community","volume":"12","year":"2019","journal-title":"Clin Transl Sci"},{"issue":"2","key":"2021030612310081300_ocaa196-B96","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1111\/cts.12595","article-title":"Deconstructing the translational tower of babel","volume":"12","author":"Austin","year":"2019","journal-title":"Clin Transl Sci"},{"key":"2021030612310081300_ocaa196-B97"},{"key":"2021030612310081300_ocaa196-B98"},{"issue":"1","key":"2021030612310081300_ocaa196-B99","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1093\/jamia\/ocz165","article-title":"Leaf: an open-source, model-agnostic, data-driven web application for cohort discovery and translational biomedical research","volume":"27","author":"Dobbins","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2021030612310081300_ocaa196-B100"},{"issue":"6","key":"2021030612310081300_ocaa196-B101","doi-asserted-by":"crossref","DOI":"10.1093\/gigascience\/giaa056","article-title":"Recommendations to enhance rigor and reproducibility in biomedical research","volume":"9","author":"Brito","year":"2020","journal-title":"GigaScience"},{"issue":"3","key":"2021030612310081300_ocaa196-B102","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1093\/jamia\/ocx079","article-title":"Synthea: an approach, method, and software mechanism for generating synthetic patients and the synthetic electronic health care record","volume":"25","author":"Walonoski","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2021030612310081300_ocaa196-B103","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1093\/jamia\/ocy142","article-title":"Synthesizing electronic health records using improved generative adversarial networks","volume":"26","author":"Baowaly","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2021030612310081300_ocaa196-B104","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1186\/s12911-019-0793-0","article-title":"The validity of synthetic clinical data: a validation study of a leading synthetic data generator (Synthea) using clinical quality measures","volume":"19","author":"Chen","year":"2019","journal-title":"BMC Med Inform Decis Mak"},{"key":"2021030612310081300_ocaa196-B105","author":"Hayes"},{"key":"2021030612310081300_ocaa196-B106","year":"2019"},{"issue":"5","key":"2021030612310081300_ocaa196-B107","first-page":"716","article-title":"Are synthetic data derivatives the future of translational medicine?","volume":"3","author":"Foraker","year":"2018","journal-title":"J Am Coll Cardio Basic Trans Sci"},{"issue":"3","key":"2021030612310081300_ocaa196-B108","doi-asserted-by":"crossref","first-page":"e1002106","DOI":"10.1371\/journal.pbio.1002106","article-title":"The extent and consequences of p-hacking in science","volume":"13","author":"Head","year":"2015","journal-title":"PLoS Biol"},{"issue":"5","key":"2021030612310081300_ocaa196-B109","doi-asserted-by":"crossref","first-page":"1589","DOI":"10.1109\/JBHI.2017.2767063","article-title":"Deep EHR: a survey of recent advances in deep learning techniques for electronic health record (EHR) analysis","volume":"22","author":"Shickel","year":"2018","journal-title":"IEEE J Biomed Health Inform"},{"issue":"3","key":"2021030612310081300_ocaa196-B110","first-page":"511","article-title":"Tensor factorization toward precision medicine","volume":"18","author":"Luo","year":"2017","journal-title":"Brief Bioinform"},{"key":"2021030612310081300_ocaa196-B111","doi-asserted-by":"crossref","DOI":"10.1001\/jamainternmed.2020.3030","article-title":"Prone positioning in awake, nonintubated patients with COVID-19 hypoxemic respiratory failure","author":"Thompson","year":"2020 17 [- ]","journal-title":"JAMA Intern Med"},{"issue":"10229","key":"2021030612310081300_ocaa196-B112","doi-asserted-by":"crossref","first-page":"1033","DOI":"10.1016\/S0140-6736(20)30628-0","article-title":"COVID-19: consider cytokine storm syndromes and immunosuppression","volume":"395","author":"Mehta","year":"2020","journal-title":"Lancet"},{"issue":"3","key":"2021030612310081300_ocaa196-B113","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1109\/TNB.2018.2837622","article-title":"Deep patient similarity learning for personalized healthcare","volume":"17","author":"Suo","year":"2018","journal-title":"IEEE Trans Nanobiosci"},{"key":"2021030612310081300_ocaa196-B114","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1161\/CIRCULATIONAHA.120.048360","article-title":"Acute heart failure in multisystem inflammatory syndrome in children (MIS-C) in the context of global SARS-CoV-2 pandemic","volume":"142","author":"Belhadjer","year":"2020","journal-title":"Circulation"},{"key":"2021030612310081300_ocaa196-B115","doi-asserted-by":"crossref","first-page":"133","DOI":"10.2147\/CLEP.S232540","article-title":"External validation of an algorithm to identify patients with high data-completeness in electronic health records for comparative effectiveness research","volume":"12","author":"Lin","year":"2020","journal-title":"Clin Epidemiol"},{"issue":"1","key":"2021030612310081300_ocaa196-B116","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1093\/jamia\/ocv210","article-title":"A proposed national research and development agenda for population health informatics: summary recommendations from a national expert workshop","volume":"24","author":"Kharrazi","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"8","key":"2021030612310081300_ocaa196-B117","doi-asserted-by":"crossref","first-page":"789","DOI":"10.1097\/MLR.0000000000000754","article-title":"Comparing population-based risk-stratification model performance using demographic, diagnosis and medication data extracted from outpatient electronic health records versus administrative claims","volume":"55","author":"Kharrazi","year":"2017","journal-title":"Med Care"},{"issue":"24","key":"2021030612310081300_ocaa196-B118","doi-asserted-by":"crossref","first-page":"2478","DOI":"10.1001\/jama.2020.8051","article-title":"COVID-19 and health equity-a new kind of \u2018herd immunity\u2019","volume":"323","author":"Williams","year":"2020","journal-title":"JAMA"},{"key":"2021030612310081300_ocaa196-B119","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.jclinepi.2020.06.004","article-title":"A framework for identifying and mitigating the equity harms of COVID-19 policy interventions","volume":"128","author":"Glover","year":"2020","journal-title":"J Clin Epidemiol"},{"issue":"26","key":"2021030612310081300_ocaa196-B120","doi-asserted-by":"crossref","first-page":"2534","DOI":"10.1056\/NEJMsa2011686","article-title":"Hospitalization and mortality among Black patients and White patients with Covid-19","volume":"382","author":"Price-Haywood","year":"2020","journal-title":"N Engl J Med"},{"key":"2021030612310081300_ocaa196-B121","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.annepidem.2020.05.003","article-title":"Assessing differential impacts of COVID-19 on Black communities","volume":"47","author":"Millett","year":"2020","journal-title":"Ann Epidemiol"},{"issue":"1","key":"2021030612310081300_ocaa196-B122","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1055\/s-0038-1667081","article-title":"Public and population health informatics: the bridging of big data to benefit communities","volume":"27","author":"Gamache","year":"2018","journal-title":"Yearb Med Inform"},{"issue":"6464","key":"2021030612310081300_ocaa196-B123","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting racial bias in an algorithm used to manage the health of populations","volume":"366","author":"Obermeyer","year":"2019","journal-title":"Science"},{"key":"2021030612310081300_ocaa196-B124","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.jbi.2013.11.004","article-title":"The National Institutes of Health\u2019s Biomedical Translational Research Information System (BTRIS): design, contents, functionality and experience to date","volume":"52","author":"Cimino","year":"2014","journal-title":"J Biomed Inform"},{"issue":"8 Suppl 3","key":"2021030612310081300_ocaa196-B125","doi-asserted-by":"crossref","first-page":"S30","DOI":"10.1097\/MLR.0b013e31829b1dbd","article-title":"Caveats for the use of operational electronic health record data in comparative effectiveness research","volume":"51","author":"Hersh","year":"2013","journal-title":"Med Care"},{"issue":"1","key":"2021030612310081300_ocaa196-B126","first-page":"1018","article-title":"Recommendations for the use of operational electronic health record data in comparative effectiveness research","volume":"1","author":"Hersh","year":"2013","journal-title":"EGEMS (Wash DC)"},{"key":"2021030612310081300_ocaa196-B127"},{"key":"2021030612310081300_ocaa196-B128"},{"key":"2021030612310081300_ocaa196-B129","author":"Chute","year":"2020"},{"key":"2021030612310081300_ocaa196-B130"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/advance-article-pdf\/doi\/10.1093\/jamia\/ocaa196\/33795831\/ocaa196.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/3\/427\/36428641\/ocaa196.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/3\/427\/36428641\/ocaa196.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,6]],"date-time":"2022-11-06T23:43:38Z","timestamp":1667778218000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/3\/427\/5893482"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,17]]},"references-count":130,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,8,17]]},"published-print":{"date-parts":[[2021,3,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaa196","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,3,1]]},"published":{"date-parts":[[2020,8,17]]}}}