{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T14:04:26Z","timestamp":1790777066622,"version":"4.1.0"},"reference-count":49,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,2,17]],"date-time":"2023-02-17T00:00:00Z","timestamp":1676592000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,2,17]],"date-time":"2023-02-17T00:00:00Z","timestamp":1676592000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Res Methodol"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Multi-institution electronic health records (EHR) are a rich source of real world data (RWD) for generating real world evidence (RWE) regarding the utilization, benefits and harms of medical interventions. They provide access to clinical data from large pooled patient populations in addition to laboratory measurements unavailable in insurance claims-based data. However, secondary use of these data for research requires specialized knowledge and careful evaluation of data quality and completeness. We discuss data quality assessments undertaken during the conduct of prep-to-research, focusing on the investigation of treatment safety and effectiveness.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Using the National COVID Cohort Collaborative (N3C) enclave, we defined a patient population using criteria typical in non-interventional inpatient drug effectiveness studies. We present the challenges encountered when constructing this dataset, beginning with an examination of data quality across data partners. We then discuss the methods and best practices used to operationalize several important study elements: exposure to treatment, baseline health comorbidities, and key outcomes of interest.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We share our experiences and lessons learned when working with heterogeneous EHR data from over 65 healthcare institutions and 4 common data models. We discuss six key areas of data variability and quality. (1) The specific EHR data elements captured from a site can vary depending on source data model and practice. (2) Data missingness remains a significant issue. (3) Drug exposures can be recorded at different levels and may not contain route of administration or dosage information. (4) Reconstruction of continuous drug exposure intervals may not always be possible. (5) EHR discontinuity is a major concern for capturing history of prior treatment and comorbidities. Lastly, (6) access to EHR data alone limits the potential outcomes which can be used in studies.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The creation of large scale centralized multi-site EHR databases such as N3C enables a wide range of research aimed at better understanding treatments and health impacts of many conditions including COVID-19. As with all observational research, it is important that research teams engage with appropriate domain experts to understand the data in order to define research questions that are both clinically important and feasible to address using these real world data.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12874-023-01839-2","type":"journal-article","created":{"date-parts":[[2023,2,17]],"date-time":"2023-02-17T05:03:09Z","timestamp":1676610189000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Data quality considerations for evaluating COVID-19 treatments using real world data: learnings from the National COVID Cohort Collaborative (N3C)"],"prefix":"10.1186","volume":"23","author":[{"given":"Hythem","family":"Sidky","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jessica C.","family":"Young","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew T.","family":"Girvin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eileen","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu Raymond","family":"Shao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nathan","family":"Hotaling","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sam","family":"Michael","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kenneth J.","family":"Wilkins","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Soko","family":"Setoguchi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michele Jonsson","family":"Funk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"The N3C Consortium","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"G. Caleb","family":"Alexander","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin","family":"Bates","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher G.","family":"Chute","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jayme L.","family":"Dahlin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ken","family":"Gersing","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Melissa A.","family":"Haendel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hemalkumar B.","family":"Mehta","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emily R.","family":"Pfaff","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Sahner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,2,17]]},"reference":[{"key":"1839_CR1","doi-asserted-by":"publisher","first-page":"10003","DOI":"10.7189\/jogh.11.10003","volume":"11","author":"Y Dong","year":"2021","unstructured":"Dong Y, Shamsuddin A, Campbell H, Theodoratou E. Current COVID-19 treatments: Rapid review of the literature. J Glob Health. 2021;11:10003.","journal-title":"J Glob Health"},{"key":"1839_CR2","doi-asserted-by":"publisher","first-page":"173451","DOI":"10.1016\/j.ejphar.2020.173451","volume":"886","author":"S Lam","year":"2020","unstructured":"Lam S, Lombardi A, Ouanounou A. COVID-19: a review of the proposed pharmacological treatments. Eur J Pharmacol. 2020;886:173451.","journal-title":"Eur J Pharmacol"},{"key":"1839_CR3","doi-asserted-by":"publisher","first-page":"e005427","DOI":"10.1136\/bmjgh-2021-005427","volume":"6","author":"M Michelen","year":"2021","unstructured":"Michelen M, et al. Characterising long COVID: a living systematic review. BMJ Glob Health. 2021;6:e005427.","journal-title":"BMJ Glob Health"},{"key":"1839_CR4","doi-asserted-by":"publisher","first-page":"758","DOI":"10.1093\/aje\/kwv254","volume":"183","author":"MA Hern\u00e1n","year":"2016","unstructured":"Hern\u00e1n MA, Robins JM. Using big data to emulate a target trial when a randomized trial is not available. Am J Epidemiol. 2016;183:758\u201364.","journal-title":"Am J Epidemiol"},{"key":"1839_CR5","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1093\/jamia\/ocaa196","volume":"28","author":"MA Haendel","year":"2021","unstructured":"Haendel MA, et al. The national COVID cohort collaborative (N3C): rationale, design, infrastructure, and deployment. J Am Med Inform Assoc. 2021;28:427\u201343.","journal-title":"J Am Med Inform Assoc"},{"key":"1839_CR6","first-page":"316","volume":"295","author":"J Lyu","year":"2022","unstructured":"Lyu J, Cui W, Finkelstein J. Assessing disparities in COVID-19 testing using national COVID cohort collaborative. Stud Health Technol Inform. 2022;295:316\u20139.","journal-title":"Stud Health Technol Inform"},{"key":"1839_CR7","doi-asserted-by":"publisher","unstructured":"Pfaff ER, et al. Synergies between centralized and federated approaches to data quality: a report from the national COVID cohort collaborative. J Am Med Inform Assoc JAMIA. 2021. https:\/\/doi.org\/10.1093\/jamia\/ocab217.","DOI":"10.1093\/jamia\/ocab217"},{"key":"1839_CR8","doi-asserted-by":"publisher","first-page":"625","DOI":"10.1001\/jama.2020.13319","volume":"324","author":"RM Califf","year":"2020","unstructured":"Califf RM, Hernandez AF, Landray M. Weighing the benefits and risks of proliferating observational treatment assessments: observational cacophony, randomized harmony. JAMA. 2020;324:625\u20136.","journal-title":"JAMA"},{"key":"1839_CR9","doi-asserted-by":"publisher","first-page":"816","DOI":"10.1002\/cpt.2185","volume":"109","author":"JM Franklin","year":"2021","unstructured":"Franklin JM, et al. Real-world evidence for assessing pharmaceutical treatments in the context of COVID-19. Clin Pharmacol Ther. 2021;109:816\u201328.","journal-title":"Clin Pharmacol Ther"},{"key":"1839_CR10","doi-asserted-by":"publisher","first-page":"654","DOI":"10.1093\/ije\/dyx283","volume":"47","author":"CR Lesko","year":"2018","unstructured":"Lesko CR, et al. Collaborative, pooled and harmonized study designs for epidemiologic research: challenges and opportunities. Int J Epidemiol. 2018;47:654\u201368.","journal-title":"Int J Epidemiol"},{"key":"1839_CR11","doi-asserted-by":"publisher","first-page":"3","DOI":"10.5334\/egems.199","volume":"6","author":"LG Qualls","year":"2018","unstructured":"Qualls LG, et al. Evaluating foundational data quality in the National Patient-Centered Clinical Research Network (PCORnet\u00ae). EGEMs Gener Evid Methods Improve Patient Outcomes. 2018;6:3.","journal-title":"EGEMs Gener Evid Methods Improve Patient Outcomes"},{"key":"1839_CR12","unstructured":"N3C COVID-19 Phenotype. https:\/\/github.com\/National-COVID-Cohort-Collaborative\/Phenotype_Data_Acquisition\/wiki\/Latest-Phenotype."},{"key":"1839_CR13","volume-title":"What are bundled payments? NEJM Catal","author":"N Catalyst","year":"2018","unstructured":"Catalyst N. What are bundled payments? NEJM Catal; 2018."},{"key":"1839_CR14","doi-asserted-by":"publisher","first-page":"913","DOI":"10.1002\/pds.5452","volume":"31","author":"JC Young","year":"2022","unstructured":"Young JC, Dasgupta N, St\u00fcrmer T, Pate V, Jonsson Funk M. Considerations for observational study design: comparing the evidence of opioid use between electronic health records and insurance claims. Pharmacoepidemiol Drug Saf. 2022;31:913\u201320.","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"1839_CR15","doi-asserted-by":"publisher","DOI":"10.1101\/2022.10.14.22281106","volume-title":"Clinical encounter heterogeneity and methods for resolving in networked EHR data: A study from N3C and RECOVER programs","author":"P Leese","year":"2022","unstructured":"Leese P, et al. Clinical encounter heterogeneity and methods for resolving in networked EHR data: A study from N3C and RECOVER programs; 2022. Preprint at. https:\/\/doi.org\/10.1101\/2022.10.14.22281106."},{"key":"1839_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/oxfordjournals.aje.a116591","volume":"137","author":"CR Weinberg","year":"1993","unstructured":"Weinberg CR. Toward a clearer definition of confounding. Am J Epidemiol. 1993;137:1\u20138.","journal-title":"Am J Epidemiol"},{"key":"1839_CR17","doi-asserted-by":"publisher","first-page":"e2116901","DOI":"10.1001\/jamanetworkopen.2021.16901","volume":"4","author":"TD Bennett","year":"2021","unstructured":"Bennett TD, et al. Clinical characterization and prediction of clinical severity of SARS-CoV-2 infection among US adults using data from the US national COVID cohort collaborative. JAMA Netw Open. 2021;4:e2116901.","journal-title":"JAMA Netw Open"},{"key":"1839_CR18","doi-asserted-by":"publisher","first-page":"1503","DOI":"10.1136\/heartjnl-2020-317393","volume":"106","author":"J Hippisley-Cox","year":"2020","unstructured":"Hippisley-Cox J, et al. Risk of severe COVID-19 disease with ACE inhibitors and angiotensin receptor blockers: cohort study including 8.3 million people. Heart. 2020;106:1503\u201311.","journal-title":"Heart"},{"key":"1839_CR19","doi-asserted-by":"crossref","unstructured":"Molenberghs G, Fitzmaurice G, Kenward MG, Tsiatis A, Verbeke G. (Eds.). Handbook of MissingData Methodology (1st ed.). Chapman and Hall\/CRC. 2014.","DOI":"10.1201\/b17622"},{"key":"1839_CR20","doi-asserted-by":"publisher","first-page":"7334","DOI":"10.1038\/s41598-021-86676-3","volume":"11","author":"Y Gu","year":"2021","unstructured":"Gu Y, et al. PaO2\/FiO2 and IL-6 are risk factors of mortality for intensive care COVID-19 patients. Sci Rep. 2021;11:7334.","journal-title":"Sci Rep"},{"key":"1839_CR21","doi-asserted-by":"publisher","first-page":"899","DOI":"10.1002\/cpt.861","volume":"103","author":"KJ Lin","year":"2018","unstructured":"Lin KJ, et al. Identifying patients with high data completeness to improve validity of comparative effectiveness research in electronic health records data. Clin Pharmacol Ther. 2018;103:899\u2013905.","journal-title":"Clin Pharmacol Ther"},{"key":"1839_CR22","doi-asserted-by":"publisher","first-page":"1225","DOI":"10.1093\/jamia\/ocac043","volume":"29","author":"Y Jin","year":"2022","unstructured":"Jin Y, Schneeweiss S, Merola D, Lin KJ. Impact of longitudinal data-completeness of electronic health record data on risk score misclassification. J Am Med Inform Assoc. 2022;29:1225\u201332.","journal-title":"J Am Med Inform Assoc"},{"key":"1839_CR23","first-page":"147","volume":"49","author":"KD Bertakis","year":"2000","unstructured":"Bertakis KD, Azari R, Helms LJ, Callahan EJ, Robbins JA. Gender differences in the utilization of health care services. J Fam Pract. 2000;49:147.","journal-title":"J Fam Pract"},{"key":"1839_CR24","doi-asserted-by":"publisher","first-page":"1054","DOI":"10.1016\/S0140-6736(20)30566-3","volume":"395","author":"F Zhou","year":"2020","unstructured":"Zhou F, et al. Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study. Lancet. 2020;395:1054\u201362.","journal-title":"Lancet"},{"key":"1839_CR25","doi-asserted-by":"publisher","first-page":"e0258154","DOI":"10.1371\/journal.pone.0258154","volume":"16","author":"E Ge","year":"2021","unstructured":"Ge E, Li Y, Wu S, Candido E, Wei X. Association of pre-existing comorbidities with mortality and disease severity among 167,500 individuals with COVID-19 in Canada: a population-based cohort study. PLoS One. 2021;16:e0258154.","journal-title":"PLoS One"},{"key":"1839_CR26","doi-asserted-by":"publisher","first-page":"3083","DOI":"10.1002\/sim.3697","volume":"28","author":"PC Austin","year":"2009","unstructured":"Austin PC. Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples. Stat Med. 2009;28:3083\u2013107.","journal-title":"Stat Med"},{"key":"1839_CR27","first-page":"1","volume-title":"SAS global forum","author":"D Yang","year":"2012","unstructured":"Yang D, Dalton JE. A unified approach to measuring the effect size between two groups using SAS\u00ae. In:  SAS global forum, vol. 335; 2012. p. 1\u20136."},{"key":"1839_CR28","doi-asserted-by":"publisher","first-page":"496","DOI":"10.1080\/01621459.1999.10474144","volume":"94","author":"JP Fine","year":"1999","unstructured":"Fine JP, Gray RJ. A proportional hazards model for the subdistribution of a competing risk. J Am Stat Assoc. 1999;94:496\u2013509.","journal-title":"J Am Stat Assoc"},{"key":"1839_CR29","doi-asserted-by":"publisher","first-page":"R5","DOI":"10.1186\/cc3921","volume":"10","author":"M Resche-Rigon","year":"2005","unstructured":"Resche-Rigon M, Azoulay E, Chevret S. Evaluating mortality in intensive care units: contribution of competing risks analyses. Crit Care. 2005;10:R5.","journal-title":"Crit Care"},{"key":"1839_CR30","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1186\/1471-2288-11-144","volume":"11","author":"GN Brock","year":"2011","unstructured":"Brock GN, Barnes C, Ramirez JA, Myers J. How to handle mortality when investigating length of hospital stay and time to clinical stability. BMC Med Res Methodol. 2011;11:144.","journal-title":"BMC Med Res Methodol"},{"key":"1839_CR31","doi-asserted-by":"publisher","first-page":"e210184","DOI":"10.1001\/jamanetworkopen.2021.0184","volume":"4","author":"S Haneuse","year":"2021","unstructured":"Haneuse S, Arterburn D, Daniels MJ. Assessing missing data assumptions in EHR-based studies: a complex and underappreciated task. JAMA Netw Open. 2021;4:e210184.","journal-title":"JAMA Netw Open"},{"key":"1839_CR32","doi-asserted-by":"publisher","first-page":"1255","DOI":"10.1093\/oxfordjournals.aje.a117592","volume":"142","author":"S Greenland","year":"1995","unstructured":"Greenland S, Finkle WD. A critical look at methods for handling missing covariates in epidemiologic regression analyses. Am J Epidemiol. 1995;142:1255\u201364.","journal-title":"Am J Epidemiol"},{"key":"1839_CR33","doi-asserted-by":"publisher","first-page":"621","DOI":"10.1111\/j.0006-341X.2002.00621.x","volume":"58","author":"SR Lipsitz","year":"2002","unstructured":"Lipsitz SR, Fitzmaurice GM, Ibrahim JG, Gelber R, Lipshultz S. Parameter estimation in longitudinal studies with outcome-dependent follow-up. Biometrics. 2002;58:621\u201330.","journal-title":"Biometrics"},{"key":"1839_CR34","doi-asserted-by":"publisher","first-page":"4770","DOI":"10.1002\/sim.6262","volume":"33","author":"KS Tan","year":"2014","unstructured":"Tan KS, French B, Troxel AB. Regression modeling of longitudinal data with outcome-dependent observation times: extensions and comparative evaluation. Stat Med. 2014;33:4770\u201389.","journal-title":"Stat Med"},{"key":"1839_CR35","doi-asserted-by":"publisher","first-page":"831","DOI":"10.1111\/sjos.12373","volume":"46","author":"W Shen","year":"2019","unstructured":"Shen W, Liu S, Chen Y, Ning J. Regression analysis of longitudinal data with outcome-dependent sampling and informative censoring. Scand J Stat. 2019;46:831\u201347.","journal-title":"Scand J Stat"},{"key":"1839_CR36","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1186\/s12874-020-01180-y","volume":"21","author":"G Carreras","year":"2021","unstructured":"Carreras G, et al. Missing not at random in end of life care studies: multiple imputation and sensitivity analysis on data from the ACTION study. BMC Med Res Methodol. 2021;21:13.","journal-title":"BMC Med Res Methodol"},{"key":"1839_CR37","doi-asserted-by":"publisher","first-page":"b2393","DOI":"10.1136\/bmj.b2393","volume":"338","author":"JAC Sterne","year":"2009","unstructured":"Sterne JAC, et al. Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ. 2009;338:b2393.","journal-title":"BMJ"},{"key":"1839_CR38","doi-asserted-by":"publisher","DOI":"10.1201\/9780367803025","volume-title":"Analysis of incomplete multivariate data","author":"JL Schafer","year":"1997","unstructured":"Schafer JL. Analysis of incomplete multivariate data: Chapman and Hall\/CRC; 1997. https:\/\/doi.org\/10.1201\/9780367803025."},{"key":"1839_CR39","doi-asserted-by":"crossref","unstructured":"RECOVERY Collaborative Group, Horby P, Lim WS, et al. Dexamethasone in Hospitalized Patients with Covid-19. N Engl J Med. 2021;384:693-704.","DOI":"10.1056\/NEJMoa2021436"},{"key":"1839_CR40","doi-asserted-by":"publisher","first-page":"1099","DOI":"10.2307\/2532251","volume":"49","author":"DF Heitjan","year":"1993","unstructured":"Heitjan DF. Ignorability and coarse data: some biomedical examples. Biometrics. 1993;49:1099.","journal-title":"Biometrics"},{"key":"1839_CR41","doi-asserted-by":"publisher","DOI":"10.1101\/2022.10.06.22280795","volume-title":"Long COVID Risk and Pre-COVID Vaccination: An EHR-Based Cohort Study from the RECOVER Program","author":"MD Brannock","year":"2022","unstructured":"Brannock MD, et al. Long COVID Risk and Pre-COVID Vaccination: An EHR-Based Cohort Study from the RECOVER Program; 2022. Preprint at. https:\/\/doi.org\/10.1101\/2022.10.06.22280795."},{"key":"1839_CR42","doi-asserted-by":"publisher","first-page":"1203","DOI":"10.13063\/2327-9214.1203","volume":"4","author":"S Haneuse","year":"2016","unstructured":"Haneuse S, Daniels M. A General Framework for Considering Selection Bias in EHR-Based Studies: What Data Are Observed and Why? eGEMs. 2016;4:1203.","journal-title":"eGEMs"},{"key":"1839_CR43","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1186\/cc3949","volume":"10","author":"D Schoenfeld","year":"2005","unstructured":"Schoenfeld D. Survival methods, including those using competing risk analysis, are not appropriate for intensive care unit outcome studies. Crit Care. 2005;10:103.","journal-title":"Crit Care"},{"key":"1839_CR44","doi-asserted-by":"publisher","first-page":"e1003871","DOI":"10.1371\/journal.pmed.1003871","volume":"19","author":"K Bhaskaran","year":"2022","unstructured":"Bhaskaran K, et al. Overall and cause-specific hospitalisation and death after COVID-19 hospitalisation in England: a cohort study using linked primary care, secondary care, and death registration data in the OpenSAFELY platform. PLoS Med. 2022;19:e1003871.","journal-title":"PLoS Med"},{"key":"1839_CR45","doi-asserted-by":"publisher","first-page":"e0261707","DOI":"10.1371\/journal.pone.0261707","volume":"16","author":"O Ayodele","year":"2021","unstructured":"Ayodele O, et al. Real-world treatment patterns and clinical outcomes for inpatients with COVID-19 in the US from September 2020 to February 2021. PLoS One. 2021;16:e0261707.","journal-title":"PLoS One"},{"key":"1839_CR46","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-020-00308-0","volume":"3","author":"GA Brat","year":"2020","unstructured":"Brat GA, et al. International electronic health record-derived COVID-19 clinical course profiles: the 4CE consortium. Npj Digit Med. 2020;3:1\u20139.","journal-title":"Npj Digit Med"},{"key":"1839_CR47","doi-asserted-by":"publisher","DOI":"10.1101\/2020.07.17.20156265","volume-title":"Descriptive epidemiology of 16,780 hospitalized COVID-19 patients in the United States","author":"D Chawla","year":"2020","unstructured":"Chawla D, et al. Descriptive epidemiology of 16,780 hospitalized COVID-19 patients in the United States; 2020. Preprint at. https:\/\/doi.org\/10.1101\/2020.07.17.20156265."},{"key":"1839_CR48","doi-asserted-by":"crossref","unstructured":"Lekoubou A, Pelton M, Ba DM, Ssentongo P. Racial Disparities in Ischemic Stroke Among Patients with COVID-19 in the United States. J Stroke Cerebrovasc Dis. 2021;30(8):105877.","DOI":"10.1016\/j.jstrokecerebrovasdis.2021.105877"},{"key":"1839_CR49","doi-asserted-by":"publisher","first-page":"1107","DOI":"10.1093\/ije\/25.6.1107","volume":"25","author":"S Greenland","year":"1996","unstructured":"Greenland S. Basic methods for sensitivity analysis of biases. Int J Epidemiol. 1996;25:1107\u201316.","journal-title":"Int J Epidemiol"}],"container-title":["BMC Medical Research Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-023-01839-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12874-023-01839-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-023-01839-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,17]],"date-time":"2023-02-17T05:03:19Z","timestamp":1676610199000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/s12874-023-01839-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,17]]},"references-count":49,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["1839"],"URL":"https:\/\/doi.org\/10.1186\/s12874-023-01839-2","relation":{},"ISSN":["1471-2288"],"issn-type":[{"value":"1471-2288","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,17]]},"assertion":[{"value":"16 June 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 January 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 February 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The N3C data transfer to NCATS is performed under a Johns Hopkins University Reliance Protocol # IRB00249128 or individual site agreements with NIH. The N3C Data Enclave is managed under the authority of the NIH; information can be found at\n                      \n                      . Use of N3C data for this study does not involve human subjects (45 CFR 46.102) as determined by the NIH Office of IRB Operations.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors hereby declare no conflicting interests pertaining to the material in this manuscript.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"46"}}