{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T06:09:57Z","timestamp":1783490997120,"version":"3.55.0"},"reference-count":38,"publisher":"BMJ","license":[{"start":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T00:00:00Z","timestamp":1652140800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000027","name":"National Institute on Alcohol Abuse and Alcoholism","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000027","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ"],"accepted":{"date-parts":[[2022,3,2]]},"abstract":"Abstract<\/jats:title>\n \n Objective<\/jats:title>\n To systematically identify, match, and compare treatment effects and study demographics from individual or meta-analysed observational studies and randomized controlled trials (RCTs) evaluating the same covid-19 treatments, comparators, and outcomes.<\/jats:p>\n <\/jats:sec>\n \n Design<\/jats:title>\n Meta-epidemiological study.<\/jats:p>\n <\/jats:sec>\n \n Data sources<\/jats:title>\n \n National Institutes of Health Covid-19 Treatment Guidelines, a living review and network meta-analysis published in\n The BMJ<\/jats:italic>\n , a living systematic review with meta-analysis and trial sequential analysis in\n PLOS Medicine<\/jats:italic>\n (The LIVING Project), and the Epistemonikos \u201cLiving OVerview of Evidence\u201d (L\u00b7OVE) evidence database.\n <\/jats:p>\n <\/jats:sec>\n \n Eligibility criteria for selection of studies<\/jats:title>\n \n RCTs in\n The BMJ<\/jats:italic>\n \u2019s living review that directly compared any of the three most frequently studied therapeutic interventions for covid-19 across all data sources (that is, hydroxychloroquine, lopinavir-ritonavir, or dexamethasone) for any safety and efficacy outcomes. Observational studies that evaluated the same interventions, comparisons, and outcomes that were reported in\n The BMJ<\/jats:italic>\n \u2019s living review.\n <\/jats:p>\n <\/jats:sec>\n \n Data extraction and synthesis<\/jats:title>\n \n Safety and efficacy outcomes from observational studies were identified and treatment effects for dichotomous (odds ratios) or continuous (mean differences or ratios of means) outcomes were calculated and, when possible, meta-analyzed to match the treatment effects from individual RCTs or meta-analyses of RCTs reported in\n The BMJ<\/jats:italic>\n \u2019s living review with the same interventions, comparisons, and outcomes (that is, matched pairs). The analysis compared the distribution of study demographics and the agreement between treatment effects from matched pairs. Matched pairs were in agreement if both observational and RCT treatment effects were significantly increasing or decreasing (P<0.05) or if both treatment effects were not significant (P\u22650.05).\n <\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n 17 new, independent meta-analyses of observational studies were conducted that compared hydroxychloroquine, lopinavir-ritonavir, or dexamethasone with an active or placebo comparator for any safety or efficacy outcomes in covid-19 treatment. These studies were matched and compared with 17 meta-analyses of RCTs reported in\n The BMJ<\/jats:italic>\n \u2019s living review. 10 additional matched pairs with only one observational study and\/or one RCT were identified. Across all 27 matched pairs, 22 had adequate reporting of demographical and clinical data for all individual studies. All 22 matched pairs had studies with overlapping distributions of sex, age, and disease severity. Overall, 21 (78%) of the 27 matched pairs had treatment effects that were in agreement. Among the 17 matched pairs consisting of meta-analyses of observational studies and meta-analyses of RCTs, 14 (82%) were in agreement; seven (70%) of the 10 matched pairs consisting of at least one observational study or one RCT were in agreement. The 18 matched pairs with treatment effects for dichotomous outcomes had a higher proportion of agreement (n=16, 89%) than did the nine matched pairs with treatment effects for continuous outcomes (n=5, 56%).\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Meta-analyses of observational studies and RCTs evaluating treatments for covid-19 have summary treatment effects that are generally in agreement. Although our evaluation is limited to three covid-19 treatments, these findings suggest that meta-analyzed evidence from observational studies might complement, but should not replace, evidence collected from RCTs.<\/jats:p>\n <\/jats:sec>","DOI":"10.1136\/bmj-2021-069400","type":"journal-article","created":{"date-parts":[[2022,5,19]],"date-time":"2022-05-19T15:14:23Z","timestamp":1652973263000},"page":"e069400","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":20,"title":["Agreement of treatment effects from observational studies and randomized controlled trials evaluating hydroxychloroquine, lopinavir-ritonavir, or dexamethasone for covid-19: meta-epidemiological study"],"prefix":"10.1136","volume":"377","author":[{"given":"Osman","family":"Moneer","sequence":"first","affiliation":[{"name":"Yale School of Medicine, Yale University, New Haven, CT, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Garrison","family":"Daly","sequence":"additional","affiliation":[{"name":"Center for Science in the Public Interest, Washington, DC, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joshua J","family":"Skydel","sequence":"additional","affiliation":[{"name":"Dartmouth-Hitchcock Medical Center, Lebanon, NH, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kate","family":"Nyhan","sequence":"additional","affiliation":[{"name":"Harvey Cushing\/John Hay Whitney Medical Library, Yale University, New Haven, CT, USA"},{"name":"Department of Environmental Health Sciences, Yale School of Public Health, New Haven, CT, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Lurie","sequence":"additional","affiliation":[{"name":"Center for Science in the Public Interest, Washington, DC, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joseph S","family":"Ross","sequence":"additional","affiliation":[{"name":"Section of General Medicine and the National Clinician Scholars Program, Department of Internal Medicine, Yale School of Medicine, New Haven, CT, USA"},{"name":"Center for Outcomes Research and Evaluation, Yale-New Haven Health System, New Haven, CT, USA"},{"name":"Department of Health Policy and Management, Yale School of Public Health, New Haven, CT, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2816-6905","authenticated-orcid":false,"given":"Joshua D","family":"Wallach","sequence":"additional","affiliation":[{"name":"Department of Environmental Health Sciences, Yale School of Public Health, New Haven, CT, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2022,5,10]]},"reference":[{"key":"2025110101512013000_377.may10_4.e069400.1","doi-asserted-by":"publisher","DOI":"10.1136\/adc.2004.058222"},{"key":"2025110101512013000_377.may10_4.e069400.2","unstructured":"NEJM. Real-world evidence\u2014what is it and what can it tell us? Accessed 23 December, 2020. https:\/\/www.nejm.org\/doi\/pdf\/10.1056\/NEJMsb1609216"},{"key":"2025110101512013000_377.may10_4.e069400.3","doi-asserted-by":"publisher","DOI":"10.1186\/s13063-015-1023-4"},{"key":"2025110101512013000_377.may10_4.e069400.4","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-021-02020-6"},{"key":"2025110101512013000_377.may10_4.e069400.5","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa0802395"},{"key":"2025110101512013000_377.may10_4.e069400.6","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa0707571"},{"key":"2025110101512013000_377.may10_4.e069400.7","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.k119"},{"key":"2025110101512013000_377.may10_4.e069400.8","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa1611925"},{"key":"2025110101512013000_377.may10_4.e069400.9","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.i493"},{"key":"2025110101512013000_377.may10_4.e069400.10","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2019.10.012"},{"key":"2025110101512013000_377.may10_4.e069400.11","doi-asserted-by":"publisher","DOI":"10.1001\/jama.286.7.821"},{"key":"2025110101512013000_377.may10_4.e069400.12","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2020.2904"},{"key":"2025110101512013000_377.may10_4.e069400.13","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(20)31180-6"},{"key":"2025110101512013000_377.may10_4.e069400.14","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa2007621"},{"key":"2025110101512013000_377.may10_4.e069400.15","unstructured":"COVID-19 Treatment Guidelines Panel. COVID-19 treatment guidelines. Accessed 31 December, 2020. https:\/\/www.covid19treatmentguidelines.nih.gov\/therapeutic-management\/"},{"key":"2025110101512013000_377.may10_4.e069400.16","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.m2980"},{"key":"2025110101512013000_377.may10_4.e069400.17","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1003293"},{"key":"2025110101512013000_377.may10_4.e069400.18","unstructured":"COVID-19 Evidence Hub. Center for Science in the Public Interest. 2020. https:\/\/cspinet.org\/covid-19-evidence-hub"},{"key":"2025110101512013000_377.may10_4.e069400.19","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCULATIONAHA.120.051718"},{"key":"2025110101512013000_377.may10_4.e069400.20","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.l4898"},{"key":"2025110101512013000_377.may10_4.e069400.21","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.i4919"},{"key":"2025110101512013000_377.may10_4.e069400.22","doi-asserted-by":"publisher","DOI":"10.1002\/9781119536604.ch11"},{"key":"2025110101512013000_377.may10_4.e069400.23","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-14-25"},{"key":"2025110101512013000_377.may10_4.e069400.24","doi-asserted-by":"publisher","DOI":"10.1093\/jac\/dkab163"},{"key":"2025110101512013000_377.may10_4.e069400.25","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.MR000034.pub2"},{"key":"2025110101512013000_377.may10_4.e069400.26","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0020811"},{"key":"2025110101512013000_377.may10_4.e069400.27","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-107-2-224"},{"key":"2025110101512013000_377.may10_4.e069400.28","unstructured":"World Health Organization. Therapeutics and covid-19: living guideline. Accessed 5 November, 2021. https:\/\/www.who.int\/publications-detail-redirect\/WHO-2019-nCoV-therapeutics-2021.3"},{"key":"2025110101512013000_377.may10_4.e069400.29","unstructured":"US Food and Drug Administration. Framework for FDA\u2019s real-world evidence program. Accessed 15 January, 2021. https:\/\/www.fda.gov\/media\/120060\/download"},{"key":"2025110101512013000_377.may10_4.e069400.30","doi-asserted-by":"publisher","DOI":"10.1002\/cpt.1351"},{"key":"2025110101512013000_377.may10_4.e069400.31","unstructured":"Gottlieb S. Breaking down barriers between clinical trials and clinical care: incorporating real world evidence into regulatory decision making, 28 January 2019. US Food and Drug Administration. 2019. https:\/\/www.fda.gov\/news-events\/speeches-fda-officials\/breaking-down-barriers-between-clinical-trials-and-clinical-care-incorporating-real-world-evidence"},{"key":"2025110101512013000_377.may10_4.e069400.32","unstructured":"Real-World Evidence Collaborative. Margolis Center for Health Policy. Accessed 9 February, 2021. https:\/\/healthpolicy.duke.edu\/projects\/real-world-evidence-collaborative"},{"key":"2025110101512013000_377.may10_4.e069400.33","doi-asserted-by":"publisher","DOI":"10.1002\/cpt.1426"},{"key":"2025110101512013000_377.may10_4.e069400.34","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-021-01920-x"},{"key":"2025110101512013000_377.may10_4.e069400.35","doi-asserted-by":"publisher","DOI":"10.1001\/jama.1995.03520290060030"},{"key":"2025110101512013000_377.may10_4.e069400.36","doi-asserted-by":"publisher","DOI":"10.1001\/jama.291.22.2720"},{"key":"2025110101512013000_377.may10_4.e069400.37","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2020.37640"},{"key":"2025110101512013000_377.may10_4.e069400.38","doi-asserted-by":"publisher","DOI":"10.1186\/s13063-016-1322-4"}],"container-title":["BMJ"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/data.bmj.org\/tdm\/10.1136\/bmj-2021-069400","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmj-2021-069400","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,1]],"date-time":"2025-11-01T08:51:30Z","timestamp":1761987090000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.bmj.com\/lookup\/doi\/10.1136\/bmj-2021-069400"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,10]]},"references-count":38,"alternative-id":["10.1136\/bmj-2021-069400"],"URL":"https:\/\/doi.org\/10.1136\/bmj-2021-069400","relation":{},"ISSN":["1756-1833"],"issn-type":[{"value":"1756-1833","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,10]]}}}