{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T10:29:22Z","timestamp":1740133762643,"version":"3.37.3"},"reference-count":49,"publisher":"Oxford University Press (OUP)","issue":"1146","license":[{"start":{"date-parts":[[2020,3,10]],"date-time":"2020-03-10T00:00:00Z","timestamp":1583798400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,4,1]]},"abstract":"<jats:title>ABSTRACT<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>To show that overpowered trials claim statistical significance detouring clinical relevance and warrant the need of superiority margin to avoid such misinterpretation.<\/jats:p><\/jats:sec><jats:sec><jats:title>Design<\/jats:title><jats:p>Selective review of articles published in the New England Journal of Medicine between 1 January 2015 and 31 December 2018 and meta-analysis following Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist.<\/jats:p><\/jats:sec><jats:sec><jats:title>Eligibility criteria for selecting studies and methods<\/jats:title><jats:p>Published superiority trials evaluating cardiovascular diseases and diabetes mellitus with positive efficacy outcome were eligible. Fixed effects meta-analysis was performed using RevMan V.5.3 to calculate overall effect estimate, pooled HR and it was compared with mean clinically significant difference.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Thirteen eligible trials with 164\u2009721 participants provided the quantitative data for this review. Largely, the primary efficacy endpoint in these trials was the composite of cardiovascular death, non-fatal myocardial infarction, unstable angina requiring rehospitalisation, coronary revascularisation and fatal or non-fatal stroke. The pooled HR was 0.86 (95% CI 0.84 to 0.89, I2=45%) which was lower than the mean clinically significant difference of 0.196 (19.6%, range: 0.09375\u20130.35) of these studies. There was a wide 95%\u2009CI in these studies from 0.56 to 0.99. The upper margin of CI in most of the studies was close to the line of no difference. Absolute risk reduction was small (1.19% to 2.3%) translating to a high median number needed to treat of 63 (range: 43 to 84) over a follow-up duration of 2.95 years.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The results of this meta-analysis indicate that overpowered trials give statistically significant results undermining clinical relevance. To avoid such misuse of current statistical tools, there is a need to derive superiority margin. We hope to generate debate on considering clinically significant difference, used to calculate sample size, as superiority margin.<\/jats:p><\/jats:sec>","DOI":"10.1136\/postgradmedj-2019-136569","type":"journal-article","created":{"date-parts":[[2020,3,10]],"date-time":"2020-03-10T21:17:19Z","timestamp":1583875039000},"page":"227-233","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":1,"title":["Meta-analysis of cardiovascular superiority trials published in the<i>New England Journal of Medicine<\/i>to elucidate the concept of superiority margin"],"prefix":"10.1093","volume":"97","author":[{"given":"Nanda","family":"Gamad","sequence":"first","affiliation":[{"name":"Department of Pharmacology, Postgraduate Institute of Medical Education and Research , Chandigarh, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nusrat","family":"Shafiq","sequence":"additional","affiliation":[{"name":"Department of Pharmacology, Postgraduate Institute of Medical Education and Research , Chandigarh, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6049-1628","authenticated-orcid":false,"given":"Samir","family":"Malhotra","sequence":"additional","affiliation":[{"name":"Department of Pharmacology, Postgraduate Institute of Medical Education and Research , Chandigarh, India"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2020,3,10]]},"reference":[{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"38","DOI":"10.7326\/ACPJC-2004-140-2-A11","article-title":"Superiority trials, noninferiority trials, and prisoners of the 2-sided null hypothesis","volume":"140","author":"Sackett","year":"2004","journal-title":"ACP J Club"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"1520","DOI":"10.1001\/archderm.140.12.1520","article-title":"Statistical significance and clinical relevance: the importance of power in clinical trials in dermatology","volume":"140","author":"Bhardwaj","year":"2004","journal-title":"Arch Dermatol"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1136\/postgradmedj-2015-133769","article-title":"Superiority trials: statistical trickery or mass blindness?","volume":"92","author":"Shafiq","year":"2016","journal-title":"Postgrad Med J"},{"key":"2023041707100995000_","first-page":"4S","article-title":"Defining a clinically meaningful effect for the design and interpretation of randomized controlled trials","volume":"10","author":"Keefe","year":"2013","journal-title":"Innov Clin Neurosci"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1186\/1471-2288-10-93","article-title":"What differences are detected by superiority trials or ruled out by noninferiority trials? A cross-sectional study on a random sample of two-hundred two-arms parallel group randomized clinical trials","volume":"10","author":"Gayet-Ageron","year":"2010","journal-title":"BMC Med Res Methodol"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1136\/ebmed-2015-110280","article-title":"Superiority trials: raising the bar of null hypothesis statistical testing","volume":"20","author":"Shafiq","year":"2015","journal-title":"Evid Based Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1136\/ebmed-2017-110881","article-title":"Effect size in CANTOS trial","volume":"23","author":"Gamad","year":"2018","journal-title":"BMJ Evid Based Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1186\/s12874-018-0594-7","article-title":"Characterising and justifying sample size sufficiency in Interview-Based studies: systematic analysis of qualitative health research over a 15-year period","volume":"18","author":"Vasileiou","year":"2018","journal-title":"BMC Med Res Methodol"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"1429","DOI":"10.1001\/jama.2018.1536","article-title":"The Proposal to Lower P Value Thresholds to .005","volume":"319","author":"Ioannidis","year":"2018","journal-title":"JAMA"},{"volume-title":"Statistical power analysis for the behavioral sciences","year":"1988","author":"Cohen","key":"2023041707100995000_"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"h2206","DOI":"10.1136\/bmj.h2206","article-title":"Measuring the benefit of treatment: number needed to treat","volume":"350","author":"Sedgwick","year":"2015","journal-title":"BMJ"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"264","DOI":"10.7326\/0003-4819-151-4-200908180-00135","article-title":"Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement","volume":"151","author":"Moher","year":"2009","journal-title":"Ann Intern Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"1489","DOI":"10.1056\/NEJMoa1501031","article-title":"Odyssey long term Investigators. efficacy and safety of alirocumab in reducing lipids and cardiovascular events","volume":"372","author":"Robinson","year":"2015","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1056\/NEJMoa1411892","article-title":"A randomized, controlled trial of 3.0 Mg of liraglutide in weight management","volume":"373","author":"Pi-Sunyer","year":"2015","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1056\/NEJMoa1400283","article-title":"Antisense inhibition of apolipoprotein C-III in patients with hypertriglyceridemia","volume":"373","author":"Gaudet","year":"2015","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"2129","DOI":"10.1056\/NEJMoa1509351","article-title":"Home use of an artificial beta cell in type 1 diabetes","volume":"373","author":"Thabit","year":"2015","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1056\/NEJMoa1509819","article-title":"Metformin versus placebo in obese pregnant women without diabetes mellitus","volume":"374","author":"Syngelaki","year":"2016","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"644","DOI":"10.1056\/NEJMoa1602494","article-title":"Closed-Loop insulin delivery during pregnancy in women with type 1 diabetes","volume":"375","author":"Stewart","year":"2016","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"1430","DOI":"10.1056\/NEJMoa1615758","article-title":"Inclisiran in patients at high cardiovascular risk with elevated LDL cholesterol","volume":"376","author":"Ray","year":"2017","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"1517","DOI":"10.1056\/NEJMoa1614062","article-title":"Lipid-reduction variability and antidrug-antibody formation with bococizumab","volume":"376","author":"Ridker","year":"2017","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"1627","DOI":"10.1056\/NEJMoa1701005","article-title":"RE-CIRCUIT Investigators. uninterrupted dabigatran versus warfarin for Ablationin atrial fibrillation","volume":"376","author":"Calkins","year":"2017","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"2337","DOI":"10.1056\/NEJMoa1708337","article-title":"Effects of Sotagliflozin added to insulin in patients with type 1 diabetes","volume":"377","author":"Garg","year":"2017","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1056\/NEJMoa1701329","article-title":"Cardiovascular and metabolic effects of ANGPTL3 antisense oligonucleotides","volume":"377","author":"Graham","year":"2017","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"711","DOI":"10.1056\/NEJMoa1806842","article-title":"A randomized trial of epinephrine in out-of-hospital cardiac arrest","volume":"379","author":"Perkins","year":"2018","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"2097","DOI":"10.1056\/NEJMoa1801174","article-title":"Alirocumab and cardiovascular outcomes after acute coronary syndrome","volume":"379","author":"Schwartz","year":"2018","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"1217","DOI":"10.1056\/NEJMoa1706444","article-title":"Effects of anacetrapib in patients with atherosclerotic vascular disease","volume":"377","author":"Bowman","year":"2017","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1056\/NEJMoa1804988","article-title":"Effects of aspirin for primary prevention in persons with diabetes mellitus","volume":"379","author":"Bowman","year":"2018","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"1319","DOI":"10.1056\/NEJMoa1709118","article-title":"Rivaroxaban with or without aspirin in stable cardiovascular disease","volume":"377","author":"Eikelboom","year":"2017","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"1119","DOI":"10.1056\/NEJMoa1707914","article-title":"Antiinflammatory therapy with canakinumab for atherosclerotic disease","volume":"377","author":"Ridker","year":"2017","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"644","DOI":"10.1056\/NEJMoa1611925","article-title":"Canagliflozin and cardiovascular and renal events in type 2 diabetes","volume":"377","author":"Neal","year":"2017","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"1713","DOI":"10.1056\/NEJMoa1615664","article-title":"Evolocumab and clinical outcomes in patients with cardiovascular disease","volume":"376","author":"Sabatine","year":"2017","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"1834","DOI":"10.1056\/NEJMoa1607141","article-title":"Semaglutide and cardiovascular outcomes in patients with type 2 diabetes","volume":"375","author":"Marso","year":"2016","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1056\/NEJMoa1603827","article-title":"Liraglutide and cardiovascular outcomes in type 2 diabetes","volume":"375","author":"Marso","year":"2016","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"2032","DOI":"10.1056\/NEJMoa1600177","article-title":"Blood-Pressure and cholesterol lowering in persons without cardiovascular disease","volume":"374","author":"Yusuf","year":"2016","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"2021","DOI":"10.1056\/NEJMoa1600176","article-title":"Cholesterol lowering in intermediate-risk persons without cardiovascular disease","volume":"374","author":"Yusuf","year":"2016","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"2117","DOI":"10.1056\/NEJMoa1504720","article-title":"Empagliflozin, cardiovascular outcomes, and mortality in type 2 diabetes","volume":"373","author":"Zinman","year":"2015","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"2103","DOI":"10.1056\/NEJMoa1511939","article-title":"A randomized trial of intensive versus standard blood-pressure control","volume":"373","author":"Wright","year":"2015","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"2387","DOI":"10.1056\/NEJMoa1410489","article-title":"Ezetimibe added to statin therapy after acute coronary syndromes","volume":"372","author":"Cannon","year":"2015","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"1791","DOI":"10.1056\/NEJMoa1500857","article-title":"Long-Term use of ticagrelor in patients with prior myocardial infarction","volume":"372","author":"Bonaca","year":"2015","journal-title":"N Engl J Med"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1056\/NEJMoa1708454","article-title":"Dual antithrombotic therapy with dabigatran after PCI in atrial fibrillation","volume":"377","author":"Cannon","year":"2017","journal-title":"N Engl J Med"},{"article-title":"Cochrane Handbook for systematic reviews of interventions version 5.1.0. The Cochrane collaboration","year":"2011","author":"Higgins","key":"2023041707100995000_"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1186\/1745-6215-8-16","article-title":"Practical methods for incorporating summary time-to-event data into meta-analysis","volume":"8","author":"Tierney","year":"2007","journal-title":"Trials"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"e012594","DOI":"10.1136\/bmjopen-2016-012594","article-title":"Non-Inferiority trials: are they inferior? A systematic review of reporting in major medical journals","volume":"6","author":"Rehal","year":"2016","journal-title":"BMJ Open"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1503\/cmaj.080484","article-title":"The \"number needed to treat\" turns 20\u2014and continues to be used and misused","volume":"179","author":"McAlister","year":"2008","journal-title":"CMAJ"},{"key":"2023041707100995000_","first-page":"21","article-title":"P-value, a true test of statistical significance? A cautionary note","volume":"6","author":"Dahiru","year":"2008","journal-title":"Ann Ib Postgrad Med"},{"key":"2023041707100995000_","first-page":"108","article-title":"The power of \"p\": on overpowered clinical trials and \"positive\" results","volume":"2","author":"Hochster","year":"2008","journal-title":"Gastrointest Cancer Res"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"e0132578","DOI":"10.1371\/journal.pone.0132578","article-title":"Sample size calculation: inaccurate a priori assumptions for nuisance parameters can greatly affect the power of a randomized controlled trial","volume":"10","author":"Tavernier","year":"2015","journal-title":"PLoS One"},{"key":"2023041707100995000_","doi-asserted-by":"crossref","first-page":"1814","DOI":"10.1097\/00000542-200006000-00042","article-title":"Current issues in clinical trial design: superiority versus equivalency studies","volume":"92","author":"Landow","year":"2000","journal-title":"Anesthesiology"},{"key":"2023041707100995000_","first-page":"150","article-title":"Superiority, equivalence, and non-inferiority trials","volume":"66","author":"Lesaffre","year":"2008","journal-title":"Bull NYU Hosp Jt Dis"}],"container-title":["Postgraduate Medical Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/pmj\/article-pdf\/97\/1146\/227\/49920709\/postgradmedj-97-227.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/pmj\/article-pdf\/97\/1146\/227\/49920709\/postgradmedj-97-227.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T12:29:29Z","timestamp":1695904169000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/pmj\/article\/97\/1146\/227\/6969639"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,10]]},"references-count":49,"journal-issue":{"issue":"1146","published-online":{"date-parts":[[2020,3,10]]},"published-print":{"date-parts":[[2021,4,1]]}},"URL":"https:\/\/doi.org\/10.1136\/postgradmedj-2019-136569","relation":{},"ISSN":["1469-0756","0032-5473"],"issn-type":[{"type":"electronic","value":"1469-0756"},{"type":"print","value":"0032-5473"}],"subject":[],"published-other":{"date-parts":[[2021,4]]},"published":{"date-parts":[[2020,3,10]]}}}