{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T22:49:18Z","timestamp":1773269358351,"version":"3.50.1"},"reference-count":26,"publisher":"PeerJ","license":[{"start":{"date-parts":[[2019,5,24]],"date-time":"2019-05-24T00:00:00Z","timestamp":1558656000000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"\n Background<\/jats:title>\n \n A recent study concluded that most findings reported as significant in sports medicine and arthroscopic surgery are not \u201crobust\u201d when evaluated with the Fragility Index (FI). A secondary analysis of data from a previous study was performed to investigate (1) the correctness of the findings, (2) the association between FI,\n p<\/jats:italic>\n -value and post hoc power, (3) median power to detect a medium effect size, and (4) the implementation of sample size analysis in these randomized controlled trials (RCTs).\n <\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n \n In addition to the 48 studies listed in the appendix accompanying the original study by Khan et al. (2017) we did a follow-up literature search and 18 additional studies were found. In total 66 studies were included in the analysis. We calculated post hoc power,\n p<\/jats:italic>\n -values and confidence intervals associated with the main outcome variable. Use of a priori power analysis was recorded. The median power to detect small (\n h<\/jats:italic>\n > 0.2), medium (\n h<\/jats:italic>\n > 0.5), or large effect (\n h<\/jats:italic>\n > 0.8) with a baseline proportion of events of 10% and 30% in each study included was calculated. Three simulation data sets were used to validate our findings.\n <\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n Inconsistencies were found in eight studies. A priori power analysis was missing in one-fourth of studies (16\/66). The median power to detect a medium effect size with a baseline proportion of events of 10% and 30% was 42% and 43%, respectively. The FI was inherently associated with the achieved\n p<\/jats:italic>\n -value and post hoc power.\n <\/jats:p>\n <\/jats:sec>\n \n Discussion<\/jats:title>\n \n A relatively high proportion of studies had inconsistencies. The FI is a surrogate measure for\n p<\/jats:italic>\n -value and post hoc power. Based on these studies, the median power in this field of research is suboptimal. There is an urgent need to investigate how well research claims in orthopedics hold in a replicated setting and the validity of research findings.\n <\/jats:p>\n <\/jats:sec>","DOI":"10.7717\/peerj.6813","type":"journal-article","created":{"date-parts":[[2019,5,24]],"date-time":"2019-05-24T04:12:20Z","timestamp":1558671140000},"page":"e6813","source":"Crossref","is-referenced-by-count":15,"title":["Fragility Index, power, strength and robustness of findings in sports medicine and arthroscopic surgery: a secondary analysis of data from a study on use of the Fragility Index in sports surgery"],"prefix":"10.7717","volume":"7","author":[{"given":"Aleksi","family":"Reito","sequence":"first","affiliation":[{"name":"Department of Surgery, Central Finland Hospital, Jyv\u00e4skyl\u00e4, Keski-Suomi, Finland"},{"name":"Coxa Hospital for Joint Replacement Ltd, Tampere, Pirkanmaa, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lauri","family":"Raittio","sequence":"additional","affiliation":[{"name":"Medical School, University of Tampere, Tampere, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Olli","family":"Helminen","sequence":"additional","affiliation":[{"name":"Department of Surgery, Central Finland Hospital, Jyv\u00e4skyl\u00e4, Keski-Suomi, Finland"},{"name":"Cancer and Translational Medicine Research Unit, Oulu University Hospital, Oulu, Pohjois-Pohjanmaa, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"4443","published-online":{"date-parts":[[2019,5,24]]},"reference":[{"issue":"24","key":"10.7717\/peerj.6813\/ref-1","doi-asserted-by":"publisher","first-page":"2068","DOI":"10.2106\/jbjs.o.00012","article-title":"Is there truly \u201cno significant difference\u201d?: Underpowered randomized controlled trials in the orthopaedic literature","volume":"97","author":"Abdullah","year":"2015","journal-title":"Journal of Bone and Joint Surgery-American Volume"},{"issue":"6924","key":"10.7717\/peerj.6813\/ref-2","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1136\/bmj.308.6924.283","article-title":"The scandal of poor medical research","volume":"308","author":"Altman","year":"1994","journal-title":"BMJ"},{"issue":"9695","key":"10.7717\/peerj.6813\/ref-3","doi-asserted-by":"publisher","first-page":"1089","DOI":"10.1016\/s0140-6736(09)61083-7","article-title":"Evaluation and stages of surgical innovations","volume":"374","author":"Barkun","year":"2009","journal-title":"Lancet"},{"issue":"20","key":"10.7717\/peerj.6813\/ref-4","doi-asserted-by":"publisher","first-page":"e91","DOI":"10.2106\/jbjs.16.00479","article-title":"P-hacking in orthopaedic literature: a twist to the tail","volume":"98","author":"Bin Abd Razak","year":"2016","journal-title":"Journal of Bone and Joint Surgery"},{"issue":"5","key":"10.7717\/peerj.6813\/ref-5","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1038\/nrn3475","article-title":"Power failure: why small sample size undermines the reliability of neuroscience","volume":"14","author":"Button","year":"2013","journal-title":"Nature Reviews Neuroscience"},{"key":"10.7717\/peerj.6813\/ref-6","first-page":"346","article-title":"The Fragility Index: a P-value in sheep\u2019s clothing?","volume":"38","author":"Carter","year":"2017","journal-title":"European Heart Journal"},{"issue":"3","key":"10.7717\/peerj.6813\/ref-7","doi-asserted-by":"publisher","first-page":"140216","DOI":"10.1098\/rsos.140216","article-title":"An investigation of the false discovery rate and the misinterpretation of p-values","volume":"1","author":"Colquhoun","year":"2014","journal-title":"Royal Society Open Science"},{"issue":"12","key":"10.7717\/peerj.6813\/ref-8","doi-asserted-by":"publisher","first-page":"171085","DOI":"10.1098\/rsos.171085","article-title":"The reproducibility of research and the misinterpretation of p-values","volume":"4","author":"Colquhoun","year":"2017","journal-title":"Royal Society Open Science"},{"issue":"4","key":"10.7717\/peerj.6813\/ref-9","doi-asserted-by":"publisher","first-page":"286","DOI":"10.1111\/j.1745-6924.2008.00079.x","article-title":"Replication and p Intervals: p values predict the future only vaguely, but confidence intervals do much better","volume":"3","author":"Cumming","year":"2008","journal-title":"Perspectives on Psychological Science: A Journal of the Association for Psychological Science"},{"key":"10.7717\/peerj.6813\/ref-10","doi-asserted-by":"publisher","first-page":"e04333","DOI":"10.7554\/eLife.04333","article-title":"An open investigation of the reproducibility of cancer biology research","volume":"3","author":"Errington","year":"2014","journal-title":"eLife"},{"issue":"3","key":"10.7717\/peerj.6813\/ref-11","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1302\/0301-620x.83b3.10582","article-title":"Sample size and statistical power of randomised, controlled trials in orthopaedics","volume":"83","author":"Freedman","year":"2001","journal-title":"Journal of Bone and Joint Surgery"},{"issue":"12","key":"10.7717\/peerj.6813\/ref-12","doi-asserted-by":"publisher","first-page":"995","DOI":"10.7326\/0003-4819-130-12-199906150-00008","article-title":"Toward evidence-based medical statistics. 1: the P value fallacy","volume":"130","author":"Goodman","year":"1999","journal-title":"Annals of Internal Medicine"},{"issue":"341","key":"10.7717\/peerj.6813\/ref-13","doi-asserted-by":"publisher","first-page":"341ps12","DOI":"10.1126\/scitranslmed.aaf5027","article-title":"What does research reproducibility mean?","volume":"8","author":"Goodman","year":"2016","journal-title":"Science Translational Medicine"},{"issue":"3","key":"10.7717\/peerj.6813\/ref-14","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1038\/nmeth.3288","article-title":"The fickle P value generates irreproducible results","volume":"12","author":"Halsey","year":"2015","journal-title":"Nature Methods"},{"issue":"1","key":"10.7717\/peerj.6813\/ref-15","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1198\/000313001300339897","article-title":"The abuse of power: the pervasive fallacy of power calculations for data analysis","volume":"55","author":"Hoenig","year":"2001","journal-title":"American Statistician"},{"key":"10.7717\/peerj.6813\/ref-16","doi-asserted-by":"crossref","first-page":"e124","DOI":"10.1371\/journal.pmed.0020124","article-title":"Why most published research findings are false","volume":"2","author":"Ioannidis","year":"2005","journal-title":"PLOS Medicine"},{"issue":"5","key":"10.7717\/peerj.6813\/ref-17","doi-asserted-by":"publisher","first-page":"640","DOI":"10.1097\/ede.0b013e31818131e7","article-title":"Why most discovered true associations are inflated","volume":"19","author":"Ioannidis","year":"2008","journal-title":"Epidemiology"},{"issue":"9","key":"10.7717\/peerj.6813\/ref-18","doi-asserted-by":"publisher","first-page":"2164","DOI":"10.1177\/0363546516674469","article-title":"The fragility of statistically significant findings from randomized trials in sports surgery: a systematic survey","volume":"45","author":"Khan","year":"2017","journal-title":"American Journal of Sports Medicine"},{"issue":"6325","key":"10.7717\/peerj.6813\/ref-19","doi-asserted-by":"publisher","first-page":"584","DOI":"10.1126\/science.aal3618","article-title":"Measurement error and the replication crisis","volume":"355","author":"Loken","year":"2017","journal-title":"Science"},{"issue":"1","key":"10.7717\/peerj.6813\/ref-20","doi-asserted-by":"publisher","first-page":"0021","DOI":"10.1038\/s41562-016-0021","article-title":"A manifesto for reproducible science","volume":"1","author":"Munaf\u00f2","year":"2017","journal-title":"Nature Human Behaviour"},{"key":"10.7717\/peerj.6813\/ref-21","doi-asserted-by":"publisher","first-page":"e23383","DOI":"10.7554\/eLife.23383","article-title":"Making sense of replications","volume":"6","author":"Nosek","year":"2017","journal-title":"eLife"},{"issue":"4","key":"10.7717\/peerj.6813\/ref-22","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1080\/19312450701641375","article-title":"Brief report: post hoc power, observed power, a priori power, retrospective power, prospective power, achieved power: sorting out appropriate uses of statistical power analyses","volume":"1","author":"O\u2019Keefe","year":"2007","journal-title":"Communication Methods and Measures"},{"issue":"6251","key":"10.7717\/peerj.6813\/ref-23","doi-asserted-by":"publisher","first-page":"aac4716","DOI":"10.1126\/science.aac4716","article-title":"PSYCHOLOGY. Estimating the reproducibility of psychological science","volume":"349","author":"Open Science Collaboration","year":"2015","journal-title":"Science"},{"issue":"3","key":"10.7717\/peerj.6813\/ref-24","doi-asserted-by":"publisher","first-page":"e2000797","DOI":"10.1371\/journal.pbio.2000797","article-title":"Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature","volume":"15","author":"Szucs","year":"2017a","journal-title":"PLOS Biology"},{"key":"10.7717\/peerj.6813\/ref-25","doi-asserted-by":"publisher","first-page":"390","DOI":"10.3389\/fnhum.2017.00390","article-title":"When null hypothesis significance testing is unsuitable for research: a reassessment","volume":"11","author":"Szucs","year":"2017b","journal-title":"Frontiers in Human Neuroscience"},{"issue":"6","key":"10.7717\/peerj.6813\/ref-26","doi-asserted-by":"publisher","first-page":"622","DOI":"10.1016\/j.jclinepi.2013.10.019","article-title":"The statistical significance of randomized controlled trial results is frequently fragile: a case for a Fragility Index","volume":"67","author":"Walsh","year":"2014","journal-title":"Journal of Clinical Epidemiology"}],"container-title":["PeerJ"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/peerj.com\/articles\/6813.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/6813.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/6813.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/6813.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,5,24]],"date-time":"2019-05-24T04:12:26Z","timestamp":1558671146000},"score":1,"resource":{"primary":{"URL":"https:\/\/peerj.com\/articles\/6813"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,5,24]]},"references-count":26,"alternative-id":["10.7717\/peerj.6813"],"URL":"https:\/\/doi.org\/10.7717\/peerj.6813","archive":["CLOCKSS","LOCKSS","Portico"],"relation":{"has-review":[{"id-type":"doi","id":"10.7287\/peerj.6813v0.3\/reviews\/4","asserted-by":"object"},{"id-type":"doi","id":"10.7287\/peerj.6813v0.2\/reviews\/4","asserted-by":"object"},{"id-type":"doi","id":"10.7287\/peerj.6813v0.2\/reviews\/3","asserted-by":"object"},{"id-type":"doi","id":"10.7287\/peerj.6813v0.1\/reviews\/1","asserted-by":"object"},{"id-type":"doi","id":"10.7287\/peerj.6813v0.1\/reviews\/2","asserted-by":"object"}]},"ISSN":["2167-8359"],"issn-type":[{"value":"2167-8359","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,5,24]]},"article-number":"e6813"}}