{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,14]],"date-time":"2026-11-14T07:03:51Z","timestamp":1794639831659,"version":"4.9.1"},"reference-count":87,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2017,1,10]],"date-time":"2017-01-10T00:00:00Z","timestamp":1484006400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2017,1,10]],"date-time":"2017-01-10T00:00:00Z","timestamp":1484006400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Hum Behav"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Improving the reliability and efficiency of scientific research will increase the credibility of the published scientific literature and accelerate discovery. Here we argue for the adoption of measures to optimize key elements of the scientific process: methods, reporting and dissemination, reproducibility, evaluation and incentives. There is some evidence from both simulations and empirical studies supporting the likely effectiveness of these measures, but their broad adoption by researchers, institutions, funders and journals will require iterative evaluation and improvement. We discuss the goals of these measures, and how they can be implemented, in the hope that this will facilitate action toward improving the transparency, reproducibility and efficiency of scientific research.<\/jats:p>","DOI":"10.1038\/s41562-016-0021","type":"journal-article","created":{"date-parts":[[2017,1,10]],"date-time":"2017-01-10T11:42:05Z","timestamp":1484048525000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2490,"title":["A manifesto for reproducible science"],"prefix":"10.1038","volume":"1","author":[{"given":"Marcus R.","family":"Munaf\u00f2","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian A.","family":"Nosek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dorothy V. M.","family":"Bishop","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katherine S.","family":"Button","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher D.","family":"Chambers","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nathalie","family":"Percie du Sert","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Uri","family":"Simonsohn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eric-Jan","family":"Wagenmakers","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer J.","family":"Ware","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John P. A.","family":"Ioannidis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2017,1,10]]},"reference":[{"issue":"8","key":"BFs415620160021_CR1","doi-asserted-by":"publisher","first-page":"e124","DOI":"10.1371\/journal.pmed.0020124","volume":"2","author":"John P. A. Ioannidis","year":"2005","unstructured":"Ioannidis, J. P. A. Why most published research findings are false. PLoS Med. 2, e124 (2005).","journal-title":"PLoS Medicine"},{"key":"BFs415620160021_CR2","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1038\/nrn3475","volume":"14","author":"KS Button","year":"2013","unstructured":"Button, K. S. et al. Power failure: why small sample size undermines the reliability of neuroscience. Nat. Rev. Neurosci. 14, 365\u2013376 (2013).","journal-title":"Nat. Rev. Neurosci."},{"issue":"4","key":"BFs415620160021_CR3","doi-asserted-by":"publisher","first-page":"e10068","DOI":"10.1371\/journal.pone.0010068","volume":"5","author":"Daniele Fanelli","year":"2010","unstructured":"Fanelli, D. \u201cPositive\u201d results increase down the Hierarchy of the Sciences. PloS ONE 5, e10068 (2010).","journal-title":"PLoS ONE"},{"key":"BFs415620160021_CR4","doi-asserted-by":"publisher","first-page":"524","DOI":"10.1177\/0956797611430953","volume":"23","author":"LK John","year":"2012","unstructured":"John, L. K., Loewenstein, G. & Prelec, D. Measuring the prevalence of questionable research practices with incentives for truth telling. Psychol. Sci. 23, 524\u2013532 (2012).","journal-title":"Psychol. Sci."},{"key":"BFs415620160021_CR5","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1177\/1745691612460688","volume":"7","author":"MC Makel","year":"2012","unstructured":"Makel, M. C., Plucker, J. A. & Hegarty, B. Replications in psychology research: how often do they really occur? Perspect. Psychol. Sci. 7, 537\u2013542 (2012).","journal-title":"Perspect. Psychol. Sci."},{"key":"BFs415620160021_CR6","doi-asserted-by":"publisher","first-page":"726","DOI":"10.1037\/0003-066X.61.7.726","volume":"61","author":"JM Wicherts","year":"2006","unstructured":"Wicherts, J. M., Borsboom, D., Kats, J. & Molenaar, D. The poor availability of psychological research data for reanalysis. Am. Psychol. 61, 726\u2013728 (2006).","journal-title":"Am. Psychol."},{"key":"BFs415620160021_CR7","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1207\/s15327957pspr0203_4","volume":"2","author":"NL Kerr","year":"1998","unstructured":"Kerr, N. L. HARKing: hypothesizing after the results are known. Pers. Soc. Psychol. Rev. 2, 196\u2013217 (1998).","journal-title":"Pers. Soc. Psychol. Rev."},{"key":"BFs415620160021_CR8","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1016\/S0140-6736(13)62297-7","volume":"383","author":"R Al-Shahi Salman","year":"2014","unstructured":"Al-Shahi Salman, R. et al. Increasing value and reducing waste in biomedical research regulation and management. Lancet 383, 176\u2013185 (2014).","journal-title":"Lancet"},{"key":"BFs415620160021_CR9","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1161\/CIRCRESAHA.114.303819","volume":"116","author":"CG Begley","year":"2015","unstructured":"Begley, C. G. & Ioannidis, J. P. Reproducibility in science: improving the standard for basic and preclinical research. Circ. Res. 116, 116\u2013126 (2015).","journal-title":"Circ. Res."},{"key":"BFs415620160021_CR10","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1016\/S0140-6736(13)62229-1","volume":"383","author":"I Chalmers","year":"2014","unstructured":"Chalmers, I. et al. How to increase value and reduce waste when research priorities are set. Lancet 383, 156\u2013165 (2014).","journal-title":"Lancet"},{"key":"BFs415620160021_CR11","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1016\/S0140-6736(13)62296-5","volume":"383","author":"AW Chan","year":"2014","unstructured":"Chan, A. W. et al. Increasing value and reducing waste: addressing inaccessible research. Lancet 383, 257\u2013266 (2014).","journal-title":"Lancet"},{"key":"BFs415620160021_CR12","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1016\/S0140-6736(13)62228-X","volume":"383","author":"P Glasziou","year":"2014","unstructured":"Glasziou, P. et al. Reducing waste from incomplete or unusable reports of biomedical research. Lancet 383, 267\u2013276 (2014).","journal-title":"Lancet"},{"key":"BFs415620160021_CR13","doi-asserted-by":"publisher","first-page":"166","DOI":"10.1016\/S0140-6736(13)62227-8","volume":"383","author":"JP Ioannidis","year":"2014","unstructured":"Ioannidis, J. P. et al. Increasing value and reducing waste in research design, conduct, and analysis. Lancet 383, 166\u2013175 (2014).","journal-title":"Lancet"},{"key":"BFs415620160021_CR14","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1016\/S0140-6736(13)62329-6","volume":"383","author":"MR Macleod","year":"2014","unstructured":"Macleod, M. R. et al. Biomedical research: increasing value, reducing waste. Lancet 383, 101\u2013104 (2014).","journal-title":"Lancet"},{"key":"BFs415620160021_CR15","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1038\/533452a","volume":"533","author":"M Baker","year":"2016","unstructured":"Baker, M. 1,500 scientists lift the lid on reproducibility. Nature 533, 452\u2013454 (2016).","journal-title":"Nature"},{"key":"BFs415620160021_CR16","doi-asserted-by":"crossref","unstructured":"Ioannidis, J. P., Fanelli, D., Dunne, D. D. & Goodman, S. N. Meta-research: evaluation and improvement of research methods and practices. PLoS Biol. 13, e1002264 (2015).","DOI":"10.1371\/journal.pbio.1002264"},{"key":"BFs415620160021_CR17","doi-asserted-by":"publisher","first-page":"514","DOI":"10.1097\/01.ede.0000135915.94799.00","volume":"15","author":"N Paneth","year":"2004","unstructured":"Paneth, N. Assessing the contributions of John Snow to epidemiology: 150 years after removal of the broad street pump handle. Epidemiology 15, 514\u2013516 (2004).","journal-title":"Epidemiology"},{"key":"BFs415620160021_CR18","doi-asserted-by":"publisher","first-page":"1065","DOI":"10.1001\/archneur.1986.00520100069017","volume":"43","author":"EA Berker","year":"1986","unstructured":"Berker, E. A., Berker, A. H. & Smith, A. Translation of Broca's 1865 report. Localization of speech in the third left frontal convolution. Arch. Neurol. 43, 1065\u20131072 (1986).","journal-title":"Arch. Neurol"},{"key":"BFs415620160021_CR19","doi-asserted-by":"publisher","first-page":"358","DOI":"10.1126\/science.189.4200.358","volume":"189","author":"N Wade","year":"1975","unstructured":"Wade, N. Discovery of pulsars: a graduate student's story. Science 189, 358\u2013364 (1975).","journal-title":"Science"},{"key":"BFs415620160021_CR20","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1037\/1089-2680.2.2.175","volume":"2","author":"RS Nickerson","year":"1998","unstructured":"Nickerson, R. S. Confirmation bias: a ubiquitous phenomenon in many guises. Rev. Gen. Psychol. 2, 175\u2013220 (1998).","journal-title":"Rev. Gen. Psychol."},{"key":"BFs415620160021_CR21","volume-title":"The Hunt for Vulcan...and How Albert Einstein Destroyed a Planet, Discovered Relativity, and Deciphered the University","author":"T Levenson","year":"2015","unstructured":"Levenson, T. The Hunt for Vulcan...and How Albert Einstein Destroyed a Planet, Discovered Relativity, and Deciphered the University (Random House, 2015)."},{"key":"BFs415620160021_CR22","volume-title":"Experimenter Effects in Behavioral Research","author":"R Rosenthal","year":"1966","unstructured":"Rosenthal, R. Experimenter Effects in Behavioral Research (Appleton-Century-Crofts, 1966)."},{"key":"BFs415620160021_CR23","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1016\/j.actpsy.2014.02.001","volume":"148","author":"AD de Groot","year":"2014","unstructured":"de Groot, A. D. The meaning of \u201csignificance\u201d for different types of research [translated and annotated by Eric-Jan Wagenmakers, Denny Borsboom, Josine Verhagen, Rogier Kievit, Marjan Bakker, Angelique Cramer, Dora Matzke, Don Mellenbergh, and Han L. J. van der Maas]. Acta Psychol. 148, 188\u2013194 (2014).","journal-title":"Acta Psychol."},{"key":"BFs415620160021_CR24","doi-asserted-by":"crossref","unstructured":"Heininga, V. E., Oldehinkel, A. J., Veenstra, R. & Nederhof, E. I just ran a thousand analyses: benefits of multiple testing in understanding equivocal evidence on gene-environment interactions. PloS ONE 10, e0125383 (2015).","DOI":"10.1371\/journal.pone.0125383"},{"key":"BFs415620160021_CR25","doi-asserted-by":"publisher","first-page":"1046","DOI":"10.1016\/j.jclinepi.2015.05.029","volume":"68","author":"CJ Patel","year":"2015","unstructured":"Patel, C. J., Burford, B. & Ioannidis, J. P. Assessment of vibration of effects due to model specification can demonstrate the instability of observational associations. J. Clin. Epidemiol. 68, 1046\u20131058 (2015).","journal-title":"J. Clin. Epidemiol."},{"key":"BFs415620160021_CR26","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1016\/j.neuroimage.2012.07.004","volume":"63","author":"J Carp","year":"2012","unstructured":"Carp, J. The secret lives of experiments: methods reporting in the fMRI literature. Neuroimage 63, 289\u2013300 (2012).","journal-title":"Neuroimage"},{"key":"BFs415620160021_CR27","doi-asserted-by":"crossref","unstructured":"Carp, J. On the plurality of (methodological) worlds: estimating the analytic flexibility of FMRI experiments. Front. Neurosci. 6, 149 (2012).","DOI":"10.3389\/fnins.2012.00149"},{"key":"BFs415620160021_CR28","doi-asserted-by":"publisher","first-page":"534","DOI":"10.1037\/a0033242","volume":"143","author":"U Simonsohn","year":"2014","unstructured":"Simonsohn, U., Nelson, L. D. & Simmons, J. P. P-curve: a key to the file-drawer. J. Exp. Psychol. Gen. 143, 534\u2013547 (2014).","journal-title":"J. Exp. Psychol. Gen."},{"key":"BFs415620160021_CR29","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1038\/526182a","volume":"526","author":"R Nuzzo","year":"2015","unstructured":"Nuzzo, R. Fooling ourselves. Nature 526, 182\u2013185 (2015).","journal-title":"Nature"},{"key":"BFs415620160021_CR30","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1038\/526187a","volume":"526","author":"R MacCoun","year":"2015","unstructured":"MacCoun, R. & Perlmutter, S. Blind analysis: hide results to seek the truth. Nature 526, 187\u2013189 (2015).","journal-title":"Nature"},{"key":"BFs415620160021_CR31","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1007\/s10654-016-0149-3","volume":"31","author":"S Greenland","year":"2016","unstructured":"Greenland, S. et al. Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations. Eur. J. Epidemiol. 31, 337\u2013350 (2016).","journal-title":"Eur. J. Epidemiol."},{"key":"BFs415620160021_CR32","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1136\/bmj.322.7280.226","volume":"322","author":"JA Sterne","year":"2001","unstructured":"Sterne, J. A. & Davey Smith, G. Sifting the evidence\u2014what's wrong with significance tests? BMJ 322, 226\u2013231 (2001).","journal-title":"BMJ"},{"key":"BFs415620160021_CR33","doi-asserted-by":"publisher","first-page":"645","DOI":"10.2466\/pms.106.2.645-649","volume":"106","author":"A Brand","year":"2008","unstructured":"Brand, A., Bradley, M. T., Best, L. A. & Stoica, G. Accuracy of effect size estimates from published psychological research. Percept. Motor Skill. 106, 645\u2013649 (2008).","journal-title":"Percept. Motor Skill"},{"key":"BFs415620160021_CR34","doi-asserted-by":"publisher","first-page":"1037","DOI":"10.1080\/17470218.2014.885986","volume":"67","author":"I Vankov","year":"2014","unstructured":"Vankov, I., Bowers, J. & Munaf\u00f2, M. R. On the persistence of low power in psychological science. Q. J. Exp. Psychol. 67, 1037\u20131040 (2014).","journal-title":"Q. J. Exp. Psychol."},{"key":"BFs415620160021_CR35","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1037\/0033-2909.105.2.309","volume":"105","author":"P Sedlmeier","year":"1989","unstructured":"Sedlmeier, P. & Gigerenzer, G. Do studies of statistical power have an effect on the power of studies? Psychol. Bull. 105, 309\u2013316 (1989).","journal-title":"Psychol. Bull."},{"key":"BFs415620160021_CR36","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1037\/h0045186","volume":"65","author":"J Cohen","year":"1962","unstructured":"Cohen, J. The statistical power of abnormal-social psychological research: a review. J. Abnorm. Soc. Psychol. 65, 145\u2013153 (1962).","journal-title":"J. Abnorm. Soc. Psychol."},{"key":"BFs415620160021_CR37","doi-asserted-by":"publisher","first-page":"815","DOI":"10.1111\/j.1360-0443.2007.01822.x","volume":"102","author":"JF Etter","year":"2007","unstructured":"Etter, J. F., Burri, M. & Stapleton, J. The impact of pharmaceutical company funding on results of randomized trials of nicotine replacement therapy for smoking cessation: a meta-analysis. Addiction 102, 815\u2013822 (2007).","journal-title":"Addiction"},{"key":"BFs415620160021_CR38","doi-asserted-by":"publisher","first-page":"831","DOI":"10.1016\/j.jclinepi.2008.09.015","volume":"62","author":"JF Etter","year":"2009","unstructured":"Etter, J. F. & Stapleton, J. Citations to trials of nicotine replacement therapy were biased toward positive results and high-impact-factor journals. J. Clin. Epidemiol. 62, 831\u2013837 (2009).","journal-title":"J. Clin. Epidemiol."},{"key":"BFs415620160021_CR39","doi-asserted-by":"publisher","first-page":"740","DOI":"10.1016\/j.jclinepi.2012.01.008","volume":"65","author":"OA Panagiotou","year":"2012","unstructured":"Panagiotou, O. A. & Ioannidis, J. P. Primary study authors of significant studies are more likely to believe that a strong association exists in a heterogeneous meta-analysis compared with methodologists. J. Clin. Epidemiol. 65, 740\u2013747 (2012).","journal-title":"J. Clin. Epidemiol."},{"key":"BFs415620160021_CR40","doi-asserted-by":"publisher","first-page":"615","DOI":"10.1177\/1745691612459058","volume":"7","author":"BA Nosek","year":"2012","unstructured":"Nosek, B. A., Spies, J. R. & Motyl, M. Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability. Perspect. Psychol. Sci. 7, 615\u2013631 (2012).","journal-title":"Perspect. Psychol. Sci."},{"key":"BFs415620160021_CR41","doi-asserted-by":"publisher","first-page":"471","DOI":"10.1111\/j.1747-4949.2009.00386.x","volume":"4","author":"PMW Bath","year":"2009","unstructured":"Bath, P. M. W., Macleod, M. R. & Green, A. R. Emulating multicentre clinical stroke trials: a new paradigm for studying novel interventions in experimental models of stroke. Int. J. Stroke 4, 471\u2013479 (2009).","journal-title":"Int. J. Stroke"},{"key":"BFs415620160021_CR42","doi-asserted-by":"publisher","first-page":"1754","DOI":"10.1161\/STROKEAHA.113.000734","volume":"44","author":"U Dirnagl","year":"2013","unstructured":"Dirnagl, U. et al. A concerted appeal for international cooperation in preclinical stroke research. Stroke 44, 1754\u20131760 (2013).","journal-title":"Stroke"},{"key":"BFs415620160021_CR43","doi-asserted-by":"publisher","first-page":"843","DOI":"10.1161\/STROKEAHA.114.007560","volume":"46","author":"X Milidonis","year":"2015","unstructured":"Milidonis, X., Marshall, I., Macleod, M. R. & Sena, E. S. Magnetic resonance imaging in experimental stroke and comparison with histology systematic review and meta-analysis. Stroke 46, 843\u2013851 (2015).","journal-title":"Stroke"},{"key":"BFs415620160021_CR44","doi-asserted-by":"publisher","first-page":"142","DOI":"10.1027\/1864-9335\/a000178","volume":"45","author":"RA Klein","year":"2014","unstructured":"Klein, R. A. et al. Investigating variation in replicability: a \u201cmany labs\u201d replication project. Soc. Psychol. 45, 142\u2013152 (2014).","journal-title":"Soc. Psychol."},{"key":"BFs415620160021_CR45","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1016\/j.jesp.2015.10.012","volume":"67","author":"CR Ebersole","year":"2016","unstructured":"Ebersole, C. R. et al. Many Labs 3: evaluating participant pool quality across the academic semester via replication. J. Exp. Soc. Psychol. 67, 68\u201382 (2016).","journal-title":"J. Exp. Soc. Psychol."},{"key":"BFs415620160021_CR46","doi-asserted-by":"crossref","unstructured":"Lenzer, J., Hoffman, J. R., Furberg, C. D. & Ioannidis, J. P. A. Ensuring the integrity of clinical practice guidelines: a tool for protecting patients. BMJ 347, f5535 (2013).","DOI":"10.1136\/bmj.f5535"},{"key":"BFs415620160021_CR47","first-page":"30","volume":"54","author":"TD Sterling","year":"1959","unstructured":"Sterling, T. D. Publication decisions and their possible effects on inferences drawn from tests of significance\u2014or vice versa. J. Am. Stat. Assoc. 54, 30\u201334 (1959).","journal-title":"J. Am. Stat. Assoc."},{"key":"BFs415620160021_CR48","doi-asserted-by":"publisher","first-page":"638","DOI":"10.1037\/0033-2909.86.3.638","volume":"86","author":"R Rosenthal","year":"1979","unstructured":"Rosenthal, R. File drawer problem and tolerance for null results. Psychol. Bull. 86, 638\u2013641 (1979).","journal-title":"Psychol. Bull."},{"key":"BFs415620160021_CR49","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1037\/h0076157","volume":"82","author":"TD Sterling","year":"1975","unstructured":"Sterling, T. D. Consequence of prejudice against the null hypothesis. Psychol. Bull. 82, 1\u201320 (1975).","journal-title":"Psychol. Bull."},{"key":"BFs415620160021_CR50","doi-asserted-by":"publisher","first-page":"1502","DOI":"10.1126\/science.1255484","volume":"345","author":"A Franco","year":"2014","unstructured":"Franco, A., Malhotra, N. & Simonovits, G. Publication bias in the social sciences: unlocking the file drawer. Science 345, 1502\u20131505 (2014).","journal-title":"Science"},{"key":"BFs415620160021_CR51","doi-asserted-by":"publisher","first-page":"1359","DOI":"10.1177\/0956797611417632","volume":"22","author":"JP Simmons","year":"2011","unstructured":"Simmons, J. P., Nelson, L. D. & Simonsohn, U. False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychol. Sci. 22, 1359\u20131366 (2011).","journal-title":"Psychol. Sci."},{"key":"BFs415620160021_CR52","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1016\/j.cortex.2012.12.016","volume":"49","author":"CD Chambers","year":"2013","unstructured":"Chambers, C. D. Registered Reports: a new publishing initiative at Cortex. Cortex 49, 609\u2013610 (2013).","journal-title":"Cortex"},{"key":"BFs415620160021_CR53","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1027\/1864-9335\/a000192","volume":"45","author":"BA Nosek","year":"2014","unstructured":"Nosek, B. A. & Lakens, D. Registered Reports: a method to increase the credibility of published results. Soc. Psychol. 45, 137\u2013141 (2014).","journal-title":"Soc. Psychol."},{"key":"BFs415620160021_CR54","doi-asserted-by":"publisher","first-page":"1422","DOI":"10.1126\/science.aab2374","volume":"348","author":"BA Nosek","year":"2015","unstructured":"Nosek, B. A. et al. Promoting an open research culture. Science 348, 1422\u20131425 (2015).","journal-title":"Science"},{"key":"BFs415620160021_CR55","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1001\/jama.1996.03540080059030","volume":"276","author":"C Begg","year":"1996","unstructured":"Begg, C. et al. Improving the quality of reporting of randomized controlled trials: the CONSORT statement. JAMA 276, 637\u2013639 (1996).","journal-title":"JAMA"},{"key":"BFs415620160021_CR56","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1001\/jama.1994.03520020048013","volume":"272","author":"D Moher","year":"1994","unstructured":"Moher, D., Dulberg, C. S. & Wells, G. A. Statistical power, sample size, and their reporting in randomized controlled trials. JAMA 272, 122\u2013124 (1994).","journal-title":"JAMA"},{"key":"BFs415620160021_CR57","doi-asserted-by":"crossref","unstructured":"Schulz, K. F., Altman, D. G., Moher, D. & Group, C. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ 340, c332 (2010).","DOI":"10.1136\/bmj.c332"},{"key":"BFs415620160021_CR58","doi-asserted-by":"publisher","first-page":"595","DOI":"10.1177\/1049731513498118","volume":"23","author":"S Grant","year":"2013","unstructured":"Grant, S. et al. Developing a reporting guideline for social and psychological intervention trials. Res. Social Work Prac. 23, 595\u2013602 (2013).","journal-title":"Res. Social Work Prac."},{"key":"BFs415620160021_CR59","doi-asserted-by":"crossref","unstructured":"Liberati, A. et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 6, e1000100 (2009).","DOI":"10.1371\/journal.pmed.1000100"},{"key":"BFs415620160021_CR60","doi-asserted-by":"publisher","first-page":"g7647","DOI":"10.1136\/bmj.g7647","volume":"349","author":"L Shamseer","year":"2016","unstructured":"Shamseer, L. et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ 349, g7647 (2015); erratum 354, i4086 (2016).","journal-title":"BMJ"},{"key":"BFs415620160021_CR61","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1016\/j.jesp.2016.03.004","volume":"67","author":"A van \u2018t Veer","year":"2016","unstructured":"van \u2018t Veer, A. & Giner-Sorolla, R. Pre-registration in social psychology: a discussion and suggested template. J. Exp. Soc. Psychol. 67, 2\u201312 (2016).","journal-title":"J. Exp. Soc. Psychol."},{"key":"BFs415620160021_CR62","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1177\/1948550615598377","volume":"7","author":"A Franco","year":"2016","unstructured":"Franco, A., Malhotra, N. & Simonovits, G. Underreporting in psychology experiments: evidence from a study registry. Soc. Psychol. Per. Sci. 7, 8\u201312 (2016).","journal-title":"Soc. Psychol. Per. Sci."},{"key":"BFs415620160021_CR63","doi-asserted-by":"crossref","unstructured":"Alsheikh-Ali, A. A., Qureshi, W., Al-Mallah, M. H. & Ioannidis, J. P. Public availability of published research data in high-impact journals. PloS ONE 6, e24357 (2011).","DOI":"10.1371\/journal.pone.0024357"},{"key":"BFs415620160021_CR64","doi-asserted-by":"crossref","unstructured":"Iqbal, S. A., Wallach, J. D., Khoury, M. J., Schully, S. D. & Ioannidis, J. P. Reproducible research practices and transparency across the biomedical literature. PLoS Biol. 14, e1002333 (2016).","DOI":"10.1371\/journal.pbio.1002333"},{"issue":"6290","key":"BFs415620160021_CR65","doi-asserted-by":"publisher","first-page":"1147","DOI":"10.1126\/science.aag2359","volume":"352","author":"Marcia McNutt","year":"2016","unstructured":"McNutt, M. Taking up TOP. Science 352, 1147 (2016).","journal-title":"Science"},{"key":"BFs415620160021_CR66","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1038\/nature12786","volume":"506","author":"IU Park","year":"2014","unstructured":"Park, I. U., Peacey, M. W. & Munaf\u00f2, M. R. Modelling the effects of subjective and objective decision making in scientific peer review. Nature 506, 93\u201396 (2014).","journal-title":"Nature"},{"key":"BFs415620160021_CR67","doi-asserted-by":"crossref","unstructured":"Button, K. S., Bal, L., Clark, A. G. & Shipley, T. Preventing the ends from justifying the means: withholding results to address publication bias in peer-review. BMC Psychol. 4, 59 (2016).","DOI":"10.1186\/s40359-016-0167-7"},{"key":"BFs415620160021_CR68","doi-asserted-by":"publisher","first-page":"899","DOI":"10.1126\/science.aaf9133","volume":"352","author":"JM Berg","year":"2016","unstructured":"Berg, J. M. et al. Preprints for the life sciences. Science 352, 899\u2013901 (2016).","journal-title":"Science"},{"key":"BFs415620160021_CR69","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1080\/1047840X.2012.692215","volume":"23","author":"BA Nosek","year":"2012","unstructured":"Nosek, B. A. & Bar-Anan, T. Scientific utopia: I. Opening scientific communication. Psychol. Inq. 23, 217\u2013243 (2012).","journal-title":"Psychol. Inq."},{"key":"BFs415620160021_CR70","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1192\/bjp.176.1.47","volume":"176","author":"E Walsh","year":"2000","unstructured":"Walsh, E., Rooney, M., Appleby, L. & Wilkinson, G. Open peer review: a randomised trial. Brit. J. Psychiat. 176, 47\u201351 (2000).","journal-title":"Brit. J. Psychiat."},{"key":"BFs415620160021_CR71","doi-asserted-by":"crossref","unstructured":"Smaldino, P. E. & McElreath, R. The natural selection of bad science. R. Soc. Open Sci. 3, 160384 (2016).","DOI":"10.1098\/rsos.160384"},{"key":"BFs415620160021_CR72","doi-asserted-by":"crossref","unstructured":"Higginson, A. D. & Munaf\u00f2, M. Current incentives for scientists lead to underpowered studies with erroneous conclusions. PLoS Biol. 14, e2000995 (2016).","DOI":"10.1371\/journal.pbio.2000995"},{"issue":"10","key":"BFs415620160021_CR73","doi-asserted-by":"publisher","first-page":"e1001747","DOI":"10.1371\/journal.pmed.1001747","volume":"11","author":"John P. A. Ioannidis","year":"2014","unstructured":"Ioannidis, J. P. How to make more published research true. PLoS Med. 11, e1001747 (2014).","journal-title":"PLoS Medicine"},{"key":"BFs415620160021_CR74","doi-asserted-by":"publisher","first-page":"7900","DOI":"10.1073\/pnas.1602413113","volume":"113","author":"A Eklund","year":"2016","unstructured":"Eklund, A., Nichols, T. E. & Knutsson, H. Cluster failure: why fMRI inferences for spatial extent have inflated false-positive rates. Proc. Natl Acad. Sci. USA 113, 7900\u20137905 (2016).","journal-title":"Proc. Natl Acad. Sci. USA"},{"issue":"5","key":"BFs415620160021_CR75","doi-asserted-by":"publisher","first-page":"e1002456","DOI":"10.1371\/journal.pbio.1002456","volume":"14","author":"Mallory C. Kidwell","year":"2016","unstructured":"Kidwell, M. C. et al. Badges to acknowledge open practices: a simple, low-cost, effective method for increasing transparency. PLoS Biol. 14, e1002456 (2016).","journal-title":"PLOS Biology"},{"key":"BFs415620160021_CR76","doi-asserted-by":"publisher","first-page":"871","DOI":"10.1038\/nbt.3004","volume":"32","author":"M Munaf\u00f2","year":"2014","unstructured":"Munaf\u00f2, M. et al. Scientific rigor and the art of motorcycle maintenance. Nat. Biotechnol. 32, 871\u2013873 (2014).","journal-title":"Nat. Biotechnol."},{"issue":"6","key":"BFs415620160021_CR77","doi-asserted-by":"publisher","first-page":"e1004961","DOI":"10.1371\/journal.pcbi.1004961","volume":"12","author":"Robert E. Kass","year":"2016","unstructured":"Kass, R. E. et al. Ten simple rules for effective statistical practice. PLoS Comput. Biol. 12, e1004961 (2016).","journal-title":"PLOS Computational Biology"},{"key":"BFs415620160021_CR78","first-page":"55","volume":"66","author":"M Schweinsberg","year":"2016","unstructured":"Schweinsberg, M. et al. The pipeline project: pre-publication independent replications of a single laboratory's research pipeline. J. Exp. Psychol. Gen. 66, 55\u201367 (2016).","journal-title":"J. Exp. Psychol. Gen."},{"issue":"jun25 2","key":"BFs415620160021_CR79","doi-asserted-by":"publisher","first-page":"g3804","DOI":"10.1136\/bmj.g3804","volume":"348","author":"A. Stevens","year":"2014","unstructured":"Stevens, A. et al. Relation of completeness of reporting of health research to journals' endorsement of reporting guidelines: systematic review. BMJ 348, g3804 (2014).","journal-title":"BMJ"},{"issue":"11","key":"BFs415620160021_CR80","doi-asserted-by":"publisher","first-page":"e7824","DOI":"10.1371\/journal.pone.0007824","volume":"4","author":"Carol Kilkenny","year":"2009","unstructured":"Kilkenny, C. et al. Survey of the quality of experimental design, statistical analysis and reporting of research using animals. PloS ONE 4, e7824 (2009).","journal-title":"PLoS ONE"},{"key":"BFs415620160021_CR81","doi-asserted-by":"crossref","unstructured":"Baker, D., Lidster, K., Sottomayor, A. & Amor, S. Two years later: journals are not yet enforcing the ARRIVE guidelines on reporting standards for pre-clinical animal studies. PLoS Biol. 12, e1001756 (2014).","DOI":"10.1371\/journal.pbio.1001756"},{"key":"BFs415620160021_CR82","doi-asserted-by":"crossref","unstructured":"Gulin, J. E., Rocco, D. M. & Garcia-Bournissen, F. Quality of reporting and adherence to ARRIVE guidelines in animal studies for Chagas disease preclinical drug research: a systematic review. PLoS Negl. Trop. Dis. 9, e0004194 (2015).","DOI":"10.1371\/journal.pntd.0004194"},{"issue":"5","key":"BFs415620160021_CR83","doi-asserted-by":"publisher","first-page":"e0154657","DOI":"10.1371\/journal.pone.0154657","volume":"11","author":"Yali Liu","year":"2016","unstructured":"Liu, Y. et al. Adherence to ARRIVE guidelines in Chinese journal reports on neoplasms in animals. PloS ONE 11, e0154657 (2016).","journal-title":"PLOS ONE"},{"key":"BFs415620160021_CR84","doi-asserted-by":"crossref","unstructured":"Gotzsche, P. C. & Ioannidis, J. P. Content area experts as authors: helpful or harmful for systematic reviews and meta-analyses? BMJ 345, e7031 (2012).","DOI":"10.1136\/bmj.e7031"},{"issue":"1","key":"BFs415620160021_CR85","doi-asserted-by":"publisher","first-page":"150547","DOI":"10.1098\/rsos.150547","volume":"3","author":"Richard D. Morey","year":"2016","unstructured":"Morey, R. D. et al. The Peer Reviewers' Openness Initiative: incentivizing open research practices through peer review. R. Soc. Open Sci. 3, 150547 (2016).","journal-title":"Royal Society Open Science"},{"key":"BFs415620160021_CR86","doi-asserted-by":"publisher","unstructured":"Simmons, J. P., Nelson, L. D. & Simonsohn, U. A 21 word solution. Preprint at http:\/\/dx.doi.org\/10.2139\/ssrn.2160588(2012).","DOI":"10.2139\/ssrn.2160588(2012)"},{"key":"BFs415620160021_CR87","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1177\/0956797613512465","volume":"25","author":"E Eich","year":"2014","unstructured":"Eich, E. Business not as usual. Psychol. Sci. 25, 3\u20136 (2014).","journal-title":"Psychol. Sci."}],"container-title":["Nature Human Behaviour"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41562-016-0021.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41562-016-0021","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41562-016-0021.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,20]],"date-time":"2024-03-20T10:08:29Z","timestamp":1710929309000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41562-016-0021"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,1,10]]},"references-count":87,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2017,1]]}},"alternative-id":["BFs415620160021"],"URL":"https:\/\/doi.org\/10.1038\/s41562-016-0021","relation":{"has-review":[{"id-type":"doi","id":"10.3410\/f.727189988.793527393","asserted-by":"object"}]},"ISSN":["2397-3374"],"issn-type":[{"value":"2397-3374","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,1,10]]},"assertion":[{"value":"10 January 2017","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"M.R.M, together with C.D.C and D.V.M.B., has received funding from the BBSRC (grant number BB\/N019660\/1) to convene a workshop on advanced methods for reproducible science, and is chair of the CHDI Foundation Independent Statistical Standing Committee. B.A.N. is executive director of the non-profit Center for Open Science with a mission to increase openness, integrity and reproducibility of research. N.P.d.S. leads the NC3Rs programme of work on experimental design, which developed the ARRIVE guidelines and Experimental Design Assistant. J.J.W. is director, experimental design, at CHDI Management\/CHDI Foundation, a non-profit biomedical research organization exclusively dedicated to developing therapeutics for Huntington's disease. The other authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"0021"}}