{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T01:46:21Z","timestamp":1793065581698,"version":"4.5.0"},"update-to":[{"DOI":"10.12688\/f1000research.12037.1","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2017,11,29]],"date-time":"2017-11-29T00:00:00Z","timestamp":1511913600000}},{"DOI":"10.12688\/f1000research.12037.2","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2017,11,29]],"date-time":"2017-11-29T00:00:00Z","timestamp":1511913600000}}],"reference-count":296,"publisher":"F1000 Research Ltd","license":[{"start":{"date-parts":[[2017,11,29]],"date-time":"2017-11-29T00:00:00Z","timestamp":1511913600000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020","doi-asserted-by":"crossref","award":["643410, H2020-EINFRA-2014-1"],"award-info":[{"award-number":["643410, H2020-EINFRA-2014-1"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["f1000research.com"],"crossmark-restriction":false},"short-container-title":["F1000Res"],"abstract":"<ns4:p>Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With the advent of web technologies, we are now witnessing a phase of innovation and experimentation in our approaches to peer review. These developments prompted us to examine emerging models of peer review from a range of disciplines and venues, and to ask how they might address some of the issues with our current systems of peer review. We examine the functionality of a range of social Web platforms, and compare these with the traits underlying a viable peer review system: quality control, quantified performance metrics as engagement incentives, and certification and reputation. Ideally, any new systems will demonstrate that they out-perform and reduce the biases of existing models as much as possible. We conclude that there is considerable scope for new peer review initiatives to be developed, each with their own potential issues and advantages. We also propose a novel hybrid platform model that could, at least partially, resolve many of the socio-technical issues associated with peer review, and potentially disrupt the entire scholarly communication system. Success for any such development relies on reaching a critical threshold of research community engagement with both the process and the platform, and therefore cannot be achieved without a significant change of incentives in research environments.<\/ns4:p>","DOI":"10.12688\/f1000research.12037.3","type":"journal-article","created":{"date-parts":[[2017,11,29]],"date-time":"2017-11-29T09:11:11Z","timestamp":1511946671000},"page":"1151","update-policy":"https:\/\/doi.org\/10.12688\/f1000research.crossmark-policy","source":"Crossref","is-referenced-by-count":186,"title":["A multi-disciplinary perspective on emergent and future innovations in peer review"],"prefix":"10.12688","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7794-0218","authenticated-orcid":false,"given":"Jonathan P.","family":"Tennant","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8525-6221","authenticated-orcid":false,"given":"Jonathan M.","family":"Dugan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Graziotin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9069-4143","authenticated-orcid":false,"given":"Damien C.","family":"Jacques","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5599-7456","authenticated-orcid":false,"given":"Fran\u00e7ois","family":"Waldner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9488-1870","authenticated-orcid":false,"given":"Daniel","family":"Mietchen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4639-436X","authenticated-orcid":false,"given":"Yehia","family":"Elkhatib","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5767-8486","authenticated-orcid":false,"given":"Lauren","family":"B. Collister","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4455-8036","authenticated-orcid":false,"given":"Christina K.","family":"Pikas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5196-9389","authenticated-orcid":false,"given":"Tom","family":"Crick","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3699-1195","authenticated-orcid":false,"given":"Paola","family":"Masuzzo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1763-8970","authenticated-orcid":false,"given":"Anthony","family":"Caravaggi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1193-3848","authenticated-orcid":false,"given":"Devin R.","family":"Berg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4425-7097","authenticated-orcid":false,"given":"Kyle E.","family":"Niemeyer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4470-7027","authenticated-orcid":false,"given":"Tony","family":"Ross-Hellauer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1433-6782","authenticated-orcid":false,"given":"Sara","family":"Mannheimer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9178-0422","authenticated-orcid":false,"given":"Lillian","family":"Rigling","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5934-7525","authenticated-orcid":false,"given":"Daniel S.","family":"Katz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9925-9623","authenticated-orcid":false,"given":"Bastian","family":"Greshake Tzovaras","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2251-8092","authenticated-orcid":false,"given":"Josmel","family":"Pacheco-Mendoza","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7791-4984","authenticated-orcid":false,"given":"Nazeefa","family":"Fatima","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0026-989X","authenticated-orcid":false,"given":"Marta","family":"Poblet","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8498-1309","authenticated-orcid":false,"given":"Marios","family":"Isaakidis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1526-0863","authenticated-orcid":false,"given":"Dasapta Erwin","family":"Irawan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8111-5082","authenticated-orcid":false,"given":"S\u00e9bastien","family":"Renaut","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3228-6501","authenticated-orcid":false,"given":"Christopher R.","family":"Madan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2612-2132","authenticated-orcid":false,"given":"Lisa","family":"Matthias","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9183-9861","authenticated-orcid":false,"given":"Jesper","family":"N\u00f8rgaard Kj\u00e6r","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0127-4893","authenticated-orcid":false,"given":"Daniel Paul","family":"O'Donnell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0068-716X","authenticated-orcid":false,"given":"Cameron","family":"Neylon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5640-909X","authenticated-orcid":false,"given":"Sarah","family":"Kearns","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6439-5652","authenticated-orcid":false,"given":"Manojkumar","family":"Selvaraju","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3127-5520","authenticated-orcid":false,"given":"Julien","family":"Colomb","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2560","published-online":{"date-parts":[[2017,11,29]]},"reference":[{"key":"ref-1","article-title":"Climate scientists hit out at \u2018sloppy\u2019 melting glaciers error.","author":"D Adam","year":"2010","journal-title":"The Guardian."},{"key":"ref-2","article-title":"Practical Ethics of the Physician (Adab al-Tabib)","author":"I Al-Rahawi"},{"key":"ref-3","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1186\/s41073-016-0022-7","article-title":"Is it becoming harder to secure reviewers for peer review? a test with data from five ecology journals.","volume":"1","author":"A Albert","year":"2016","journal-title":"Research Integrity and Peer Review."},{"key":"ref-4","doi-asserted-by":"publisher","first-page":"e0179031","DOI":"10.1371\/journal.pone.0179031","article-title":"A prospective study on an innovative online forum for peer reviewing of surgical science.","volume":"12","author":"M Almquist","year":"2017","journal-title":"PLoS One."},{"key":"ref-5","doi-asserted-by":"publisher","first-page":"967-987","DOI":"10.1177\/0170840614530916","article-title":"Habitat and habitus: Boxed-in versus box-breaking research.","volume":"35","author":"M Alvesson","year":"2014","journal-title":"Organization Studies."},{"key":"ref-6","doi-asserted-by":"publisher","first-page":"136-151","DOI":"10.1632\/prof.2011.2011.1.136","article-title":"Engaging digital scholarship: Thoughts on evaluating multimedia scholarship.","author":"S Anderson","year":"2011","journal-title":"Profession."},{"key":"ref-7","article-title":"Mastering Bitcoin: unlocking digital cryptocurrencies.","author":"A Antonopoulos","year":"2014"},{"key":"ref-8","doi-asserted-by":"publisher","first-page":"63-84","DOI":"10.1007\/s11948-997-0017-3","article-title":"Peer review for journals: Evidence on quality control, fairness, and innovation.","volume":"3","author":"J Armstrong","year":"1997","journal-title":"Sci Eng Ethics."},{"key":"ref-9","article-title":"arXiv monthly submission rates","year":"2017"},{"key":"ref-10","doi-asserted-by":"publisher","first-page":"131-138","DOI":"10.1111\/j.1365-2648.2008.04816.x","article-title":"Blinding in peer review: the preferences of reviewers for nursing journals.","volume":"64","author":"J Baggs","year":"2008","journal-title":"J Adv Nurs."},{"key":"ref-11","doi-asserted-by":"publisher","first-page":"337-352","DOI":"10.1098\/rsnr.2015.0029","article-title":"Credibility, peer review, and Nature, 1945\u20131990","volume":"69","author":"M Baldwin","year":"2015","journal-title":"Notes Rec R Soc Lond."},{"key":"ref-12","doi-asserted-by":"publisher","first-page":"44-49","DOI":"10.1063\/PT.3.3463","article-title":"In referees we trust?","volume":"70","author":"M Baldwin","year":"2017a","journal-title":"Phys Today."},{"key":"ref-13","doi-asserted-by":"publisher","DOI":"10.1063\/PT.5.9098","article-title":"What it was like to be peer reviewed in the 1860s.","author":"M Baldwin","year":"2017b","journal-title":"Phys Today."},{"key":"ref-14","article-title":"Annotated bibliography on evaluating digital scholarship for tenure and promotion","author":"C Ball","year":"2016"},{"key":"ref-295","doi-asserted-by":"publisher","DOI":"10.5256\/f1000research.14133.r27486","article-title":"Referee report for: A multidisciplinary perspective on emergent and future innovations in peer review [version 2; referees: 2 approved]","author":"V Barbour","year":"2017"},{"key":"ref-15","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.60223","article-title":"Blockchain for science and knowledge creation","author":"S Bartling","year":"2016","journal-title":"Zenodo."},{"key":"ref-16","doi-asserted-by":"publisher","first-page":"310-317","DOI":"10.1016\/S0196-0644(98)70006-X","article-title":"Who reviews the reviewers? Feasibility of using a fictitious manuscript to evaluate peer reviewer performance.","volume":"32","author":"W Baxt","year":"1998","journal-title":"Ann Emerg Med."},{"key":"ref-17","doi-asserted-by":"publisher","first-page":"331-338","DOI":"10.1177\/1056492603258974","article-title":"The manuscript review process the proper roles of authors, referees, and editors.","volume":"12","author":"A Bedeian","year":"2003","journal-title":"J Manage Inquiry."},{"key":"ref-18","doi-asserted-by":"publisher","first-page":"52-66","DOI":"10.1109\/MS.2013.13","article-title":"Social networking meets software development: Perspectives from GitHub, MSDN, Stack Exchange, and TopCoder.","volume":"30","author":"A Begel","year":"2013","journal-title":"IEEE Software."},{"key":"ref-19","doi-asserted-by":"publisher","DOI":"10.3998\/3336451.0017.304","article-title":"Peer review personas.","volume":"17","author":"N Belojevic","year":"2014","journal-title":"J Electron Publ."},{"key":"ref-20","doi-asserted-by":"publisher","first-page":"166-182","DOI":"10.1016\/j.ijforecast.2010.03.003","article-title":"The predictive validity of peer review: A selective review of the judgmental forecasting qualities of peers, and implications for innovation in science.","volume":"27","author":"W Benda","year":"2011","journal-title":"Int J Forecasting."},{"key":"ref-21","doi-asserted-by":"publisher","DOI":"10.1126\/science.aab2568","article-title":"Updated: Sexist peer review elicits furious twitter response, PLOS apology.","author":"R Bernstein","year":"2015","journal-title":"Science."},{"key":"ref-22","doi-asserted-by":"publisher","first-page":"269-277","DOI":"10.3233\/ISU-140749","article-title":"EPISCIENCES \u2013 an overlay publication platform.","volume":"34","author":"C Berthaud","year":"2014","journal-title":"Information Services Use."},{"key":"ref-23","doi-asserted-by":"publisher","first-page":"11-45","DOI":"10.1080\/1045722022000003435","article-title":"From book censorship to academic peer review.","volume":"12","author":"M Biagioli","year":"2002","journal-title":"Emergences: Journal for the Study of Media & Composite Cultures."},{"key":"ref-45","doi-asserted-by":"publisher","DOI":"10.6084\/m9.figshare.4884878.v1","article-title":"What might peer review look like in 2030?","year":"2017","journal-title":"figshare."},{"key":"ref-24","doi-asserted-by":"publisher","first-page":"73-88","DOI":"10.1108\/14684520810865994","article-title":"Wikipedia and academic peer review: Wikipedia as a recognised medium for scholarly publication?","volume":"32","author":"E Black","year":"2008","journal-title":"Online Inform Rev."},{"key":"ref-25","first-page":"1041-1067","article-title":"The effects of double-blind versus single-blind reviewing: Experimental evidence from the american economic review.","volume":"81","author":"R Blank","year":"1991","journal-title":"Am Econ Rev."},{"key":"ref-26","doi-asserted-by":"publisher","first-page":"907-909","DOI":"10.1104\/pp.15.01443","article-title":"Vigilante Science.","volume":"169","author":"M Blatt","year":"2015","journal-title":"Plant Physiol."},{"key":"ref-27","doi-asserted-by":"publisher","first-page":"238-242","DOI":"10.3138\/jsp.42.2.238","article-title":"Extending ArXiv.org to achieve open peer review and publishing.","volume":"42","author":"A Boldt","year":"2011","journal-title":"J Scholarly Publ."},{"key":"ref-28","article-title":"Novel processes and metrics for a scientific evaluation rooted in the principles of science - Version 1","author":"M Bon","year":"2017"},{"key":"ref-29","doi-asserted-by":"publisher","first-page":"72-77","DOI":"10.2533\/chimia.2010.72","article-title":"How long is the peer review process for journal manuscripts? A case study on Angewandte Chemie International Edition.","volume":"64","author":"L Bornmann","year":"2010a","journal-title":"Chimia (Aarau)."},{"key":"ref-30","doi-asserted-by":"publisher","first-page":"124-131","DOI":"10.1087\/20100207","article-title":"Reliability of reviewers\u2019 ratings when using public peer review: a case study.","volume":"23","author":"L Bornmann","year":"2010b","journal-title":"Learn Publ."},{"key":"ref-31","doi-asserted-by":"publisher","first-page":"2215-2222","DOI":"10.1002\/asi.23329","article-title":"Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references.","volume":"66","author":"L Bornmann","year":"2015","journal-title":"J Assoc Inf Sci Technol."},{"key":"ref-32","doi-asserted-by":"publisher","first-page":"843-856","DOI":"10.1007\/s11192-011-0569-5","article-title":"Closed versus open reviewing of journal manuscripts: how far do comments differ in language use?","volume":"91","author":"L Bornmann","year":"2012","journal-title":"Scientometrics."},{"key":"ref-33","doi-asserted-by":"publisher","DOI":"10.15200\/winn.142497.72083","article-title":"The cost of the rejection-resubmission cycle.","author":"B Brembs","year":"2015","journal-title":"The Winnower."},{"key":"ref-34","doi-asserted-by":"publisher","first-page":"291","DOI":"10.3389\/fnhum.2013.00291","article-title":"Deep impact: unintended consequences of journal rank.","volume":"7","author":"B Brembs","year":"2013","journal-title":"Front Hum Neurosci."},{"key":"ref-35","doi-asserted-by":"publisher","first-page":"595-600","DOI":"10.1017\/S1049096515000827","article-title":"Reviewer fatigue? why scholars decline to review their peers\u2019 work.","volume":"48","author":"M Breuning","year":"2015","journal-title":"PS: Polit Sci Polit."},{"key":"ref-36","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1186\/s12916-016-0631-5","article-title":"Impact of interventions to improve the quality of peer review of biomedical journals: a systematic review and meta-analysis.","volume":"14","author":"R Bruce","year":"2016","journal-title":"BMC Med."},{"key":"ref-37","doi-asserted-by":"publisher","first-page":"4-6","DOI":"10.1016\/j.tree.2007.07.008","article-title":"Double-blind review favours increased representation of female authors.","volume":"23","author":"A Budden","year":"2008","journal-title":"Trends Ecol Evol."},{"key":"ref-38","doi-asserted-by":"publisher","first-page":"e0173610","DOI":"10.1371\/journal.pone.0173610","article-title":"The myopia of crowds: Cognitive load and collective evaluation of answers on stack exchange.","volume":"12","author":"K Burghardt","year":"2017","journal-title":"PLoS One."},{"key":"ref-39","doi-asserted-by":"publisher","first-page":"1323-1329","DOI":"10.1001\/jama.1990.03440100023003","article-title":"The evolution of editorial peer review.","volume":"263","author":"J Burnham","year":"1990","journal-title":"JAMA."},{"key":"ref-40","doi-asserted-by":"publisher","first-page":"239-264","DOI":"10.1177\/000312240406900205","article-title":"The academic caste system: Prestige hierarchies in PhD exchange networks.","volume":"69","author":"V Burris","year":"2004","journal-title":"Am Sociol Rev."},{"key":"ref-41","doi-asserted-by":"publisher","first-page":"181-211","DOI":"10.1177\/1075547098019003002","article-title":"Peer review for journals as it stands today\u2014part 1.","volume":"19","author":"J Campanario","year":"1998a","journal-title":"Sci Commun."},{"key":"ref-42","doi-asserted-by":"publisher","first-page":"277-306","DOI":"10.1177\/1075547098019004002","article-title":"Peer review for journals as it stands today\u2014part 2.","volume":"19","author":"J Campanario","year":"1998b","journal-title":"Sci Commun."},{"key":"ref-43","article-title":"Proof of prespecified endpoints in medical research with the bitcoin blockchain.","author":"B Carlisle","year":"2014","journal-title":"The Grey Literature."},{"key":"ref-44","doi-asserted-by":"publisher","first-page":"1763-1771","DOI":"10.1002\/asi.23665","article-title":"Attitudes of referees in a multidisciplinary journal: An empirical analysis.","volume":"68","author":"N Casnici","year":"2017","journal-title":"J Assoc Inf Sci Technol."},{"key":"ref-46","doi-asserted-by":"publisher","first-page":"4-17","DOI":"10.3934\/Neuroscience.2014.1.4","article-title":"Instead of \u201cplaying the game\u201d it is time to change the rules: Registered Reports at AIMS Neuroscience and beyond.","volume":"1","author":"C Chambers","year":"2014","journal-title":"AIMS Neurosci."},{"key":"ref-47","doi-asserted-by":"publisher","first-page":"627-628","DOI":"10.1111\/ejn.13519","article-title":"Registered reports at the European Journal of Neuroscience: consolidating and extending peer-reviewed study pre-registration.","volume":"45","author":"C Chambers","year":"2017","journal-title":"Eur J Neurosci."},{"key":"ref-48","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1186\/s12916-015-0395-3","article-title":"The most important tasks for peer reviewers evaluating a randomized controlled trial are not congruent with the tasks most often requested by journal editors.","volume":"13","author":"A Chauvin","year":"2015","journal-title":"BMC Med."},{"key":"ref-49","doi-asserted-by":"publisher","first-page":"345-354","DOI":"10.1509\/jmkr.43.3.345","article-title":"The effect of word of mouth on sales: Online book reviews.","volume":"43","author":"J Chevalier","year":"2006","journal-title":"J Mark Res."},{"key":"ref-50","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.28699","article-title":"How should novelty be valued in science?","volume":"6","author":"B Cohen","year":"2017","journal-title":"eLife."},{"key":"ref-51","first-page":"109-142","article-title":"The role of journals in the growth of scientific knowledge","author":"S Cole","year":"2000"},{"key":"ref-52","doi-asserted-by":"publisher","first-page":"13-61","DOI":"10.5210\/fm.v14i4.2309","article-title":"Signs of epistemic disruption: Transformations in the knowledge system of the academic journal","volume":"14","author":"B Cope","year":"2009"},{"key":"ref-53","article-title":"How meaningful are user ratings? (this article = 4.5 stars!)","author":"D Crotty","year":"2009"},{"key":"ref-54","doi-asserted-by":"publisher","first-page":"306-8","DOI":"10.1038\/532306a","article-title":"Peer review: Troubled from the start.","volume":"532","author":"A Csiszar","year":"2016","journal-title":"Nature."},{"key":"ref-55","article-title":"Peer review and journal models","author":"P Dall\u2019Aglio","year":"2006"},{"key":"ref-56","doi-asserted-by":"publisher","first-page":"e0186111","DOI":"10.1371\/journal.pone.0186111","article-title":"Can editors save peer review from peer reviewers?","volume":"12","author":"R D\u2019Andrea","year":"2017","journal-title":"PLoS One."},{"key":"ref-57","doi-asserted-by":"publisher","DOI":"10.1002\/3527602208","article-title":"Guardians of science: fairness and reliability of peer review","author":"H Daniel","year":"1993"},{"key":"ref-58","doi-asserted-by":"publisher","first-page":"28","DOI":"10.5334\/dsj-2017-028","article-title":"Connecting the persistent identifier ecosystem: Building the technical and human infrastructure for open research.","volume":"16","author":"A Dappert","year":"2017","journal-title":"Data Sci J."},{"key":"ref-59","doi-asserted-by":"publisher","first-page":"297-299","DOI":"10.1111\/cobi.12333","article-title":"Use of double-blind peer review to increase author diversity.","volume":"29","author":"E Darling","year":"2015","journal-title":"Conserv Biol."},{"key":"ref-60","article-title":"Wither portable peer review.","author":"P Davis","year":"2017","journal-title":"The Scholarly Kitchen."},{"key":"ref-61","doi-asserted-by":"publisher","first-page":"203-215","DOI":"10.1007\/s11192-007-1661-8","article-title":"Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles?","volume":"71","author":"P Davis","year":"2007","journal-title":"Scientometrics."},{"key":"ref-62","article-title":"From bench to bedside: Enabling reproducible commercial science via blockchain.","author":"V Dhillon","year":"2016","journal-title":"Bitcoin Magazine."},{"key":"ref-64","doi-asserted-by":"publisher","first-page":"145-146","DOI":"10.1017\/S0140525X00065791","article-title":"When nonreliability of reviews indicates solid science.","volume":"14","author":"D Eckberg","year":"1991","journal-title":"Behav Brain Sci."},{"key":"ref-65","doi-asserted-by":"publisher","DOI":"10.22230\/src.2010v1n2a24","article-title":"A survey of scholarly journals using open journal systems.","volume":"1","author":"B Edgar","year":"2010","journal-title":"Scholarly Res Commun."},{"key":"ref-66","article-title":"Peer review is f***ed up \u2013 let\u2019s fix it","author":"M Eisen","year":"2011"},{"key":"ref-67","doi-asserted-by":"publisher","first-page":"5-8","DOI":"10.1145\/2793013.2793018","article-title":"Does the Internet deserve everybody?","author":"Y Elkhatib","year":"2015"},{"key":"ref-68","article-title":"The influence of the Internet on identity creation and extreme groups","author":"R Emilsson","year":"2015"},{"key":"ref-69","doi-asserted-by":"publisher","first-page":"560","DOI":"10.1038\/352560b0","article-title":"Chauvinism.","volume":"352","author":"E Ernst","year":"1991","journal-title":"Nature."},{"key":"ref-70","article-title":"Hypothes.is reaches funding goal.","author":"T Farley","year":"2011","journal-title":"James Randi Educational Foundation Swift Blog."},{"key":"ref-71","doi-asserted-by":"publisher","first-page":"161-179","DOI":"10.1080\/02691728.2010.498929","article-title":"Peer-to-peer review and the future of scholarly authority.","volume":"24","author":"K Fitzpatrick","year":"2010","journal-title":"Soc Epistemol."},{"key":"ref-72","doi-asserted-by":"publisher","first-page":"196-201","DOI":"10.1632\/prof.2011.2011.1.196","article-title":"Peer review, judgment, and reading.","author":"K Fitzpatrick","year":"2011a","journal-title":"Profession."},{"key":"ref-73","doi-asserted-by":"crossref","DOI":"10.18574\/nyu\/9780814728970.001.0001","article-title":"Planned Obsolescence","author":"K Fitzpatrick","year":"2011b"},{"key":"ref-74","doi-asserted-by":"publisher","first-page":"311-326","DOI":"10.3138\/jsp.44-4-001","article-title":"Defining and characterizing open peer review: A review of the literature.","volume":"44","author":"E Ford","year":"2013","journal-title":"J Scholarly Publ."},{"key":"ref-75","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1186\/s41073-017-0027-x","article-title":"Recruitment of reviewers is becoming harder at some journals: a test of the influence of reviewer fatigue at six journals in ecology and evolution.","volume":"2","author":"C Fox","year":"2017","journal-title":"Res Integr Peer Rev."},{"key":"ref-76","doi-asserted-by":"publisher","first-page":"298-309","DOI":"10.2307\/2943969","article-title":"Scientific misconduct and editorial and peer review processes.","volume":"65","author":"M Fox","year":"1994","journal-title":"J Higher Educ."},{"key":"ref-77","first-page":"e13a","article-title":"Reputation systems: a new vision for publishing and peer review.","volume":"1","author":"P Frishauf","year":"2009","journal-title":"J Participat Med."},{"key":"ref-78","doi-asserted-by":"publisher","first-page":"1007-1023","DOI":"10.1007\/s11192-017-2414-y","article-title":"Characteristics of papers published in journals: an analysis of open access journals, country of publication, and languages used.","volume":"112","author":"N Fukuzawa","year":"2017","journal-title":"Scientometrics."},{"key":"ref-79","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.546100","article-title":"Untangling Academic Publishing: A history of the relationship between commercial interests, academic prestige and the circulation of research.","author":"A Fyfe","year":"2017","journal-title":"Zenodo."},{"key":"ref-80","doi-asserted-by":"publisher","first-page":"257-65","DOI":"10.1016\/j.jclinepi.2014.09.024","article-title":"A systematic review highlights a knowledge gap regarding the effectiveness of health-related training programs in journalology.","volume":"68","author":"J Galipeau","year":"2015","journal-title":"J Clin Epidemiol."},{"key":"ref-81","article-title":"GPeerReview - a tool for making digital-signatures using data mining.","author":"M Gashler","year":"2008","journal-title":"KDnuggets."},{"key":"ref-82","doi-asserted-by":"publisher","first-page":"18","DOI":"10.3389\/fncom.2012.00018","article-title":"Learning from open source software projects to improve scientific review.","volume":"6","author":"S Ghosh","year":"2012","journal-title":"Front Comput Neurosci."},{"key":"ref-83","doi-asserted-by":"publisher","first-page":"117-118","DOI":"10.1038\/530117a","article-title":"Toolbox: Low-cost journals piggyback on arXiv.","volume":"530","author":"E Gibney","year":"2016","journal-title":"Nature."},{"key":"ref-84","doi-asserted-by":"publisher","first-page":"646-652","DOI":"10.1097\/AOG.0b013e31818425d4","article-title":"Author perception of peer review.","volume":"112","author":"M Gibson","year":"2008","journal-title":"Obstet Gynecol."},{"key":"ref-85","doi-asserted-by":"publisher","first-page":"83-95","DOI":"10.1300\/J123v30n03_13","article-title":"Winners and losers in the global research village.","volume":"30","author":"P Ginsparg","year":"1997","journal-title":"Ser Libr."},{"key":"ref-86","doi-asserted-by":"publisher","first-page":"2762-2765","DOI":"10.1001\/jama.287.21.2762","article-title":"Making reviewers visible: openness, accountability, and credit.","volume":"287","author":"F Godlee","year":"2002","journal-title":"JAMA."},{"key":"ref-87","doi-asserted-by":"publisher","first-page":"237-240","DOI":"10.1001\/jama.280.3.237","article-title":"Effect on the quality of peer review of blinding reviewers and asking them to sign their reports: a randomized controlled trial.","volume":"280","author":"F Godlee","year":"1998","journal-title":"JAMA."},{"key":"ref-88","doi-asserted-by":"publisher","first-page":"11-21","DOI":"10.7326\/0003-4819-121-1-199407010-00003","article-title":"Manuscript quality before and after peer review and editing at Annals of Internal Medicine.","volume":"121","author":"S Goodman","year":"1994","journal-title":"Ann Intern Med."},{"key":"ref-89","doi-asserted-by":"publisher","first-page":"31-56","DOI":"10.1016\/0197-2456(89)90017-2","article-title":"Methodology and overt and hidden bias in reports of 196 double-blind trials of nonsteroidal antiinflammatory drugs in rheumatoid arthritis.","volume":"10","author":"P G\u00f8tzsche","year":"1989","journal-title":"Control Clin Trials."},{"key":"ref-90","article-title":"Effectiveness of anonymization in double-blind review","author":"C Goues","year":"2017"},{"key":"ref-91","article-title":"Fetisch peer review.","author":"K Graf","year":"2014","journal-title":"Archivalia."},{"key":"ref-92","doi-asserted-by":"publisher","DOI":"10.1038\/nature05535","article-title":"Overview: Nature\u2019s peer review trial.","author":"S Greaves","year":"2006","journal-title":"Nature."},{"key":"ref-93","doi-asserted-by":"publisher","first-page":"b2680","DOI":"10.1136\/bmj.b2680","article-title":"How citation distortions create unfounded authority: analysis of a citation network.","volume":"339","author":"S Greenberg","year":"2009","journal-title":"BMJ."},{"key":"ref-94","doi-asserted-by":"publisher","first-page":"567-570","DOI":"10.1038\/sj.embor.7400718","article-title":"Through a glass darkly: The present and the future of editorial peer review.","volume":"7","author":"L Grivell","year":"2006","journal-title":"EMBO Rep."},{"key":"ref-95","doi-asserted-by":"publisher","first-page":"407-410","DOI":"10.1093\/biosci\/bix034","article-title":"Peer review: A system under stress.","volume":"67","author":"R Gropp","year":"2017","journal-title":"BioScience."},{"key":"ref-96","doi-asserted-by":"publisher","first-page":"391-392","DOI":"10.1098\/rsnr.2016.0035","article-title":"How has publishing changed in the last twenty years?","volume":"70","author":"S Gupta","year":"2016","journal-title":"Notes Rec R Soc J Hist Sci."},{"key":"ref-97","doi-asserted-by":"publisher","first-page":"450-467","DOI":"10.1002\/asi.23669","article-title":"Dimensions of trust in scholarly communication: Problematizing peer review in the aftermath of John Bohannon\u2019s \u201csting\u201d in science.","volume":"68","author":"J Haider","year":"2017","journal-title":"J Assoc Inf Sci Technol."},{"key":"ref-98","doi-asserted-by":"publisher","first-page":"1607-1615","DOI":"10.1109\/HICSS.2014.206","article-title":"Badges of friendship: Social influence and badge acquisition on stack overflow","author":"A Halavais","year":"2014"},{"key":"ref-99","article-title":"How to create a smart mob: Understanding a social network capital","author":"A Harmon","year":"2010"},{"key":"ref-100","doi-asserted-by":"publisher","first-page":"368-373","DOI":"10.7556\/jaoa.2014.035","article-title":"Wikipedia vs peer-reviewed medical literature for information about the 10 most costly medical conditions.","volume":"114","author":"R Hasty","year":"2014","journal-title":"J Am Osteopath Assoc."},{"key":"ref-101","doi-asserted-by":"publisher","first-page":"2393-2395","DOI":"10.1056\/NEJMp1512330","article-title":"Peer-Review Fraud--Hacking the Scientific Publication Process.","volume":"373","author":"C Haug","year":"2015","journal-title":"N Engl J Med."},{"key":"ref-102","doi-asserted-by":"publisher","first-page":"14","DOI":"10.3390\/fi8020014","article-title":"The evolution of wikipedia\u2019s norm network.","volume":"8","author":"B Heaberlin","year":"2016","journal-title":"Future Internet."},{"key":"ref-103","doi-asserted-by":"publisher","first-page":"191-211","DOI":"10.1007\/978-3-319-00026-8_13","article-title":"Dynamic Publication Formats and Collaborative Authoring.","author":"L Heller","year":"2014","journal-title":"Opening Science."},{"key":"ref-104","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.21718","article-title":"Gender bias in scholarly peer review.","volume":"6","author":"M Helmer","year":"2017","journal-title":"eLife."},{"key":"ref-105","doi-asserted-by":"publisher","first-page":"189-190","DOI":"10.1016\/j.tree.2012.01.005","article-title":"Peerage of Science: will it work?","volume":"27","author":"A Hettyey","year":"2012","journal-title":"Trends Ecol Evol."},{"key":"ref-106","doi-asserted-by":"publisher","first-page":"1438-1441","DOI":"10.1001\/jama.1990.03440100162024","article-title":"The philosophical basis of peer review and the suppression of innovation.","volume":"263","author":"D Horrobin","year":"1990","journal-title":"JAMA."},{"key":"ref-107","doi-asserted-by":"publisher","first-page":"243-252","DOI":"10.1145\/1321440.1321476","article-title":"Measuring article quality in Wikipedia: models and evaluation.","author":"M Hu","year":"2007"},{"key":"ref-108","article-title":"Peer review has its shortcomings, but AI is a risky fix.","author":"J Hukkinen","year":"2017","journal-title":"Wired."},{"key":"ref-109","doi-asserted-by":"publisher","first-page":"e124","DOI":"10.1371\/journal.pmed.0020124","article-title":"Why most published research findings are false.","volume":"2","author":"J Ioannidis","year":"2005","journal-title":"PLoS Med."},{"key":"ref-110","doi-asserted-by":"publisher","first-page":"881-884","DOI":"10.1136\/bjo.2008.151886","article-title":"The effect of masking manuscripts for the peer-review process of an ophthalmic journal.","volume":"93","author":"S Isenberg","year":"2009","journal-title":"Br J Ophthalmol."},{"key":"ref-111","doi-asserted-by":"publisher","first-page":"1-12","DOI":"10.1016\/0197-2456(95)00134-4","article-title":"Assessing the quality of reports of randomized clinical trials: is blinding necessary?","volume":"17","author":"A Jadad","year":"1996","journal-title":"Control Clin Trials."},{"key":"ref-112","doi-asserted-by":"publisher","first-page":"48-55","DOI":"10.1087\/20120107","article-title":"Open and transparent: the review process of the semantic web journal.","volume":"25","author":"K Janowicz","year":"2012","journal-title":"Learn Publ."},{"key":"ref-113","doi-asserted-by":"publisher","first-page":"MR000016","DOI":"10.1002\/14651858.MR000016.pub3","article-title":"Editorial peer review for improving the quality of reports of biomedical studies.","author":"T Jefferson","year":"2007","journal-title":"Cochrane Database Syst Rev."},{"key":"ref-114","doi-asserted-by":"publisher","first-page":"2786-2790","DOI":"10.1001\/jama.287.21.2786","article-title":"Measuring the quality of editorial peer review.","volume":"287","author":"T Jefferson","year":"2002","journal-title":"JAMA."},{"key":"ref-115","doi-asserted-by":"publisher","first-page":"13-21","DOI":"10.1002\/leap.1008","article-title":"Peer review: The current landscape and future trends.","volume":"29","author":"M Jubb","year":"2016","journal-title":"Learn Publ."},{"key":"ref-116","doi-asserted-by":"publisher","first-page":"240-242","DOI":"10.1001\/jama.280.3.240","article-title":"Does masking author identity improve peer review quality? A randomized controlled trial. PEER Investigators.","volume":"280","author":"A Justice","year":"1998","journal-title":"JAMA."},{"key":"ref-117","first-page":"329","article-title":"What we know and need to know about online dispute resolution.","volume":"67","author":"E Katsh","year":"2015","journal-title":"SCL Rev."},{"key":"ref-118","doi-asserted-by":"publisher","first-page":"1000-1011","DOI":"10.1109\/JPROC.2008.921613","article-title":"Peer review anew: Three principles and a case study in postpublication quality assurance.","volume":"96","author":"C Kelty","year":"2008","journal-title":"Proc IEEE."},{"key":"ref-119","first-page":"283-299","article-title":"Exploring citations for conflict of interest detection in peer review system.","volume":"4","author":"M Khan","year":"2012","journal-title":"IJCISIM."},{"key":"ref-120","doi-asserted-by":"publisher","DOI":"10.7287\/peerj-cs.86v0.1\/reviews\/2","article-title":"Peer review #2 of \u201csoftware citation principles (v0.1)\u201d.","author":"G Klyne","year":"2016","journal-title":"PeerJ Comput Sci."},{"key":"ref-121","article-title":"GitHub is the next big social network, powered by what you do, not who you know.","author":"A Kosner","year":"2012","journal-title":"Forbes."},{"key":"ref-122","doi-asserted-by":"publisher","first-page":"163-206","DOI":"10.1007\/BF02020420","article-title":"Federal research impact assessment: Axioms, approaches, applications.","volume":"34","author":"R Kostoff","year":"1995","journal-title":"Scientometrics."},{"key":"ref-123","doi-asserted-by":"publisher","first-page":"e0166387","DOI":"10.1371\/journal.pone.0166387","article-title":"The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise.","volume":"11","author":"M Kovanis","year":"2016","journal-title":"PLoS One."},{"key":"ref-296","doi-asserted-by":"publisher","first-page":"651-671","DOI":"10.1007\/s11192-017-2375-1","article-title":"Evaluating alternative systems of peer review: a large-scale agent-based modelling approach to scientific publication.","volume":"113","author":"M Kovanis","year":"2017","journal-title":"Scientometrics."},{"key":"ref-124","doi-asserted-by":"publisher","first-page":"94","DOI":"10.3389\/fncom.2012.00094","article-title":"An emerging consensus for open evaluation: 18 visions for the future of scientific publishing.","volume":"6","author":"N Kriegeskorte","year":"2012","journal-title":"Front Comput Neurosci."},{"key":"ref-125","doi-asserted-by":"publisher","first-page":"1321-1322","DOI":"10.1001\/jama.1990.03440100021002","article-title":"Peer review in 18th-century scientific journalism.","volume":"263","author":"D Kronick","year":"1990","journal-title":"JAMA."},{"key":"ref-126","first-page":"135-145","article-title":"Growth of collective intelligence by linking knowledge workers through social media.","author":"J Kub\u00e1tov\u00e1","year":"2012","journal-title":"Lex ET Scientia International Journal (LESIJ)."},{"key":"ref-127","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.32014","article-title":"Rooting out bias.","volume":"6","author":"B Kuehn","year":"2017","journal-title":"eLife."},{"key":"ref-128","doi-asserted-by":"publisher","DOI":"10.7287\/peerj-cs.86v0.1\/reviews\/1","article-title":"Peer review #1 of \u201csoftware citation principles (v0.1)\u201d.","author":"T Kuhn","year":"2016a","journal-title":"PeerJ Comput Sci."},{"key":"ref-129","doi-asserted-by":"publisher","DOI":"10.7287\/peerj-cs.86v0.2\/reviews\/1","article-title":"Peer review #1 of \u201csoftware citation principles (v0.2)\u201d.","author":"T Kuhn","year":"2016b","journal-title":"PeerJ Comput Sci."},{"key":"ref-131","doi-asserted-by":"publisher","first-page":"e0127502","DOI":"10.1371\/journal.pone.0127502","article-title":"The Oligopoly of Academic Publishers in the Digital Era.","volume":"10","author":"V Larivi\u00e8re","year":"2015","journal-title":"PLoS One."},{"key":"ref-130","doi-asserted-by":"publisher","first-page":"1157-1169","DOI":"10.1002\/asi.23044","article-title":"arxiv e-prints and the journal of record: An analysis of roles and relationships.","volume":"65","author":"V Larivi\u00e8re","year":"2014","journal-title":"J Assoc Inf Sci Technol."},{"key":"ref-132","doi-asserted-by":"publisher","first-page":"575-603","DOI":"10.1007\/s11192-010-0202-z","article-title":"The rate of growth in scientific publication and the decline in coverage provided by Science Citation index.","volume":"84","author":"P Larsen","year":"2010","journal-title":"Scientometrics."},{"key":"ref-133","doi-asserted-by":"publisher","first-page":"256-257","DOI":"10.1126\/science.aan4141","article-title":"Promote scientific integrity via journal peer review data.","volume":"357","author":"C Lee","year":"2017","journal-title":"Science."},{"key":"ref-134","doi-asserted-by":"publisher","first-page":"2-17","DOI":"10.1002\/asi.22784","article-title":"Bias in peer review.","volume":"64","author":"C Lee","year":"2013","journal-title":"J Am Soc Inf Sci Technol."},{"key":"ref-135","article-title":"The new Reddit journal of science.","author":"D Lee","year":"2015","journal-title":"IMM-press Magazine."},{"key":"ref-136","doi-asserted-by":"publisher","first-page":"e26895","DOI":"10.1371\/journal.pone.0026895","article-title":"Cooperation between referees and authors increases peer review accuracy.","volume":"6","author":"J Leek","year":"2011","journal-title":"PLoS One."},{"key":"ref-137","doi-asserted-by":"publisher","first-page":"455-457","DOI":"10.1038\/541455a","article-title":"Journals invite too few women to referee.","volume":"541","author":"J Lerback","year":"2017","journal-title":"Nature."},{"key":"ref-138","doi-asserted-by":"publisher","DOI":"10.21432\/T21C7R","article-title":"Utilizing peer interactions to promote learning through a web-based peer assessment system.","volume":"34","author":"L Li","year":"2009","journal-title":"Can J Learn Technol."},{"key":"ref-139","doi-asserted-by":"publisher","first-page":"246-247","DOI":"10.1001\/jama.280.3.246","article-title":"US and non-US submissions: an analysis of reviewer bias.","volume":"280","author":"A Link","year":"1998","journal-title":"JAMA."},{"key":"ref-140","doi-asserted-by":"publisher","first-page":"97-121","DOI":"10.1080\/02691728.2010.534567","article-title":"Shifting power relations and the ethics of journal peer review.","volume":"25","author":"W Lipworth","year":"2011","journal-title":"Soc Epistemol."},{"key":"ref-141","doi-asserted-by":"publisher","first-page":"267-280","DOI":"10.1007\/s11673-011-9312-4","article-title":"Should biomedical publishing be \u201copened up\u201d? toward a values-based peer-review process.","volume":"8","author":"W Lipworth","year":"2011","journal-title":"J Bioeth Inq."},{"key":"ref-142","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1038\/546009a","article-title":"Crowd-based peer review can be good and fast.","volume":"546","author":"B List","year":"2017","journal-title":"Nature."},{"key":"ref-143","doi-asserted-by":"crossref","first-page":"539-543","DOI":"10.1901\/jaba.1990.23-539","article-title":"Gender factors in reviewer recommendations for manuscript publication.","volume":"23","author":"M Lloyd","year":"1990","journal-title":"J Appl Behav Anal."},{"key":"ref-144","doi-asserted-by":"publisher","first-page":"915-925","DOI":"10.1016\/j.ijhcs.2006.04.010","article-title":"Pair programming productivity: Novice-novice vs. expert-expert.","volume":"64","author":"K Lui","year":"2006","journal-title":"Int J Hum Comput Stud."},{"key":"ref-145","doi-asserted-by":"publisher","first-page":"106-117","DOI":"10.1108\/14666180010345537","article-title":"Trends and evolution in the development of grey literature: a review.","volume":"1","author":"D Luzi","year":"2000","journal-title":"Int J Grey Lit."},{"key":"ref-146","doi-asserted-by":"publisher","first-page":"211-220","DOI":"10.3138\/jsp.44.3.001","article-title":"A three-decade history of the duration of peer review.","volume":"44","author":"R Lyman","year":"2013","journal-title":"J Scholarly Publ."},{"key":"ref-147","doi-asserted-by":"publisher","first-page":"351-398","DOI":"10.1080\/19416520802211628","article-title":"8 social hierarchy: The self-reinforcing nature of power and status.","volume":"2","author":"J Magee","year":"2008","journal-title":"Acad Manag Ann."},{"key":"ref-148","doi-asserted-by":"publisher","first-page":"109-128","DOI":"10.1080\/13600860701492104","article-title":"Black box, pandora\u2019s box or virtual toolbox? an experiment in a journal\u2019s transparent peer review on the web.","volume":"21","author":"P Maharg","year":"2007","journal-title":"Int Rev Law Comp Technol."},{"key":"ref-149","doi-asserted-by":"publisher","first-page":"161-175","DOI":"10.1007\/BF01173636","article-title":"Publication prejudices: An experimental study of confirmatory bias in the peer review system.","volume":"1","author":"M Mahoney","year":"1977","journal-title":"Cognit Ther Res."},{"key":"ref-150","first-page":"1-22","article-title":"Development of european scientific journal publishing before 1850.","author":"A Manten","year":"1980","journal-title":"Development of science publishing in Europe."},{"key":"ref-151","doi-asserted-by":"publisher","first-page":"e1670","DOI":"10.7717\/peerj.1670","article-title":"Improving the peer-review process and editorial quality: key errors escaping the review and editorial process in top scientific journals.","volume":"4","author":"A Margalida","year":"2016","journal-title":"PeerJ."},{"key":"ref-152","doi-asserted-by":"publisher","first-page":"100-117","DOI":"10.3233\/978-1-61499-769-6-100","article-title":"Arxiv-based commenting resources by and for astrophysicists and physicists: An initial survey","author":"M Marra","year":"2017"},{"key":"ref-153","doi-asserted-by":"publisher","first-page":"117-22","DOI":"10.6004\/jadpro.2012.3.2.8","article-title":"Peer Review: Publication's Gold Standard.","volume":"3","author":"K Mayden","year":"2012","journal-title":"J Adv Pract Oncol."},{"key":"ref-154","first-page":"59","article-title":"Peer review and legal publishing: What law librarians need to know about open, single-blind, and double-blind reviewing.","volume":"101","author":"N McCormack","year":"2009","journal-title":"Law Libr J."},{"key":"ref-155","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.16800","article-title":"How open science helps researchers succeed.","volume":"5","author":"E McKiernan","year":"2016","journal-title":"eLife."},{"key":"ref-156","article-title":"Alternative peer review: Quality management for 21st century scholarship","author":"G McKiernan","year":"2003"},{"key":"ref-157","doi-asserted-by":"publisher","first-page":"1371-1376","DOI":"10.1001\/jama.1990.03440100079012","article-title":"The effects of blinding on the quality of peer review. A randomized trial.","volume":"263","author":"R McNutt","year":"1990","journal-title":"JAMA."},{"key":"ref-158","doi-asserted-by":"crossref","first-page":"521-527","DOI":"10.1106\/0MXD-YM6F-3LM6-G9EB","article-title":"Referees\u2019 attitudes toward open peer review and electronic transmission of papers.","volume":"7","author":"R Melero","year":"2001","journal-title":"Food Sci Technol Int."},{"key":"ref-159","doi-asserted-by":"publisher","first-page":"56-63","DOI":"10.1126\/science.159.3810.56","article-title":"The Matthew Effect in Science: The reward and communication systems of science are considered.","volume":"159","author":"R Merton","year":"1968","journal-title":"Science."},{"key":"ref-160","article-title":"The sociology of science: Theoretical and empirical investigations","author":"R Merton","year":"1973"},{"key":"ref-161","doi-asserted-by":"publisher","first-page":"60-72","DOI":"10.1177\/1478929916658918","article-title":"The present and the future of the research excellence framework impact agenda in the UK academy: A reflection from politics and international studies.","volume":"15","author":"A Mhurch\u00fa","year":"2017","journal-title":"Political Stud Rev."},{"key":"ref-162","doi-asserted-by":"publisher","DOI":"10.21956\/wellcomeopenres.13272.r25804","article-title":"Referee report for: Sharing individual patient and parasite-level data through the worldwide antimalarial resistance network platform: A qualitative case study [version 1; referees: 2 approved].","author":"D Mietchen","year":"2017","journal-title":"Wellcome Open Res."},{"key":"ref-163","doi-asserted-by":"publisher","first-page":"2047-2054","DOI":"10.1002\/asi.20663","article-title":"The effect of \u201copen access\u201d on citation impact: An analysis of ArXiv\u2019s condensed matter section.","volume":"58","author":"H Moed","year":"2007","journal-title":"J Am Soc Inf Sci Technol."},{"key":"ref-164","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1186\/s12916-017-0927-0","article-title":"Core competencies for scientific editors of biomedical journals: consensus statement.","volume":"15","author":"D Moher","year":"2017","journal-title":"BMC Med."},{"key":"ref-165","doi-asserted-by":"publisher","DOI":"10.1057\/palcomms.2016.105","article-title":"\u201cexcellence R Us\u201d: university research and the fetishisation of excellence.","volume":"3","author":"S Moore","year":"2017","journal-title":"Palgrave Commun."},{"key":"ref-166","doi-asserted-by":"publisher","first-page":"830-831","DOI":"10.1111\/j.1365-2929.2006.02573.x","article-title":"The case for open peer review.","volume":"40","author":"J Morrison","year":"2006","journal-title":"Med Educ."},{"key":"ref-167","article-title":"The royal society and the prehistory of peer review, 1665\u20131965.","author":"N Moxham","year":"2017","journal-title":"Hist J."},{"key":"ref-168","doi-asserted-by":"crossref","first-page":"185-200","DOI":"10.2307\/20721420","article-title":"What makes a helpful review? A study of customer reviews on Amazon.com.","volume":"34","author":"S Mudambi","year":"2010","journal-title":"MIS Quarterly."},{"key":"ref-169","doi-asserted-by":"publisher","first-page":"197-214","DOI":"10.3233\/ISU-2008-0582","article-title":"Quality, certification and peer review.","volume":"28","author":"A Mulligan","year":"2008","journal-title":"Inf Serv Use."},{"key":"ref-170","doi-asserted-by":"publisher","first-page":"132-161","DOI":"10.1002\/asi.22798","article-title":"Peer review in a changing world: An international study measuring the attitudes of researchers.","volume":"64","author":"A Mulligan","year":"2013","journal-title":"J Am Soc Inf Sci Technol."},{"key":"ref-171","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-016-0021","article-title":"A manifesto for reproducible science.","volume":"1","author":"M Munaf\u00f2","year":"2017","journal-title":"Nat Hum Behav."},{"key":"ref-172","doi-asserted-by":"publisher","first-page":"603-615","DOI":"10.1080\/1360080X.2014.957890","article-title":"Perceptions of the UK\u2019s research excellence framework 2014: a media analysis.","volume":"36","author":"T Murphy","year":"2014","journal-title":"J Higher Educ Pol Manage."},{"key":"ref-173","article-title":"Bitcoin: A peer-to-peer electronic cash system","author":"S Nakamoto","year":"2008"},{"key":"ref-174","doi-asserted-by":"publisher","first-page":"867","DOI":"10.1038\/468867a","article-title":"Response required.","volume":"468","year":"2010","journal-title":"Nature."},{"key":"ref-175","doi-asserted-by":"publisher","first-page":"0034","DOI":"10.1038\/s41562-016-0034","article-title":"Promoting reproducibility with registered reports.","volume":"1","year":"2017","journal-title":"Nat Hum Behav."},{"key":"ref-176","doi-asserted-by":"publisher","first-page":"e1000242","DOI":"10.1371\/journal.pbio.1000242","article-title":"Article-level metrics and the evolution of scientific impact.","volume":"7","author":"C Neylon","year":"2009","journal-title":"PLoS Biol."},{"key":"ref-177","article-title":"A brief survey on peer review in scholarly communication.","author":"J Nicholson","year":"2016","journal-title":"The Winnower."},{"key":"ref-178","doi-asserted-by":"publisher","first-page":"957-971","DOI":"10.1002\/asi.23711","article-title":"Understanding and supporting anonymity policies in peer review.","volume":"68","author":"S Nobarany","year":"2016","journal-title":"J Assoc Inf Sci Technol."},{"key":"ref-179","doi-asserted-by":"publisher","first-page":"137-141","DOI":"10.1027\/1864-9335\/a000192","article-title":"Registered reports: A method to increase the credibility of published results.","volume":"45","author":"B Nosek","year":"2014","journal-title":"Soc Psychol."},{"key":"ref-180","doi-asserted-by":"publisher","first-page":"1315-6","DOI":"10.1001\/jama.2016.11014","article-title":"Single-blind vs Double-blind Peer Review in the Setting of Author Prestige.","volume":"316","author":"K Okike","year":"2016","journal-title":"JAMA."},{"key":"ref-181","doi-asserted-by":"publisher","DOI":"10.1098\/rstl.1665.0001","article-title":"Epistle dedicatory.","volume":"1","author":"H Oldenburg","year":"1665","journal-title":"Phil Trans."},{"key":"ref-182","first-page":"32-44","article-title":"The state of the evidence: what we know and what we don\u2019t know about journal peer review","author":"J Overbeke","year":"1999"},{"key":"ref-183","article-title":"The world\u2019s largest 2-way dialogue between scientists and the public.","author":"S Owens","year":"2014","journal-title":"Sci Am."},{"key":"ref-184","doi-asserted-by":"publisher","first-page":"309-316","DOI":"10.1087\/20150411","article-title":"Data exchange standards to support and acknowledge peer-review activity.","volume":"28","author":"L Paglione","year":"2015","journal-title":"Learn Publ."},{"key":"ref-185","doi-asserted-by":"publisher","first-page":"53-55","DOI":"10.1142\/S2251158X15000193","article-title":"PhysicsOverflow: A postgraduate-level physics Q&A site and open peer review system.","volume":"4","author":"A Pallavi Sudhir","year":"2015","journal-title":"Asia Pac Phys Newslett."},{"key":"ref-186","article-title":"Is double-blind review better","author":"S Palus","year":"2015"},{"key":"ref-187","doi-asserted-by":"publisher","first-page":"e1002216","DOI":"10.1371\/journal.pcbi.1002216","article-title":"BioStar: An online question & answer resource for the bioinformatics community.","volume":"7","author":"L Parnell","year":"2011","journal-title":"PLoS Comput Biol."},{"key":"ref-188","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1186\/s12916-014-0128-z","article-title":"Why training and specialization is needed for peer review: a case study of peer review for randomized controlled trials.","volume":"12","author":"J Patel","year":"2014","journal-title":"BMC Med."},{"key":"ref-189","doi-asserted-by":"publisher","first-page":"e12431","DOI":"10.3897\/rio.3.e12431","article-title":"Strategies and guidelines for scholarly publishing of biodiversity data.","volume":"3","author":"L Penev","year":"2017","journal-title":"Research Ideas and Outcomes."},{"key":"ref-190","doi-asserted-by":"publisher","first-page":"553-559","DOI":"10.1007\/s11192-010-0253-1","article-title":"Natural selection of academic papers.","volume":"85","author":"P Perakakis","year":"2010","journal-title":"Scientometrics."},{"key":"ref-191","doi-asserted-by":"publisher","first-page":"153-4","DOI":"10.1038\/528153a","article-title":"Annotating the scholarly web.","volume":"528","author":"J Perkel","year":"2015","journal-title":"Nature."},{"key":"ref-192","doi-asserted-by":"publisher","first-page":"187-195","DOI":"10.1017\/S0140525X00011183","article-title":"Peer-review practices of psychological journals: The fate of published articles, submitted again.","volume":"5","author":"D Peters","year":"1982","journal-title":"Behav Brain Sci."},{"key":"ref-193","doi-asserted-by":"publisher","first-page":"1480-1483","DOI":"10.1016\/S0140-6736(96)05016-7","article-title":"Readers\u2019 evaluation of effect of peer review and editing on quality of articles in the nederlands tijdschrift voor geneeskunde.","volume":"348","author":"J Pierie","year":"1996","journal-title":"Lancet."},{"key":"ref-194","article-title":"Mega-journals: the future, a stepping stone to it or a leap into the abyss?","author":"S Pinfield","year":"2016","journal-title":"Times Higher Education."},{"key":"ref-195","article-title":"Publish or perish? The rise of the fractional author...","volume":"38","author":"A Plume","year":"2014","journal-title":"Research Trends."},{"key":"ref-196","doi-asserted-by":"publisher","first-page":"426-432","DOI":"10.1056\/NEJM198708133170706","article-title":"Statistical problems in the reporting of clinical trials. A survey of three medical journals.","volume":"317","author":"S Pocock","year":"1987","journal-title":"N Engl J Med."},{"key":"ref-197","doi-asserted-by":"publisher","DOI":"10.7264\/N3542KVW","article-title":"The blind shall see! the question of anonymity in journal peer review.","author":"D Pontille","year":"2014","journal-title":"Ada: A Journal of Gender, New Media, and Technology."},{"key":"ref-198","doi-asserted-by":"publisher","first-page":"57-79","DOI":"10.1007\/s10746-014-9335-z","article-title":"From manuscript evaluation to article valuation: the changing technologies of journal peer review.","volume":"38","author":"D Pontille","year":"2015","journal-title":"Hum Stud."},{"key":"ref-199","doi-asserted-by":"publisher","first-page":"33","DOI":"10.3389\/fncom.2012.00033","article-title":"Multi-stage open peer review: Scientific evaluation integrating the strengths of traditional peer review with the virtues of transparency and self-regulation.","volume":"6","author":"U P\u00f6schl","year":"2012","journal-title":"Front Comput Neurosci."},{"key":"ref-200","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2017.10.019","article-title":"A community\u2019s perspective on the status and future of peer review in software engineering.","author":"L Prechelt","year":"2017","journal-title":"Inf Softw Technol."},{"key":"ref-201","doi-asserted-by":"publisher","first-page":"437-440","DOI":"10.1038\/495437a","article-title":"Scholarship: Beyond the paper.","volume":"495","author":"J Priem","year":"2013","journal-title":"Nature."},{"key":"ref-202","doi-asserted-by":"publisher","DOI":"10.5210\/fm.v15i7.2874","article-title":"Scientometrics 2.0: New metrics of scholarly impact on the social web.","volume":"15","author":"J Priem","year":"2010","journal-title":"First Monday."},{"key":"ref-203","doi-asserted-by":"publisher","first-page":"19","DOI":"10.3389\/fncom.2012.00019","article-title":"Decoupling the scholarly journal.","volume":"6","author":"J Priem","year":"2012","journal-title":"Front Comput Neurosci."},{"key":"ref-204","doi-asserted-by":"publisher","first-page":"4039-4056","DOI":"10.1098\/rsta.2010.0155","article-title":"Adoption and use of web 2.0 in scholarly communications.","volume":"368","author":"R Procter","year":"2010a","journal-title":"Philos Trans A Math Phys Eng Sci."},{"key":"ref-205","article-title":"If you build it, will they come? How researchers perceive and use Web 2.0","author":"R Procter","year":"2010b"},{"key":"ref-206","article-title":"OJS stats","year":"2016"},{"key":"ref-207","first-page":"261-267","article-title":"Stalking the perfect journal.","volume":"2","author":"G Pullum","year":"1984","journal-title":"Nat Lang Linguist Th."},{"key":"ref-208","doi-asserted-by":"publisher","DOI":"10.1093\/database\/baw028","article-title":"Centralizing content and distributing labor: a community model for curating the very long tail of microbial genomes.","volume":"2016","author":"T Putman","year":"2016","journal-title":"Database (Oxford)."},{"key":"ref-209","doi-asserted-by":"publisher","first-page":"175-190","DOI":"10.1080\/17508487.2015.1019901","article-title":"Academic perceptions of higher education assessment processes in neoliberal academia.","volume":"57","author":"R Raaper","year":"2016","journal-title":"Crit Stud Educ."},{"key":"ref-63","doi-asserted-by":"publisher","first-page":"31-3","DOI":"10.1038\/535031a","article-title":"Let's make peer review scientific.","volume":"535","author":"D Rennie","year":"2016","journal-title":"Nature."},{"key":"ref-210","article-title":"Misconduct and journal peer review","author":"D Rennie","year":"2003"},{"key":"ref-211","article-title":"Activities, costs and funding flows in the scholarly communications system in the UK: Report commissioned by the Research Information Network (RIN)","year":"2008"},{"key":"ref-212","article-title":"Analysis of 7 million Amazon reviews: customers who receive free or discounted item much more likely to write positive review","year":"2016"},{"key":"ref-213","doi-asserted-by":"publisher","first-page":"255-256","DOI":"10.1177\/088307389501000325","article-title":"Priority, rivalry, and peer review.","volume":"10","author":"J Riggs","year":"1995","journal-title":"J Child Neurol."},{"key":"ref-214","doi-asserted-by":"publisher","first-page":"163-167","DOI":"10.1093\/jole\/lzw009","article-title":"Double-blind reviewing at evolang 11 reveals gender bias.","volume":"1","author":"S Roberts","year":"2016","journal-title":"Journal of Language Evolution."},{"key":"ref-215","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.32011","article-title":"Decisions, decisions.","volume":"6","author":"P Rodgers","year":"2017","journal-title":"eLife."},{"key":"ref-216","doi-asserted-by":"publisher","first-page":"319-328","DOI":"10.1145\/1458082.1458127","article-title":"An algorithm to determine peer-reviewers","author":"M Rodriguez","year":"2008"},{"key":"ref-217","doi-asserted-by":"publisher","first-page":"149-159","DOI":"10.1177\/0165551506062327","article-title":"The convergence of digital libraries and the peer-review process.","volume":"32","author":"M Rodriguez","year":"2006","journal-title":"J Inform Sci."},{"key":"ref-218","doi-asserted-by":"publisher","first-page":"269-277","DOI":"10.1002\/leap.1111","article-title":"Peer review: The experience and views of early career researchers.","volume":"30","author":"B Rodr\u00edguez-Bravo","year":"2017","journal-title":"Learn Publ."},{"key":"ref-219","doi-asserted-by":"publisher","first-page":"1675-1680","DOI":"10.1001\/jama.295.14.1675","article-title":"Effect of blinded peer review on abstract acceptance.","volume":"295","author":"J Ross","year":"2006","journal-title":"JAMA."},{"key":"ref-220","article-title":"Onboarding at rOpenSci: A year in reviews.","author":"N Ross","year":"2016","journal-title":"rOpenSci Blog."},{"key":"ref-221","doi-asserted-by":"publisher","first-page":"588","DOI":"10.12688\/f1000research.11369.1","article-title":"What is open peer review? A systematic review [version 1; referees: 1 approved, 3 approved with reservations].","volume":"6","author":"T Ross-Hellauer","year":"2017","journal-title":"F1000Res."},{"key":"ref-222","doi-asserted-by":"publisher","first-page":"84-88","DOI":"10.1007\/978-3-642-39476-8_18","article-title":"Digital badges: Signposts and claims of achievement","volume":"374","author":"R Rughini\u015f","year":"2013"},{"key":"ref-223","doi-asserted-by":"publisher","first-page":"121-132","DOI":"10.1016\/j.jeap.2008.03.009","article-title":"Scientific publishing in developing countries: Challenges for the future.","volume":"7","author":"F Salager-Meyer","year":"2008","journal-title":"J Engl Acad Purp."},{"key":"ref-224","doi-asserted-by":"publisher","first-page":"78-82","DOI":"10.1016\/j.jeap.2013.11.003","article-title":"Writing and publishing in peripheral scholarly journals: How to enhance the global influence of multilingual scholars?","volume":"13","author":"F Salager-Meyer","year":"2014","journal-title":"Journal of English for Academic Purposes."},{"key":"ref-225","first-page":"307-338","article-title":"The early history of Nupedia and Wikipedia: a memoir","author":"L Sanger","year":"2005"},{"key":"ref-226","doi-asserted-by":"publisher","first-page":"446","DOI":"10.1038\/nature.2017.21342","article-title":"'You never said my peer review was confidential' - scientist challenges publisher.","volume":"541","author":"Q Schiermeier","year":"2017","journal-title":"Nature."},{"key":"ref-227","doi-asserted-by":"publisher","first-page":"62-74","DOI":"10.3233\/978-1-61499-769-6-62","article-title":"New toolkits on the block: Peer review alternatives in scholarly communication","author":"B Schmidt","year":"2017"},{"key":"ref-228","doi-asserted-by":"publisher","first-page":"673","DOI":"10.1136\/bmj.38023.700775.AE","article-title":"Effects of training on quality of peer review: randomised controlled trial.","volume":"328","author":"S Schroter","year":"2004","journal-title":"BMJ."},{"key":"ref-229","doi-asserted-by":"publisher","first-page":"314-317","DOI":"10.1001\/jama.295.3.314","article-title":"Differences in review quality and recommendations for publication between peer reviewers suggested by authors or by editors.","volume":"295","author":"S Schroter","year":"2006","journal-title":"JAMA."},{"key":"ref-230","doi-asserted-by":"publisher","first-page":"567-585","DOI":"10.1007\/s11192-017-2264-7","article-title":"Does single blind peer review hinder newcomers?","volume":"113","author":"M Seeber","year":"2017","journal-title":"Scientometrics."},{"key":"ref-231","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1045\/january2012-shotton","article-title":"The five stars of online journal articles: A framework for article evaluation.","volume":"18","author":"D Shotton","year":"2012","journal-title":"D-Lib Magazine."},{"key":"ref-232","doi-asserted-by":"publisher","first-page":"297-304","DOI":"10.1098\/rsnr.2016.0026","article-title":"Science periodicals in the nineteenth and twenty-first centuries.","volume":"70","author":"S Shuttleworth","year":"2016","journal-title":"Notes Rec R Soc Lond."},{"key":"ref-233","doi-asserted-by":"publisher","first-page":"360-365","DOI":"10.1073\/pnas.1418218112","article-title":"Measuring the effectiveness of scientific gatekeeping.","volume":"112","author":"K Siler","year":"2015a","journal-title":"Proc Natl Acad Sci U S A."},{"key":"ref-234","doi-asserted-by":"publisher","first-page":"360-365","DOI":"10.1073\/pnas.1418218112","article-title":"Measuring the effectiveness of scientific gatekeeping.","volume":"112","author":"K Siler","year":"2015b","journal-title":"Proc Natl Acad Sci U S A."},{"key":"ref-235","doi-asserted-by":"publisher","first-page":"29-61","DOI":"10.1177\/0162243916656919","article-title":"Peer review and scholarly originality: Let 1,000 flowers bloom, but don\u2019t step on any.","volume":"42","author":"K Siler","year":"2017","journal-title":"Sci Technol Hum Val."},{"key":"ref-236","article-title":"Here\u2019s why more than 50,000 psychology studies are about to have PubPeer entries.","author":"D Singh Chawla","year":"2016","journal-title":"Retraction Watch."},{"key":"ref-237","doi-asserted-by":"publisher","first-page":"e86","DOI":"10.7717\/peerj-cs.86","article-title":"Software citation principles.","volume":"2","author":"A Smith","year":"2016","journal-title":"PeerJ Computer Science."},{"key":"ref-238","doi-asserted-by":"publisher","first-page":"79-91","DOI":"10.1087\/09531519950145896","article-title":"The deconstructed journal \u2014 a new model for academic publishing.","volume":"12","author":"J Smith","year":"1999","journal-title":"Learn Publ."},{"key":"ref-239","doi-asserted-by":"crossref","first-page":"178-182","DOI":"10.1177\/014107680609900414","article-title":"Peer review: a flawed process at the heart of science and journals.","volume":"99","author":"R Smith","year":"2006","journal-title":"J R Soc Med."},{"key":"ref-240","doi-asserted-by":"publisher","first-page":"S13","DOI":"10.1186\/bcr2742","article-title":"Classical peer review: an empty gun.","volume":"12","author":"R Smith","year":"2010","journal-title":"Breast Cancer Res."},{"key":"ref-241","doi-asserted-by":"publisher","first-page":"90-97","DOI":"10.1111\/j.1365-2929.2004.02026.x","article-title":"Reviewers\u2019 perceptions of the peer review process for a medical education journal.","volume":"39","author":"L Snell","year":"2005","journal-title":"Med Educ."},{"key":"ref-242","doi-asserted-by":"publisher","DOI":"10.1145\/1206049.1206050","article-title":"Editorial: Single-versus double-blind reviewing.","volume":"32","author":"R Snodgrass","year":"2007","journal-title":"ACM Trans Database Syst."},{"key":"ref-243","article-title":"Peer-review in the internet age","author":"P Sobkowicz","year":"2008"},{"key":"ref-244","doi-asserted-by":"publisher","first-page":"357-358","DOI":"10.1016\/S0167-7799(02)01985-6","article-title":"The history of the peer-review process.","volume":"20","author":"R Spier","year":"2002","journal-title":"Trends Biotechnol."},{"key":"ref-245","doi-asserted-by":"publisher","first-page":"501-502","DOI":"10.1007\/s11192-017-2518-4","article-title":"Scientometrics of peer review.","volume":"113","author":"F Squazzoni","year":"2017a","journal-title":"Scientometrics."},{"key":"ref-246","doi-asserted-by":"publisher","first-page":"352","DOI":"10.1038\/546352a","article-title":"Publishing: Journals could share peer-review data.","volume":"546","author":"F Squazzoni","year":"2017b","journal-title":"Nature."},{"key":"ref-247","doi-asserted-by":"publisher","first-page":"9-71","DOI":"10.1632\/prof.2007.2007.1.9","article-title":"Report of the MLA task force on evaluating scholarship for tenure and promotion.","author":"D Stanton","year":"2007","journal-title":"Profession."},{"key":"ref-248","doi-asserted-by":"publisher","first-page":"e68397","DOI":"10.1371\/journal.pone.0068397","article-title":"Why has the number of scientific retractions increased?","volume":"8","author":"R Steen","year":"2013","journal-title":"PLoS One."},{"key":"ref-249","doi-asserted-by":"publisher","first-page":"265-268","DOI":"10.1087\/20130406","article-title":"RUBRIQ: tools, services, and software to improve peer review.","volume":"26","author":"L Stemmle","year":"2013","journal-title":"Learn Publ."},{"key":"ref-250","article-title":"Popularity of arxiv.org within computer science","author":"C Sutton","year":"2017"},{"key":"ref-251","article-title":"Blockchain: Blueprint for a new economy","author":"M Swan","year":"2015"},{"key":"ref-252","article-title":"Intriguing properties of neural networks.","author":"C Szegedy","year":"2014"},{"key":"ref-253","doi-asserted-by":"publisher","first-page":"355-367","DOI":"10.1145\/2531602.2531690","article-title":"Collaborative problem solving: A study of MathOverflow","author":"Y Tausczik","year":"2014"},{"key":"ref-254","doi-asserted-by":"publisher","first-page":"2","DOI":"10.18243\/eon\/2017.10.8.1","article-title":"The dark side of peer review.","volume":"10","author":"J Tennant","year":"2017","journal-title":"Editorial Office News."},{"key":"ref-255","doi-asserted-by":"publisher","first-page":"632","DOI":"10.12688\/f1000research.8460.3","article-title":"The academic, economic and societal impacts of Open Access: an evidence-based review [version 3; referees: 4 approved, 1 approved with reservations].","volume":"5","author":"J Tennant","year":"2016","journal-title":"F1000Res."},{"key":"ref-256","doi-asserted-by":"publisher","first-page":"e1002538","DOI":"10.1371\/journal.pbio.1002538","article-title":"Protocols.io: Virtual Communities for Protocol Development and Discussion.","volume":"14","author":"L Teytelman","year":"2016","journal-title":"PLoS Biol."},{"key":"ref-257","doi-asserted-by":"crossref","DOI":"10.2139\/ssrn.3039505","article-title":"Science is shaped by wikipedia: Evidence from a randomized control trial","author":"N Thompson","year":"2017"},{"key":"ref-258","doi-asserted-by":"publisher","first-page":"323-326","DOI":"10.1109\/CSMR.2013.41","article-title":"Network structure of social coding in GitHub","author":"F Thung","year":"2013"},{"key":"ref-259","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1707323114","article-title":"Reviewer bias in single-versus double-blind peer review.","author":"A Tomkins","year":"2017","journal-title":"Proceedings of the National Academy of Sciences."},{"key":"ref-260","article-title":"Astroblocks puts proofs of scientific discoveries on the bitcoin blockchain.","author":"K Torpey","year":"2015","journal-title":"Inside Bitcoins."},{"key":"ref-261","doi-asserted-by":"publisher","first-page":"349-350","DOI":"10.1016\/S0169-5347(02)02545-4","article-title":"Gender bias in the refereeing process?","volume":"17","author":"T Tregenza","year":"2002","journal-title":"Trends Ecol Evol."},{"key":"ref-262","first-page":"1-35","article-title":"Online reputation systems","author":"J Ubois","year":"2003"},{"key":"ref-263","doi-asserted-by":"publisher","first-page":"e84896","DOI":"10.1371\/journal.pone.0084896","article-title":"Why publishing everything is more effective than selective publishing of statistically significant results.","volume":"9","author":"M van Assen","year":"2014","journal-title":"PLoS One."},{"key":"ref-264","doi-asserted-by":"publisher","DOI":"10.1038\/nature.2017.22094","article-title":"Web of Science owner buys up booming peer-review platform.","author":"R Van Noorden","year":"2017","journal-title":"Nature News."},{"key":"ref-265","doi-asserted-by":"publisher","first-page":"c5729","DOI":"10.1136\/bmj.c5729","article-title":"Effect on peer review of telling reviewers that their signed reviews might be posted on the web: randomised controlled trial.","volume":"341","author":"S van Rooyen","year":"2010","journal-title":"BMJ."},{"key":"ref-266","doi-asserted-by":"publisher","first-page":"23-27","DOI":"10.1136\/bmj.318.7175.23","article-title":"Effect of open peer review on quality of reviews and on reviewers\u2019 recommendations: a randomised trial.","volume":"318","author":"S van Rooyen","year":"1999","journal-title":"BMJ."},{"key":"ref-267","doi-asserted-by":"publisher","first-page":"234-237","DOI":"10.1001\/jama.280.3.234","article-title":"Effect of blinding and unmasking on the quality of peer review: a randomized trial.","volume":"280","author":"S van Rooyen","year":"1998","journal-title":"JAMA."},{"key":"ref-268","article-title":"Molecular Ecology\u2019s best reviewers 2015.","author":"T Vines","year":"2015a","journal-title":"The Molecular Ecologist."},{"key":"ref-269","doi-asserted-by":"publisher","first-page":"36-38","DOI":"10.1002\/lob.10022","article-title":"The core inefficiency of peer review and a potential solution.","volume":"24","author":"T Vines","year":"2015b","journal-title":"Limnology and Oceanography Bulletin."},{"key":"ref-270","doi-asserted-by":"publisher","first-page":"185-198","DOI":"10.1016\/j.envsoft.2014.10.007","article-title":"Web technologies for environmental big data.","volume":"63","author":"C Vitolo","year":"2015","journal-title":"Environ Model Softw."},{"key":"ref-271","article-title":"We need a Github of science","author":"M von Muhlen","year":"2011"},{"key":"ref-272","article-title":"Three recommendations to enable annotations on the web","year":"2017"},{"key":"ref-273","doi-asserted-by":"publisher","first-page":"e0165359","DOI":"10.1371\/journal.pone.0165359","article-title":"Open-Access Mega-Journals: A Bibliometric Profile.","volume":"11","author":"S Wakeling","year":"2016","journal-title":"PLoS One."},{"key":"ref-274","doi-asserted-by":"publisher","first-page":"169","DOI":"10.3389\/fnins.2015.00169","article-title":"Emerging trends in peer review-a survey.","volume":"9","author":"R Walker","year":"2015","journal-title":"Front Neurosci."},{"key":"ref-275","doi-asserted-by":"publisher","first-page":"47-51","DOI":"10.1192\/bjp.176.1.47","article-title":"Open peer review: a randomised controlled trial.","volume":"176","author":"E Walsh","year":"2000","journal-title":"Br J Psychiatry."},{"key":"ref-276","doi-asserted-by":"publisher","first-page":"903","DOI":"10.1186\/s40064-016-2601-y","article-title":"Editorial behaviors in peer review.","volume":"5","author":"W Wang","year":"2016","journal-title":"Springerplus."},{"key":"ref-277","doi-asserted-by":"publisher","first-page":"799-820","DOI":"10.1108\/14684521111176516","article-title":"Knowledge sharing in wiki communities: an empirical study.","volume":"35","author":"W Wang","year":"2011","journal-title":"Online Inform Rev."},{"key":"ref-278","doi-asserted-by":"publisher","first-page":"109-112","DOI":"10.3233\/ISU-2008-0568","article-title":"Peer review in scholarly journals: Perspective of the scholarly community \u2013 results from an international study.","volume":"28","author":"M Ware","year":"2008","journal-title":"Inf Serv Use."},{"key":"ref-279","doi-asserted-by":"publisher","first-page":"23-53","DOI":"10.1080\/13614576.2011.566812","article-title":"Peer review: Recent experience and future directions.","volume":"16","author":"M Ware","year":"2011","journal-title":"New Review of Information Networking."},{"key":"ref-280","doi-asserted-by":"publisher","first-page":"41-50","DOI":"10.1002\/leap.1002","article-title":"Rewarding reviewers\u2013sense or sensibility? a Wiley study explained.","volume":"29","author":"V Warne","year":"2016","journal-title":"Learn Publ."},{"key":"ref-281","doi-asserted-by":"publisher","first-page":"351-353","DOI":"10.1016\/j.tree.2008.03.003","article-title":"Does double-blind review benefit female authors?","volume":"23","author":"T Webb","year":"2008","journal-title":"Trends Ecol Evol."},{"key":"ref-282","doi-asserted-by":"publisher","first-page":"1-12","DOI":"10.1002\/meet.2008.14504503155","article-title":"Peer review and secrecy in the \u201cinformation age\u201d.","volume":"45","author":"M Weicher","year":"2008","journal-title":"Proc Am Soc Inform Sci Tech."},{"key":"ref-283","article-title":"Annotation is now a web standard","author":"D Whaley","year":"2017"},{"key":"ref-284","doi-asserted-by":"publisher","first-page":"478-479","DOI":"10.1016\/j.tree.2008.06.003","article-title":"Journal review and gender equality: a critical comment on Budden et al.","volume":"23","author":"R Whittaker","year":"2008","journal-title":"Trends Ecol Evol."},{"key":"ref-285","doi-asserted-by":"publisher","first-page":"e0147913","DOI":"10.1371\/journal.pone.0147913","article-title":"Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals.","volume":"11","author":"J Wicherts","year":"2016","journal-title":"PLoS One."},{"key":"ref-286","article-title":"Digital medievalist","year":"2017"},{"key":"ref-287","doi-asserted-by":"publisher","first-page":"e1002446","DOI":"10.1371\/journal.pcbi.1002446","article-title":"Topic pages: PLoS Computational Biology meets Wikipedia.","volume":"8","author":"S Wodak","year":"2012","journal-title":"PLoS Comput Biol."},{"key":"ref-288","doi-asserted-by":"publisher","first-page":"359-373","DOI":"10.1108\/14684521211241396","article-title":"Wikipedia for academic publishing: advantages and challenges.","volume":"36","author":"L Xiao","year":"2012","journal-title":"Online Inform Rev."},{"key":"ref-289","doi-asserted-by":"publisher","first-page":"332-347","DOI":"10.1108\/OIR-04-2013-0062","article-title":"Academic opinions of Wikipedia and open access publishing.","volume":"38","author":"L Xiao","year":"2014","journal-title":"Online Inform Rev."},{"key":"ref-290","doi-asserted-by":"publisher","first-page":"72","DOI":"10.3389\/fncom.2012.00072","article-title":"Designing next-generation platforms for evaluating scientific output: what scientists can learn from the social web.","volume":"6","author":"T Yarkoni","year":"2012","journal-title":"Front Comput Neurosci."},{"key":"ref-291","doi-asserted-by":"publisher","first-page":"937-952","DOI":"10.1177\/0963662516649806","article-title":"The case of #arseniclife: Blogs and Twitter in informal peer review.","volume":"26","author":"S Yeo","year":"2017","journal-title":"Front Comput Neurosci."},{"key":"ref-292","doi-asserted-by":"publisher","first-page":"e0163477","DOI":"10.1371\/journal.pone.0163477","article-title":"Where Is Current Research on Blockchain Technology?-A Systematic Review.","volume":"11","author":"J Yli-Huumo","year":"2016","journal-title":"PLoS One."},{"key":"ref-293","article-title":"Nature cancels public reviews of scientific papers.","author":"N Zamiska","year":"2006","journal-title":"Wall Str J."},{"key":"ref-294","doi-asserted-by":"publisher","first-page":"66-100","DOI":"10.1007\/BF01553188","article-title":"Patterns of evaluation in science: Institutionalization, structure and functions of the referee system.","volume":"9","author":"H Zuckerman","year":"1971","journal-title":"Minerva."}],"container-title":["F1000Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/f1000research.com\/articles\/6-1151\/v3\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/f1000research.com\/articles\/6-1151\/v3\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/f1000research.com\/articles\/6-1151\/v3\/iparadigms","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,29]],"date-time":"2024-06-29T02:03:03Z","timestamp":1719626583000},"score":1,"resource":{"primary":{"URL":"https:\/\/f1000research.com\/articles\/6-1151\/v3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,11,29]]},"references-count":296,"URL":"https:\/\/doi.org\/10.12688\/f1000research.12037.3","relation":{},"ISSN":["2046-1402"],"issn-type":[{"value":"2046-1402","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,11,29]]},"assertion":[{"value":"Indexed","URL":"https:\/\/f1000research.com\/articles\/6-1151\/v3#article-reports","order":0,"name":"referee-status","label":"Referee status","group":{"name":"current-referee-status","label":"Current Referee Status"}},{"value":"10.5256\/f1000research.14133.r27485, David Moher, Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, ON, Canada, 10 Nov 2017, version 2, indexed","URL":"https:\/\/f1000research.com\/articles\/6-1151\/v2#referee-response-27485","order":0,"name":"referee-response-27485","label":"Referee Report","group":{"name":"article-reports","label":"Article Reports"}},{"value":"10.5256\/f1000research.14133.r27486, Virginia Barbour, Queensland University of Technology (QUT), Brisbane, Qld, Australia, 13 Nov 2017, version 2, indexed","URL":"https:\/\/f1000research.com\/articles\/6-1151\/v2#referee-response-27486","order":1,"name":"referee-response-27486","label":"Referee Report","group":{"name":"article-reports","label":"Article Reports"}},{"value":"TRH was supported by funding from the European Commission H2020 project OpenAIRE2020 (Grant agreement: 643410, Call: H2020-EINFRA-2014-1). The publication costs of this article were funded by Imperial College London. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.","order":2,"name":"grant-information","label":"Grant Information"},{"value":"This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.","order":0,"name":"copyright-info","label":"Copyright"}]}}