{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T10:16:03Z","timestamp":1772878563244,"version":"3.50.1"},"reference-count":43,"publisher":"MIT Press","issue":"2","license":[{"start":{"date-parts":[[2021,2,17]],"date-time":"2021-02-17T00:00:00Z","timestamp":1613520000000},"content-version":"vor","delay-in-days":413,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>A potential motivation for scientists to deposit their scientific work as preprints is to enhance its citation or social impact. In this study we assessed the citation and altmetric advantage of bioRxiv, a preprint server for the biological sciences. We retrieved metadata of all bioRxiv preprints deposited between November 2013 and December 2017, and matched them to articles that were subsequently published in peer-reviewed journals. Citation data from Scopus and altmetric data from Altmetric.com were used to compare citation and online sharing behavior of bioRxiv preprints, their related journal articles, and nondeposited articles published in the same journals. We found that bioRxiv-deposited journal articles had sizably higher citation and altmetric counts compared to nondeposited articles. Regression analysis reveals that this advantage is not explained by multiple explanatory variables related to the articles\u2019 publication venues and authorship. Further research will be required to establish whether such an effect is causal in nature. bioRxiv preprints themselves are being directly cited in journal articles, regardless of whether the preprint has subsequently been published in a journal. bioRxiv preprints are also shared widely on Twitter and in blogs, but remain relatively scarce in mainstream media and Wikipedia articles, in comparison to peer-reviewed journal articles.<\/jats:p>","DOI":"10.1162\/qss_a_00043","type":"journal-article","created":{"date-parts":[[2020,4,1]],"date-time":"2020-04-01T15:54:37Z","timestamp":1585756477000},"page":"618-638","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":74,"title":["The relationship between bioRxiv preprints, citations and altmetrics"],"prefix":"10.1162","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7582-6339","authenticated-orcid":false,"given":"Nicholas","family":"Fraser","sequence":"first","affiliation":[{"name":"ZBW\u2014Leibniz Information Centre for Economics, Kiel, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5572-575X","authenticated-orcid":false,"given":"Fakhri","family":"Momeni","sequence":"additional","affiliation":[{"name":"GESIS\u2014Leibniz Institute for the Social Sciences, Cologne, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6656-1658","authenticated-orcid":false,"given":"Philipp","family":"Mayr","sequence":"additional","affiliation":[{"name":"GESIS\u2014Leibniz Institute for the Social Sciences, Cologne, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5840-0806","authenticated-orcid":false,"given":"Isabella","family":"Peters","sequence":"additional","affiliation":[{"name":"ZBW\u2014Leibniz Information Centre for Economics, Kiel, Germany"},{"name":"Kiel University, Kiel, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2020,6,1]]},"reference":[{"key":"2025073014030426200_bib1","doi-asserted-by":"crossref","unstructured":"Abdill,  R. J., & Blekhman,  R. (2019). Tracking the popularity and outcomes of all bioRxiv preprints. ELife, 8, e45133. https:\/\/doi.org\/10.7554\/eLife.45133","DOI":"10.7554\/eLife.45133"},{"key":"2025073014030426200_bib2","doi-asserted-by":"crossref","unstructured":"Ajiferuke,  I., & Famoye,  F. (2015). Modelling count response variables in informetric studies: Comparison among count, linear, and lognormal regression models. Journal of Informetrics, 9(3), 499\u2013513. https:\/\/doi.org\/10.1016\/j.joi.2015.05.001","DOI":"10.1016\/j.joi.2015.05.001"},{"key":"2025073014030426200_bib3","doi-asserted-by":"crossref","unstructured":"Akaike,  H.\n           (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716\u2013723. https:\/\/doi.org\/10.1109\/tac.1974.1100705","DOI":"10.1109\/TAC.1974.1100705"},{"key":"2025073014030426200_bib4","doi-asserted-by":"crossref","unstructured":"Bates,  D., Maechler,  M., Bolker,  B., & Walker,  S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1\u201348. https:\/\/doi.org\/10.18637\/jss.v067.io1","DOI":"10.18637\/jss.v067.i01"},{"key":"2025073014030426200_bib6","doi-asserted-by":"crossref","unstructured":"Berg,  J. M., Bhalla,  N., Bourne,  P. E., Chalfie,  M., Drubin,  D. G., Fraser,  J. S., \u2026 Wolberger,  C. (2016). Preprints for the life sciences. Science, 352(6288), 899\u2013901. https:\/\/doi.org\/10.1126\/science.aaf9133","DOI":"10.1126\/science.aaf9133"},{"key":"2025073014030426200_bib7","doi-asserted-by":"crossref","unstructured":"Bornmann,  L.\n           (2014). Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics. Journal of Informetrics, 8(4), 895\u2013903. https:\/\/doi.org\/10.1016\/j.joi.2014.09.005","DOI":"10.1016\/j.joi.2014.09.005"},{"key":"2025073014030426200_bib8","doi-asserted-by":"crossref","unstructured":"Brown,  C.\n           (2001). The e-volution of preprints in the scholarly communication of physicists and astronomers. Journal of the American Society for Information Science and Technology, 52(3), 187\u2013200.","DOI":"10.1002\/1097-4571(2000)9999:9999<::AID-ASI1586>3.0.CO;2-D"},{"key":"2025073014030426200_bib9","doi-asserted-by":"crossref","unstructured":"Cagan,  R.\n           (2013). The San Francisco Declaration on Research Assessment. Disease Models & Mechanisms, 6(4), 869\u2013870. https:\/\/doi.org\/10.1242\/dmm.012955","DOI":"10.1242\/dmm.012955"},{"key":"2025073014030426200_bib10","unstructured":"Chamberlain,  S., Zhu,  H., Jahn,  N., Boettiger,  C., & Ram,  K. (2019). rcrossref: Client for various CrossRef APIs. R package version 0.8.9.9200. https:\/\/github.com\/ropensci\/rcrossref"},{"key":"2025073014030426200_bib11","doi-asserted-by":"crossref","unstructured":"Davis,  P. M., & Fromerth,  M. J. (2007). Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles?Scientometrics, 71(2), 203\u2013215. https:\/\/doi.org\/10.1007\/s11192-007-1661-8","DOI":"10.1007\/s11192-007-1661-8"},{"key":"2025073014030426200_bib12","doi-asserted-by":"crossref","unstructured":"Davis,  P. M., Lewenstein,  B. V., Simon,  D. H., Booth,  J. G., & Connolly,  M. J. L. (2008). Open access publishing, article downloads, and citations: Randomised controlled trial. British Medical Journal, 337, a568\u2013a568. https:\/\/doi.org\/10.1136\/bmj.a568","DOI":"10.1136\/bmj.a568"},{"key":"2025073014030426200_bib13","doi-asserted-by":"crossref","unstructured":"Didegah,  F., Bowman,  T. D., & Holmberg,  K. (2018). On the differences between citations and altmetrics: An investigation of factors driving altmetrics versus citations for Finnish articles. Journal of the Association for Information Science and Technology, 69(6), 832\u2013843. https:\/\/doi.org\/10.1002\/asi.23934","DOI":"10.1002\/asi.23934"},{"key":"2025073014030426200_bib14","doi-asserted-by":"crossref","unstructured":"Donner,  P.\n           (2018). Effect of publication month on citation impact. Journal of Informetrics, 12(1), 330\u2013343. https:\/\/doi.org\/10.1016\/j.joi.2018.01.012","DOI":"10.1016\/j.joi.2018.01.012"},{"key":"2025073014030426200_bib15","unstructured":"Fang,  Z., & Costas,  R. (2018). Studying the posts accumulation patterns of Altmetric.com data sources. Presented at 2018 Altmetrics Workshop (Altmetrics18), London, September 25, 2018. Retrieved from http:\/\/altmetrics.org\/wp-content\/uploads\/2018\/04\/altmetrics18_paper_5_Fang.pdf"},{"key":"2025073014030426200_bib16","unstructured":"Foster,  J., Hearst,  M., Nivre,  J., & Zhao,  S. (2017). Report on ACL survey on preprint publishing and reviewing. Association for Computational Linguistics. https:\/\/www.aclweb.org\/portal\/sites\/default\/files\/SurveyReport2017.pdf"},{"key":"2025073014030426200_bib17","doi-asserted-by":"crossref","unstructured":"Fu,  Y. D., & Hughey,  J. J. (2019). Releasing a preprint is associated with more attention and citations for the peer-reviewed article. eLife, 8, e52646. https:\/\/doi.org\/10.7554\/eLife.52646","DOI":"10.7554\/eLife.52646"},{"key":"2025073014030426200_bib19","doi-asserted-by":"crossref","unstructured":"Gargouri,  Y., Hajjem,  C., Larivi\u00e8re,  V., Gingras,  Y., Carr,  L., Brody,  T., & Harnad,  S. (2010). Self-selected or mandated, open access increases citation impact for higher quality research. PLOS ONE, 5(10), e13636. https:\/\/doi.org\/10.1371\/journal.pone.0013636","DOI":"10.1371\/journal.pone.0013636"},{"key":"2025073014030426200_bib20","doi-asserted-by":"crossref","unstructured":"Gentil-Beccot,  A., Mele,  S., & Brooks,  T. C. (2010). Citing and reading behaviours in high-energy physics. Scientometrics, 84(2), 345\u2013355. https:\/\/doi.org\/10.1007\/s11192-009-0111-1","DOI":"10.1007\/s11192-009-0111-1"},{"key":"2025073014030426200_bib21","doi-asserted-by":"crossref","unstructured":"Ginsparg,  P.\n           (2016). Preprint d\u00e9j\u00e0 vu. EMBO Journal, 35(24), 2620\u20132625. https:\/\/doi.org\/10.15252\/embj.201695531","DOI":"10.15252\/embj.201695531"},{"key":"2025073014030426200_bib22","unstructured":"Harrison,  J.\n           (2019). RSelenium: R bindings for Selenium WebDriver. R package version 1.7.5. https:\/\/CRAN.R-project.org\/package=RSelenium"},{"key":"2025073014030426200_bib24","unstructured":"Haustein,  S., Bowman,  T. D., & Costas,  R. (2015). When is an article actually published? An analysis of online availability, publication, and indexation dates. ArXiv:1505.00796 [Cs]. Retrieved from http:\/\/arXiv.org\/abs\/1505.00796"},{"key":"2025073014030426200_bib25","doi-asserted-by":"crossref","unstructured":"Haustein,  S., Costas,  R., & Larivi\u00e8re,  V. (2015). Characterizing social media metrics of scholarly papers: The effect of document properties and collaboration patterns. PLOS ONE, 10(3), e0120495. https:\/\/doi.org\/10.1371\/journal.pone.0120495","DOI":"10.1371\/journal.pone.0120495"},{"key":"2025073014030426200_bib26","doi-asserted-by":"crossref","unstructured":"Henneken,  E. A., Kurtz,  M. J., Eichhorn,  G., Accomazzi,  A., Grant,  C., Thompson,  D., & Murray,  S. S. (2006). Effect of e-printing on citation rates in astronomy and physics. Journal of Electronic Publishing, 9(2). https:\/\/doi.org\/10.3998\/3336451.0009.202","DOI":"10.3998\/3336451.0009.202"},{"key":"2025073014030426200_bib27","doi-asserted-by":"crossref","unstructured":"Henneken,  E. A., Kurtz,  M. J., Eichhorn,  G., Accomazzi,  A., Grant,  C. S., Thompson,  D., \u2026 Warner,  S. (2007). E-prints and journal articles in astronomy: a productive co-existence. Learned Publishing, 20(1), 16\u201322. https:\/\/doi.org\/10.1087\/095315107779490661","DOI":"10.1087\/095315107779490661"},{"key":"2025073014030426200_bib28","doi-asserted-by":"crossref","unstructured":"Kelly,  D.\n           (2018). SIGIR community survey on preprint services. ACM SIGIR Forum, 52(1), 11\u201333. https:\/\/doi.org\/10.1145\/3274784.3274787","DOI":"10.1145\/3274784.3274787"},{"key":"2025073014030426200_bib29","doi-asserted-by":"crossref","unstructured":"Kurtz,  M. J., Eichhorn,  G., Accomazzi,  A., Grant,  C., Demleitner,  M., Henneken,  E., & Murray,  S. S. (2005). The effect of use and access on citations. Information Processing & Management, 41(6), 1395\u20131402. https:\/\/doi.org\/10.1016\/j.ipm.2005.03.010","DOI":"10.1016\/j.ipm.2005.03.010"},{"key":"2025073014030426200_bib30","doi-asserted-by":"crossref","unstructured":"Larivi\u00e8re,  V., Ni,  C., Gingras,  Y., Cronin,  B., & Sugimoto,  C. R. (2013). Bibliometrics: Global gender disparities in science. Nature, 504(7479), 211\u2013213. https:\/\/doi.org\/10.1038\/504211a","DOI":"10.1038\/504211a"},{"key":"2025073014030426200_bib31","doi-asserted-by":"crossref","unstructured":"Larivi\u00e8re,  V., Sugimoto,  C. R., Macaluso,  B., Milojevi\u0107,  S., Cronin,  B., & Thelwall,  M. (2014). arXiv E-prints and the journal of record: An analysis of roles and relationships: arXiv E-Prints and the Journal of Record. Journal of the Association for Information Science and Technology, 65(6), 1157\u20131169. https:\/\/doi.org\/10.1002\/asi.23044","DOI":"10.1002\/asi.23044"},{"key":"2025073014030426200_bib32","doi-asserted-by":"crossref","unstructured":"Maggio,  L. A., ArtinoJr.,  A. R., & Driessen,  E. W. (2018). Preprints: Facilitating early discovery, access, and feedback. Perspectives on Medical Education, 7(5), 287\u2013289. https:\/\/doi.org\/10.1007\/s40037-018-0451-8","DOI":"10.1007\/S40037-018-0451-8"},{"key":"2025073014030426200_bib33","doi-asserted-by":"crossref","unstructured":"Moed,  H. F.\n           (2007). The effect of \u201copen access\u201d on citation impact: An analysis of ArXiv\u2019s condensed matter section. Journal of the American Society for Information Science and Technology, 58(13), 2047\u20132054. https:\/\/doi.org\/10.1002\/asi.20663","DOI":"10.1002\/asi.20663"},{"key":"2025073014030426200_bib34","doi-asserted-by":"crossref","unstructured":"Moed,  H. F., Aisati,  M., & Plume,  A. (2013). Studying scientific migration in Scopus. Scientometrics, 94(3), 929\u2013942. https:\/\/doi.org\/10.1007\/s11192-012-0783-9","DOI":"10.1007\/s11192-012-0783-9"},{"key":"2025073014030426200_bib35","doi-asserted-by":"crossref","unstructured":"Nane,  G. F., Larivi\u00e8re,  V., & Costas,  R. (2017). Predicting the age of researchers using bibliometric data. Journal of Informetrics, 11(3), 713\u2013729. https:\/\/doi.org\/10.1016\/j.joi.2017.05.002","DOI":"10.1016\/j.joi.2017.05.002"},{"key":"2025073014030426200_bib36","doi-asserted-by":"crossref","unstructured":"Piwowar,  H., Priem,  J., Larivi\u00e8re,  V., Alperin,  J. P., Matthias,  L., Norlander,  B., \u2026 Haustein,  S. (2018). The state of OA: a large-scale analysis of the prevalence and impact of Open Access articles. PeerJ, 6, e4375. https:\/\/doi.org\/10.7717\/peerj.4375","DOI":"10.7717\/peerj.4375"},{"key":"2025073014030426200_bib37","doi-asserted-by":"crossref","unstructured":"Ruocco,  G., Daraio,  C., Folli,  V., & Leonetti,  M. (2017). Bibliometric indicators: the origin of their log-normal distribution and why they are not a reliable proxy for an individual scholar\u2019s talent. Palgrave Communications, 3, 17064. https:\/\/doi.org\/10.1057\/palcomms.2017.64","DOI":"10.1057\/palcomms.2017.64"},{"key":"2025073014030426200_bib38","doi-asserted-by":"crossref","unstructured":"Santamar\u00eda,  L., & Mihaljevi\u0107,  H. (2018). Comparison and benchmark of name-to-gender inference services. PeerJ Computer Science, 4, e156. https:\/\/doi.org\/10.7717\/peerj-cs.156","DOI":"10.7717\/peerj-cs.156"},{"key":"2025073014030426200_bib39","doi-asserted-by":"crossref","unstructured":"Serghiou,  S., & Ioannidis,  J. P. A. (2018). Altmetric scores, citations, and publication of studies posted as preprints. Journal of the American Medical Association, 319(4), 402. https:\/\/doi.org\/10.1001\/jama.2017.21168","DOI":"10.1001\/jama.2017.21168"},{"key":"2025073014030426200_bib40","doi-asserted-by":"crossref","unstructured":"Stoddard,  B. L., & Fox,  K. R. (2019). Editorial: Preprints, citations and Nucleic Acids Research. Nucleic Acids Research, 47(1), 1\u20132. https:\/\/doi.org\/10.1093\/nar\/gky1229","DOI":"10.1093\/nar\/gky1229"},{"key":"2025073014030426200_bib41","doi-asserted-by":"crossref","unstructured":"Tahamtan,  I., Safipour Afshar,  A., & Ahamdzadeh,  K. (2016). Factors affecting number of citations: A comprehensive review of the literature. Scientometrics, 107(3), 1195\u20131225. https:\/\/doi.org\/10.1007\/s11192-016-1889-2","DOI":"10.1007\/s11192-016-1889-2"},{"key":"2025073014030426200_bib42","doi-asserted-by":"crossref","unstructured":"Thelwall,  M.\n           (2016). Are the discretised lognormal and hooked power law distributions plausible for citation data?Journal of Informetrics, 10(2), 454\u2013470. https:\/\/doi.org\/10.1016\/j.joi.2016.03.001","DOI":"10.1016\/j.joi.2016.03.001"},{"key":"2025073014030426200_bib43","doi-asserted-by":"crossref","unstructured":"Thelwall,  M. & Wilson,  P. (2014). Regression for citation data: An evaluation of different methods. Journal of Informetrics, 8(4), 963\u2013971. https:\/\/doi.org\/10.1016\/j.joi.2014.09.011","DOI":"10.1016\/j.joi.2014.09.011"},{"key":"2025073014030426200_bib44","doi-asserted-by":"crossref","unstructured":"van der Loo,  M. P. J.\n           (2014). The stringdist package for approximate string matching. R Journal, 6(1), 111\u2013122.","DOI":"10.32614\/RJ-2014-011"},{"key":"2025073014030426200_bib45","doi-asserted-by":"crossref","unstructured":"van Dijk,  D., Manor,  O., & Carey,  L. B. (2014). Publication metrics and success on the academic job market. Current Biology, 24(11), R516\u2013R517. https:\/\/doi.org\/10.1016\/j.cub.2014.04.039","DOI":"10.1016\/j.cub.2014.04.039"},{"key":"2025073014030426200_bib47","unstructured":"Wickham,  H.\n           (2016). rvest: Easily harvest (scrape) web pages. R package version 0.3.2. https:\/\/CRAN.R-project.org\/package=rvest"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/1\/2\/618\/1885934\/qss_a_00043.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/1\/2\/618\/1885934\/qss_a_00043.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T18:03:39Z","timestamp":1753898619000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/1\/2\/618\/96153\/The-relationship-between-bioRxiv-preprints"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020]]},"references-count":43,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,6,1]]}},"URL":"https:\/\/doi.org\/10.1162\/qss_a_00043","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/673665","asserted-by":"object"}]},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020]]},"published":{"date-parts":[[2020]]}}}