{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,14]],"date-time":"2026-02-14T03:13:20Z","timestamp":1771038800803,"version":"3.50.1"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2022,5,25]],"date-time":"2022-05-25T00:00:00Z","timestamp":1653436800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,5,25]],"date-time":"2022-05-25T00:00:00Z","timestamp":1653436800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The role of preprints in the scientific production and their part in citations have been growing over the past 10 years. In this paper we study preprint citations in several different aspects: the progression of preprint citations over time, their relative frequencies in relation to the IMRaD structure of articles, their distributions over time, per preprint database and per PLOS journal. We have processed the PLOS corpus that covers 7 journals and a total of about 240,000 articles up to January 2021, and produced a dataset of 8460 preprint citation contexts that cite 12 different preprint databases. Our results show that preprint citations are found with the highest frequency in the Method section of articles, though small variations exist with respect to journals. The PLOS Computational Biology journal stands out as it contains more than three times more preprint citations than any other PLOS journal. The relative parts of the different preprint databases are also examined. While ArXiv and bioRxiv are the most frequent citation sources, bioRxiv\u2019s disciplinary nature can be observed as it is the source of more than 70% of preprint citations in PLOS Biology, PLOS Genetics and PLOS Pathogens. We have also compared the lexical content of preprint citation contexts to the citation content to peer-reviewed publications. Finally, by performing a lexicometric analysis, we have shown that preprint citation contexts differ significantly from citation contexts of peer-reviewed publications. This confirms that authors make use of different lexical content when citing preprints compared to the rest of citations.<\/jats:p>","DOI":"10.1007\/s11192-022-04388-5","type":"journal-article","created":{"date-parts":[[2022,5,25]],"date-time":"2022-05-25T11:02:57Z","timestamp":1653476577000},"page":"6895-6912","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Preprint citation practice in PLOS"],"prefix":"10.1007","volume":"127","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1803-6952","authenticated-orcid":false,"given":"Marc","family":"Bertin","sequence":"first","affiliation":[]},{"given":"Iana","family":"Atanassova","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,5,25]]},"reference":[{"key":"4388_CR1","doi-asserted-by":"publisher","first-page":"e45133","DOI":"10.7554\/eLife.45133","volume":"8","author":"RJ Abdill","year":"2019","unstructured":"Abdill, R. J., & Blekhman, R. (2019). Meta-Research: Tracking the popularity and outcomes of all bioRxiv preprints. eLife, 8, e45133. https:\/\/doi.org\/10.7554\/eLife.45133.","journal-title":"eLife"},{"key":"4388_CR4","doi-asserted-by":"publisher","first-page":"e10927","DOI":"10.7717\/peerj.10927","volume":"9","author":"D A\u00f1azco","year":"2021","unstructured":"A\u00f1azco, D., Nicolalde, B., Espinosa, I., Camacho, J., Mushtaq, M., Gimenez, J., & Teran, E. (2021). Publication rate and citation counts for preprints released during the covid-19 pandemic: The good, the bad and the ugly. PeerJ, 9, e10927. https:\/\/doi.org\/10.7717\/peerj.10927.","journal-title":"PeerJ"},{"issue":"2","key":"4388_CR2","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1002\/leap.1265","volume":"33","author":"KR Anderson","year":"2020","unstructured":"Anderson, K. R. (2020). bioRxiv: Trends and analysis of five years of preprints. Learned Publishing, 33(2), 104\u2013109. https:\/\/doi.org\/10.1002\/leap.1265","journal-title":"Learned Publishing"},{"key":"4388_CR3","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.6092101","author":"I Atanassova","year":"2022","unstructured":"Atanassova, I., & Bertin, M. (2022). Preprint citations in PLOS dataset. Zenodo. https:\/\/doi.org\/10.5281\/zenodo.6092101.","journal-title":"Zenodo"},{"key":"4388_CR5","volume-title":"L\u2019analyse des donn\u00e9es: L\u2019analyse des correspondances","author":"J-P Benz\u00e9cri","year":"1973","unstructured":"Benz\u00e9cri, J.-P. (1973). L\u2019analyse des donn\u00e9es: L\u2019analyse des correspondances. Dunod."},{"key":"4388_CR6","unstructured":"Benz\u00e9cri, J.-P. (1992). In N. Y. Dekker (Ed.), Correspondence Analysis Handbook (translated from: Pratique de l\u2019analyse des donn\u00e9es, 1. Expos\u00e9 \u00e9l\u00e9mentaire. Dunod. ISBN 978-2-04-015732-6)."},{"issue":"6358","key":"4388_CR7","doi-asserted-by":"publisher","first-page":"1331","DOI":"10.1126\/science.aaq0167","volume":"357","author":"J Berg","year":"2017","unstructured":"Berg, J. (2017). Preprint ecosystems. Science, 357(6358), 1331\u20131331. https:\/\/doi.org\/10.1126\/science.aaq0167","journal-title":"Science"},{"issue":"6288","key":"4388_CR8","doi-asserted-by":"publisher","first-page":"899","DOI":"10.1126\/science.aaf9133","volume":"352","author":"JM Berg","year":"2016","unstructured":"Berg, J. M., Bhalla, N., Bourne, P. E., Chalfie, M., Drubin, D. G., Fraser, J. S., & Wolberger, C. (2016). Preprints for the life sciences. Science, 352(6288), 899\u2013901. https:\/\/doi.org\/10.1126\/science.aaf9133","journal-title":"Science"},{"key":"4388_CR9","unstructured":"Bertin, M., & Atanassova, I. (2014). A study of lexical distribution in citation contexts through the IMRaD standard. In Proceedings of the 1st Workshop on Bibliometric-enhanced Information Retrieval (BIR) co-located with 36th European Conference on Information Retrieval (ECIR) (Vol. 1143, pp. 5\u201312). http:\/\/ceur-ws.org\/Vol-1143\/paper1.pdf."},{"key":"4388_CR10","unstructured":"Bertin, M., & Atanassova, I. (2021). The place of preprint citations in the IMRaD structure: a study of PLOS Journals. In Proceedings of the 18th ISSI Conference. https:\/\/www.issi-society.org\/proceedings\/issi_2021\/Proceedings%20ISSI%202021.pdf."},{"issue":"1","key":"4388_CR11","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1002\/asi.23367","volume":"67","author":"M Bertin","year":"2016","unstructured":"Bertin, M., Atanassova, I., Gingras, Y., & Larivi\u00e8re, V. (2016). The invariant distribution of references in scientific articles. Journal of the Association for Information Science and Technology, 67(1), 164\u2013177. https:\/\/doi.org\/10.1002\/asi.23367","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"4388_CR12","unstructured":"Bordignon, F., Ermakova, L., & Noel, M. (2021, April). Preprint abstracts in times of crisis: a comparative study with the pre-pandemic period. In I. Frommholz, P. Mayr, G. Cabanac, & S. Verberne (Eds.), Proceedings of the 11th international workshop on bibliometric-enhanced information retrieval co-located with 43rd European Conference on Information Retrieval (Vol. 2847, pp. 37\u201344). https:\/\/hal-enpc.archives-ouvertes.fr\/hal-03187900."},{"key":"4388_CR13","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-021-03900-7","author":"G Cabanac","year":"2021","unstructured":"Cabanac, G., Oikonomidi, T., & Boutron, I. (2021). Day-to-day discovery of preprint-publication links. Scientometrics. https:\/\/doi.org\/10.1007\/s11192-021-03900-7.","journal-title":"Scientometrics"},{"issue":"2","key":"4388_CR14","doi-asserted-by":"publisher","first-page":"73","DOI":"10.17646\/kome.2017.26","volume":"5","author":"JAT da Silva","year":"2017","unstructured":"da Silva, J. A. T. (2017a). Preprints: Ethical hazard or academic liberation? Kome, 5(2), 73\u201380. https:\/\/doi.org\/10.17646\/kome.2017.26.","journal-title":"Kome"},{"issue":"6","key":"4388_CR15","first-page":"1026","volume":"113","author":"JAT da Silva","year":"2017","unstructured":"da Silva, J. A. T. (2017b). Preprints should not be cited. Current Science, 113(6), 1026\u20131027.","journal-title":"Current Science"},{"key":"4388_CR16","doi-asserted-by":"publisher","first-page":"74","DOI":"10.21037\/amj.2017.05.23","volume":"2","author":"JAT da Silva","year":"2017","unstructured":"da Silva, J. A. T. (2017c). The preprint wars. AME Medical Journal, 2, 74. https:\/\/doi.org\/10.21037\/amj.2017.05.23","journal-title":"AME Medical Journal"},{"issue":"2","key":"4388_CR17","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1016\/j.mjafi.2017.08.002","volume":"74","author":"JAT da Silva","year":"2018","unstructured":"da Silva, J. A. T. (2018). The preprint debate: What are the issues? Medical Journal Armed Forces India, 74(2), 162\u2013164. https:\/\/doi.org\/10.1016\/j.mjafi.2017.08.002","journal-title":"Medical Journal Armed Forces India"},{"issue":"5","key":"4388_CR18","doi-asserted-by":"publisher","first-page":"e1001563","DOI":"10.1371\/journal.pbio.1001563","volume":"11","author":"P Desjardins-Proulx","year":"2013","unstructured":"Desjardins-Proulx, P., White, E. P., Adamson, J. J., Ram, K., Poisot, T., & Gravel, D. (2013). The case for open preprints in biology. PLoS Biology, 11(5), e1001563. https:\/\/doi.org\/10.1371\/journal.pbio.1001563.","journal-title":"PLoS Biology"},{"key":"4388_CR19","doi-asserted-by":"publisher","DOI":"10.1101\/2020.05.22.111294","author":"N Fraser","year":"2021","unstructured":"Fraser, N., Brierley, L., Dey, G., Polka, J. K., P\u00e1lfy, M., Nanni, F., & Coates, J. A. (2021). Preprinting the COVID-19 pandemic. bioRxiv. https:\/\/doi.org\/10.1101\/2020.05.22.111294.","journal-title":"bioRxiv"},{"issue":"2","key":"4388_CR20","doi-asserted-by":"publisher","first-page":"618","DOI":"10.1162\/qss\\_a_00043","volume":"1","author":"N Fraser","year":"2020","unstructured":"Fraser, N., Momeni, F., Mayr, P., & Peters, I. (2020). The relationship between bioRxiv preprints, citations and altmetrics. Quantitative Science Studies, 1(2), 618\u2013638. https:\/\/doi.org\/10.1162\/qss_a_00043","journal-title":"Quantitative Science Studies"},{"key":"4388_CR21","doi-asserted-by":"publisher","DOI":"10.1099\/acmi.0.000013","author":"NK Fry","year":"2019","unstructured":"Fry, N. K., Marshall, H., & Mellins-Cohen, T. (2019). In praise of preprints. Access Microbiology. https:\/\/doi.org\/10.1099\/acmi.0.000013.","journal-title":"Access Microbiology"},{"key":"4388_CR22","doi-asserted-by":"publisher","first-page":"e52646","DOI":"10.7554\/eLife.52646","volume":"8","author":"DY Fu","year":"2019","unstructured":"Fu, D. Y., & Hughey, J. J. (2019). Meta-research: Releasing a preprint is associated with more attention and citations for the peer-reviewed article. eLife, 8, e52646. https:\/\/doi.org\/10.7554\/eLife.52646","journal-title":"eLife"},{"issue":"7","key":"4388_CR23","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1038\/426007a","volume":"426","author":"J Giles","year":"2003","unstructured":"Giles, J. (2003). Preprint server seeks way to halt plagiarists. Nature, 426(7), 7. https:\/\/doi.org\/10.1038\/426007a","journal-title":"Nature"},{"issue":"1","key":"4388_CR24","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1080\/02763869.2020.1704597","volume":"39","author":"MB Hoy","year":"2020","unstructured":"Hoy, M. B. (2020). Rise of the Rxivs: How preprint servers are changing the publishing process. Medical Reference Services Quarterly, 39(1), 84\u201389. https:\/\/doi.org\/10.1080\/02763869.2020.1704597.","journal-title":"Medical Reference Services Quarterly"},{"issue":"4","key":"4388_CR25","doi-asserted-by":"publisher","first-page":"1002549","DOI":"10.1371\/journal.pmed.1002549","volume":"15","author":"MA Johansson","year":"2018","unstructured":"Johansson, M. A., Reich, N. G., Meyers, L. A., & Lipsitch, M. (2018). Preprints: An underutilized mechanism to accelerate outbreak science. PLoS Medicine, 15(4), 1002549. https:\/\/doi.org\/10.1371\/journal.pmed.1002549.","journal-title":"PLoS Medicine"},{"issue":"1","key":"4388_CR26","doi-asserted-by":"publisher","first-page":"4","DOI":"10.6087\/kcse.223","volume":"8","author":"YH Jung","year":"2021","unstructured":"Jung, Y. H., & Sun, H. (2021). Korean editors\u2019 and researchers\u2019 experiences with preprints and attitudes towards preprint policies. Science Editing, 8(1), 4\u20139. https:\/\/doi.org\/10.6087\/kcse.223.","journal-title":"Science Editing"},{"issue":"6358","key":"4388_CR27","doi-asserted-by":"publisher","first-page":"1344","DOI":"10.1126\/science.357.6358.1344","volume":"357","author":"J Kaiser","year":"2017","unstructured":"Kaiser, J. (2017). The preprint dilemma. Science, 357(6358), 1344\u20131349. https:\/\/doi.org\/10.1126\/science.357.6358.1344","journal-title":"Science"},{"issue":"6","key":"4388_CR28","doi-asserted-by":"publisher","first-page":"1157","DOI":"10.1002\/asi.23044","volume":"65","author":"V Larivi\u00e8re","year":"2014","unstructured":"Larivi\u00e8re, V., Sugimoto, C. R., Macaluso, B., Milojevi\u0107, S., Cronin, B., & Thelwall, M. (2014). arXiv E-prints and the journal of record: An analysis of roles and relationships. Journal of the Association for Information Science and Technology, 65(6), 1157\u20131169. https:\/\/doi.org\/10.1002\/asi.23044","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"4388_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v025.i01","volume":"25","author":"S L\u00ea","year":"2008","unstructured":"L\u00ea, S., Josse, J., & Husson, F. (2008). FactoMineR: An R package for multivariate analysis. Journal of Statistical Software, 25, 1\u201318. https:\/\/doi.org\/10.18637\/jss.v025.i01.","journal-title":"Journal of Statistical Software"},{"key":"4388_CR30","doi-asserted-by":"publisher","DOI":"10.1108\/ajim-03-2015-0049","author":"X Li","year":"2015","unstructured":"Li, X., Thelwall, M., & Kousha, K. (2015). The role of arXiv, RePEc, SSRN and PMC in formal scholarly communication. ASLIB Journal of Information Management. https:\/\/doi.org\/10.1108\/ajim-03-2015-0049.","journal-title":"ASLIB Journal of Information Management"},{"issue":"5","key":"4388_CR31","doi-asserted-by":"publisher","first-page":"e627","DOI":"10.1016\/s2214-109x(20)30113-3","volume":"8","author":"MS Majumder","year":"2020","unstructured":"Majumder, M. S., & Mandl, K. D. (2020). Early in the epidemic: Impact of preprints on global discourse about COVID-19 transmissibility. The Lancet Global Health, 8(5), e627\u2013e630. https:\/\/doi.org\/10.1016\/s2214-109x(20)30113-3.","journal-title":"The Lancet Global Health"},{"issue":"1","key":"4388_CR32","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1111\/jep.13498","volume":"27","author":"S Nabavi Nouri","year":"2021","unstructured":"Nabavi Nouri, S., Cohen, Y. A., Madhavan, M. V., Slomka, P. J., Iskandrian, A. E., & Einstein, A. J. (2021). Preprint manuscripts and servers in the era of coronavirus disease 2019. Journal of Evaluation in Clinical Practice, 27(1), 16\u201321. https:\/\/doi.org\/10.1111\/jep.13498","journal-title":"Journal of Evaluation in Clinical Practice"},{"issue":"4","key":"4388_CR33","doi-asserted-by":"publisher","first-page":"e1008565","DOI":"10.1371\/journal.pgen.1008565","volume":"16","author":"NC Penfold","year":"2020","unstructured":"Penfold, N. C., & Polka, J. K. (2020). Technical and social issues influencing the adoption of preprints in the life sciences. PLoS Genetics, 16(4), e1008565. https:\/\/doi.org\/10.1371\/journal.pgen.1008565.","journal-title":"PLoS Genetics"},{"key":"4388_CR34","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1045\/december2001-pinfield","volume":"7","author":"S Pinfield","year":"2001","unstructured":"Pinfield, S. (2001). How do physicists use an e-print archive? Implications for institutional e-print services. D-Lib Magazine, 7, 12. https:\/\/doi.org\/10.1045\/december2001-pinfield.","journal-title":"D-Lib Magazine"},{"key":"4388_CR35","unstructured":"Ratinaud, P., & D\u00e9jean, S. (2009). Iramuteq: impl\u00e9mentation de la m\u00e9thode alceste d\u2019analyse de texte dans un logiciel libre. Mod\u00e9lisation appliqu\u00e9e aux sciences humaines et sociales MASHS, 8\u20139. http:\/\/www.iramuteq.org\/."},{"issue":"1","key":"4388_CR36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12910-021-00667-7","volume":"22","author":"R Ravinetto","year":"2021","unstructured":"Ravinetto, R., Caillet, C., Zaman, M. H., Singh, J. A., Guerin, P. J., Ahmad, A., et al. (2021). Preprints in times of Covid19: The time is ripe for agreeing on terminology and good practices. BMC Medical Ethics, 22(1), 1\u20135. https:\/\/doi.org\/10.1186\/s12910-021-00667-7.","journal-title":"BMC Medical Ethics"},{"key":"4388_CR37","unstructured":"Saier, T., & F\u00e4rber, M. (2019, April). Bibliometric-Enhanced arXiv: A Data Set for Paper-Based and Citation-Based Tasks. In G. Cabanac, I. Frommholz, & P. Mayr (Eds.), Proceedings of the 8th International workshop on bibliometric-enhanced information retrieval (bir)co-located with the 41st European Conference on Information Retrieval (ECIR 2019) (Vol. 2345, pp. 14\u201326). http:\/\/ceur-ws.org\/Vol-2345\/paper2.pdf."},{"issue":"2","key":"4388_CR38","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1016\/j.joi.2018.03.007","volume":"12","author":"H Small","year":"2018","unstructured":"Small, H. (2018). Characterizing highly cited method and non-method papers using citation contexts: The role of uncertainty. Journal of Informetrics, 12(2), 461\u2013480. https:\/\/doi.org\/10.1016\/j.joi.2018.03.007","journal-title":"Journal of Informetrics"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04388-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-022-04388-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04388-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,5]],"date-time":"2022-12-05T05:18:07Z","timestamp":1670217487000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-022-04388-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,25]]},"references-count":38,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["4388"],"URL":"https:\/\/doi.org\/10.1007\/s11192-022-04388-5","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,25]]},"assertion":[{"value":"2 November 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 April 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 May 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant financial or non-financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}