{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T07:27:35Z","timestamp":1772004455782,"version":"3.50.1"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2021,4,18]],"date-time":"2021-04-18T00:00:00Z","timestamp":1618704000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,4,18]],"date-time":"2021-04-18T00:00:00Z","timestamp":1618704000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100012519","name":"\u00c9cole des Hautes \u00c9tudes en Sant\u00e9 Publique","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100012519","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2021,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Preprints promote the open and fast communication of non-peer reviewed work. Once a preprint is published in a peer-reviewed venue, the preprint server updates its web page: a prominent hyperlink leading to the newly published work is added. Linking preprints to publications is of utmost importance as it provides readers with the latest version of a now certified work. Yet leading preprint servers fail to identify all existing preprint\u2013publication links. This limitation calls for a more thorough approach to this critical information retrieval task: overlooking published evidence translates into partial and even inaccurate systematic reviews on health-related issues, for instance. We designed an algorithm leveraging the Crossref public and free source of bibliographic metadata to comb the literature for preprint\u2013publication links. We tested it on a reference preprint set identified and curated for a living systematic review on interventions for preventing and treating COVID-19 performed by international collaboration: the COVID-NMA initiative (<jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/covid-nma.com\">covid-nma.com<\/jats:ext-link>). The reference set comprised 343 preprints, 121 of which appeared as a publication in a peer-reviewed journal. While the preprint servers identified 39.7% of the preprint\u2013publication links, our linker identified 90.9% of the expected links with no clues taken from the preprint servers. The accuracy of the proposed linker is 91.5% on this reference set, with 90.9% sensitivity and 91.9% specificity. This is a 16.26% increase in accuracy compared to that of preprint servers. We release this software as supplementary material to foster its integration into preprint servers\u2019 workflows and enhance a daily preprint\u2013publication chase that is useful to all readers, including systematic reviewers. This preprint\u2013publication linker currently provides day-to-day updates to the biomedical experts of the COVID-NMA initiative.<\/jats:p>","DOI":"10.1007\/s11192-021-03900-7","type":"journal-article","created":{"date-parts":[[2021,4,18]],"date-time":"2021-04-18T12:02:21Z","timestamp":1618747341000},"page":"5285-5304","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":39,"title":["Day-to-day discovery of preprint\u2013publication links"],"prefix":"10.1007","volume":"126","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3060-6241","authenticated-orcid":false,"given":"Guillaume","family":"Cabanac","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2094-6015","authenticated-orcid":false,"given":"Theodora","family":"Oikonomidi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5263-6241","authenticated-orcid":false,"given":"Isabelle","family":"Boutron","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,4,18]]},"reference":[{"key":"3900_CR1","doi-asserted-by":"publisher","unstructured":"Abdill, R. J., Adamowicz, E. M., & Blekhman, R. (2020). International authorship and collaboration across biorxiv preprints. eLife, 9, e58496. https:\/\/doi.org\/10.7554\/elife.58496","DOI":"10.7554\/elife.58496"},{"key":"3900_CR2","doi-asserted-by":"publisher","unstructured":"Abdill, R. J., & Blekhman, R. (2019). Tracking the popularity and outcomes of all bioRxiv preprints. eLife, 8, e45133. https:\/\/doi.org\/10.7554\/elife.45133","DOI":"10.7554\/elife.45133"},{"issue":"2","key":"3900_CR3","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1002\/leap.1265","volume":"33","author":"KR Anderson","year":"2020","unstructured":"Anderson, K. R. (2020). bioRxiv: Trends and analysis of five years of preprints. Learned Publishing, 33(2), 104\u2013109. https:\/\/doi.org\/10.1002\/leap.1265.","journal-title":"Learned Publishing"},{"key":"3900_CR4","doi-asserted-by":"publisher","unstructured":"Baumann, A., & Wohlrabe, K. (2020). Where have all the working papers gone? Evidence from four major economics working paper series. Scientometrics, 124(3), 2433-2441. https:\/\/doi.org\/10.1007\/s11192-020-03570-x","DOI":"10.1007\/s11192-020-03570-x"},{"key":"3900_CR5","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.cd013769","author":"I Boutron","year":"2020","unstructured":"Boutron, I., Chaimani, A., Devane, D., Meerpohl, J. J., Rada, G., Hr\u00f3bjartsson, A., et al. (2020a). Interventions for the prevention and treatment of COVID-19: a living mapping of research and living network meta-analysis. Cochrane Database of Systematic Reviews. https:\/\/doi.org\/10.1002\/14651858.cd013769.","journal-title":"Cochrane Database of Systematic Reviews"},{"key":"3900_CR6","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.cd013770","author":"I Boutron","year":"2020","unstructured":"Boutron, I., Chaimani, A., Devane, D., Meerpohl, J. J., Rada, G., Hr\u00f3bjartsson, A., et al. (2020b). Interventions for the treatment of COVID-19: a living network meta-analysis. Cochrane Database of Systematic Reviews. https:\/\/doi.org\/10.1002\/14651858.cd013770.","journal-title":"Cochrane Database of Systematic Reviews"},{"key":"3900_CR7","doi-asserted-by":"publisher","unstructured":"Boutron, I., Chaimani, A., Meerpohl, J. J., Hr\u00f3bjartsson, A., Devane, D., Rada, G., et al. (2020). The COVID-NMA project: Building an evidence ecosystem for the COVID-19 pandemic. Annals of Internal Medicine, 173(12), 1015\u20131017. https:\/\/doi.org\/10.7326\/m20-5261.","DOI":"10.7326\/m20-5261"},{"issue":"6494","key":"3900_CR8","doi-asserted-by":"publisher","first-page":"924","DOI":"10.1126\/science.368.6494.924","volume":"368","author":"J Brainard","year":"2020","unstructured":"Brainard, J. (2020). New tools aim to tame pandemic paper tsunami. Science, 368(6494), 924\u2013925. https:\/\/doi.org\/10.1126\/science.368.6494.924.","journal-title":"Science"},{"issue":"2","key":"3900_CR9","doi-asserted-by":"publisher","first-page":"e1001603","DOI":"10.1371\/journal.pmed.1001603","volume":"11","author":"JH Elliott","year":"2014","unstructured":"Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L. (2014). Living systematic reviews: An emerging opportunity to narrow the evidence-practice gap. PLoS Medicine, 11(2), e1001603. https:\/\/doi.org\/10.1371\/journal.pmed.1001603.","journal-title":"PLoS Medicine"},{"key":"3900_CR10","doi-asserted-by":"publisher","unstructured":"Fraser, N., Brierley, L., Dey, G., Polka, J. K., P\u00e1lfy, M., & Coates, J. A. (2020, May 23). Preprinting a pandemic: The role of preprints in the COVID-19 pandemic. (medRxiv preprint, version 1) https:\/\/doi.org\/10.1101\/2020.05.22.111294","DOI":"10.1101\/2020.05.22.111294"},{"key":"3900_CR11","doi-asserted-by":"publisher","unstructured":"Fraser, N., Momeni, F., Mayr, P., & Peters, I. (2020). The relationship between bioRxiv preprints, citations and altmetrics. Quantitative Science Studies, 1\u201321,. https:\/\/doi.org\/10.1162\/qss_a_00043.","DOI":"10.1162\/qss_a_00043"},{"issue":"5","key":"3900_CR12","doi-asserted-by":"publisher","first-page":"102267","DOI":"10.1016\/j.ipm.2020.102267","volume":"57","author":"Y Gao","year":"2020","unstructured":"Gao, Y., Wu, Q., & Zhu, L. (2020). Merging the citations received by arXiv-deposited eprints and their corresponding published journal articles: Problems and perspectives. Information Processing & Management, 57(5), 102267. https:\/\/doi.org\/10.1016\/j.ipm.2020.102267.","journal-title":"Information Processing & Management"},{"issue":"4","key":"3900_CR13","doi-asserted-by":"publisher","first-page":"390","DOI":"10.1063\/1.4823313","volume":"8","author":"P Ginsparg","year":"1994","unstructured":"Ginsparg, P. (1994). First steps towards electronic research communication. Computers in Physics, 8(4), 390\u2013396. https:\/\/doi.org\/10.1063\/1.4823313.","journal-title":"Computers in Physics"},{"issue":"1","key":"3900_CR14","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1162\/qss_a_00022","volume":"1","author":"G Hendricks","year":"2020","unstructured":"Hendricks, G., Tkaczyk, D., Lin, J., & Feeney, P. (2020). Crossref: The sustainable source of community-owned scholarly metadata. Quantitative Science Studies, 1(1), 414\u2013427. https:\/\/doi.org\/10.1162\/qss_a_00022.","journal-title":"Quantitative Science Studies"},{"issue":"1","key":"3900_CR15","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1162\/qss_a_00020","volume":"1","author":"C Herzog","year":"2020","unstructured":"Herzog, C., Hook, D., & Konkiel, S. (2020). Dimensions: Bringing down barriers between scientometricians and data. Quantitative Science Studies, 1(1), 387\u2013395. https:\/\/doi.org\/10.1162\/qss_a_00020.","journal-title":"Quantitative Science Studies"},{"key":"3900_CR16","doi-asserted-by":"publisher","unstructured":"Himmelstein, D. S., Romero, A. R., Levernier, J. G., Munro, T. A., McLaughlin, S. R., Greshake Tzovaras, B., & Greene, C. S. (2018). Sci-Hub provides access to nearly all scholarly literature. eLife, 7, e32822. https:\/\/doi.org\/10.7554\/elife.32822","DOI":"10.7554\/elife.32822"},{"issue":"3","key":"3900_CR17","doi-asserted-by":"publisher","first-page":"2687","DOI":"10.1007\/s11192-020-03587-2","volume":"124","author":"J Homolak","year":"2020","unstructured":"Homolak, J., Kodvanj, I., & Virag, D. (2020). Preliminary analysis of COVID-19 academic information patterns: A call for open science in the times of closed borders. Scientometrics, 124(3), 2687\u20132701. https:\/\/doi.org\/10.1007\/s11192-020-03587-2.","journal-title":"Scientometrics"},{"issue":"4","key":"3900_CR18","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1007\/s00799-018-0234-1","volume":"20","author":"M Klein","year":"2019","unstructured":"Klein, M., Broadwell, P., Farb, S. E., & Grappone, T. (2019). Comparing published scientific journal articles to their pre-print versions. International Journal on Digital Libraries, 20(4), 335\u2013350. https:\/\/doi.org\/10.1007\/s00799-018-0234-1.","journal-title":"International Journal on Digital Libraries"},{"issue":"7807","key":"3900_CR19","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1038\/d41586-020-01394-6","volume":"581","author":"D Kwon","year":"2020","unstructured":"Kwon, D. (2020). How swamped preprint servers are blocking bad coronavirus research. Nature, 581(7807), 130\u2013131. https:\/\/doi.org\/10.1038\/d41586-020-01394-6.","journal-title":"Nature"},{"key":"3900_CR20","unstructured":"Lammey, R. (2016, November 2). Preprints are go at Crossref! Retrieved from https:\/\/www.crossref.org\/blog\/preprints-are-go-at-crossref\/."},{"issue":"6","key":"3900_CR21","doi-asserted-by":"publisher","first-page":"1157","DOI":"10.1002\/asi.23044","volume":"65","author":"V Larivi\u00e8re","year":"2014","unstructured":"Larivi\u00e8re, V., Sugimoto, C. R., Macaluso, B., Milojevic, S., Cronin, B., & Thelwall, M. (2014). arXiv E-prints and the journal of record: An analysis of roles and relationships. Journal of the Association for Information Science and Technology, 65(6), 1157\u20131169. https:\/\/doi.org\/10.1002\/asi.23044.","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"5323","key":"3900_CR22","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1038\/234034a0","volume":"234","author":"M Levandowsky","year":"1971","unstructured":"Levandowsky, M., & Winter, D. (1971). Distance between sets. Nature, 234(5323), 34\u201335. https:\/\/doi.org\/10.1038\/234034a0.","journal-title":"Nature"},{"key":"3900_CR23","unstructured":"Lin, J., & Ram, K. (2018, August 21). Leaving the house\u2014where preprints go. Retrieved from https:\/\/www.crossref.org\/blog\/leaving-the-house-where-preprints-go\/"},{"issue":"1","key":"3900_CR24","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1007\/s11192-020-03430-8","volume":"124","author":"J Lin","year":"2020","unstructured":"Lin, J., Yu, Y., Zhou, Y., Zhou, Z., & Shi, X. (2020). How many preprints have actually been printed and why: a case study of computer science preprints on arXiv. Scientometrics, 124(1), 555\u2013574. https:\/\/doi.org\/10.1007\/s11192-020-03430-8.","journal-title":"Scientometrics"},{"key":"3900_CR25","doi-asserted-by":"publisher","unstructured":"McKiernan, G. (2000). arXiv.org: The Los Alamos National Laboratory eprint server. International Journal on Grey Literature, 1(3), 127-138. https:\/\/doi.org\/10.1108\/14666180010345564","DOI":"10.1108\/14666180010345564"},{"key":"3900_CR26","unstructured":"medRxiv. 2020, (July 14). Frequently Asked Questions (FAQ). Retrieved from https:\/\/web.archive.org\/web\/20200714\/https:\/\/www.medrxiv.org\/about\/FAQ"},{"key":"3900_CR27","doi-asserted-by":"publisher","unstructured":"Oikonomidi, T., Boutron, I., Pierre, O., Cabanac, G., Ravaud, P., & the COVID-19 NMA Consortium. (2020). Changes in evidence for studies assessing interventions for COVID-19 reported in preprints: Meta-research study. BMC Medicine, 18(402). https:\/\/doi.org\/10.1186\/s12916-020-01880-8","DOI":"10.1186\/s12916-020-01880-8"},{"issue":"7","key":"3900_CR28","doi-asserted-by":"publisher","first-page":"666","DOI":"10.1038\/s41562-020-0911-0","volume":"4","author":"A Palayew","year":"2020","unstructured":"Palayew, A., Norgaard, O., Safreed-Harmon, K., Andersen, T. H., Rasmussen, L. N., & Lazarus, J. V. (2020). Pandemic publishing poses a new COVID-19 challenge [Comment]. Nature Human Behaviour, 4(7), 666\u2013669. https:\/\/doi.org\/10.1038\/s41562-020-0911-0.","journal-title":"Nature Human Behaviour"},{"key":"3900_CR29","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1016\/j.jclinepi.2020.01.027","volume":"123","author":"P Ravaud","year":"2020","unstructured":"Ravaud, P., Cr\u00e9quit, P., Williams, H. C., Meerpohl, J., Craig, J. C., & Boutron, I. (2020). Future of evidence ecosystem series: 3. From an evidence synthesis ecosystem to an evidence ecosystem. Journal of Clinical Epidemiology, 123, 153\u2013161. https:\/\/doi.org\/10.1016\/j.jclinepi.2020.01.027.","journal-title":"Journal of Clinical Epidemiology"},{"key":"3900_CR30","doi-asserted-by":"publisher","unstructured":"Rawlinson, C., & Bloom, T. (2019). New preprint server for medical research: Announcing the launch of medRiv for faster access to better evidence [Editorial]. BMJ, l2301. https:\/\/doi.org\/10.1136\/bmj.l2301","DOI":"10.1136\/bmj.l2301"},{"key":"3900_CR31","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1016\/s0076-6879(96)66012-1","volume":"266","author":"GD Schuler","year":"1996","unstructured":"Schuler, G. D., Epstein, J. A., Ohkawa, H., & Kans, J. A. (1996). Entrez: Molecular biology database and retrieval system. Methods in Enzymology, 266, 141\u2013162. https:\/\/doi.org\/10.1016\/s0076-6879(96)66012-1.","journal-title":"Methods in Enzymology"},{"key":"3900_CR32","doi-asserted-by":"publisher","unstructured":"Sever, R., Roeder, T., Hindle, S., Sussman, L., Black, K.-J., Argentine, J., . . . Inglis, J. R. (2019, November 6). bioRxiv: the preprint server for biology. (bioRxiv preprint, version 1) https:\/\/doi.org\/10.1101\/833400","DOI":"10.1101\/833400"},{"key":"3900_CR33","doi-asserted-by":"crossref","unstructured":"Visser, M., van Eck, N. J., & Waltman, L. (2020, May 21). Large-scale comparison of bibliographic data sources: Scopus, Web of Science, Dimensions, Crossref, and Microsoft Academic. Retrieved from https:\/\/arxiv.org\/abs\/2005.10732 (arXiv preprint, version 1)","DOI":"10.1162\/qss_a_00112"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-021-03900-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-021-03900-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-021-03900-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,26]],"date-time":"2021-05-26T17:44:36Z","timestamp":1622051076000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-021-03900-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,18]]},"references-count":33,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,6]]}},"alternative-id":["3900"],"URL":"https:\/\/doi.org\/10.1007\/s11192-021-03900-7","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,18]]},"assertion":[{"value":"7 November 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 February 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 April 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}