{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,12]],"date-time":"2026-07-12T03:01:38Z","timestamp":1783825298637,"version":"3.55.0"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2022,6,1]],"date-time":"2022-06-01T00:00:00Z","timestamp":1654041600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,6,9]],"date-time":"2022-06-09T00:00:00Z","timestamp":1654732800000},"content-version":"vor","delay-in-days":8,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["101017452"],"award-info":[{"award-number":["101017452"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2022,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This work aims to identify classes of DOI mistakes by analysing the open bibliographic metadata available in Crossref, highlighting which publishers were responsible for such mistakes and how many of these incorrect DOIs could be corrected through automatic processes. By using a list of invalid cited DOIs gathered by OpenCitations while processing the OpenCitations Index of Crossref open DOI-to-DOI citations (COCI) in the past two years, we retrieved the citations in the January 2021 Crossref dump to such invalid DOIs. We processed these citations by keeping track of their validity and the publishers responsible for uploading the related citation data in Crossref. Finally, we identified patterns of factual errors in the invalid DOIs and the regular expressions needed to catch and correct them. The outcomes of this research show that only a few publishers were responsible for and\/or affected by the majority of invalid citations. We extended the taxonomy of DOI name errors proposed in past studies and defined more elaborated regular expressions that can clean a higher number of mistakes in invalid DOIs than prior approaches. The data gathered in our study can enable investigating possible reasons for DOI mistakes from a qualitative point of view, helping publishers identify the problems underlying their production of invalid citation data. Also, the DOI cleaning mechanism we present could be integrated into the existing process (e.g. in COCI) to add citations by automatically correcting a wrong DOI. This study was run strictly following Open Science principles, and, as such, our research outcomes are fully reproducible.<\/jats:p>","DOI":"10.1007\/s11192-022-04367-w","type":"journal-article","created":{"date-parts":[[2022,6,9]],"date-time":"2022-06-09T12:03:49Z","timestamp":1654776229000},"page":"3593-3612","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Identifying and correcting invalid citations due to DOI errors in Crossref data"],"prefix":"10.1007","volume":"127","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9812-4065","authenticated-orcid":false,"given":"Alessia","family":"Cioffi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6279-3830","authenticated-orcid":false,"given":"Sara","family":"Coppini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8420-0696","authenticated-orcid":false,"given":"Arcangelo","family":"Massari","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5486-7070","authenticated-orcid":false,"given":"Arianna","family":"Moretti","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0530-4305","authenticated-orcid":false,"given":"Silvio","family":"Peroni","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7363-6737","authenticated-orcid":false,"given":"Cristian","family":"Santini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4114-074X","authenticated-orcid":false,"given":"Nooshin","family":"Shahidzadeh Asadi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,6,9]]},"reference":[{"key":"4367_CR1","doi-asserted-by":"publisher","unstructured":"Boente, R., Massari, A., Santini, C., & Tural, D. (2021a). Classes of errors in DOI names: Output dataset (v1.0.0) [Data set]. Zenodo. https:\/\/doi.org\/10.5281\/ZENODO.4892551.","DOI":"10.5281\/ZENODO.4892551"},{"key":"4367_CR2","doi-asserted-by":"publisher","unstructured":"Boente, R., Massari, A., Santini, C., & Tural, D. (2021b). Classes of errors in DOI names (Data Management Plan) (Version 5). Zenodohttps:\/\/doi.org\/10.5281\/zenodo.4733919.","DOI":"10.5281\/zenodo.4733919"},{"key":"4367_CR3","doi-asserted-by":"publisher","unstructured":"Boente, R., Massari, A., Santini, C., & Tural, D. (2021c). Protocol: Investigating DOIs classes of errors v5. https:\/\/doi.org\/10.17504\/protocols.io.buuknwuw.","DOI":"10.17504\/protocols.io.buuknwuw"},{"issue":"3","key":"4367_CR4","doi-asserted-by":"publisher","first-page":"1453","DOI":"10.1007\/s11192-016-2225-6","volume":"110","author":"C Boudry","year":"2017","unstructured":"Boudry, C., & Chartron, G. (2017). Availability of digital object identifiers in publications archived by PubMed. Scientometrics, 110(3), 1453\u20131469. https:\/\/doi.org\/10.1007\/s11192-016-2225-6","journal-title":"Scientometrics"},{"issue":"4","key":"4367_CR5","doi-asserted-by":"publisher","first-page":"292","DOI":"10.5860\/crl.67.4.292","volume":"67","author":"RA Buchanan","year":"2006","unstructured":"Buchanan, R. A. (2006). Accuracy of cited references: The role of citation databases. College & Research Libraries, 67(4), 292\u2013303. https:\/\/doi.org\/10.5860\/crl.67.4.292","journal-title":"College & Research Libraries"},{"key":"4367_CR6","doi-asserted-by":"publisher","unstructured":"Cioffi, A., Coppini, S., Moretti, A., & Shahidzadeh Asadi, N. (2021a). Investigating Missing Citations in COCI [Data Management Plan]. https:\/\/doi.org\/10.5281\/zenodo.4671486.","DOI":"10.5281\/zenodo.4671486"},{"key":"4367_CR7","doi-asserted-by":"publisher","unstructured":"Cioffi, A., Coppini, S., Moretti, A., & Shahidzadeh Asadi, N. (2021b). Missing Citations in COCI: Publishers Analytics Result (Second) [Data set]. Zenodohttps:\/\/doi.org\/10.5281\/ZENODO.5018586.","DOI":"10.5281\/ZENODO.5018586"},{"key":"4367_CR8","doi-asserted-by":"publisher","unstructured":"Coppini, S., Moretti, A., Shahidzadeh Asadi, N., & Cioffi, A. (2021a). open-sci\/2020-2021a-the-leftovers-20-code: Version 1.1.0 (v1.1.0) [Computer software]. Zenodo. https:\/\/doi.org\/10.5281\/ZENODO.5070140.","DOI":"10.5281\/ZENODO.5070140"},{"key":"4367_CR9","doi-asserted-by":"publisher","unstructured":"Coppini, S., Shahidzadeh, N., Cioffi, A., & Moretti, A. (2021b). Investigating Invalid DOIs in COCI - Protocol v4 [Protocol]. https:\/\/doi.org\/10.17504\/protocols.io.bv9jn94n.","DOI":"10.17504\/protocols.io.bv9jn94n"},{"key":"4367_CR10","doi-asserted-by":"publisher","unstructured":"Crossref. (2021). January 2021 Public Data File from Crossref . https:\/\/doi.org\/10.13003\/GU3DQMJVG4.","DOI":"10.13003\/GU3DQMJVG4"},{"key":"4367_CR11","doi-asserted-by":"publisher","DOI":"10.1101\/539833","author":"S Domanskyi","year":"2019","unstructured":"Domanskyi, S., Szedlak, A., Hawkins, N. T., Wang, J., Paternostro, G., & Piermarocchi, C. (2019). Polled Digital Cell Sorter (p-DCS): Automatic identification of hematological cell types from single cell RNA-sequencing clusters [Preprint]. Bioinformatics. https:\/\/doi.org\/10.1101\/539833","journal-title":"Bioinformatics"},{"issue":"3","key":"4367_CR12","doi-asserted-by":"publisher","first-page":"2181","DOI":"10.1007\/s11192-014-1503-4","volume":"102","author":"F Franceschini","year":"2015","unstructured":"Franceschini, F., Maisano, D., & Mastrogiacomo, L. (2015). Errors in DOI indexing by bibliometric databases. Scientometrics, 102(3), 2181\u20132186. https:\/\/doi.org\/10.1007\/s11192-014-1503-4","journal-title":"Scientometrics"},{"key":"4367_CR101","doi-asserted-by":"publisher","unstructured":"Franceschini, F., Maisano, D., & Mastrogiacomo, L. (2016). The museum of errors\/horrors in Scopus. Journal of Informetrics, 10(1), 174\u2013182. https:\/\/doi.org\/10.1016\/j.joi.2015.11.006","DOI":"10.1016\/j.joi.2015.11.006"},{"issue":"1","key":"4367_CR13","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1007\/s10479-011-0841-3","volume":"219","author":"CR Garc\u00eda-Alonso","year":"2014","unstructured":"Garc\u00eda-Alonso, C. R., P\u00e9rez-Naranjo, L. M., & Fern\u00e1ndez-Caballero, J. C. (2014). Multiobjective evolutionary algorithms to identify highly autocorrelated areas: The case of spatial distribution in financially compromised farms. Annals of Operations Research, 219(1), 187\u2013202. https:\/\/doi.org\/10.1007\/s10479-011-0841-3","journal-title":"Annals of Operations Research"},{"key":"4367_CR14","doi-asserted-by":"publisher","DOI":"10.1101\/545681","author":"C Garc\u00eda-Timermans","year":"2019","unstructured":"Garc\u00eda-Timermans, C., Rubbens, P., Heyse, J., Kerckhof, F.-M., Props, R., Skirtach, A. G., Waegeman, W., & Boon, N. (2019). Measuring phenotypic heterogeneity in isogenic bacterial populations using flow cytometry and Raman spectroscopy [Preprint]. Bioengineering. https:\/\/doi.org\/10.1101\/545681","journal-title":"Bioengineering"},{"key":"4367_CR102","doi-asserted-by":"publisher","unstructured":"Gorraiz, J., Melero-Fuentes, D., Gumpenberger, C., & Valderrama-Zuri\u00e1n, J.-C. (2016). Availability of digital object identifiers (DOIs) in Web of Science and Scopus. Journal of Informetrics, 10(1), 98\u2013109. https:\/\/doi.org\/10.1016\/j.joi.2015.11.008","DOI":"10.1016\/j.joi.2015.11.008"},{"key":"4367_CR15","doi-asserted-by":"crossref","unstructured":"Heibi, I., Peroni, S., & Shotton, D. (2019a). Crowdsourcing open citations with CROCI\u2014An analysis of the current status of open citations, and a proposal. ArXiv:1902.02534 [Cs]. http:\/\/arxiv.org\/abs\/1902.02534.","DOI":"10.59350\/zcrhs-r7h02"},{"issue":"2","key":"4367_CR16","doi-asserted-by":"publisher","first-page":"1213","DOI":"10.1007\/s11192-019-03217-6","volume":"121","author":"I Heibi","year":"2019","unstructured":"Heibi, I., Peroni, S., & Shotton, D. (2019b). Software review: COCI, the OpenCitations Index of Crossref open DOI-to-DOI citations. Scientometrics, 121(2), 1213\u20131228. https:\/\/doi.org\/10.1007\/s11192-019-03217-6","journal-title":"Scientometrics"},{"issue":"1","key":"4367_CR17","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1162\/qss_a_00022","volume":"1","author":"G Hendricks","year":"2020","unstructured":"Hendricks, G., Tkaczyk, D., Lin, J., & Feeney, P. (2020). Crossref: The sustainable source of community-owned scholarly metadata. Quantitative Science Studies, 1(1), 414\u2013427. https:\/\/doi.org\/10.1162\/qss_a_00022","journal-title":"Quantitative Science Studies"},{"key":"4367_CR18","doi-asserted-by":"publisher","first-page":"673","DOI":"10.1007\/978-3-319-90698-0_26","volume-title":"Ornamental crops","author":"SL Krebs","year":"2018","unstructured":"Krebs, S. L. (2018). Rhododendron. In J. van Huylenbroeck (Ed.), Ornamental crops (Vol. 11, pp. 673\u2013718). Springer. https:\/\/doi.org\/10.1007\/978-3-319-90698-0_26"},{"key":"4367_CR19","doi-asserted-by":"publisher","DOI":"10.1101\/543256","author":"L Li","year":"2019","unstructured":"Li, L., Ning, Z., Zhang, X., Mayne, J., Cheng, K., Stintzi, A., & Figeys, D. (2019). RapidAIM: A culture- and metaproteomics-based Rapid Assay of Individual Microbiome responses to drugs [Preprint]. Microbiology. https:\/\/doi.org\/10.1101\/543256","journal-title":"Microbiology"},{"key":"4367_CR103","doi-asserted-by":"publisher","unstructured":"Massari, A., Santini, C., Boente, R., Tural, D., & Peroni, S. (2021). open-sci\/2020-2021-grasshoppers-code: Classes of errors in DOI names (v1.2.0) [Computer software]. Zenodo. https:\/\/doi.org\/10.5281\/ZENODO.6205836","DOI":"10.5281\/ZENODO.6205836"},{"key":"4367_CR20","doi-asserted-by":"publisher","unstructured":"Massari, A. (2022). Classes of errors in DOI names: evaluation dataset (v1.0.0) [Data set]. Zenodo. https:\/\/doi.org\/10.5281\/zenodo.6188748.","DOI":"10.5281\/zenodo.6188748"},{"key":"4367_CR21","doi-asserted-by":"publisher","unstructured":"Massari, A., Santini, C., Boente, R., Tural, D., & Peroni, S. (2022). open-sci\/2020-2021-grasshoppers-code: Classes of errors in DOI names (v1.2.0) [Computer software]. Zenodo. https:\/\/doi.org\/10.5281\/zenodo.6205836.","DOI":"10.5281\/zenodo.6205836"},{"issue":"8","key":"4367_CR22","doi-asserted-by":"publisher","first-page":"S153","DOI":"10.1074\/mcp.TIR118.001251","volume":"18","author":"C Meng","year":"2019","unstructured":"Meng, C., Basunia, A., Peters, B., Gholami, A. M., Kuster, B., & Culhane, A. C. (2019). MOGSA: Integrative single sample gene-set analysis of multiple omics data. Molecular & Cellular Proteomics, 18(8), S153\u2013S168. https:\/\/doi.org\/10.1074\/mcp.TIR118.001251","journal-title":"Molecular & Cellular Proteomics"},{"key":"4367_CR26","doi-asserted-by":"publisher","unstructured":"Peroni, S. (2021). Citations to invalid DOI-identified entities obtained from processing DOI-to-DOI citations to add in COCI (1.0) [Data set]. Zenodo. https:\/\/doi.org\/10.5281\/ZENODO.4625300.","DOI":"10.5281\/ZENODO.4625300"},{"issue":"1","key":"4367_CR27","doi-asserted-by":"publisher","first-page":"428","DOI":"10.1162\/qss_a_00023","volume":"1","author":"S Peroni","year":"2020","unstructured":"Peroni, S., & Shotton, D. (2020). OpenCitations, an infrastructure organization for open scholarship. Quantitative Science Studies, 1(1), 428\u2013444. https:\/\/doi.org\/10.1162\/qss_a_00023","journal-title":"Quantitative Science Studies"},{"key":"4367_CR28","unstructured":"Ruediger Wischenbart Content and Consulting. (2019). Global 50: The World Ranking of the Publishing Industry 2019. Livres Hebdo, Paris. https:\/\/www.publishersweekly.com\/binary-data\/Global502019.pdf."},{"key":"4367_CR100","doi-asserted-by":"publisher","unstructured":"Valderrama-Zuri\u00e1n, J.-C., Aguilar-Moya, R., Melero-Fuentes, D., & Aleixandre-Benavent, R. (2015). A systematic analysis of duplicate records in Scopus. Journal of Informetrics, 9(3), 570\u2013576. https:\/\/doi.org\/10.1016\/j.joi.2015.05.002","DOI":"10.1016\/j.joi.2015.05.002"},{"issue":"86","key":"4367_CR29","first-page":"2579","volume":"9","author":"L van der Maaten","year":"2008","unstructured":"van der Maaten, L., & Hinton, G. (2008). Visualizing Data Using t-SNE., 9(86), 2579\u20132605.","journal-title":"Visualizing Data Using t-SNE."},{"key":"4367_CR30","doi-asserted-by":"publisher","first-page":"131","DOI":"10.17660\/ActaHortic.2020.1288.20","volume":"1288","author":"S Wang","year":"2020","unstructured":"Wang, S., Van Huylenbroeck, J., & Zhang, L.-H. (2020). Adaptability of Rhododendron species to climate and growth conditions at Lushan Botanical Garden. Acta Horticulturae, 1288, 131\u2013138. https:\/\/doi.org\/10.17660\/ActaHortic.2020.1288.20","journal-title":"Acta Horticulturae"},{"key":"4367_CR31","doi-asserted-by":"publisher","first-page":"160018","DOI":"10.1038\/sdata.2016.18","volume":"3","author":"MD Wilkinson","year":"2016","unstructured":"Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., Bouwman, J., Brookes, A. J., Clark, T., Crosas, M., Dillo, I., Dumon, O., Edmunds, S., Evelo, C. T., Finkers, R., & Mons, B. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3, 160018. https:\/\/doi.org\/10.1038\/sdata.2016.18","journal-title":"Scientific Data"},{"issue":"3","key":"4367_CR32","doi-asserted-by":"publisher","first-page":"1427","DOI":"10.1007\/s11192-019-03162-4","volume":"120","author":"S Xu","year":"2019","unstructured":"Xu, S., Hao, L., An, X., Zhai, D., & Pang, H. (2019). Types of DOI errors of cited references in Web of Science with a cleaning method. Scientometrics, 120(3), 1427\u20131437. https:\/\/doi.org\/10.1007\/s11192-019-03162-4","journal-title":"Scientometrics"},{"issue":"2","key":"4367_CR33","doi-asserted-by":"publisher","first-page":"709","DOI":"10.1007\/s11192-018-2980-7","volume":"118","author":"J Zhu","year":"2019","unstructured":"Zhu, J., Hu, G., & Liu, W. (2019). DOI errors and possible solutions for Web of Science. Scientometrics, 118(2), 709\u2013718. https:\/\/doi.org\/10.1007\/s11192-018-2980-7","journal-title":"Scientometrics"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04367-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-022-04367-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04367-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,22]],"date-time":"2023-11-22T21:54:15Z","timestamp":1700690055000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-022-04367-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6]]},"references-count":34,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,6]]}},"alternative-id":["4367"],"URL":"https:\/\/doi.org\/10.1007\/s11192-022-04367-w","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6]]},"assertion":[{"value":"22 November 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 March 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 June 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 August 2022","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Update","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Missing Open Access funding information has been added in the Funding Note.","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}}]}}