{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:31:46Z","timestamp":1740123106837,"version":"3.37.3"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2023,5,14]],"date-time":"2023-05-14T00:00:00Z","timestamp":1684022400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,5,14]],"date-time":"2023-05-14T00:00:00Z","timestamp":1684022400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Deutsches Zentrum f\u00fcr Hochschul- und Wissenschaftsforschung GmbH (DZHW)"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2023,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper analyzes Wikipedia\u2019s representation of the Nobel Prize winning CRISPR\/Cas9 technology, a method for gene editing. We propose and evaluate different heuristics to match publications from several publication corpora against Wikipedia\u2019s central article on CRISPR and against the complete Wikipedia revision history in order to retrieve further Wikipedia articles relevant to the topic and to analyze Wikipedia\u2019s referencing patterns. We explore to what extent the selection of referenced literature of Wikipedia\u2019s central article on CRISPR adheres to scientific standards and inner-scientific perspectives by assessing its overlap with (1) the Web of Science (WoS) database, (2) a WoS-based field-delineated corpus, (3) highly-cited publications within this corpus, and (4) publications referenced by field-specific reviews. We develop a diachronic perspective on citation latency and compare the delays with which publications are cited in relevant Wikipedia articles to the citation dynamics of these publications\u00a0over time. Our results confirm that a combination of verbatim searches by title, DOI, and PMID is sufficient and cannot be improved significantly by more elaborate search heuristics. We show that Wikipedia references a substantial amount of publications that are recognized by experts and highly cited, but that Wikipedia also cites less visible literature, and, to a certain degree, even not strictly scientific literature. Delays in occurrence on Wikipedia compared to the publication years show (most pronounced in case of the central CRISPR article) a dependence on the dynamics of both the field and the editor\u2019s reaction to it in terms of activity.<\/jats:p>","DOI":"10.1007\/s11192-023-04703-8","type":"journal-article","created":{"date-parts":[[2023,5,15]],"date-time":"2023-05-15T12:33:33Z","timestamp":1684154013000},"page":"3649-3673","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A diachronic perspective on citation latency in Wikipedia articles on CRISPR\/Cas-9: an exploratory case study"],"prefix":"10.1007","volume":"128","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6970-3714","authenticated-orcid":false,"given":"Marion","family":"Schmidt","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0925-0503","authenticated-orcid":false,"given":"Wolfgang","family":"Kircheis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0657-5254","authenticated-orcid":false,"given":"Arno","family":"Simons","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2451-0665","authenticated-orcid":false,"given":"Martin","family":"Potthast","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9033-2217","authenticated-orcid":false,"given":"Benno","family":"Stein","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,5,14]]},"reference":[{"key":"4703_CR1","doi-asserted-by":"publisher","unstructured":"Redi, M., & Taraborelli, D. (2018). Accessibility and topics of citations with identifiers in Wikipedia. figshare. Dataset. https:\/\/doi.org\/10.6084\/m9.figshare.6819710.v1","DOI":"10.6084\/m9.figshare.6819710.v1"},{"issue":"2","key":"4703_CR2","doi-asserted-by":"publisher","first-page":"e0228713","DOI":"10.1371\/journal.pone.0228713","volume":"15","author":"W Arroyo-Machado","year":"2020","unstructured":"Arroyo-Machado, W., Torres-Salinas, D., Herrera-Viedma, E., & Romero-Fr\u00edas, E. (2020). Science through Wikipedia: A novel representation of open knowledge through co-citation networks. PLoS ONE, 15(2), e0228713. https:\/\/doi.org\/10.1371\/journal.pone.0228713","journal-title":"PLoS ONE"},{"key":"4703_CR3","doi-asserted-by":"publisher","DOI":"10.1177\/0894439321993836","author":"N Banasik-Jemielniak","year":"2021","unstructured":"Banasik-Jemielniak, N., Jemielniak, D., & Wilamowski, M. (2021). Psychology and Wikipedia: Measuring psychology journals\u2019 impact by Wikipedia citations. Social Science Computer Review. https:\/\/doi.org\/10.1177\/0894439321993836","journal-title":"Social Science Computer Review"},{"issue":"3","key":"4703_CR4","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1177\/0748730418768120","volume":"33","author":"O Benjakob","year":"2018","unstructured":"Benjakob, O., & Aviram, R. (2018). A clockwork Wikipedia: From a broad perspective to a case study. Journal of Biological Rhythms, 33(3), 233\u2013244.","journal-title":"Journal of Biological Rhythms"},{"key":"4703_CR5","unstructured":"Casebourne, I., Davies, C., Fernandes, M., & Norman, N. (2012). Assessing the accuracy and quality of Wikipedia entries compared to popular online encyclopaedias: A comparative preliminary study across disciplines in English, Spanish and Arabic. Retrieved from http:\/\/commons.wikimedia.org\/wiki\/File:EPIC_Oxford_report.pdf"},{"key":"4703_CR6","doi-asserted-by":"publisher","unstructured":"Chen, C.-C., & Roth, C. (2012). {{Citation needed}}: The dynamics of referencing in Wikipedia. In Proceedings of the Eighth Annual International Symposium on Wikis and Open Collaboration - WikiSym \u201912, 1. https:\/\/doi.org\/10.1145\/2462932.2462943","DOI":"10.1145\/2462932.2462943"},{"issue":"4","key":"4703_CR7","doi-asserted-by":"publisher","first-page":"1349","DOI":"10.1162\/qss_a_00080","volume":"1","author":"G Colavizza","year":"2020","unstructured":"Colavizza, G. (2020). COVID-19 research in Wikipedia. Quantitative Science Studies, 1(4), 1349\u20131380. https:\/\/doi.org\/10.1162\/qss_a_00080","journal-title":"Quantitative Science Studies"},{"key":"4703_CR28","doi-asserted-by":"publisher","unstructured":"Cong, L., Ran, F. A., Cox, D., Lin, S., Barretto, R., Habib, N., Hsu, P. D., Wu, X., Jiang, W., Marraffini, L. A., & Zhang, F. (2013). Multiplex genome engineering using CRISPR\/Cas systems. Science, 339(6121), 819\u2013823. https:\/\/doi.org\/10.1126\/science.1231143","DOI":"10.1126\/science.1231143"},{"issue":"2","key":"4703_CR8","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1001603","volume":"11","author":"JH Elliott","year":"2014","unstructured":"Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L. (2014). Living systematic reviews: An emerging opportunity to narrow the evidence-practice gap. PLoS Medicine, 11(2), e1001603.","journal-title":"PLoS Medicine"},{"key":"4703_CR9","unstructured":"Estevez, B., & Cukierman, H. (2012). The climate change controversy through 15 articles of Portuguese Wikipedia. Wikipedia Academy."},{"key":"4703_CR10","doi-asserted-by":"crossref","unstructured":"Garcia del Valle, E. P., Lagunes Garcia, G., Prieto Santamaria, L., Zanin, M., Menasalvas Ruiz, E., & Rodriguez Gonzalez, A. (2018). Evaluating Wikipedia as a source of information for disease understanding. In 2018 IEEE 31st International Symposium on Computer-Based Medical Systems (CBMS) (pp. 399\u2013404).","DOI":"10.1109\/CBMS.2018.00076"},{"issue":"7070","key":"4703_CR11","doi-asserted-by":"publisher","first-page":"900","DOI":"10.1038\/438900a","volume":"438","author":"J Giles","year":"2005","unstructured":"Giles, J. (2005). Internet encyclopaedias go head to head. Nature, 438(7070), 900\u2013901.","journal-title":"Nature"},{"key":"4703_CR12","doi-asserted-by":"publisher","DOI":"10.1080\/25785648.2023.2168939","author":"J Grabowski","year":"2023","unstructured":"Grabowski, J., & Klein, S. (2023). Wikipedia\u2019s intentional distortion of the history of the holocaust. The Journal of Holocaust Research. https:\/\/doi.org\/10.1080\/25785648.2023.2168939","journal-title":"The Journal of Holocaust Research"},{"issue":"1","key":"4703_CR13","doi-asserted-by":"publisher","first-page":"e11429","DOI":"10.2196\/11429","volume":"21","author":"D Jemielniak","year":"2019","unstructured":"Jemielniak, D., Masukume, G., & Wilamowski, M. (2019). The most influential medical journals according to Wikipedia: Quantitative analysis. Journal of Medical Internet Research, 21(1), e11429.","journal-title":"Journal of Medical Internet Research"},{"key":"4703_CR29","doi-asserted-by":"publisher","unstructured":"Jinek, M., Chylinski, K., Fonfara, I., Hauer, M., Doudna, J. A., & Charpentier, E. (2012). A programmable dual-RNA\u2013guided DNA endonuclease in adaptive bacterial immunity ditching invading DNA. Science, 337(6096), 816\u2013821. https:\/\/doi.org\/10.1126\/science.1225829","DOI":"10.1126\/science.1225829"},{"issue":"3","key":"4703_CR14","doi-asserted-by":"publisher","first-page":"1881","DOI":"10.1177\/1460458219892711","volume":"26","author":"A Joorabchi","year":"2020","unstructured":"Joorabchi, A., Doherty, C., & Dawson, J. (2020). \u2018WP2Cochrane\u2019, a tool linking Wikipedia to the Cochrane Library: Results of a bibliometric analysis evaluating article quality and importance. Health Informatics Journal, 26(3), 1881\u20131897.","journal-title":"Health Informatics Journal"},{"issue":"3","key":"4703_CR15","doi-asserted-by":"publisher","first-page":"762","DOI":"10.1002\/asi.23694","volume":"68","author":"K Kousha","year":"2017","unstructured":"Kousha, K., & Thelwall, M. (2017). Are wikipedia citations important evidence of the impact of scholarly articles and books? Journal of the Association for Information Science and Technology, 68(3), 762\u2013779. https:\/\/doi.org\/10.1002\/asi.23694","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"4703_CR30","doi-asserted-by":"publisher","unstructured":"Mali, P., Yang, L., Esvelt, K. M., Aach, J., Guell, M., DiCarlo, J. E., Norville, J. E., & Church, G. M. (2013). RNA-guided human genome engineering via cas9. Science 339(6121), 823\u2013826. https:\/\/doi.org\/10.1126\/science.1232033","DOI":"10.1126\/science.1232033"},{"key":"4703_CR34","doi-asserted-by":"publisher","unstructured":"Mesgari, M., Okoli, C., Mehdi, M., Nielsen, F. \u00c5., & Lanam\u00e4ki, A. (2015). \u201cThe sum of all human knowledge\u201d: A systematic review of scholarly research on the content of wikipedia. Journal of the Association for Information Science and Technology, 66(2), 219\u2013245. https:\/\/doi.org\/10.1002\/asi.23172","DOI":"10.1002\/asi.23172"},{"key":"4703_CR32","doi-asserted-by":"publisher","unstructured":"Piccardi, T., Redi, M., Colavizza, G., & West, R. (2020). Quantifying engagement with citations on wikipedia. Proceedings of The Web Conference, 2020, 2365\u20132376. https:\/\/doi.org\/10.1145\/3366423.3380300","DOI":"10.1145\/3366423.3380300"},{"issue":"1","key":"4703_CR16","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1007\/s11192-017-2474-z","volume":"113","author":"A Pooladian","year":"2017","unstructured":"Pooladian, A., & Borrego, \u00c1. (2017). Methodological issues in measuring citations in Wikipedia: A case study in Library and Information Science. Scientometrics, 113(1), 455\u2013464. https:\/\/doi.org\/10.1007\/s11192-017-2474-z","journal-title":"Scientometrics"},{"key":"4703_CR17","unstructured":"Priem, J., Piwowar, H. A., & Hemminger, B. M. (2012). Altmetrics in the wild: Using social media to explore scholarly impact. Retrieved from http:\/\/arxiv.org\/abs\/1203.4745"},{"issue":"8","key":"4703_CR18","doi-asserted-by":"publisher","first-page":"1753","DOI":"10.1017\/S003329171100287X","volume":"42","author":"NJ Reavley","year":"2012","unstructured":"Reavley, N. J., Mackinnon, A. J., Morgan, A. J., Alvarez-Jimenez, M., Hetrick, S. E., Killackey, E., Nelson, B., Purcell, R., Yap, M. B. H., & Jorm, A. F. (2012). Quality of information sources about mental disorders: A comparison of Wikipedia with centrally controlled web and printed sources. Psychological Medicine, 42(8), 1753\u20131762.","journal-title":"Psychological Medicine"},{"key":"4703_CR19","doi-asserted-by":"publisher","unstructured":"Redi, M., Fetahu, B., Morgan, J., & Taraborelli, D. (2019). Citation needed: A taxonomy and algorithmic assessment of Wikipedia\u2019s verifiability. In The World Wide Web Conference on - WWW \u201919 (pp. 1567\u20131578). https:\/\/doi.org\/10.1145\/3308558.3313618","DOI":"10.1145\/3308558.3313618"},{"key":"4703_CR20","unstructured":"Schmidt, M., Kircheis, W., Simons, A., Potthast, M., & Stein, B. (2021). Does Wikipedia cover the relevant literature on major innovations timely? An exploratory case study of CRISPR\/Cas9. In 18th International Conference on Scientometrics & Informetrics - Proceedings, 2021\u20132026."},{"key":"4703_CR33","doi-asserted-by":"publisher","unstructured":"Shuai, X., Jiang, Z., Liu, X., & Bollen, J. (2013). A comparative study of academic and Wikipedia ranking. In Proceedings of the 13th ACM\/IEEE-CS Joint Conference on Digital Libraries, 25\u201328. https:\/\/doi.org\/10.1145\/2467696.2467746","DOI":"10.1145\/2467696.2467746"},{"key":"4703_CR21","unstructured":"Simons, A., Kircheis, W., Schmidt, M., Potthast, M., & Stein, B. (in preparation). Who are the \u201cHeroes of CRISPR\u201d? Controversies about micro-notability in innovation histories on Wikipedia."},{"issue":"1","key":"4703_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1162\/qss_a_00105","volume":"2","author":"H Singh","year":"2021","unstructured":"Singh, H., West, R., & Colavizza, G. (2021). Wikipedia citations: A comprehensive data set of citations with identifiers extracted from English Wikipedia. Quantitative Science Studies, 2(1), 1\u201319. https:\/\/doi.org\/10.1162\/qss_a_00105","journal-title":"Quantitative Science Studies"},{"key":"4703_CR23","unstructured":"Teplitskiy, M., Lu, G., & Duede, E. (2015). The transmission of scientific knowledge to Wikipedia. In Wikipedia, a Social Pedia: Research Challenges and Opportunities: Papers from the 2015 ICWSM Workshop. 2015 ICWSM Workshop."},{"issue":"9","key":"4703_CR24","doi-asserted-by":"publisher","first-page":"2116","DOI":"10.1002\/asi.23687","volume":"68","author":"M Teplitskiy","year":"2017","unstructured":"Teplitskiy, M., Lu, G., & Duede, E. (2017). Amplifying the impact of open access: Wikipedia and the diffusion of science. Journal of the Association for Information Science and Technology, 68(9), 2116\u20132127. https:\/\/doi.org\/10.1002\/asi.23687","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"4703_CR25","doi-asserted-by":"crossref","unstructured":"Thompson, N. C., & Hanley, D. (2018). Science is Shaped by Wikipedia: Evidence From a Randomized Control Trial. ide.mit.edu\/sites\/default\/files\/publications\/SSRN-id3039505.pdf","DOI":"10.2139\/ssrn.3039505"},{"key":"4703_CR31","doi-asserted-by":"publisher","unstructured":"Turki, H., Hadj Taieb, M. A., Shafee, T., Lubiana, T., Jemielniak, D., Aouicha, M. B., Labra Gayo, J. E., Youngstrom, E. A., Banat, M., Das, D., Mietchen, D., & On Behalf Of WikiProject Covid- (2022). Representing COVID-19 information in collaborative knowledge graphs: The case of Wikidata. Semantic Web, 13(2), 233\u2013264. https:\/\/doi.org\/10.3233\/SW-210444","DOI":"10.3233\/SW-210444"},{"key":"4703_CR26","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2110.13790","author":"P Yang","year":"2021","unstructured":"Yang, P., & Colavizza, G. (2021). A map of science in Wikipedia. Companion Proceedings of the Web Conference. https:\/\/doi.org\/10.48550\/ARXIV.2110.13790","journal-title":"Companion Proceedings of the Web Conference"},{"key":"4703_CR27","unstructured":"Zagovora, O., Ulloa, R., Weller, K., & Fl\u00f6ck, F. (2020). I Updated the <ref>: The Evolution of References in the English Wikipedia and the Implications for Altmetrics. Retrieved from https:\/\/arxiv.org\/abs\/2010.03083"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-023-04703-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-023-04703-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-023-04703-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T17:29:49Z","timestamp":1684862989000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-023-04703-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,14]]},"references-count":34,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["4703"],"URL":"https:\/\/doi.org\/10.1007\/s11192-023-04703-8","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"type":"print","value":"0138-9130"},{"type":"electronic","value":"1588-2861"}],"subject":[],"published":{"date-parts":[[2023,5,14]]},"assertion":[{"value":"19 October 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 March 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 May 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant financial or non-financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"Not applicable\u2014the research did not involve human participants.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}]}}