{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,10]],"date-time":"2026-10-10T06:12:15Z","timestamp":1791612735820,"version":"4.3.4"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,10,17]],"date-time":"2020-10-17T00:00:00Z","timestamp":1602892800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,10,17]],"date-time":"2020-10-17T00:00:00Z","timestamp":1602892800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001321","name":"National Research Foundation","doi-asserted-by":"publisher","award":["111258"],"award-info":[{"award-number":["111258"]}],"id":[{"id":"10.13039\/501100001321","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This study is one of the first that uses the recently introduced open access (OA) labels in the Web of Science (WoS) metadata to investigate whether OA articles published in Directory of Open Access Journals (DOAJ) listed journals experience a citation advantage in comparison to subscription journal articles, specifically those of which no self-archived versions are available. Bibliometric data on all articles and reviews indexed in WoS, and published from 2013 to 2015, were analysed. In addition to normalised citation score (NCS), we used two additional measures of citation advantage: whether an article was cited at all; and whether an article is among the most frequently cited percentile of articles within its respective subject area (pptopX\u00a0%). For each WoS subject area, the strength of the relationship between access status (whether an article was published in an OA journal) and each of these three measures was calculated. We found that OA journal articles experience a citation advantage in very few subject areas and, in most of these subject areas, the citation advantage was found on only a single measure of citation advantage, namely whether the article was cited at all. Our results lead us to conclude that access status accounts for little of the variability in the number of citations an article accumulates. The methodology and the calculations that were used in this study are described in detail and we believe that the lessons we learnt, and the recommendations we make, will be of much use to future researchers interested in using the WoS OA labels, and to the field of citation advantage in general.<\/jats:p>","DOI":"10.1007\/s11192-020-03734-9","type":"journal-article","created":{"date-parts":[[2020,10,17]],"date-time":"2020-10-17T18:02:33Z","timestamp":1602957753000},"page":"459-484","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":56,"title":["Do open access journal articles experience a citation advantage? Results and methodological reflections of an application of multiple measures to an analysis by WoS subject areas"],"prefix":"10.1007","volume":"126","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6150-3208","authenticated-orcid":false,"given":"Isabel","family":"Basson","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4192-8860","authenticated-orcid":false,"given":"Jaco P.","family":"Blanckenberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8091-5830","authenticated-orcid":false,"given":"Heidi","family":"Prozesky","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,10,17]]},"reference":[{"key":"3734_CR1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1021919228368","author":"DW Aksnes","year":"2003","unstructured":"Aksnes, D. W. (2003). A macro study of self-citation. Scientometrics. https:\/\/doi.org\/10.1023\/A:1021919228368.","journal-title":"Scientometrics"},{"key":"3734_CR2","doi-asserted-by":"publisher","DOI":"10.5860\/crl.65.5.372","author":"K Antelman","year":"2004","unstructured":"Antelman, K. (2004). Do open-access articles have a greater research impact? College & Research Libraries. https:\/\/doi.org\/10.5860\/crl.65.5.372.","journal-title":"College & Research Libraries"},{"key":"3734_CR3","unstructured":"Archambault, E., Amyot, D., Campbell, D., Caruso, J., Deschamps, P., Nicol, A., et al. (2014). Evolution of open access policies and availability, 1996\u20132013. RTD-B6-PP-2011-2: Study to develop a set of indicators to measure open access. Report. Science-Metrix. Retrieved from August 20, 2017 from http:\/\/science-metrix.com\/files\/science-metrix\/publications\/d_4.5_sm_ec_dg-rtd_oa_policies_proportion_oa_1996-2013_v05p_0.pdf."},{"key":"3734_CR4","unstructured":"Archambault, E., Amyot, D., Deschamps, P., Nicol, A., Provencher, F., Rebout, L., et al. (2014). Proportion of open access papers published in peer-reviewed journals at the European and world level\u20141996\u20132013. RTD-B6-PP-2011-2: Study to develop a set of indicators to measure open access. Report. Science-Metrix. Retrieved January 16, 2020 from https:\/\/science-metrix.com\/sites\/default\/files\/science-metrix\/publications\/d_1.8_sm_ec_dg-rtd_proportion_oa_1996-2013_v11p.pdf."},{"key":"3734_CR5","unstructured":"Basson, I. (2019). An investigation of open access citation advantage through multiple measures and across subject areas for articles published from 2005 to 2014. PhD thesis. Stellenbosch: Stellenbosch University. Retrieved January 15, 2020 from http:\/\/scholar.sun.ac.za\/handle\/10019.1\/105966."},{"key":"3734_CR6","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.1802","author":"B-C Bj\u00f6rk","year":"2011","unstructured":"Bj\u00f6rk, B.-C. (2011). A study of innovative features in scholarly open access journals. Journal of Medical Internet Research. https:\/\/doi.org\/10.2196\/jmir.1802.","journal-title":"Journal of Medical Internet Research"},{"key":"3734_CR7","doi-asserted-by":"publisher","DOI":"10.1002\/asi.10031","author":"QL Burrell","year":"2002","unstructured":"Burrell, Q. L. (2002). Will this paper ever be cited? Journal of the American Society for Information Science and Technology. https:\/\/doi.org\/10.1002\/asi.10031.","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"3734_CR8","unstructured":"Chan, L., Cuplinskas, D., Eisen, M., Friend, F., Genova, Y., Gu\u00e9don, J.-C., et al.. (2002). Read the Budapest open access initiative. Declaration. Open Society Foundations. Retrieved January 15, 2020 from http:\/\/openscience.ens.fr\/ABOUT_OPEN_ACCESS\/DECLARATIONS\/2002_02_14_Budapest_Open_Access_Initiative.pdf."},{"key":"3734_CR9","unstructured":"Clarivate Analytics. (2018). New features and announcements. Resource page. Clarivate Analytics. Retrieved July 21, 2020 from https:\/\/images.webofknowledge.com\/images\/help\/WOS\/hp_whatsnew_wos.html."},{"key":"3734_CR10","doi-asserted-by":"publisher","DOI":"10.1016\/j.joi.2007.04.001","author":"ID Craig","year":"2007","unstructured":"Craig, I. D., Plume, A. M., McVeigh, M. E., Pringle, J., & Amin, M. (2007). Do open access articles have greater citation impact? A critical review of the literature. Journal of Informetrics. https:\/\/doi.org\/10.1016\/j.joi.2007.04.001.","journal-title":"Journal of Informetrics"},{"key":"3734_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(85)90080-9","volume-title":"The citation process","author":"B Cronin","year":"1984","unstructured":"Cronin, B. (1984). The citation process. London: Taylor Graham. https:\/\/doi.org\/10.1016\/0306-4573(85)90080-9."},{"key":"3734_CR12","doi-asserted-by":"publisher","DOI":"10.1016\/j.acalib.2011.07.002","author":"R Cullen","year":"2011","unstructured":"Cullen, R., & Chawner, B. (2011). Institutional repositories, open access, and scholarly communication: A study of conflicting paradigms. Journal of Academic Librarianship. https:\/\/doi.org\/10.1016\/j.acalib.2011.07.002.","journal-title":"Journal of Academic Librarianship"},{"key":"3734_CR13","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-007-1661-8","author":"PM Davis","year":"2007","unstructured":"Davis, P. M., & Fromerth, M. J. (2007). Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles? Scientometrics. https:\/\/doi.org\/10.1007\/s11192-007-1661-8.","journal-title":"Scientometrics"},{"key":"3734_CR14","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-017-2422-y","author":"P Dorta-Gonz\u00e1lez","year":"2017","unstructured":"Dorta-Gonz\u00e1lez, P., Gonz\u00e1lez-Betancor, S. M., & Dorta-Gonz\u00e1lez, M. I. (2017). Reconsidering the gold open access citation advantage postulate in a multidisciplinary context: An analysis of the subject categories in the Web of Science database 2009\u20132014. Scientometrics. https:\/\/doi.org\/10.1007\/s11192-017-2422-y.","journal-title":"Scientometrics"},{"key":"3734_CR15","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.0040157","author":"G Eysenbach","year":"2006","unstructured":"Eysenbach, G. (2006). Citation advantage of open access articles. PLoS Biology. https:\/\/doi.org\/10.1371\/journal.pbio.0040157.","journal-title":"PLoS Biology"},{"key":"3734_CR16","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-017-2414-y","author":"N Fukuzawa","year":"2017","unstructured":"Fukuzawa, N. (2017). Characteristics of papers published in journals: An analysis of open access journals, country of publication, and languages used. Scientometrics. https:\/\/doi.org\/10.1007\/s11192-017-2414-y.","journal-title":"Scientometrics"},{"key":"3734_CR17","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0013636","author":"Y Gargouri","year":"2010","unstructured":"Gargouri, Y., Hajjem, C., Larivi\u00e9re, V., Gingras, Y., Carr, L., Brody, T., et al. (2010). Self-selected or mandated, open access increases citation impact for higher quality research. PLoS ONE. https:\/\/doi.org\/10.1371\/journal.pone.0013636.","journal-title":"PLoS ONE"},{"key":"3734_CR18","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-017-2419-6","author":"V Garousi","year":"2017","unstructured":"Garousi, V., & Fernandes, J. M. (2017). Quantity versus impact of software engineering papers: a quantitative study. Scientometrics. https:\/\/doi.org\/10.1007\/s11192-017-2419-6.","journal-title":"Scientometrics"},{"key":"3734_CR19","doi-asserted-by":"publisher","DOI":"10.1023\/B:SCIE.0000018535.99885.e9","author":"W Gl\u00e4nzel","year":"2004","unstructured":"Gl\u00e4nzel, W., & Thijs, B. (2004). The influence of author self-citations on bibliometric macro indicators. Scientometrics. https:\/\/doi.org\/10.1023\/B:SCIE.0000018535.99885.e9.","journal-title":"Scientometrics"},{"issue":"4","key":"3734_CR20","first-page":"39","volume":"28","author":"C Hajjem","year":"2005","unstructured":"Hajjem, C., Harnad, S., & Gingras, Y. (2005). Ten-year cross-disciplinary comparison of the growth of open access and how it increases research citation impact. IEEE Data Engineering Bulletin, 28(4), 39\u201346.","journal-title":"IEEE Data Engineering Bulletin"},{"key":"3734_CR21","doi-asserted-by":"publisher","DOI":"10.1016\/j.serrev.2007.12.005","author":"S Harnad","year":"2008","unstructured":"Harnad, S., Brody, T., Valli\u00e8res, F., Carr, L., Hitchcock, S., Gingras, Y., et al. (2008). The access\/impact problem and the green and gold roads to open access: An update. Serials Review. https:\/\/doi.org\/10.1016\/j.serrev.2007.12.005.","journal-title":"Serials Review"},{"key":"3734_CR22","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2005.03.010","author":"MJ Kurtz","year":"2005","unstructured":"Kurtz, M. J., Eichhorn, G., Accomazzi, A., Grant, C., Demleitner, M., Henneken, E., et al. (2005). The effect of use and access on citations. Information Processing and Management. https:\/\/doi.org\/10.1016\/j.ipm.2005.03.010.","journal-title":"Information Processing and Management"},{"key":"3734_CR23","doi-asserted-by":"publisher","DOI":"10.1038\/35079151","author":"S Lawrence","year":"2001","unstructured":"Lawrence, S. (2001). Free online availability substantially increases a paper\u2019s impact. Nature. https:\/\/doi.org\/10.1038\/35079151.","journal-title":"Nature"},{"key":"3734_CR24","doi-asserted-by":"publisher","DOI":"10.3390\/publications4010001","author":"S Miguel","year":"2016","unstructured":"Miguel, S., de Oliveira, E. F. T., & Gr\u00e1cio, M. C. C. (2016). Scientific production on open access: A worldwide bibliometric analysis in the academic and scientific context. Publications. https:\/\/doi.org\/10.3390\/publications4010001.","journal-title":"Publications"},{"key":"3734_CR25","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-020-03356-1","author":"S Mohammed","year":"2020","unstructured":"Mohammed, S., Morgan, A., & Nyantaki, E. (2020). On the influence of uncited publications on a researcher\u2019s\u00a0h-index. Scientometrics. https:\/\/doi.org\/10.1007\/s11192-020-03356-1.","journal-title":"Scientometrics"},{"key":"3734_CR27","doi-asserted-by":"crossref","unstructured":"Perianes-Rodr\u00edguez, A., & Olmeda-G\u00f3mez, C. (2019). Effects of journal choice on the visibility of scientific publications: A comparison between subscription-based and full Open Access models. Scientometrics. https:\/\/doi.org\/10.1007\/s11192-019-03265-y.","DOI":"10.1007\/s11192-019-03265-y"},{"issue":"2","key":"3734_CR26","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1177\/030631277700700207","volume":"7","author":"AL Porter","year":"1977","unstructured":"Porter, A. L. (1977). Citation analysis: Queries and caveats. Social Studies of Science, 7(2), 257\u2013267.","journal-title":"Social Studies of Science"},{"key":"3734_CR28","doi-asserted-by":"publisher","DOI":"10.5860\/crl.58.1.19","author":"CA Schwartz","year":"1997","unstructured":"Schwartz, C. A. (1997). The rise and fall of uncitedness. College and Research Libraries. https:\/\/doi.org\/10.5860\/crl.58.1.19.","journal-title":"College and Research Libraries"},{"key":"3734_CR29","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20676","author":"H Sotudeh","year":"2007","unstructured":"Sotudeh, H., & Horri, A. (2007). The citation performance of open access journals: A disciplinary investigation of citation distribution models. Journal of the Association for Information Science and Technology. https:\/\/doi.org\/10.1002\/asi.20676.","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"3734_CR30","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-009-1870-4","author":"H Sotudeh","year":"2009","unstructured":"Sotudeh, H., & Horri, A. (2009). Countries positioning in open access journals system: An investigation of citation distribution patterns. Scientometrics. https:\/\/doi.org\/10.1007\/s11192-009-1870-4.","journal-title":"Scientometrics"},{"key":"3734_CR31","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-016-1889-2","author":"I Tahamtan","year":"2016","unstructured":"Tahamtan, I., Safipour, A. A., & Ahamdzadeh, K. (2016). Factors affecting number of citations: A comprehensive review of the literature. Scientometrics. https:\/\/doi.org\/10.1007\/s11192-016-1889-2.","journal-title":"Scientometrics"},{"key":"3734_CR32","unstructured":"Thomson Reuters. (2018). InCites: Indicators handbook. Resource document. Clarivate Analytics. Retrieved January 15, 2020 from http:\/\/help.prod-incites.com\/inCites2Live\/8980-TRS\/version\/default\/part\/AttachmentData\/data\/InCites-Indicators-Handbook%20-%20June%202018.pdf."},{"issue":"3","key":"3734_CR33","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1023\/A:1016082432660","volume":"54","author":"RJW Tijssen","year":"2002","unstructured":"Tijssen, R. J. W., Visser, M. S., & Van Leeuwen, T. N. (2002). Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference? Scientometrics, 54(3), 381\u2013397.","journal-title":"Scientometrics"},{"key":"3734_CR34","doi-asserted-by":"publisher","DOI":"10.3145\/epi.2016.ene.03","author":"D Torres-Salinas","year":"2016","unstructured":"Torres-Salinas, D., Robinson-Garc\u00eda, N., & Aguillo, I. F. (2016). Bibliometric and benchmark analysis of gold open access in Spain: Big output and little impact. El profesional de la informaci\u00f3n. https:\/\/doi.org\/10.3145\/epi.2016.ene.03.","journal-title":"El profesional de la informaci\u00f3n"},{"issue":"1","key":"3734_CR35","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1023\/A:1010549719484","volume":"51","author":"TN Van Leeuwen","year":"2001","unstructured":"Van Leeuwen, T. N., Moed, H. F., Tijssen, R. J. W., Visser, M. S., & Van Raan, A. F. J. (2001). Language biases in the coverage of the Science Citation Index and its consequences for international comparisons of national research performance. Scientometrics, 51(1), 335\u2013346.","journal-title":"Scientometrics"},{"key":"3734_CR36","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24029","author":"TN Van Leeuwen","year":"2018","unstructured":"Van Leeuwen, T. N., Tatum, C., & Wouters, P. F. (2018). Exploring possibilities to use bibliometric data to monitor gold open access publishing at the national level. Journal of the American Society for Information Science and Technology. https:\/\/doi.org\/10.1002\/asi.24029.","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"2","key":"3734_CR37","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1023\/A:1024141819302","volume":"57","author":"TN Van Leeuwen","year":"2003","unstructured":"Van Leeuwen, T. N., Visser, M. S., Moed, H. F., Nederhof, T. J., & Van Raan, A. F. J. (2003). The Holy Grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence. Scientometrics, 57(2), 257\u2013280.","journal-title":"Scientometrics"},{"key":"3734_CR38","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-017-08404-0","author":"R Van Noorden","year":"2017","unstructured":"Van Noorden, R. (2017). The science that\u2019s never been cited. Nature. https:\/\/doi.org\/10.1038\/d41586-017-08404-0.","journal-title":"Nature"},{"key":"3734_CR39","doi-asserted-by":"publisher","DOI":"10.1016\/j.joi.2016.02.007","author":"L Waltman","year":"2016","unstructured":"Waltman, L. (2016). A review of the literature on citation impact indicators. Journal of Informetrics. https:\/\/doi.org\/10.1016\/j.joi.2016.02.007.","journal-title":"Journal of Informetrics"},{"key":"3734_CR40","doi-asserted-by":"publisher","DOI":"10.1002\/asi","author":"L Waltman","year":"2013","unstructured":"Waltman, L., & Schreiber, M. (2013). On the calculation of percentile-based bibliometric indicators. Journal of the American Society for Information Science and Technology. https:\/\/doi.org\/10.1002\/asi.","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"3734_CR41","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-011-0354-5","author":"L Waltman","year":"2011","unstructured":"Waltman, L., Van Eck, N. J., Van Leeuwen, T. N., Visser, M. S., & Van Raan, A. F. J. (2011). Towards a new crown indicator: An empirical analysis. Scientometrics. https:\/\/doi.org\/10.1007\/s11192-011-0354-5.","journal-title":"Scientometrics"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-020-03734-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-020-03734-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-020-03734-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,17]],"date-time":"2021-10-17T02:21:01Z","timestamp":1634437261000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-020-03734-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,17]]},"references-count":41,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["3734"],"URL":"https:\/\/doi.org\/10.1007\/s11192-020-03734-9","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,17]]},"assertion":[{"value":"8 May 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 October 2020","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The authors declare no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}