{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T13:56:13Z","timestamp":1770990973305,"version":"3.50.1"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2022,2,26]],"date-time":"2022-02-26T00:00:00Z","timestamp":1645833600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,2,26]],"date-time":"2022-02-26T00:00:00Z","timestamp":1645833600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Spanish Ministry of Science","award":["PID2019-109127RB-I00"],"award-info":[{"award-number":["PID2019-109127RB-I00"]}]},{"DOI":"10.13039\/501100006393","name":"Universidad de Granada","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006393","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The aim of this study is to analyze to which extent the Journal Impact Factor (JIF) reflects the amount of excellent publications contained in a journal in the corresponding subject category. We are introducing two percentile-based indicators in order to measure the excellence contribution at journal level. Calculations of these indicators have been carried out for twenty different Journal Citation Reports (JCR) subject categories to investigate the correlation with Garfield\u2019s Journal Impact Factor. Differences in the ranking according to all three indicators especially in First Quartile (Q1) of each category are shown and discussed. We have also studied the effect of multidisciplinary journals to the excellence contribution at category level and observed considerable differences between the twenty considered categories under analysis. Their omission would lead to neglect a large part of excellent publications, especially in the hard sciences. The introduced excellence indicators are very robust considering the types of documents considered for their calculation. The results of this study show that the journal excellence content is not completely reflected in the JIF measure and affects both Science and Social Science Edition categories. Therefore, the introduction of journal excellence indicators will help to give a more complete picture of the citation impact of a journal, because they are informing directly about the total and normalized excellence contribution of each journal to the corresponding subject category. They are a valuable enrichment and complement of the JIF, and more suitable than the Journal Citation Indicator, recently added to the JCR, because they reflect the inherent skewness of the citation distribution.<\/jats:p>","DOI":"10.1007\/s11192-022-04295-9","type":"journal-article","created":{"date-parts":[[2022,2,26]],"date-time":"2022-02-26T17:02:43Z","timestamp":1645894963000},"page":"7229-7251","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Measuring the excellence contribution at the journal level: an alternative to Garfield\u2019s impact factor"],"prefix":"10.1007","volume":"127","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2414-3212","authenticated-orcid":false,"given":"Juan","family":"Gorraiz","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0549-2716","authenticated-orcid":false,"given":"Ursula","family":"Ulrych","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7529-5198","authenticated-orcid":false,"given":"Wolfgang","family":"Gl\u00e4nzel","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9437-8757","authenticated-orcid":false,"given":"Wenceslao","family":"Arroyo-Machado","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8790-3314","authenticated-orcid":false,"given":"Daniel","family":"Torres-Salinas","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,2,26]]},"reference":[{"issue":"2","key":"4295_CR1","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1007\/s11192-007-1696-x","volume":"72","author":"J Adams","year":"2007","unstructured":"Adams, J., Gurney, K. A., & Marshall, S. (2007). Profiling citation impact: A new methodology. Scientometrics, 72(2), 325\u2013344. https:\/\/doi.org\/10.1007\/s11192-007-1696-x","journal-title":"Scientometrics"},{"issue":"6134","key":"4295_CR2","doi-asserted-by":"publisher","first-page":"787","DOI":"10.1126\/science.1240319","volume":"340","author":"B Alberts","year":"2013","unstructured":"Alberts, B. (2013). Impact factor distortions. Science, 340(6134), 787\u2013787. https:\/\/doi.org\/10.1126\/science.1240319","journal-title":"Science"},{"key":"4295_CR3","unstructured":"American Society for Cell Biology. (2012). San Francisco Declaration on Research Assessment. Retrieved from http:\/\/www.ascb.org\/dora\/."},{"key":"4295_CR4","unstructured":"Antonoyiannakis, M. (2019). How a single paper affects the impact factor: Implications for scholarly publishing. arXiv preprint. https:\/\/arxiv.org\/abs\/1906.02660."},{"issue":"3","key":"4295_CR5","doi-asserted-by":"publisher","first-page":"639","DOI":"10.1007\/s11192-007-2036-x","volume":"79","author":"\u00c9 Archambault","year":"2009","unstructured":"Archambault, \u00c9., & Larivi\u00e8re, V. (2009). History of the journal impact factor: Contingencies and consequences. Scientometrics, 79(3), 639\u2013653.","journal-title":"Scientometrics"},{"issue":"45","key":"4295_CR6","doi-asserted-by":"publisher","first-page":"11433","DOI":"10.1523\/JNEUROSCI.0003-08.2008","volume":"28","author":"CT Bergstrom","year":"2008","unstructured":"Bergstrom, C. T., West, J. D., & Wiseman, M. A. (2008). The eigenfactor\u2122 metrics. Journal of Neuroscience, 28(45), 11433\u201311434.","journal-title":"Journal of Neuroscience"},{"issue":"1","key":"4295_CR7","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1016\/j.joi.2012.10.001","volume":"7","author":"L Bornmann","year":"2013","unstructured":"Bornmann, L., Leydesdorff, L., & Mutz, R. (2013). The use of percentiles and percentile rank classes in the analysis of bibliometric data: Opportunities and limits. Journal of Informetrics, 7(1), 158\u2013165. https:\/\/doi.org\/10.1016\/j.joi.2012.10.001","journal-title":"Journal of Informetrics"},{"issue":"1","key":"4295_CR8","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1007\/s11192-006-0147-4","volume":"69","author":"T Braun","year":"2006","unstructured":"Braun, T., Gl\u00e4nzel, W., & Schubert, A. (2006). A hirsch-type index for journals. Scientometrics, 69(1), 169\u2013173. https:\/\/doi.org\/10.1007\/s11192-006-0147-4","journal-title":"Scientometrics"},{"issue":"7303","key":"4295_CR9","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1038\/466179b","volume":"466","author":"JD Dimitrov","year":"2010","unstructured":"Dimitrov, J. D., Kaveri, S. V., & Bayry, J. (2010). Metrics: Journal\u2019s impact factor skewed by a single paper. Nature, 466(7303), 179. https:\/\/doi.org\/10.1038\/466179b","journal-title":"Nature"},{"issue":"2","key":"4295_CR10","doi-asserted-by":"publisher","first-page":"645","DOI":"10.1007\/s11192-012-0929-9","volume":"95","author":"P Dorta-Gonzalez","year":"2013","unstructured":"Dorta-Gonzalez, P., & Dorta-Gonz\u00e1lez, M. I. (2013). Comparing journals from different fields of science and social science through a JCR subject categories normalized impact factor. Scientometrics, 95(2), 645\u2013672. https:\/\/doi.org\/10.1007\/s11192-012-0929-9","journal-title":"Scientometrics"},{"issue":"3","key":"4295_CR11","first-page":"143","volume":"2","author":"JD Frame","year":"1977","unstructured":"Frame, J. D. (1977). Mainstream research in Latin America and the Caribbean. Interciencia, 2(3), 143\u2013148.","journal-title":"Interciencia"},{"issue":"4060","key":"4295_CR12","doi-asserted-by":"publisher","first-page":"471","DOI":"10.1126\/science.178.4060.471","volume":"178","author":"E Garfield","year":"1972","unstructured":"Garfield, E. (1972). Citation analysis as a tool in journal evaluation. Science, 178(4060), 471\u2013479.","journal-title":"Science"},{"key":"4295_CR13","unstructured":"Garfield, E. (1976). Preface. In Garfield, E. (Ed.) Journal Citation Reports \u00ae A Bibliometric Analysis of References Processed for the 1974 Science Citation Index \u00ae. Science Citation Index, Vol. 9, 1975 Annual."},{"key":"4295_CR14","first-page":"1","volume":"295","author":"E Garfield","year":"2005","unstructured":"Garfield, E. (2005). The agony and the ecstasy\u2014the history and meaning of the journal impact factor. Journal of Biological Chemistry, 295, 1\u201322.","journal-title":"Journal of Biological Chemistry"},{"issue":"3","key":"4295_CR15","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1002\/asi.5090140304","volume":"14","author":"E Garfield","year":"1963","unstructured":"Garfield, E., & Sher, I. H. (1963). New factors in the evaluation of scientific literature through citation indexing. American Documentation, 14(3), 195\u2013201.","journal-title":"American Documentation"},{"key":"4295_CR16","unstructured":"Gl\u00e4nzel, W. (2006). The \u2018perspective shift\u2019in bibliometrics and its consequences. In I International Conference on Multidisciplinary Information Sciences & Technologies (pp. 25\u201328). Retrieved from http:\/\/www.slideshare.net\/inscit2006\/the-perspective-shift-in-bibliometrics-and-its-consequences."},{"key":"4295_CR17","unstructured":"Gl\u00e4nzel, W., Chi, P. S., Gumpenberger, C., & Gorraiz, J. (2016). Information sources-information targets: Evaluative aspects of the scientists\u2019 publication strategies. In 21st International Conference on Science and Technology Indicators-STI 2016. Book of Proceedings."},{"issue":"2","key":"4295_CR18","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1023\/A:1014848323806","volume":"53","author":"W Gl\u00e4nzel","year":"2002","unstructured":"Gl\u00e4nzel, W., & Moed, H. F. (2002). Journal impact measures in bibliometric research. Scientometrics, 53(2), 171\u2013193.","journal-title":"Scientometrics"},{"issue":"3","key":"4295_CR19","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1016\/j.joi.2010.03.002","volume":"4","author":"B Gonz\u00e1lez-Pereira","year":"2010","unstructured":"Gonz\u00e1lez-Pereira, B., Guerrero-Bote, V. P., & Moya-Aneg\u00f3n, F. (2010). A new approach to the metric of journals scientific prestige: The SJR indicator. Journal of Informetrics, 4(3), 379\u2013391. https:\/\/doi.org\/10.1016\/j.joi.2010.03.002","journal-title":"Journal of Informetrics"},{"issue":"3","key":"4295_CR20","doi-asserted-by":"publisher","first-page":"1699","DOI":"10.1007\/s11192-015-1703-6","volume":"105","author":"J Gorraiz","year":"2015","unstructured":"Gorraiz, J., & Gumpenberger, C. (2015). A flexible bibliometric approach for the assessment of professorial appointments. Scientometrics, 105(3), 1699\u20131719. https:\/\/doi.org\/10.1007\/s11192-015-1703-6","journal-title":"Scientometrics"},{"key":"4295_CR21","unstructured":"Gorraiz, J., Gumpenberger, C., Schl\u00f6gl, C., & Wieland, M. (2012a). On the temporal stability of Garfield\u2018s Impact Factor and its suitability to identify hot papers. In Proceedings of STI 2012a Montreal. 17th international conference on science and technology indicators (pp. 319\u2013332)."},{"issue":"2","key":"4295_CR22","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1007\/s11192-011-0579-3","volume":"91","author":"J Gorraiz","year":"2012","unstructured":"Gorraiz, J., Reimann, R., & Gumpenberger, C. (2012). Key factors and considerations in the assessment of international collaboration: A case study for Austria and six countries. Scientometrics, 91(2), 417\u2013433. https:\/\/doi.org\/10.1007\/s11192-011-0579-3","journal-title":"Scientometrics"},{"key":"4295_CR23","unstructured":"Gorraiz, J., Ulrych, U., Gl\u00e4nzel, W., Arroyo-Machado, W., & Torres-Salinas, D. (2021). Measuring the excellence contribution at the journal level: an alternative to Garfield\u2019s impact factor. In W. Gl\u00e4nzel, S. Heeffer, P.-S. Chi, & R. Rousseau (Eds.), 18th International Conference on Scientometrics and Informetrics, ISSI 2021 (pp. 465\u2013476). https:\/\/digibug.ugr.es\/handle\/10481\/69675."},{"key":"4295_CR24","doi-asserted-by":"crossref","unstructured":"Gorraiz, J., Wieland, M., Ulrych, U., & Gumpenberger, C. (2020). De Profundis: a decade of bibliometric services under scrutiny. In Evaluative informetrics: The art of metrics-based research assessment (pp. 233\u2013260). Springer.","DOI":"10.1007\/978-3-030-47665-6_11"},{"issue":"4","key":"4295_CR25","doi-asserted-by":"publisher","first-page":"674","DOI":"10.1016\/j.joi.2012.07.001","volume":"6","author":"VP Guerrero-Bote","year":"2012","unstructured":"Guerrero-Bote, V. P., & Moya- Aneg\u00f3n, F. (2012). A further step forward in measuring journals\u2019 scientific prestige: The SJR2 indicator. Journal of Informetrics, 6(4), 674\u2013688.","journal-title":"Journal of Informetrics"},{"key":"4295_CR26","doi-asserted-by":"crossref","unstructured":"Larivi\u00e8re, V., & Sugimoto, C. R. (2019). The journal impact factor: a brief history, critique, and discussion of adverse effects. In Springer handbook of science and technology indicators (pp. 3\u201324). Springer.","DOI":"10.1007\/978-3-030-02511-3_1"},{"issue":"11","key":"4295_CR27","doi-asserted-by":"publisher","first-page":"2140","DOI":"10.1002\/asi.22731","volume":"63","author":"GA Lozano","year":"2012","unstructured":"Lozano, G. A., Larivi\u00e8re, V., & Gingras, Y. (2012). The weakening relationship between the impact factor and papers\u2019 citations in the digital age. Journal of the Association for Information Science and Technology, 63(11), 2140\u20132145. https:\/\/doi.org\/10.1002\/asi.22731","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"6873","key":"4295_CR28","doi-asserted-by":"publisher","first-page":"731","DOI":"10.1038\/415731a","volume":"415","author":"HF Moed","year":"2002","unstructured":"Moed, H. F. (2002). The impact-factors debate: The ISI\u2019s uses and limits. Nature, 415(6873), 731\u2013732.","journal-title":"Nature"},{"issue":"3","key":"4295_CR29","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1016\/j.joi.2010.01.002","volume":"4","author":"HF Moed","year":"2010","unstructured":"Moed, H. F. (2010a). Measuring contextual citation impact of scientific journals. Journal of Informetrics, 4(3), 265\u2013277. https:\/\/doi.org\/10.1016\/j.joi.2010.01.002","journal-title":"Journal of Informetrics"},{"issue":"1","key":"4295_CR30","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1002\/asi.21424","volume":"62","author":"HF Moed","year":"2010","unstructured":"Moed, H. F. (2010b). The source normalized impact per paper is a valid and sophisticated indicator of journal citation impact. Journal of the American Society for Information Science and Technology, 62(1), 211\u2013213. https:\/\/doi.org\/10.1002\/asi.21424","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"6579","key":"4295_CR31","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1038\/381186a0","volume":"381","author":"HF Moed","year":"1995","unstructured":"Moed, H. F., & van Leeuwen, T. N. (1995). Impact factors can mislead. Nature, 381(6579), 186.","journal-title":"Nature"},{"issue":"1","key":"4295_CR32","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1177\/0193841X14524957","volume":"39","author":"M Osterloh","year":"2014","unstructured":"Osterloh, M., & Frey, B. S. (2014). Ranking Games. Evaluation Review, 39(1), 102\u2013129. https:\/\/doi.org\/10.1177\/0193841X14524957","journal-title":"Evaluation Review"},{"key":"4295_CR33","unstructured":"Repiso, R., Gumpenberger, C., Wieland, M., & Gorraiz, J. (2019). Impact measures in the humanities: A blessing or a curse?. Book of Abstracts QQML 2019. Retrieved from http:\/\/qqml.org\/wp-content\/uploads\/2017\/09\/Book-of-Abstracts_Final_AfterConf_v1.pdf."},{"issue":"2","key":"4295_CR34","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1002\/leap.1264","volume":"33","author":"R Repiso","year":"2020","unstructured":"Repiso, R., Moreno-Delgado, A., & Torres-Salinas, D. (2020). If PLOS ONE were really 101 different specialized journals: A proposed approach to the evaluation of multidisciplinary megajournals. Learned Publishing, 33(2), 96\u2013103. https:\/\/doi.org\/10.1002\/leap.1264","journal-title":"Learned Publishing"},{"issue":"3","key":"4295_CR35","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1007\/bf02129597","volume":"36","author":"A Schubert","year":"1996","unstructured":"Schubert, A., & Braun, T. (1996). Cross-field normalization of scientometric indicators. Scientometrics, 36(3), 311\u2013324. https:\/\/doi.org\/10.1007\/bf02129597","journal-title":"Scientometrics"},{"issue":"1\u20136","key":"4295_CR36","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/bf02093234","volume":"16","author":"A Schubert","year":"1989","unstructured":"Schubert, A., Gl\u00e4nzel, W., & Braun, T. (1989). Scientometric Datafiles. A comprehensive set of indicators on 2649 journals and 96 countries in all major fields and subfields 1981\u20131985. Scientometrics, 16(1\u20136), 3\u2013478. https:\/\/doi.org\/10.1007\/bf02093234","journal-title":"Scientometrics"},{"issue":"1","key":"4295_CR37","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1177\/016555158801400106","volume":"14","author":"R Todorov","year":"1988","unstructured":"Todorov, R., & Gl\u00e4nzel, W. (1988). Journal citation measures: A concise review. Journal of Information Science, 14(1), 47\u201356. https:\/\/doi.org\/10.1177\/016555158801400106","journal-title":"Journal of Information Science"},{"issue":"7633","key":"4295_CR38","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1038\/nature.2016.21131","volume":"540","author":"R Van Noorden","year":"2016","unstructured":"Van Noorden, R. (2016). Controversial impact factor gets a heavyweight rival. Nature, 540(7633), 325\u2013326. https:\/\/doi.org\/10.1038\/nature.2016.21131","journal-title":"Nature"},{"issue":"3","key":"4295_CR39","doi-asserted-by":"publisher","first-page":"236","DOI":"10.5860\/0710236","volume":"71","author":"JD West","year":"2010","unstructured":"West, J. D., Bergstrom, T. C., & Bergstrom, C. T. (2010). The Eigenfactor\u2122 Metrics: A network approach to assessing scholarly journals. College & Research Libraries, 71(3), 236\u2013244. https:\/\/doi.org\/10.5860\/0710236","journal-title":"College & Research Libraries"},{"key":"4295_CR40","doi-asserted-by":"publisher","DOI":"10.12688\/f1000research.23418.1","author":"L Waltman","year":"2020","unstructured":"Waltman, L., & Traag, V. A. (2020). Use of the journal impact factor for assessing individual articles need not be statistically wrong. F1000Research. https:\/\/doi.org\/10.12688\/f1000research.23418.1","journal-title":"F1000Research"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04295-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-022-04295-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04295-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,5]],"date-time":"2022-12-05T05:13:13Z","timestamp":1670217193000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-022-04295-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,26]]},"references-count":40,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["4295"],"URL":"https:\/\/doi.org\/10.1007\/s11192-022-04295-9","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,26]]},"assertion":[{"value":"22 November 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 February 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 February 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Wolfgang Gl\u00e4nzel is editor-in-chief of Scientometrics.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}