{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T08:38:34Z","timestamp":1770712714126,"version":"3.49.0"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2022,2,21]],"date-time":"2022-02-21T00:00:00Z","timestamp":1645401600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,2,21]],"date-time":"2022-02-21T00:00:00Z","timestamp":1645401600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The average Category Normalised Citation Impact (CNCI) of an institution\u2019s publication output is a widely used indicator for research performance benchmarking. However, it combines all entity contributions, obscuring individual inputs and preventing clear insight and sound policy recommendations if it is not correctly understood. Here, variations (Fractional and Collaboration [Collab] CNCI)\u2014which aim to address the obscurity problem\u2014are compared to the Standard CNCI indicator for over 250 institutions, spread globally, covering a ten-year period using Web of Science data. Results demonstrate that both Fractional and Collab CNCI methods produce lower index values than Standard CNCI. Fractional and Collab results are often near-identical despite fundamentally different calculation approaches. Collab-CNCI, however, avoids assigning fractional credit (which is potentially incorrect) and is relatively easy to implement. As single metrics obscure individual inputs, institutional output is also deconstructed into five collaboration groups. These groups track the increasing international collaboration trend, particularly highly multi-lateral studies and the decrease in publications authored by single institutions. The deconstruction also shows that both Standard and Fractional CNCI increase with the level of collaboration. However, Collab-CNCI does not necessarily follow this pattern thus enabling the identification of institutions where, for example, their domestic single articles are their best performing group. Comparing CNCI variants and deconstructing portfolios by collaboration type is, when understood and used correctly, an essential tool for interpreting institutional performance and informing policy making.<\/jats:p>","DOI":"10.1007\/s11192-022-04303-y","type":"journal-article","created":{"date-parts":[[2022,2,21]],"date-time":"2022-02-21T16:15:06Z","timestamp":1645460106000},"page":"7435-7448","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Comparing standard, collaboration and fractional CNCI at the institutional level: Consequences for performance evaluation"],"prefix":"10.1007","volume":"127","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1338-5910","authenticated-orcid":false,"given":"Ross W. K.","family":"Potter","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0347-3527","authenticated-orcid":false,"given":"Martin","family":"Szomszor","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0325-4431","authenticated-orcid":false,"given":"Jonathan","family":"Adams","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,2,21]]},"reference":[{"key":"4303_CR1","doi-asserted-by":"publisher","DOI":"10.3389\/frma.2018.00012","author":"J Adams","year":"2018","unstructured":"Adams, J., & Gurney, K. A. (2018). Bilateral and multilateral coauthorship and citation impact: Patterns in UK and US international collaboration. Frontiers in Research Metrics and Analysis. https:\/\/doi.org\/10.3389\/frma.2018.00012","journal-title":"Frontiers in Research Metrics and Analysis"},{"key":"4303_CR3","unstructured":"Adams, J., Pendlebury, D. A., & Potter, R. W. K. (2022) Making it count: Research credit management in a collaborative world, Clarivate, London. ISBN 978-1-8382799-7-4"},{"key":"4303_CR2","unstructured":"Adams, J., Pendlebury, D. A., Potter, R. W. K., & Szomszor, M. (2019). Multi-authorship and research analytics. Clarivate Analytics, London. ISBN 978-1-9160868-6-9"},{"issue":"1","key":"4303_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/2158244019829575","volume":"9","author":"DW Aksnes","year":"2019","unstructured":"Aksnes, D. W., Langfeldt, L., & Wouters, P. (2019). Citations, citation indicators, and research quality: An overview of basic concepts and theories. SAGE Open, 9(1), 1\u201317. https:\/\/doi.org\/10.1177\/2158244019829575","journal-title":"SAGE Open"},{"issue":"1","key":"4303_CR4","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/j.joi.2011.08.002","volume":"6","author":"DW Aksnes","year":"2012","unstructured":"Aksnes, D. W., Schneider, J. W., & Gunnarsson, M. (2012). Ranking national research systems by citation indicators. A comparative analysis using whole and fractionalised counting methods. Journal of Informetrics, 6(1), 36\u201343. https:\/\/doi.org\/10.1016\/j.joi.2011.08.002","journal-title":"Journal of Informetrics"},{"key":"4303_CR6","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1002\/(SICI)1097-4571(199503)46:2<97::AID-ASI3>3.0.CO;2-L","volume":"46","author":"Q Burrell","year":"1995","unstructured":"Burrell, Q., & Rousseau, R. (1995). Fractional counts for authorship attribution: A numerical study. Journal of the American Society for Information Science, 46, 97\u2013102. https:\/\/doi.org\/10.1002\/(SICI)1097-4571(199503)46:2%3c97::AID-ASI3%3e3.0.CO;2-L","journal-title":"Journal of the American Society for Information Science"},{"issue":"4","key":"4303_CR7","first-page":"82","volume":"64","author":"H Carlsson","year":"2009","unstructured":"Carlsson, H. (2009). Allocation of research funds using bibliometric indicators\u2014Asset and challenge to Swedish higher education sector. InfoTrend, 64(4), 82\u201388.","journal-title":"InfoTrend"},{"key":"4303_CR8","volume-title":"Social stratification in science","author":"JR Cole","year":"1973","unstructured":"Cole, J. R., & Cole, S. (1973). Social stratification in science. The University of Chicago Press."},{"issue":"2","key":"4303_CR9","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1002\/(SICI)1097-4571(2000)51:2<145::AID-ASI6>3.0.CO;2-9","volume":"51","author":"L Egghe","year":"2000","unstructured":"Egghe, L., Rousseau, R., & van Hooydonk, G. (2000). Methods for accrediting publications to authors or countries: Consequences for evaluation studies. Journal of the American Society for Information Science, 51(2), 145\u2013157. https:\/\/doi.org\/10.1002\/(SICI)1097-4571(2000)51:2%3c145::AID-ASI6%3e3.0.CO;2-9","journal-title":"Journal of the American Society for Information Science"},{"key":"4303_CR10","unstructured":"Evidence. (2007). The use of bibliometrics to measure research quality in UK higher education institutions. Report to Universities UK. Universities UK. ISBN 978 1 84036 165 4. Retrieved September 17, 2021 from https:\/\/dera.ioe.ac.uk\/\/26316\/"},{"key":"4303_CR11","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1126\/science.122.3159.108","volume":"122","author":"E Garfield","year":"1955","unstructured":"Garfield, E. (1955). Citation indexes for science. A new dimension in documentation through association of ideas. Science, 122, 108\u2013111. https:\/\/doi.org\/10.1126\/science.122.3159.108","journal-title":"Science"},{"key":"4303_CR12","first-page":"84","volume-title":"Can citation indexing be automated? Essay of an information scientist, 1","author":"E Garfield","year":"1977","unstructured":"Garfield, E. (1977). Can citation indexing be automated? Essay of an information scientist, 1 (pp. 84\u201390). ISI Press."},{"issue":"3","key":"4303_CR13","doi-asserted-by":"publisher","first-page":"932","DOI":"10.1162\/qss_a_00141","volume":"2","author":"M Gauffriau","year":"2021","unstructured":"Gauffriau, M. (2021). Counting methods introduced into the bibliometric research literature 1970\u20132018: A review. Quantitative Science Studies, 2(3), 932\u2013975. https:\/\/doi.org\/10.1162\/qss_a_00141","journal-title":"Quantitative Science Studies"},{"issue":"1","key":"4303_CR14","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1023\/a:1015684505035","volume":"54","author":"W Gl\u00e4nzel","year":"2002","unstructured":"Gl\u00e4nzel, W., & De Lange, C. (2002). A distributional approach to multinationality measures of international scientific collaboration. Scientometrics, 54(1), 75\u201389. https:\/\/doi.org\/10.1023\/a:1015684505035","journal-title":"Scientometrics"},{"issue":"2","key":"4303_CR15","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1007\/s11192-011-0579-3","volume":"91","author":"J Gorraiz","year":"2012","unstructured":"Gorraiz, J., Reimann, R., & Gumpenberger, C. (2012). Key factors and considerations in the assessment of international collaboration: A case study for Austria and six countries. Scientometrics, 91(2), 417\u2013433. https:\/\/doi.org\/10.1007\/s11192-011-0579-3","journal-title":"Scientometrics"},{"key":"4303_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/0306-4573(87)90033-1","volume":"23","author":"CD Hurt","year":"1987","unstructured":"Hurt, C. D. (1987). Conceptual citation differences in science, technology, and social sciences literature. Information Processing & Management, 23, 1\u20136. https:\/\/doi.org\/10.1016\/0306-4573(87)90033-1","journal-title":"Information Processing & Management"},{"issue":"4","key":"4303_CR17","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0231735","volume":"5","author":"A Jappe","year":"2020","unstructured":"Jappe, A. (2020). Professional standards in bibliometric research evaluation? Ameta-evaluation of European assessment practice 2005\u20132019. PLoS ONE, 5(4), e0231735. https:\/\/doi.org\/10.1371\/journal.pone.0231735","journal-title":"PLoS ONE"},{"key":"4303_CR18","unstructured":"Kronman, U., Gunnarsson, M., & Karlsson, S. (2010). The bibliometric database at the Swedish Research Council\u2014Contents, methods and indicators. Swedish Research Council, Stockholm"},{"issue":"6","key":"4303_CR19","doi-asserted-by":"publisher","first-page":"1146","DOI":"10.1002\/asi.21511","volume":"62","author":"L Leydesdorff","year":"2011","unstructured":"Leydesdorff, L., & Shin, J. C. (2011). How to evaluate universities in terms of their relative citation impacts: Fractional counting of citations and the normalization of differences among disciplines. Journal of the American Society for Information Science and Technology, 62(6), 1146\u20131155. https:\/\/doi.org\/10.1002\/asi.21511","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"10258","key":"4303_CR20","doi-asserted-by":"publisher","first-page":"1250","DOI":"10.1016\/S0140-6736(20)30750-9","volume":"396","author":"R Lozano","year":"2020","unstructured":"Lozano, R., et al. (2020). Measuring universal health coverage based on an index of effective coverage of health services in 204 countries and territories, 1990\u20132019: A systematic analysis for the Global Burden of Disease Study 2019. The Lancet, 396(10258), 1250\u20131284. https:\/\/doi.org\/10.1016\/S0140-6736(20)30750-9","journal-title":"The Lancet"},{"key":"4303_CR21","volume-title":"The use of bibliometrics in research policy and evaluation activities","author":"Nordforsk,","year":"2010","unstructured":"Nordforsk. (2010). Bibliometric research performance indicators for the Nordic Countries. A publication from the NORIA-net. In J. W. Schneider (Ed.), The use of bibliometrics in research policy and evaluation activities. NordForsk."},{"key":"4303_CR22","volume-title":"Bibliometric indicators for the Nordic Universities","author":"Nordforsk,","year":"2011","unstructured":"Nordforsk. (2011). Comparing research at Nordic Universities using bibliometric indicators. A publication from the NORIA-net. In F. Piro (Ed.), Bibliometric indicators for the Nordic Universities. NordForsk."},{"issue":"4","key":"4303_CR23","doi-asserted-by":"publisher","DOI":"10.1016\/j.joi.2020.101075","volume":"14","author":"RWK Potter","year":"2020","unstructured":"Potter, R. W. K., Szomszor, M., & Adams, J. (2020). Interpreting CNCIs on a country-scale: The effect of domestic and international collaboration type. Journal of Informetrics, 14(4), 101075. https:\/\/doi.org\/10.1016\/j.joi.2020.101075","journal-title":"Journal of Informetrics"},{"key":"4303_CR24","unstructured":"Potter, R. W. K., Szomszor, M., & Adams, J. (2021). Research performance indicators and management decision making: Using Collab-CNCI to understand institutional impact. In: Proceedings of the 18th international conference on scientometrics and informetrics, 913\u2013920."},{"key":"4303_CR25","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1007\/s11192-017-2573-x","volume":"114","author":"LC Ribeiro","year":"2018","unstructured":"Ribeiro, L. C., Rapini, M. S., Silva, L. A., & Albuquerque, E. A. (2018). Growth patterns of the network of international collaboration in science. Scientometrics, 114, 159\u2013179. https:\/\/doi.org\/10.1007\/s11192-017-2573-x","journal-title":"Scientometrics"},{"issue":"2","key":"4303_CR26","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1016\/j.joi.2019.03.010","volume":"13","author":"G Sivertsen","year":"2019","unstructured":"Sivertsen, G., Rosseau, R., & Zhang, L. (2019). Measuring scientific contributions with modified fractional counting. Journal of Informetrics, 13(2), 679\u2013694. https:\/\/doi.org\/10.1016\/j.joi.2019.03.010","journal-title":"Journal of Informetrics"},{"key":"4303_CR27","doi-asserted-by":"publisher","first-page":"30","DOI":"10.3389\/frma.2020.628703","volume":"5","author":"M Szomszor","year":"2021","unstructured":"Szomszor, M., Adams, J., Fry, R., Gebert, C., Pendlebury, A. D., Potter, R. W. K., & Rogers, G. (2021). Interpreting bibliometric data. Frontiers in Research Metrics and Analytics, 5, 30. https:\/\/doi.org\/10.3389\/frma.2020.628703","journal-title":"Frontiers in Research Metrics and Analytics"},{"issue":"1","key":"4303_CR28","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1162\/qss_a_00003","volume":"1","author":"M Thelwall","year":"2020","unstructured":"Thelwall, M. (2020). Large publishing consortia produce higher citation impact research but coauthor contributions are hard to evaluate. Quantitative Science Studies, 1(1), 290\u2013302. https:\/\/doi.org\/10.1162\/qss_a_00003","journal-title":"Quantitative Science Studies"},{"issue":"10","key":"4303_CR29","doi-asserted-by":"publisher","first-page":"944","DOI":"10.1002\/(SICI)1097-4571(199710)48:10<944::AID-ASI8>3.0.CO;2-1","volume":"48","author":"G van Hooydonk","year":"1997","unstructured":"van Hooydonk, G. (1997). Fractional counting of multiauthored publications: Consequences for the impact of author. Journal of the American Society for Information Science, 48(10), 944\u2013945. https:\/\/doi.org\/10.1002\/(SICI)1097-4571(199710)48:10%3c944::AID-ASI8%3e3.0.CO;2-1","journal-title":"Journal of the American Society for Information Science"},{"key":"4303_CR30","unstructured":"Vetenskapsr\u00e5det. (2014). Guidelines for using bibliometrics at the Swedish Research Council. The Swedish Research Council, Stockholm."},{"issue":"10258","key":"4303_CR32","doi-asserted-by":"publisher","first-page":"1285","DOI":"10.1016\/S0140-6736(20)30677-2","volume":"396","author":"SE Vollset","year":"2020","unstructured":"Vollset, S. E., et al. (2020). Fertility, mortality, migration, and population scenarios for 195 countries and territories from 2017 to 2100: A forecasting analysis for the Global Burden of Disease Study. The Lancet, 396(10258), 1285\u20131306. https:\/\/doi.org\/10.1016\/S0140-6736(20)30677-2","journal-title":"The Lancet"},{"key":"4303_CR33","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1016\/j.joi.2016.02.007","volume":"10","author":"L Waltman","year":"2016","unstructured":"Waltman, L. (2016). A review of the literature on citation impact indicators. Journal of Informetrics, 10, 365\u2013391. https:\/\/doi.org\/10.1016\/j.joi.2016.02.007","journal-title":"Journal of Informetrics"},{"issue":"4","key":"4303_CR34","doi-asserted-by":"publisher","first-page":"872","DOI":"10.1016\/j.joi.2015.08.001","volume":"9","author":"L Waltman","year":"2015","unstructured":"Waltman, L., & van Eck, N. J. (2015). Field-normalized citation impact indicators and the choice of an appropriate counting method. Journal of Informetrics, 9(4), 872\u2013894. https:\/\/doi.org\/10.1016\/j.joi.2015.08.001","journal-title":"Journal of Informetrics"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04303-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-022-04303-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04303-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,5]],"date-time":"2022-12-05T05:12:27Z","timestamp":1670217147000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-022-04303-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,21]]},"references-count":33,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["4303"],"URL":"https:\/\/doi.org\/10.1007\/s11192-022-04303-y","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,21]]},"assertion":[{"value":"28 October 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 February 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 February 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All authors are associated with the Institute for Scientific Information, which is part of Clarivate, the owner of the <i>Web of Science<\/i>.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}