{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T13:26:44Z","timestamp":1774445204304,"version":"3.50.1"},"reference-count":15,"publisher":"Emerald","issue":"1","license":[{"start":{"date-parts":[[2014,1,7]],"date-time":"2014-01-07T00:00:00Z","timestamp":1389052800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2014,1,7]]},"abstract":"\n Purpose<\/jats:title>\n \u2013 This study is concerned with a problem in measuring citation impact with the aid of percentile data, which arises from the assignment of publications (or the journals in which the publications have appeared) by Thomson Reuters for the Web of Science to more than one subject category. If there is more than one subject category for a publication, it is initially unclear which category is to be used to create the reference set for the calculation of the percentile. This paper seeks to address these issues. <\/jats:p>\n <\/jats:sec>\n \n Design\/methodology\/approach<\/jats:title>\n \u2013 In this study the author would like to look at whether the calculation of differences between the citation impact of research institutions is affected by whether the minimum (the maximum percentile), the maximum (the minimum percentile), the mean or the median impact (percentile) for the different subject categories is used. The study is based on a sample of percentile data for three research institutions (n<\/jats:italic>=4,232). <\/jats:p>\n <\/jats:sec>\n \n Findings<\/jats:title>\n \u2013 The result of the comparison of citation impact of the three institutions remains very similar for all the calculation methods, but on a different level. <\/jats:p>\n <\/jats:sec>\n \n Originality\/value<\/jats:title>\n \u2013 It is the first study, which investigates how far it makes a difference in the comparison of the citation impact of three different research institutes whether \u2013 with multiple assignments of subject categories to one publication \u2013 the minimum, the maximum, the mean or the median inverted percentile is used. An answer to the question is very relevant since different methods are used in practical application. For example, the web-based research evaluation tool InCites uses the minimum percentile.<\/jats:p>\n <\/jats:sec>","DOI":"10.1108\/jd-10-2012-0136","type":"journal-article","created":{"date-parts":[[2013,12,12]],"date-time":"2013-12-12T10:35:30Z","timestamp":1386844530000},"page":"52-61","source":"Crossref","is-referenced-by-count":9,"title":["Assigning publications to multiple subject categories for bibliometric analysis"],"prefix":"10.1108","volume":"70","author":[{"given":"Lutz","family":"Bornmann","sequence":"first","affiliation":[]}],"member":"140","reference":[{"key":"key2021010400570939700_b1","unstructured":"Bornmann, L.\n (n.d.a), \u201cHow to analyze percentile impact data meaningfully in bibliometrics? The statistical analysis of distributions, percentile rank classes and top-cited papers\u201d, Journal of the American Society for Information Science and Technology, in press."},{"key":"key2021010400570939700_b2","unstructured":"Bornmann, L.\n (n.d.b), \u201cThe problem of percentile rank scores used with small reference sets\u201d, Journal of the American Society of Information Science and Technology, in press."},{"key":"key2021010400570939700_b3","doi-asserted-by":"crossref","unstructured":"Bornmann, L.\n , \n De Moya Aneg\u00f3n, F.\n and \n Leydesdorff, L.\n (2012), \u201cThe new excellence indicator in the world report of the SCImago Institutions Rankings 2011\u201d, Journal of Informetrics, Vol. 6, pp. 333-335.","DOI":"10.1016\/j.joi.2011.11.006"},{"key":"key2021010400570939700_b4","doi-asserted-by":"crossref","unstructured":"Bornmann, L.\n , \n Leydesdorff, L.\n and \n Mutz, R.\n (2013), \u201cThe use of percentiles and percentile rank classes in the analysis of bibliometric data: opportunities and limits\u201d, Journal of Informetrics, Vol. 7, pp. 158-165.","DOI":"10.1016\/j.joi.2012.10.001"},{"key":"key2021010400570939700_b5","doi-asserted-by":"crossref","unstructured":"Bornmann, L.\n , \n Mutz, R.\n , \n Marx, W.\n , \n Schier, H.\n and \n Daniel, H.-D.\n (2011), \u201cA multilevel modelling approach to investigating the predictive validity of editorial decisions: do the editors of a high-profile journal select manuscripts that are highly cited after publication?\u201d, Journal of the Royal Statistical Society \u2013 Series A (Statistics in Society), Vol. 174, pp. 857-879.","DOI":"10.1111\/j.1467-985X.2011.00689.x"},{"key":"key2021010400570939700_b6","doi-asserted-by":"crossref","unstructured":"Herranz, N.\n and \n Ruiz-Castillo, J.\n (2012), \u201cSub-field normalization in the multiplicative case: high- and low-impact citation indicators\u201d, Research Evaluation, Vol. 21, pp. 113-125.","DOI":"10.1093\/reseval\/rvs006"},{"key":"key2021010400570939700_b7","doi-asserted-by":"crossref","unstructured":"Leydesdorff, L.\n , \n Bornmann, L.\n , \n Mutz, R.\n and \n Opthof, T.\n (2011), \u201cTurning the tables in citation analysis one more time: principles for comparing sets of documents\u201d, Journal of the American Society for Information Science and Technology, Vol. 62, pp. 1370-1381.","DOI":"10.1002\/asi.21534"},{"key":"key2021010400570939700_b8","doi-asserted-by":"crossref","unstructured":"Rousseau, R.\n (2012), \u201cBasic properties of both percentile rank scores and the I3 indicator\u201d, Journal of the American Society for Information Science and Technology, Vol. 63, pp. 416-420.","DOI":"10.1002\/asi.21684"},{"key":"key2021010400570939700_b9","unstructured":"Schreiber, M.\n (2012a), \u201cInconsistencies of recently proposed citation impact indicators and how to avoid them\u201d, available at: http:\/\/arxiv.org\/abs\/1202.3861 (accessed 20 February 2013)."},{"key":"key2021010400570939700_b10","unstructured":"Schreiber, M.\n (2012b), \u201cUncertainties and ambiguities in percentiles and how to avoid them\u201d, available at: http:\/\/arxiv.org\/abs\/1205.3588 (accessed 21 May 2013)."},{"key":"key2021010400570939700_b11","doi-asserted-by":"crossref","unstructured":"Schubert, A.\n and \n Braun, T.\n (1986), \u201cRelative indicators and relational charts for comparative assessment of publication output and citation impact\u201d, Scientometrics, Vol. 9, pp. 281-291.","DOI":"10.1007\/BF02017249"},{"key":"key2021010400570939700_b12","unstructured":"Tijssen, R.\n and \n Van Leeuwen, T.\n (2006), \u201cCentres of research excellence and science indicators. Can \u2018excellence\u2019 be captured in numbers?\u201d, in \n Gl\u00e4nzel, W.\n (Ed.), Ninth International Conference on Science and Technology Indicators, Katholieke Universiteit Leuven, Leuven."},{"key":"key2021010400570939700_b13","doi-asserted-by":"crossref","unstructured":"Tijssen, R.\n , \n Visser, M.\n and \n Van Leeuwen, T.\n (2002), \u201cBenchmarking international scientific excellence: are highly cited research papers an appropriate frame of reference?\u201d, Scientometrics, Vol. 54, pp. 381-397.","DOI":"10.1023\/A:1016082432660"},{"key":"key2021010400570939700_b14","doi-asserted-by":"crossref","unstructured":"Vinkler, P.\n (2012), \u201cThe case of scientometricians with the \u2018absolute relative\u2019 impact indicator\u201d, Journal of Informetrics, Vol. 6, pp. 254-264.","DOI":"10.1016\/j.joi.2011.12.004"},{"key":"key2021010400570939700_b15","doi-asserted-by":"crossref","unstructured":"Waltman, L.\n , \n Calero-Medina, C.\n , \n Kosten, J.\n , \n Noyons, E.C.M.\n , \n Tijssen, R.J.W.\n , \n Van Eck, N.J.\n , \n Van Leeuwen, T.N.\n , \n Van Raan, A.F.J.\n , \n Visser, M.S.\n and \n Wouters, P.\n (2012), \u201cThe Leiden Ranking 2011\/2012: data collection, indicators, and interpretation\u201d, Journal of the American Society for Information Science and Technology, Vol. 63, pp. 2419-2432.","DOI":"10.1002\/asi.22708"}],"container-title":["Journal of Documentation"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/JD-10-2012-0136","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JD-10-2012-0136\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JD-10-2012-0136\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:35:07Z","timestamp":1753396507000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/jd\/article\/70\/1\/52-61\/204814"}},"subtitle":["An empirical case study based on percentiles"],"short-title":[],"issued":{"date-parts":[[2014,1,7]]},"references-count":15,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2014,1,7]]}},"alternative-id":["10.1108\/JD-10-2012-0136"],"URL":"https:\/\/doi.org\/10.1108\/jd-10-2012-0136","relation":{},"ISSN":["0022-0418"],"issn-type":[{"value":"0022-0418","type":"print"}],"subject":[],"published":{"date-parts":[[2014,1,7]]}}}