{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T22:14:46Z","timestamp":1776809686095,"version":"3.51.2"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2011,6,17]],"date-time":"2011-06-17T00:00:00Z","timestamp":1308268800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/2.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2011,9]]},"DOI":"10.1007\/s11192-011-0424-8","type":"journal-article","created":{"date-parts":[[2011,6,17]],"date-time":"2011-06-17T18:54:49Z","timestamp":1308336889000},"page":"1011-1016","source":"Crossref","is-referenced-by-count":17,"title":["A comment to the paper by Waltman et al., Scientometrics, 87, 467\u2013481, 2011"],"prefix":"10.1007","volume":"88","author":[{"given":"Tobias","family":"Opthof","sequence":"first","affiliation":[]},{"given":"Loet","family":"Leydesdorff","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2011,6,17]]},"reference":[{"issue":"3","key":"424_CR1","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1016\/j.joi.2009.10.004","volume":"4","author":"L Bornmann","year":"2010","unstructured":"Bornmann, L., Leydesdorff, L., & Van den Besselaar, P. (2010). A meta-evaluation of scientific research proposals: Different ways of comparing rejected to awarded applications. Journal of Informetrics,\n                           4(3), 211\u2013220.","journal-title":"Journal of Informetrics"},{"issue":"4","key":"424_CR2","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1023\/B:MINE.0000005155.70870.bd","volume":"41","author":"A Geuna","year":"2003","unstructured":"Geuna, A., & Martin, B. R. (2003). University research evaluation and funding: An international comparison. Minerva,\n                           41(4), 277\u2013304.","journal-title":"Minerva"},{"issue":"1","key":"424_CR3","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/s11024-010-9141-3","volume":"48","author":"W Halffman","year":"2010","unstructured":"Halffman, W., & Leydesdorff, L. (2010). Is inequality among universities increasing? Gini coefficients and the elusive rise of elite universities. Minerva,\n                           48(1), 55\u201372.","journal-title":"Minerva"},{"issue":"46","key":"424_CR4","doi-asserted-by":"publisher","first-page":"16569","DOI":"10.1073\/pnas.0507655102","volume":"102","author":"JE Hirsch","year":"2005","unstructured":"Hirsch, J. E. (2005). An index to quantify an individual\u2019s scientific research output. Proceedings of the National Academy of Sciences of the USA,\n                           102(46), 16569\u201316572.","journal-title":"Proceedings of the National Academy of Sciences of the USA"},{"issue":"2","key":"424_CR5","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1002\/asi.20743","volume":"59","author":"L Leydesdorff","year":"2008","unstructured":"Leydesdorff, L. (2008). Caveats for the use of citation indicators in research and journal evaluation. Journal of the American Society for Information Science and Technology,\n                           59(2), 278\u2013287.","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"4","key":"424_CR6","doi-asserted-by":"publisher","first-page":"644","DOI":"10.1016\/j.joi.2010.05.003","volume":"4","author":"L Leydesdorff","year":"2010","unstructured":"Leydesdorff, L., & Opthof, T. (2010). Normalization at the field level: Fractional counting of citations. Journal of Informetrics,\n                           4(4), 644\u2013646.","journal-title":"Journal of Informetrics"},{"issue":"1","key":"424_CR7","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1016\/j.joi.2010.10.003","volume":"5","author":"L Leydesdorff","year":"2011","unstructured":"Leydesdorff, L., & Opthof, T. (2011). Remaining problems with the \u201cNew Crown Indicator\u201d (MNCS) of the CWTS. Journal of Informetrics,\n                           5(1), 224\u2013225.","journal-title":"Journal of Informetrics"},{"key":"424_CR8","first-page":"151","volume":"16","author":"MH MacRoberts","year":"1987","unstructured":"MacRoberts, M. H., & MacRoberts, B. R. (1987). Another test of the normative theory of citing. Journal of the American Society for Information Science,\n                           16, 151\u2013172.","journal-title":"Journal of the American Society for Information Science"},{"issue":"3","key":"424_CR9","doi-asserted-by":"publisher","first-page":"435","DOI":"10.1007\/BF02129604","volume":"36","author":"MH MacRoberts","year":"1996","unstructured":"MacRoberts, M. H., & MacRoberts, B. R. (1996). Problems of citation analysis. Scientometrics,\n                           36(3), 435\u2013444.","journal-title":"Scientometrics"},{"issue":"1","key":"424_CR10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/asi.21228","volume":"61","author":"MH MacRoberts","year":"2010","unstructured":"MacRoberts, M. H., & MacRoberts, B. R. (2010). Problems of citation analysis: A study of uncited and seldom-cited influences. Journal of the American Society for Information Science and Technology,\n                           61(1), 1\u201312.","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"424_CR11","volume-title":"Citation analysis in research evaluation","author":"HF Moed","year":"2005","unstructured":"Moed, H. F. (2005). Citation analysis in research evaluation. Dordrecht: Springer."},{"issue":"3","key":"424_CR12","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1007\/BF02017338","volume":"33","author":"HF Moed","year":"1995","unstructured":"Moed, H. F., De Bruin, R. E., & Van Leeuwen, T. N. (1995). New bibliometric tools for the assessment of national research performance: Database description, overview of indicators and first applications. Scientometrics,\n                           33(3), 381\u2013422.","journal-title":"Scientometrics"},{"key":"424_CR13","volume-title":"Evaluative bibliometrics: The use of publication and citation analysis in the evaluation of scientific activity","author":"F Narin","year":"1976","unstructured":"Narin, F. (1976). Evaluative bibliometrics: The use of publication and citation analysis in the evaluation of scientific activity. Washington, DC: National Science Foundation."},{"issue":"1","key":"424_CR14","doi-asserted-by":"publisher","first-page":"31","DOI":"10.3152\/095820211X12941371876382","volume":"20","author":"J Neufeld","year":"2011","unstructured":"Neufeld, J., & von Ins, M. (2011). Informed peer review and uninformed bibliometrics? Research Evaluation,\n                           20(1), 31\u201346.","journal-title":"Research Evaluation"},{"issue":"3","key":"424_CR15","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1016\/j.joi.2010.02.003","volume":"4","author":"T Opthof","year":"2010","unstructured":"Opthof, T., & Leydesdorff, L. (2010). Caveats for the journal and field normalizations in the CWTS (\u201cLeiden\u201d) evaluations of research performance. Journal of Informetrics,\n                           4(3), 423\u2013430.","journal-title":"Journal of Informetrics"},{"issue":"5","key":"424_CR16","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1007\/BF02017249","volume":"9","author":"A Schubert","year":"1986","unstructured":"Schubert, A., & Braun, T. (1986). Relative indicators and relational charts for comparative assessment of publication output and citation impact. Scientometrics,\n                           9(5), 281\u2013291.","journal-title":"Scientometrics"},{"issue":"4","key":"424_CR17","doi-asserted-by":"publisher","first-page":"273","DOI":"10.3152\/095820209X475360","volume":"18","author":"P Besselaar Van den","year":"2009","unstructured":"Van den Besselaar, P., & Leydesdorff, L. (2009). Past performance, peer review, and project selection: A case study in the social and behavioral sciences. Research Evaluation,\n                           18(4), 273\u2013288.","journal-title":"Research Evaluation"},{"issue":"3","key":"424_CR18","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1556\/Scient.67.2006.3.10","volume":"67","author":"AFJ Raan Van","year":"2006","unstructured":"Van Raan, A. F. J. (2006). Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups. Scientometrics,\n                           67(3), 491\u2013502.","journal-title":"Scientometrics"},{"issue":"3","key":"424_CR19","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1007\/BF02026039","volume":"10","author":"P Vinkler","year":"1986","unstructured":"Vinkler, P. (1986). Evaluation of some methods for the relative assessment of scientific publications. Scientometrics,\n                           10(3), 157\u2013177.","journal-title":"Scientometrics"},{"issue":"2","key":"424_CR20","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1007\/BF02017315","volume":"36","author":"P Vinkler","year":"1996","unstructured":"Vinkler, P. (1996). Model for quantitative selection of relative scientometric impact indicators. Scientometrics,\n                           36(2), 223\u2013236.","journal-title":"Scientometrics"},{"key":"424_CR21","unstructured":"VSNU. (2002). Chemistry and chemical engineering. VSNU Series \u2018Assessment of Research Quality.\u2019 Utrecht: VSNU. ISBN 90 5588 4979."},{"key":"424_CR22","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1007\/s11192-011-0354-5","volume":"87","author":"L Waltman","year":"2011","unstructured":"Waltman, L., van Eck, N. J., van Leeuwen, T. N., Visser, M. S., & Van Raan, A. F. J. (2011a). Towards a new crown indicator: An empirical analysis. Scientometrics,\n                           87, 467\u2013481.","journal-title":"Scientometrics"},{"issue":"1","key":"424_CR23","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1016\/j.joi.2010.08.001","volume":"5","author":"L Waltman","year":"2011","unstructured":"Waltman, L., Van Eck, N. J., Van Leeuwen, T. N., Visser, M. S., & Van Raan, A. F. J. (2011b). Towards a new crown indicator: Some theoretical considerations. Journal of Informetrics,\n                           5(1), 37\u201347.","journal-title":"Journal of Informetrics"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-011-0424-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-011-0424-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-011-0424-8.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-011-0424-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,4,18]],"date-time":"2019-04-18T14:48:51Z","timestamp":1555598931000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-011-0424-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,6,17]]},"references-count":23,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2011,9]]}},"alternative-id":["424"],"URL":"https:\/\/doi.org\/10.1007\/s11192-011-0424-8","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,6,17]]}}}