{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T11:45:45Z","timestamp":1769082345858,"version":"3.49.0"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2013,6,18]],"date-time":"2013-06-18T00:00:00Z","timestamp":1371513600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2013,12]]},"DOI":"10.1007\/s11192-013-1058-9","type":"journal-article","created":{"date-parts":[[2013,6,17]],"date-time":"2013-06-17T10:49:11Z","timestamp":1371466151000},"page":"767-777","source":"Crossref","is-referenced-by-count":29,"title":["Comparison of a citation-based indicator and peer review for absolute and specific measures of research-group excellence"],"prefix":"10.1007","volume":"97","author":[{"given":"O.","family":"Mryglod","sequence":"first","affiliation":[]},{"given":"R.","family":"Kenna","sequence":"additional","affiliation":[]},{"given":"Yu.","family":"Holovatch","sequence":"additional","affiliation":[]},{"given":"B.","family":"Berche","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2013,6,18]]},"reference":[{"key":"1058_CR20","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1007\/s11192-009-0115-x","volume":"84","author":"J-C Billaut","year":"2010","unstructured":"Billaut, J. -C., Bouyssou, D., & Vincke, P. (2010). Should you believe in the Shanghai ranking? Scientometrics 84, 237\u2013263.","journal-title":"Scientometrics"},{"key":"1058_CR3","doi-asserted-by":"crossref","first-page":"857","DOI":"10.1007\/s11192-011-0547-y","volume":"91","author":"L Bornmann","year":"2012","unstructured":"Bornmann, L. (2012). The Hawthorne effect in journal peer review, Scientometrics 91, 857\u2013862.","journal-title":"Scientometrics"},{"key":"1058_CR14","doi-asserted-by":"crossref","first-page":"149","DOI":"10.3152\/095820208X319166","volume":"17","author":"L Bornmann","year":"2008","unstructured":"Bornmann, L., Wallon, G., & Ledin, A. (2008). Is the h index related to (standard) bibliometric measures and to the assessments by peers? An investigation of the h index by using molecular life sciences data, Research Evaluation 17, 149-156.","journal-title":"Research Evaluation"},{"key":"1058_CR15","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1038\/464016a","volume":"464","author":"D Butler","year":"2010","unstructured":"Butler, D. (2010). University rankings smarten up, Nature, 464,16\u201317.","journal-title":"Nature"},{"key":"1058_CR2","doi-asserted-by":"crossref","first-page":"e18521","DOI":"10.1371\/journal.pone.0018521","volume":"6","author":"GE Derrick","year":"2001","unstructured":"Derrick, G. E., Haynes, A., Chapman, S., & Hall, W. D. (2001). The association between four citation metrics and peer rankings of research influence of Australian researchers in six fields of public health, PLoS One, 6, e18521.","journal-title":"PLoS One"},{"key":"1058_CR13","doi-asserted-by":"crossref","first-page":"538","DOI":"10.3152\/030234207X256529","volume":"34","author":"C Donovan","year":"2007","unstructured":"Donovan, C. (2007). Future pathways for science policy and research assessment: Metrics vs peer review, quality vs impact. Science and Public Policy 34, 538-542.","journal-title":"Science and Public Policy"},{"issue":"1","key":"1058_CR9","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1007\/s11192-006-0144-7","volume":"69","author":"L Egghe","year":"2006","unstructured":"Egghe, L. (2006). Theory and practise of the g-index, Scientometrics,69(1), 131\u2013152.","journal-title":"Scientometrics,"},{"key":"1058_CR32","unstructured":"Evidence. (2010). Evidence (a Thomson Reuters business) report. The future of the UK university research base, July 2010."},{"key":"1058_CR33","unstructured":"Evidence. (2011). Funding research excellence: Research group size, critical mass and performance. A University Alliance report, July 2011."},{"key":"1058_CR17","unstructured":"Evidence. (2012). Bibliometric evaluation and international benchmarking of the UK\u2019s physics research, Summary report prepared for the Institute of Physics by Evidence, Thomson Reuters."},{"key":"1058_CR19","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1007\/s11192-007-1712-1","volume":"72","author":"RV Florian","year":"2007","unstructured":"Florian, R. V. (2007). Irreproducibility of the results of the Shanghai academic ranking of world universities Scientometrics 72, 25\u201332.","journal-title":"Scientometrics"},{"issue":"3159","key":"1058_CR6","first-page":"108","volume":"122","author":"E Garfield","year":"1955","unstructured":"Garfield, E. (1955). Citation indexes for science: A new dimension in documentation through association of Ideas. Science, 122(3159), 108\u2013111.","journal-title":"HortScience"},{"key":"1058_CR7","first-page":"406","volume":"1","author":"E Garfield","year":"1973","unstructured":"Garfield, E. (1973). Citation frequency as a measure of research activity and performance in essays of an information scientist, Current Contents, 1, 406\u2013408.","journal-title":"Current Contents"},{"issue":"46","key":"1058_CR8","doi-asserted-by":"crossref","first-page":"16569","DOI":"10.1073\/pnas.0507655102","volume":"102","author":"JE Hirsch","year":"2005","unstructured":"Hirsch, J. E. (2005). An index to quantify an individual\u2019s scientific research output. PNAS, 102(46),16569\u201316572.","journal-title":"PNAS,"},{"key":"1058_CR21","first-page":"30","volume":"5","author":"JPA Ioannidis","year":"2007","unstructured":"Ioannidis, J. P. A. et\u00a0al. (2007). International ranking systems for universities and institutions: A critical appraisal BMC Medicine 5, 30.","journal-title":"Medicine"},{"issue":"2","key":"1058_CR25","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1007\/s11192-010-0282-9","volume":"86","author":"R Kenna","year":"2010","unstructured":"Kenna, R., & Berche, B. (2010). Critical mass and the dependency of research quality on group size. Scientometrics, 86(2), 527\u2013540.","journal-title":"Scientometrics"},{"issue":"3","key":"1058_CR26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1787\/hemp-23-5kg0vswcm27g","volume":"23","author":"R Kenna","year":"2011","unstructured":"Kenna, R., & Berche, B. (2011). Critical masses for academic research groups and consequences for higher education research policy and management. Higher Education Management and Policy, 23(3), 1\u201321","journal-title":"Higher Education Management and Policy"},{"key":"1058_CR22","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1038\/463291a","volume":"463","author":"C Macilwain","year":"2010","unstructured":"Macilwain, C. (2010). Wild goose chase. Nature, 463, 291.","journal-title":"Nature"},{"key":"1058_CR23","author":"O Mryglod","year":"2010","unstructured":"Mryglod O., Kenna R., Holovatch Y., Berche B. (2012). Absolute and specific measures of research group excellence. Scientometrics doi: 10.1007\/s11192-012-0874-7 .","journal-title":"Scientometrics"},{"key":"1058_CR12","volume-title":"Citation analysis in research evaluation","author":"HF Moed","year":"2005","unstructured":"Moed, H. F. (2005). Citation analysis in research evaluation. Dordrecht: Springer."},{"key":"1058_CR4","unstructured":"Nature. (2010). Editorial, Metrics Special. 465, p. 845. Retrieved April 2012, from http:\/\/www.nature.com\/metrics ."},{"issue":"6","key":"1058_CR36","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1108\/00220410310698734","volume":"59","author":"M Norris","year":"2003","unstructured":"Norris, M., & Oppenheim, C. (2003). Citation counts and the Research Assessment Exercise. V archaeology and the 2001 RAE, Journal of Documentation, 59(6), 709\u2013730.","journal-title":"Journal of Documentation"},{"key":"1058_CR35","unstructured":"Oppenheim C., & Summers M. A. C. (2008). Citation counts and the Research Assessment Exercise, part VI. Unit of assessment 67 (music), Information Research, 13(2)."},{"key":"1058_CR30","unstructured":"RAE. (2008). The panel criteria and working methods. Panel E. (2006). Retrieved October 19, 2012, from http:\/\/www.rae.ac.uk\/pubs\/2006\/01\/docs\/eall.pdf ."},{"issue":"3","key":"1058_CR34","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1007\/BF02129597","volume":"36","author":"A Schubert","year":"1996","unstructured":"Schubert, A., & Braun, T. (1996). Cross-field normalization of scientometric indicators. Scientometrics 36(3), 311\u2013324.","journal-title":"Scientometrics"},{"key":"1058_CR28","author":"O Stauffer","year":"2012","unstructured":"Stauffer D. (2012). A biased review of sociophysics. Journal of Statistical Physics doi: 10.1007\/s10955-012-0604-9 .","journal-title":"Journal of Statistical Physics"},{"key":"1058_CR27","unstructured":"The official web-page of the RAE. (2008). Retrieved October 18, 2012, from http:\/\/www.rae.ac.uk\/ ."},{"key":"1058_CR31","unstructured":"The official web-page of the Higher Education Funding Council for England. Funding for universities and colleges in 2009\u201310 (2009). Electronic Publication 01\/2009 in the ADMIN-HEFCE Archives. Retrieved October 19, 2012."},{"key":"1058_CR18","unstructured":"The official web-page of Academic Ranking of World Universities (ARWU). (2012). Retrieved October 19, 2012, from http:\/\/www.shanghairanking.com ."},{"key":"1058_CR24","unstructured":"The official web-page of Evidence Thomson Reuters. (2012). Retrieved October 18, 2012, from http:\/\/www.evidence.co.uk ."},{"key":"1058_CR29","unstructured":"The official web-page of the REF. (2012). Retrieved October 19, 2012, from http:\/\/www.ref.ac.uk\/ ."},{"issue":"1","key":"1058_CR1","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1007\/s11192-005-0008-6","volume":"62","author":"AFJ Raan van","year":"2005","unstructured":"van Raan, A. F. J. (2005). Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods, Scientometrics, 62(1), 133\u2013143.","journal-title":"Scientometrics"},{"issue":"3","key":"1058_CR10","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1023\/A:1010519000767","volume":"50","author":"P Vinkler","year":"2001","unstructured":"Vinkler, P. (2001). An attempt for defining some basic categories of scientometrics and classifying the indicators of evaluative scientometrics. Scientometrics, 50(3), 539\u2013544","journal-title":"Scientometrics"},{"issue":"3","key":"1058_CR11","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1023\/B:SCIE.0000006888.69146.24","volume":"58","author":"P Vinkler","year":"2003","unstructured":"Vinkler, P. (2003). Relations of relative scientometric indicators. Scientometrics,58(3), 687\u2013694.","journal-title":"Scientometrics"},{"issue":"1","key":"1058_CR5","first-page":"26","volume":"30","author":"J Warner","year":"2003","unstructured":"Warner, J. (2003). Citation Analysis and Research Assessment in the United Kingdom, American Society for Information Science and Technology, 30(1), 26\u201327.","journal-title":"American Society for Information Science and Technology"},{"key":"1058_CR16","unstructured":"Williams R., de Rassenfosse G., Jensen P., & Marginson S. (2012). U21 Ranking of National Higher Education Systems, Report of the project sponsored by Universitas 21, University of Melbourne."}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-013-1058-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-013-1058-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-013-1058-9","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,6,1]],"date-time":"2019-06-01T09:34:29Z","timestamp":1559381669000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-013-1058-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,6,18]]},"references-count":36,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2013,12]]}},"alternative-id":["1058"],"URL":"https:\/\/doi.org\/10.1007\/s11192-013-1058-9","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,6,18]]}}}