{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T06:28:17Z","timestamp":1778912897330,"version":"3.51.4"},"reference-count":21,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2011,7,23]],"date-time":"2011-07-23T00:00:00Z","timestamp":1311379200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2011,12]]},"DOI":"10.1007\/s11192-011-0459-x","type":"journal-article","created":{"date-parts":[[2011,7,22]],"date-time":"2011-07-22T16:04:04Z","timestamp":1311350644000},"page":"929-941","source":"Crossref","is-referenced-by-count":73,"title":["National research assessment exercises: a comparison of peer review and bibliometrics rankings"],"prefix":"10.1007","volume":"89","author":[{"given":"Giovanni","family":"Abramo","sequence":"first","affiliation":[]},{"given":"Ciriaco Andrea","family":"D\u2019Angelo","sequence":"additional","affiliation":[]},{"given":"Flavia","family":"Di Costa","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2011,7,23]]},"reference":[{"issue":"3","key":"459_CR1","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1007\/s11192-011-0352-7","volume":"87","author":"G Abramo","year":"2011","unstructured":"Abramo, G., & D\u2019Angelo, C. A. (2011). Evaluating research: From informed peer review to bibliometrics. Scientometrics, 87(3), 499\u2013514.","journal-title":"Scientometrics"},{"issue":"1","key":"459_CR2","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1016\/j.respol.2008.11.001","volume":"38","author":"G Abramo","year":"2009","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Caprasecca, A. (2009). Allocative efficiency in public research funding: Can bibliometrics help? Research Policy, 38(1), 206\u2013215.","journal-title":"Research Policy"},{"issue":"2","key":"459_CR3","doi-asserted-by":"crossref","first-page":"111","DOI":"10.3152\/095820208X280916","volume":"17","author":"G Abramo","year":"2008","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Di Costa, F. (2008). Assessment of sectoral aggregation distortion in research productivity measurements. Research Evaluation, 17(2), 111\u2013121.","journal-title":"Research Evaluation"},{"issue":"3","key":"459_CR4","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1007\/s11192-010-0238-0","volume":"85","author":"G Abramo","year":"2010","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Viel, F. (2010). Peer review research assessment:A sensitivity analysis of performance rankings to the share of research product evacuate. Scientometrics, 85(3), 705\u2013720.","journal-title":"Scientometrics"},{"issue":"1","key":"459_CR5","doi-asserted-by":"crossref","first-page":"33","DOI":"10.3152\/147154404781776563","volume":"13","author":"DW Aksnes","year":"2004","unstructured":"Aksnes, D. W., & Taxt, R. E. (2004). Peers reviews and bibliometric indicators: A comparative study at Norvegian University. Research Evaluation, 13(1), 33\u201341.","journal-title":"Research Evaluation"},{"issue":"2","key":"459_CR6","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1002\/asi.21460","volume":"62","author":"CA D\u2019Angelo","year":"2011","unstructured":"D\u2019Angelo, C. A., Giuffrida, C., & Abramo, G. (2011). A heuristic approach to author name disambiguation in large-scale bibliometric databases. Journal of the American Society for Information Science and Technology, 62(2), 257\u2013269.","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"459_CR7","unstructured":"ERA. (2010). The Excellence in Research for Australia Initiative http:\/\/www.arc.gov.au\/era\/ ."},{"issue":"2","key":"459_CR8","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1016\/j.joi.2010.12.002","volume":"5","author":"M Franceschet","year":"2011","unstructured":"Franceschet, M., & Costantini, A. (2011). The first Italian research assessment exercise: A bibliometric perspective. Journal of Informetrics, 5(2), 275\u2013291.","journal-title":"Journal of Informetrics"},{"issue":"10","key":"459_CR9","doi-asserted-by":"crossref","first-page":"1438","DOI":"10.1001\/jama.263.10.1438","volume":"263","author":"DF Horrobin","year":"1990","unstructured":"Horrobin, D. F. (1990). The philosophical basis of peer review and the suppression of innovation. Journal of the American Medical Association, 263(10), 1438\u20131441.","journal-title":"Journal of the American Medical Association"},{"issue":"2","key":"459_CR10","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.joi.2006.09.007","volume":"1","author":"J Lundberg","year":"2007","unstructured":"Lundberg, J. (2007). Lifting the crown-citation z-score. Journal of Informetrics, 1(2), 145\u2013154.","journal-title":"Journal of Informetrics"},{"issue":"3","key":"459_CR11","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1007\/BF02129604","volume":"36","author":"MH MacRoberts","year":"1996","unstructured":"MacRoberts, M. H., & MacRoberts, B. R. (1996). Problems of citation analysis. Scientometrics, 36(3), 435\u2013444.","journal-title":"Scientometrics"},{"key":"459_CR12","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1038\/415731a","volume":"415","author":"HF Moed","year":"2002","unstructured":"Moed, H. F. (2002). The impact-factors debate: The ISI\u2019s uses and limits. Nature, 415, 731\u2013732.","journal-title":"Nature"},{"key":"459_CR13","volume-title":"Citation analysis in research evaluation","author":"HF Moed","year":"2005","unstructured":"Moed, H. F. (2005). Citation analysis in research evaluation. Dordrecht: Springer."},{"issue":"1","key":"459_CR14","first-page":"7","volume":"5","author":"H Moxam","year":"1992","unstructured":"Moxam, H., & Anderson, J. (1992). Peer review. A view from the inside. Science and Technology Policy, 5(1), 7\u201315.","journal-title":"Science and Technology Policy"},{"key":"459_CR15","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1108\/EUM0000000007207","volume":"53","author":"C Oppenheim","year":"1997","unstructured":"Oppenheim, C. (1997). The correlation between citation counts and the 1992 research assessment exercise ratings for British research in genetics, anatomy and archaeology. Journal of Documentation, 53, 477\u2013487.","journal-title":"Journal of Documentation"},{"issue":"6","key":"459_CR16","first-page":"709","volume":"56","author":"C Oppenheim","year":"2003","unstructured":"Oppenheim, C., & Norris, M. (2003). Citation counts and the research assessment exercise V: Archaeology and the 2001 RAE. Journal of Documentation, 56(6), 709\u2013730.","journal-title":"Journal of Documentation"},{"issue":"1","key":"459_CR17","first-page":"1","volume":"57","author":"DA Pendlebury","year":"2009","unstructured":"Pendlebury, D. A. (2009). The use and misuse of journal metrics and other citation indicators. Scientometrics, 57(1), 1\u201311.","journal-title":"Scientometrics"},{"key":"459_CR18","unstructured":"REF. (2009). Report on the pilot exercise to develop bibliometric indicators for the Research Excellence Framework. http:\/\/www.hefce.ac.uk\/pubs\/hefce\/2009\/09_39\/ ."},{"issue":"1","key":"459_CR19","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/S0048-7333(98)00026-2","volume":"27","author":"EJ Rinia","year":"1998","unstructured":"Rinia, E. J., van Leeuwen, Th. N., van Vuren, H. G., & van Raan, A. F. J. (1998). Comparative analysis of a set of bibliometric indicators and central peer review criteria: Evaluation of condensed matter physics in the Netherlands. Research Policy, 27(1), 95\u2013107.","journal-title":"Research Policy"},{"issue":"1","key":"459_CR20","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1007\/s11192-005-0008-6","volume":"62","author":"AFJ Raan van","year":"2005","unstructured":"van Raan, A. F. J. (2005). Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods. Scientometrics, 62(1), 133\u2013143.","journal-title":"Scientometrics"},{"key":"459_CR21","unstructured":"VTR. (2006). Valutazione Triennale (2001\u20132003) della Ricerca italiana (italian Triennal Assessment Excercise). Risultati delle valutazioni dei Panel di Area. http:\/\/vtr2006.cineca.it\/php5\/vtr_rel_civr_rapp_panel_menu.php?info=-&&sel_lingua=EN&decritta=1&versione=2&aggiorna=0&info= . Accessed July 5, 2010)."}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-011-0459-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-011-0459-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-011-0459-x","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,6,1]],"date-time":"2019-06-01T09:34:17Z","timestamp":1559381657000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-011-0459-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,7,23]]},"references-count":21,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2011,12]]}},"alternative-id":["459"],"URL":"https:\/\/doi.org\/10.1007\/s11192-011-0459-x","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,7,23]]}}}