{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T15:36:25Z","timestamp":1759937785758},"reference-count":17,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2010,5,18]],"date-time":"2010-05-18T00:00:00Z","timestamp":1274140800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2010,12]]},"DOI":"10.1007\/s11192-010-0238-0","type":"journal-article","created":{"date-parts":[[2010,5,17]],"date-time":"2010-05-17T10:50:53Z","timestamp":1274093453000},"page":"705-720","source":"Crossref","is-referenced-by-count":11,"title":["Peer review research assessment: a sensitivity analysis of performance rankings to the share of research product evaluated"],"prefix":"10.1007","volume":"85","author":[{"given":"Giovanni","family":"Abramo","sequence":"first","affiliation":[]},{"given":"Ciriaco Andrea","family":"D\u2019Angelo","sequence":"additional","affiliation":[]},{"given":"Fulvio","family":"Viel","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2010,5,18]]},"reference":[{"key":"238_CR1","doi-asserted-by":"crossref","unstructured":"Abramo, G., & D\u2019Angelo, C. A. (2009). A decision support system for public research organizations participating in national research assessment exercises. Journal of the American Society for Information Science and Technology, 60(10), 2095\u20132106.","DOI":"10.1002\/asi.21126"},{"issue":"2","key":"238_CR2","doi-asserted-by":"crossref","first-page":"111","DOI":"10.3152\/095820208X280916","volume":"17","author":"G Abramo","year":"2008","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Di Costa, F. (2008). Assessment of sectoral aggregation distortion in research productivity measurements. Research Evaluation, 17(2), 111\u2013121.","journal-title":"Research Evaluation"},{"issue":"1","key":"238_CR3","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1016\/j.respol.2008.11.001","volume":"38","author":"G Abramo","year":"2009","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Caprasecca, A. (2009). Allocative efficiency in public research funding: Can bibliometrics help? Research Policy, 38(1), 206\u2013215.","journal-title":"Research Policy"},{"key":"238_CR16","unstructured":"DEST. (2007). Department of Education, Science and Training. Research quality framework: Assessing the quality and impact of research in Australia\u2014RQF submission specifications. Canberra: Commonwealth of Australia."},{"key":"238_CR4","unstructured":"ERA. (2009). The Excellence in Research for Australia. Evaluation Guidelines for the 2009 ERA Trial. http:\/\/www.arc.gov.au\/pdf\/ERA_Eval_Guide.pdf (last accessed 5 November 2010)."},{"issue":"4","key":"238_CR5","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1023\/B:MINE.0000005155.70870.bd","volume":"41","author":"A Geuna","year":"2003","unstructured":"Geuna, A., & Martin, B. R. (2003). University research evaluation and funding: An international comparison. Minerva, 41(4), 277\u2013304.","journal-title":"Minerva"},{"key":"238_CR6","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1007\/s10734-008-9154-0","volume":"57","author":"D Hicks","year":"2009","unstructured":"Hicks, D. (2009). Evolving regimes of multi-university research evaluation. Higher Education, 57, 393\u2013404.","journal-title":"Higher Education"},{"key":"238_CR7","doi-asserted-by":"crossref","first-page":"1438","DOI":"10.1001\/jama.1990.03440100162024","volume":"263","author":"DF Horrobin","year":"1990","unstructured":"Horrobin, D. F. (1990). The philosophical basis of peer review and the suppression of innovation. Journal of the American Medical Association, 263, 1438\u20131441.","journal-title":"Journal of the American Medical Association"},{"key":"238_CR8","unstructured":"Moxam, H., & Anderson, J. (1992). Peer review. A view from the inside. Science and Technology Policy, 5(1), 7\u201315."},{"key":"238_CR9","unstructured":"NRC. (2009). US National Research Council. http:\/\/sites.nationalacademies.org\/NRC\/index.htm (last accessed 5 November 2010)."},{"key":"238_CR10","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1108\/EUM0000000007207","volume":"53","author":"C Oppenheim","year":"1997","unstructured":"Oppenheim, C. (1997). The correlation between citation counts and the 1992 research assessment exercise ratings for British research in genetics, anatomy and archaeology. Journal of Documentation, 53, 477\u2013487.","journal-title":"Journal of Documentation"},{"issue":"6","key":"238_CR11","first-page":"709","volume":"56","author":"C Oppenheim","year":"2003","unstructured":"Oppenheim, C., & Norris, M. (2003). Citation counts and the research assessment exercise V: Archaeology and the 2001 RAE. Journal of Documentation, 56(6), 709\u2013730.","journal-title":"Journal of Documentation"},{"key":"238_CR12","unstructured":"PBRF. (2008). Performance-Based Research Fund \u2013 ANNUALREPORT 2008. http:\/\/www.tec.govt.nz\/Documents\/Publications\/PBRF-AR-2008-for-web.pdf (last accessed 5 November 2010)."},{"key":"238_CR13","unstructured":"RAE. (2008). Research Assessment Exercise \u2013 2008. Panel criteria and working methods. http:\/\/www.rae.ac.uk\/pubs\/2006\/01\/ (last accessed 5 November 2010)."},{"key":"238_CR14","unstructured":"REF. (2009). Report on the pilot exercise to develop bibliometric indicators for the Research Excellence Framework. http:\/\/www.hefce.ac.uk\/pubs\/hefce\/2009\/09_39\/ (last accessed 5 November 2010)."},{"key":"238_CR15","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/S0048-7333(98)00026-2","volume":"27","author":"EJ Rinia","year":"1998","unstructured":"Rinia, E. J., van Leeuwen, Th. N., van Vuren, H. G., & Van Raan, A. F. J. (1998). Comparative analysis of a set of bibliometric indicators and central peer review criteria, evaluation of condensed matter physics in the Netherlands. Research Policy, 27, 95\u2013107.","journal-title":"Research Policy"},{"key":"238_CR17","unstructured":"VTR. (2006). Valutazione Triennale (2001\u20132003) della Ricerca italiana (italian Triennal Assessment Excercise). Risultati delle valutazioni dei Panel di Area. http:\/\/vtr2006.cineca.it\/php5\/vtr_ris_val_panel.php (last accessed 5 November 2010)."}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-010-0238-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-010-0238-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-010-0238-0","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,6,1]],"date-time":"2019-06-01T09:27:05Z","timestamp":1559381225000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-010-0238-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,5,18]]},"references-count":17,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2010,12]]}},"alternative-id":["238"],"URL":"https:\/\/doi.org\/10.1007\/s11192-010-0238-0","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,5,18]]}}}