{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,24]],"date-time":"2025-09-24T10:32:24Z","timestamp":1758709944425,"version":"3.37.3"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2022,5,16]],"date-time":"2022-05-16T00:00:00Z","timestamp":1652659200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,5,16]],"date-time":"2022-05-16T00:00:00Z","timestamp":1652659200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001538","name":"Victoria University of Wellington","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001538","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2022,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The introduction of performance-based research funding systems (PBRFS) in many countries has generated new information on their impacts. Recent research has considered whether such systems generate convergence or divergence of research quality across universities and academic disciplines. However, little attention has been given to the processes determining research quality changes. This paper utilises anonymised longitudinal researcher data over 15\u00a0years of the New Zealand PBRFS to evaluate whether research quality changes are characterised by convergence or divergence, and the processes determining those dynamics. A unique feature is the use of longitudinal data to decompose changes in researcher quality into contributions arising from the entry, exit and quality transformations of retained researchers, and their impacts on convergence or divergence of research quality across universities and disciplines. The paper also identifies how researcher dynamics vary systematically between universities and disciplines, providing new insights into the effects of these systems.<\/jats:p>","DOI":"10.1007\/s11192-022-04376-9","type":"journal-article","created":{"date-parts":[[2022,5,16]],"date-time":"2022-05-16T13:25:08Z","timestamp":1652707508000},"page":"3021-3047","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Sources of convergence and divergence in university research quality: evidence from the performance-based research funding system in New Zealand"],"prefix":"10.1007","volume":"127","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8708-0669","authenticated-orcid":false,"given":"Robert A.","family":"Buckle","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5061-0075","authenticated-orcid":false,"given":"John","family":"Creedy","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6419-4260","authenticated-orcid":false,"given":"Norman","family":"Gemmell","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,5,16]]},"reference":[{"key":"4376_CR1","first-page":"514","volume":"30","author":"G Abramo","year":"2022","unstructured":"Abramo, G., & D\u2019Angelo, C. A. (2022). The different responses of universities to introduction of performance-based research funding. Research Evaluation, 30, 514\u2013528.","journal-title":"Research Evaluation"},{"key":"4376_CR2","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1017\/S0022050700046209","volume":"46","author":"M Abramovitz","year":"1986","unstructured":"Abramovitz, M. (1986). Catching up, forging ahead, and falling behind. Journal of Economic History, 46, 385\u2013406.","journal-title":"Journal of Economic History"},{"key":"4376_CR3","unstructured":"Adams, J. (2008). Strategic review of the performance-based research fund: The assessment process. Report Prepared for the Tertiary Education Commission, Wellington."},{"key":"4376_CR4","unstructured":"Adams, J., & Gurney, K. (2010). Funding selectivity, concentration and excellence\u2014How good is the UK\u2019s research? Higher Education Research Institute."},{"key":"4376_CR5","doi-asserted-by":"publisher","first-page":"3","DOI":"10.3152\/095820207X190674","volume":"16","author":"K Barker","year":"2007","unstructured":"Barker, K. (2007). The UK Research Assessment Exercise: The evolution of a national research evaluation system. Research Evaluation, 16, 3\u201312.","journal-title":"Research Evaluation"},{"key":"4376_CR6","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1086\/261816","volume":"100","author":"RJ Barro","year":"1991","unstructured":"Barro, R. J., & Sala-i-Martin, X. (1991). Convergence. Journal of Political Economy, 100, 223\u2013251.","journal-title":"Journal of Political Economy"},{"key":"4376_CR7","first-page":"1072","volume":"75","author":"WJ Baumol","year":"1986","unstructured":"Baumol, W. J. (1986). Productivity growth, convergence, and welfare: What the long-run data show. American Economic Review, 75, 1072\u20131085.","journal-title":"American Economic Review"},{"key":"4376_CR8","doi-asserted-by":"publisher","DOI":"10.2202\/1935-1682.1976","author":"G Boyle","year":"2008","unstructured":"Boyle, G. (2008). Pay peanuts and get monkeys? Evidence from academia. The B.E. Journal of Economic Analysis and Policy. https:\/\/doi.org\/10.2202\/1935-1682.1976","journal-title":"The B.E. Journal of Economic Analysis and Policy"},{"key":"4376_CR9","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1111\/j.1835-2561.2010.00076.x","volume":"52","author":"A Broadbent","year":"2010","unstructured":"Broadbent, A. (2010). The UK Research Assessment Exercise: Performance measurement and resource allocation. Australian Accounting Review, 52, 14\u201323.","journal-title":"Australian Accounting Review"},{"key":"4376_CR10","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1080\/00779954.2018.1429486","volume":"53","author":"RA Buckle","year":"2019","unstructured":"Buckle, R. A., & Creedy, J. (2019a). The evolution of research quality in New Zealand universities as measured by the performance-based research fund process. New Zealand Economic Papers, 53, 144\u2013165.","journal-title":"New Zealand Economic Papers"},{"key":"4376_CR11","doi-asserted-by":"publisher","first-page":"270","DOI":"10.1080\/00779954.2018.1480054","volume":"53","author":"RA Buckle","year":"2019","unstructured":"Buckle, R. A., & Creedy, J. (2019b). An evaluation of metrics used by the performance-based research fund process in New Zealand. New Zealand Economic Papers, 53, 270\u2013287.","journal-title":"New Zealand Economic Papers"},{"key":"4376_CR12","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1080\/00779954.2019.1636122","volume":"54","author":"RA Buckle","year":"2020","unstructured":"Buckle, R. A., & Creedy, J. (2020). The \u2018disciplinary effect\u2019 of the performance-based research fund process in New Zealand. New Zealand Economic Papers, 54, 107\u2013126.","journal-title":"New Zealand Economic Papers"},{"key":"4376_CR13","doi-asserted-by":"publisher","first-page":"3919","DOI":"10.1080\/00036846.2020.1725235","volume":"52","author":"RA Buckle","year":"2020","unstructured":"Buckle, R. A., Creedy, J., & Gemmell, N. (2020). Is external research assessment associated with convergence or divergence of research quality across universities and disciplines? Evidence from the PBRF process in New Zealand. Applied Economics, 52, 3919\u20133932.","journal-title":"Applied Economics"},{"key":"4376_CR14","doi-asserted-by":"crossref","unstructured":"Buckle, R.A., Creedy, J., & Ball, A. (2021). Fifteen years of a PBRFS in New Zealand: incentives and outcomes. Australian Economic Review, 54, 208\u2013230.","DOI":"10.1111\/1467-8462.12415"},{"volume-title":"General-to-specific modelling","year":"2005","key":"4376_CR15","unstructured":"Campos, J., Ericsson, N. R., & Hendry, D. F. (Eds.). (2005). General-to-specific modelling. Edward Elgar Publishing."},{"key":"4376_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2202\/1941-1928.1097","volume":"3","author":"JL Castle","year":"2011","unstructured":"Castle, J. L., Doornik, J. A., & Hendry, D. F. (2011). Evaluating automatic model selection. Journal of Time Series Econometrics, 3, 1\u201331.","journal-title":"Journal of Time Series Econometrics"},{"key":"4376_CR17","unstructured":"Castle, J. L., & Hendry, D. F. (2014). \u2018Data mining\u2019 with more variables than observations. VoxEU.org (CEPR\u2019s Policy Portal), 13 August 2014."},{"key":"4376_CR18","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1111\/hequ.12185","volume":"73","author":"D Checchi","year":"2019","unstructured":"Checchi, D., Malgarini, M., & Sarlo, S. (2019). Do performance-based research funding systems affect research production and impact? Higher Education Quarterly, 73, 45\u201369.","journal-title":"Higher Education Quarterly"},{"key":"4376_CR19","doi-asserted-by":"publisher","first-page":"1439","DOI":"10.1007\/s11192-020-03517-2","volume":"124","author":"D Checchi","year":"2020","unstructured":"Checchi, D., Mazzotta, I., & Malgarini, M. (2020). Convergence or polarisation? The impact of research assessment exercises in the Italian case. Scientometrics, 124, 1439\u20131455.","journal-title":"Scientometrics"},{"key":"4376_CR20","volume-title":"Performance-based funding and performance agreements in fourteen higher education systems","author":"H de Boer","year":"2015","unstructured":"de Boer, H., Jongbloed, B., Benneworth, P., Cremonini, L., Kolster, R., Kottmann, A., Lemmens-Krug, K., & Vossensteyn, H. (2015). Performance-based funding and performance agreements in fourteen higher education systems. Universiteit Twente."},{"key":"4376_CR21","doi-asserted-by":"publisher","first-page":"263","DOI":"10.2307\/2233817","volume":"101","author":"S Dowrick","year":"1991","unstructured":"Dowrick, S., & Gemmell, N. (1991). Industrialisation, catching up and economic growth: A comparative study across the world\u2019s capitalist economies. Economic Journal, 101, 263\u2013275.","journal-title":"Economic Journal"},{"key":"4376_CR22","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1016\/0272-7757(91)90002-7","volume":"10","author":"R Ehrenberg","year":"1991","unstructured":"Ehrenberg, R., Kasper, H., & Rees, D. (1991). Faculty turnover at American colleges and universities: Analyses of AAUP data. Economics of Education Review, 10, 99\u2013111.","journal-title":"Economics of Education Review"},{"key":"4376_CR23","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1787\/hemp-v15-art12-en","volume":"15","author":"PG Hare","year":"2003","unstructured":"Hare, P. G. (2003). The United Kingdom\u2019s Research Assessment Exercise: Impact on institutions, departments, individuals. Higher Education Management and Policy, 15, 43\u201362.","journal-title":"Higher Education Management and Policy"},{"key":"4376_CR24","doi-asserted-by":"crossref","unstructured":"Hendry, D. F., & Doornik, J. A. (2014). Empirical model discovery and theory evaluation: Automatic model selection methods in econometrics. MIT Press.","DOI":"10.7551\/mitpress\/9780262028356.001.0001"},{"key":"4376_CR25","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1016\/j.respol.2011.09.007","volume":"41","author":"D Hicks","year":"2012","unstructured":"Hicks, D. (2012). Performance-based university research funding schemes. Research Policy, 41, 251\u2013261.","journal-title":"Research Policy"},{"key":"4376_CR26","unstructured":"Kolarz, P., Dijkstal, E., Nielsen, A. F., & Farla, K. (2019). International landscape study of research and innovation systems. Technopolis Group."},{"key":"4376_CR27","doi-asserted-by":"publisher","first-page":"247","DOI":"10.3152\/095820211X13118583635693","volume":"20","author":"B Martin","year":"2011","unstructured":"Martin, B. (2011). The research excellence framework and the impact agenda, are we creating a Frankenstein Monster? Research Evaluation, 20, 247\u2013254.","journal-title":"Research Evaluation"},{"key":"4376_CR28","unstructured":"New Zealand Tertiary Education Commission (2019) Improving research quality: The results of the PBRF 2018 quality evaluation. Tertiary Education Commission."},{"key":"4376_CR29","unstructured":"OECD. (2010) Performance-based funding for public research in tertiary education institutions: Workshop proceedings. OECD."},{"key":"4376_CR30","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1162\/rest.2009.10157","volume":"92","author":"AA Payne","year":"2010","unstructured":"Payne, A. A., & Roberts, J. (2010). Government oversight of public universities: Are centralized performance schemes related to increased quantity or quality? Review of Economics and Statistics, 92, 207\u2013212.","journal-title":"Review of Economics and Statistics"},{"key":"4376_CR31","doi-asserted-by":"publisher","first-page":"427","DOI":"10.2307\/3440905","volume":"95","author":"DT Quah","year":"1993","unstructured":"Quah, D. T. (1993). Galton\u2019s fallacy and the convergence hypothesis. Scandinavian Journal of Economics, 95, 427\u2013443.","journal-title":"Scandinavian Journal of Economics"},{"key":"4376_CR32","doi-asserted-by":"publisher","first-page":"581","DOI":"10.1007\/s11192-010-0236-2","volume":"85","author":"JC Shin","year":"2010","unstructured":"Shin, J. C., & Cummings, W. K. (2010). Multilevel analysis of academic publishing across disciplines: Research preference, collaboration, and time on research. Scientometrics, 85, 581\u2013594.","journal-title":"Scientometrics"},{"key":"4376_CR33","doi-asserted-by":"publisher","DOI":"10.13140\/RG.2.1.4929.1363","author":"J Wilsdon","year":"2015","unstructured":"Wilsdon, J., Allen, L., Belfiore, E., Campbell, P., Curry, S., Hill, S., Jones, R., Kain, R., Kerridge, S., Thelwall, M., Tinkler, J., & Johnson, B. (2015). The metric tide: Report of the independent review of the role of metrics in research assessment and management. HEFCE. https:\/\/doi.org\/10.13140\/RG.2.1.4929.1363","journal-title":"HEFCE"},{"key":"4376_CR34","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1093\/reseval\/rvy018","volume":"27","author":"P Woelert","year":"2018","unstructured":"Woelert, P., & McKenzie, L. (2018). Follow the money? How Australian universities replicate national performancebased funding mechanisms. Research Evaluation, 27, 184\u2013195.","journal-title":"Research Evaluation"},{"key":"4376_CR35","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1007\/s11162-007-9062-7","volume":"49","author":"YJ Xu","year":"2008","unstructured":"Xu, Y. J. (2008). Faculty turnover: Discipline-specific attention is warranted. Research in Higher Education, 49, 40\u201361.","journal-title":"Research in Higher Education"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04376-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-022-04376-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04376-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,15]],"date-time":"2022-06-15T08:42:49Z","timestamp":1655282569000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-022-04376-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,16]]},"references-count":35,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,6]]}},"alternative-id":["4376"],"URL":"https:\/\/doi.org\/10.1007\/s11192-022-04376-9","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"type":"print","value":"0138-9130"},{"type":"electronic","value":"1588-2861"}],"subject":[],"published":{"date-parts":[[2022,5,16]]},"assertion":[{"value":"20 June 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 April 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 May 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}