{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,7]],"date-time":"2025-06-07T11:24:21Z","timestamp":1749295461949,"version":"3.37.3"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,8,5]],"date-time":"2020-08-05T00:00:00Z","timestamp":1596585600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,8,5]],"date-time":"2020-08-05T00:00:00Z","timestamp":1596585600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2020,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Research assessment exercises have enjoyed ever-increasing popularity in many countries in recent years, both as a method to guide public funds allocation and as a validation tool for adopted research support policies. Italy\u2019s most recently completed evaluation effort (VQR 2011\u201314) required each university to submit to the Ministry for Education, University, and Research (MIUR) 2 research products per author (3 in the case of other research institutions), chosen in such a way that the same product is not assigned to two authors belonging to the same institution. This constraint suggests that larger institutions, where collaborations among colleagues may be more frequent, could suffer a size-related bias in their evaluation scores. To validate our claim, we investigate the outcome of artificially splitting Sapienza University of Rome, one of the largest universities in Europe, in a number of separate partitions, according to several criteria, noting significant score increases for several partitioning scenarios.<\/jats:p>","DOI":"10.1007\/s11192-020-03643-x","type":"journal-article","created":{"date-parts":[[2020,8,5]],"date-time":"2020-08-05T13:02:32Z","timestamp":1596632552000},"page":"533-549","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Are Italian research assessment exercises size-biased?"],"prefix":"10.1007","volume":"125","author":[{"given":"Camil","family":"Demetrescu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrea","family":"Ribichini","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2016-1966","authenticated-orcid":false,"given":"Marco","family":"Schaerf","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,8,5]]},"reference":[{"issue":"1","key":"3643_CR1","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/S0272-7757(01)00068-1","volume":"22","author":"M Abbott","year":"2003","unstructured":"Abbott, M., & Doucouliagos, C. (2003). The efficiency of Australian universities: A data envelopment analysis. Economics of Education Review, 22(1), 89\u201397. https:\/\/doi.org\/10.1016\/S0272-7757(01)00068-1.","journal-title":"Economics of Education Review"},{"issue":"6","key":"3643_CR2","doi-asserted-by":"publisher","first-page":"701","DOI":"10.1007\/s10734-011-9471-6","volume":"63","author":"G Abramo","year":"2012","unstructured":"Abramo, G., Cicero, T., & D\u2019Angelo, C. A. (2012). Revisiting size effects in higher education research productivity. Higher Education, 63(6), 701\u2013717.","journal-title":"Higher Education"},{"issue":"11","key":"3643_CR3","doi-asserted-by":"publisher","first-page":"2202","DOI":"10.1002\/asi.23323","volume":"66","author":"G Abramo","year":"2015","unstructured":"Abramo, G., & D\u2019Angelo, C. A. (2015). The VQR, Italy\u2019s second national research assessment: Methodological failures and ranking distortions. Journal of the Association for Information Science and Technology, 66(11), 2202\u20132214. https:\/\/doi.org\/10.1002\/asi.23323.","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"3","key":"3643_CR4","doi-asserted-by":"publisher","first-page":"2053","DOI":"10.1007\/s11192-016-2153-5","volume":"109","author":"G Abramo","year":"2016","unstructured":"Abramo, G., & D\u2019Angelo, C. A. (2016). Refrain from adopting the combination of citation and journal metrics to grade publications, as used in the Italian National Research Assessment Exercise (VQR 2011\u20132014). Scientometrics, 109(3), 2053\u20132065. https:\/\/doi.org\/10.1007\/s11192-016-2153-5.","journal-title":"Scientometrics"},{"issue":"3","key":"3643_CR5","doi-asserted-by":"publisher","first-page":"783","DOI":"10.1016\/j.joi.2017.06.003","volume":"11","author":"G Abramo","year":"2017","unstructured":"Abramo, G., & D\u2019Angelo, C. A. (2017). On tit for tat: Franceschini and Maisano versus ANVUR regarding the Italian research assessment exercise VQR 2011\u20132014. Journal of Informetrics, 11(3), 783\u2013787. https:\/\/doi.org\/10.1016\/j.joi.2017.06.003.","journal-title":"Journal of Informetrics"},{"issue":"1","key":"3643_CR6","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1007\/s11192-011-0373-2","volume":"88","author":"G Abramo","year":"2011","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Di Costa, F. (2011). National research assessment exercises: The effects of changing the rules of the game during the game. Scientometrics, 88(1), 229\u2013238. https:\/\/doi.org\/10.1007\/s11192-011-0373-2.","journal-title":"Scientometrics"},{"issue":"2","key":"3643_CR7","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1016\/j.joi.2013.01.009","volume":"7","author":"G Abramo","year":"2013","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Murgia, G. (2013a). The collaboration behaviors of scientists in Italy: A field level analysis. Journal of Informetrics, 7(2), 442\u2013454. https:\/\/doi.org\/10.1016\/j.joi.2013.01.009.","journal-title":"Journal of Informetrics"},{"issue":"4","key":"3643_CR8","doi-asserted-by":"publisher","first-page":"811","DOI":"10.1016\/j.joi.2013.07.002","volume":"7","author":"G Abramo","year":"2013","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Murgia, G. (2013b). Gender differences in research collaboration. Journal of Informetrics, 7(4), 811\u2013822. https:\/\/doi.org\/10.1016\/j.joi.2013.07.002.","journal-title":"Journal of Informetrics"},{"issue":"1","key":"3643_CR9","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1007\/s10734-013-9685-x","volume":"68","author":"G Abramo","year":"2014","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Di Costa, F. (2014). Investigating returns to scope of research fields in universities. Higher Education, 68(1), 69\u201385.","journal-title":"Higher Education"},{"issue":"2","key":"3643_CR10","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1007\/s11192-019-03136-6","volume":"120","author":"G Abramo","year":"2019","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Di Costa, F. (2019). A gender analysis of top scientists\u2019 collaboration behavior: Evidence from Italy. Scientometrics, 120(2), 405\u2013418.","journal-title":"Scientometrics"},{"key":"3643_CR11","unstructured":"Adams, J., & Thomson, S. (2011). Funding research excellence: research group size, critical mass & performance. London: University Alliance. ISBN 9781908190086."},{"key":"3643_CR12","doi-asserted-by":"publisher","first-page":"127","DOI":"10.2307\/20076113","volume":"49\/50","author":"JD Adams","year":"1998","unstructured":"Adams, J. D., & Griliches, Z. (1998). Research productivity in a system of universities. Annales d\u2019\u00c9conomie et de Statistique, 49\/50, 127\u2013162.","journal-title":"Annales d\u2019\u00c9conomie et de Statistique"},{"issue":"3","key":"3643_CR13","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1093\/reseval\/rvv008","volume":"24","author":"A Ancaiani","year":"2015","unstructured":"Ancaiani, A., Anfossi, A. F., Barbara, A., Benedetto, S., Blasi, B., Carletti, V., et al. (2015). Evaluating scientific research in Italy: The 2004\u201310 research evaluation exercise. Research Evaluation, 24(3), 242\u2013255. https:\/\/doi.org\/10.1093\/reseval\/rvv008.","journal-title":"Research Evaluation"},{"issue":"1","key":"3643_CR14","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1016\/S0038-0121(00)00010-0","volume":"35","author":"NK Avkiran","year":"2001","unstructured":"Avkiran, N. K. (2001). Investigating technical and scale efficiencies of Australian Universities through data envelopment analysis. Socio-Economic Planning Sciences, 35(1), 57\u201380. https:\/\/doi.org\/10.1016\/S0038-0121(00)00010-0.","journal-title":"Socio-Economic Planning Sciences"},{"issue":"3","key":"3643_CR15","doi-asserted-by":"publisher","first-page":"1651","DOI":"10.1007\/s11192-016-1929-y","volume":"108","author":"A Baccini","year":"2016","unstructured":"Baccini, A., & De Nicolao, G. (2016a). Do they agree? Bibliometric evaluation versus informed peer review in the Italian research assessment exercise. Scientometrics, 108(3), 1651\u20131671. https:\/\/doi.org\/10.1007\/s11192-016-1929-y.","journal-title":"Scientometrics"},{"issue":"3","key":"3643_CR16","doi-asserted-by":"publisher","first-page":"1675","DOI":"10.1007\/s11192-016-2055-6","volume":"108","author":"A Baccini","year":"2016","unstructured":"Baccini, A., & De Nicolao, G. (2016b). Reply to the comment of bertocchi. Scientometrics, 108(3), 1675\u20131684. https:\/\/doi.org\/10.1007\/s11192-016-2055-6.","journal-title":"Scientometrics"},{"issue":"4","key":"3643_CR17","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1093\/reseval\/rvx013","volume":"26","author":"A Baccini","year":"2017","unstructured":"Baccini, A., & De Nicolao, G. (2017). A letter on Ancaiani et al. \u201cEvaluating scientific research in Italy: The 2004\u201310 research evaluation exercise. Research Evaluation, 26(4), 353\u2013357, 04. https:\/\/doi.org\/10.1093\/reseval\/rvx013.","journal-title":"Research Evaluation"},{"key":"3643_CR18","doi-asserted-by":"publisher","unstructured":"Benedetto, S., Checchi, D., Graziosi, A., & Malgarini, M. (2017a). Comments on the paper \u201cCritical remarks on the Italian assessment exercise\u201d, Journal of Informetrics, 11(2017), 337\u2013357. Journal of Informetrics, 11(2), 622\u2013624 (2017a). https:\/\/doi.org\/10.1016\/j.joi.2017.03.005.","DOI":"10.1016\/j.joi.2017.03.005"},{"key":"3643_CR19","doi-asserted-by":"publisher","unstructured":"Benedetto, S., Checchi, D., Graziosi, A., & Malgarini, M. (2017b). Comments on the correspondence \u201cOn tit for tat: Franceschini and Maisano versus ANVUR regarding the Italian research assessment exercise VQR 2011\u20132014\u201d. Journal of Informetrics, 11(2017), 783\u2013787. Journal of Informetrics, 11(3), 838\u2014840 (2017b). https:\/\/doi.org\/10.1016\/j.joi.2017.07.002.","DOI":"10.1016\/j.joi.2017.07.002"},{"key":"3643_CR20","doi-asserted-by":"publisher","unstructured":"Benedetto, S., Cicero, T., Malgarini, M., & Nappi, C. (2017c). Reply to the letter on Ancaiani et al. \u201cEvaluating scientific research in Italy: The 2004\u201310 research evaluation exercise\u201d. Research Evaluation, 26(4), 358\u2013360 (2017c). https:\/\/doi.org\/10.1093\/reseval\/rvx017.","DOI":"10.1093\/reseval\/rvx017"},{"issue":"2","key":"3643_CR21","doi-asserted-by":"publisher","first-page":"451","DOI":"10.1016\/j.respol.2014.08.004","volume":"44","author":"G Bertocchi","year":"2015","unstructured":"Bertocchi, G., Gambardella, A., Jappelli, T., Nappi, C. A., & Peracchi, F. (2015). Bibliometric evaluation vs. informed peer review: Evidence from Italy. Research Policy, 44(2), 451\u2013466. https:\/\/doi.org\/10.1016\/j.respol.2014.08.004.","journal-title":"Research Policy"},{"key":"3643_CR22","doi-asserted-by":"publisher","first-page":"05","DOI":"10.1007\/s11192-016-1965-7","volume":"108","author":"G Bertocchi","year":"2016","unstructured":"Bertocchi, G., Gambardella, A., Jappelli, T., Nappi, C., & Peracchi, F. (2016). Comment to: Do they agree? Bibliometric evaluation versus informed peer review in the Italian research assessment exercise. Scientometrics, 108, 05. https:\/\/doi.org\/10.1007\/s11192-016-1965-7.","journal-title":"Scientometrics"},{"issue":"1","key":"3643_CR23","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1007\/s11192-005-0205-3","volume":"63","author":"A Bonaccorsi","year":"2005","unstructured":"Bonaccorsi, A., & Daraio, C. (2005). Exploring size and agglomeration effects on public research productivity. Scientometrics, 63(1), 87\u2013120.","journal-title":"Scientometrics"},{"issue":"10","key":"3643_CR24","doi-asserted-by":"publisher","first-page":"1393","DOI":"10.1016\/j.respol.2011.07.002","volume":"40","author":"B Bozeman","year":"2011","unstructured":"Bozeman, B., & Gaughan, M. (2011). How do men and women differ in research collaborations? An analysis of the collaborative motives and strategies of academic researchers. Research Policy, 40(10), 1393\u20131402. https:\/\/doi.org\/10.1016\/j.respol.2011.07.002.","journal-title":"Research Policy"},{"issue":"4","key":"3643_CR25","doi-asserted-by":"publisher","first-page":"1263","DOI":"10.1016\/j.joi.2018.10.005","volume":"12","author":"A Calabrese","year":"2018","unstructured":"Calabrese, A., Capece, G., Costa, R., Di Pillo, F., & Giuffrida, S. (2018). A \u2019power law\u2019 based method to reduce size-related bias in indicators of knowledge performance: An application to university research assessment. Journal of Informetrics, 12(4), 1263\u20131281.","journal-title":"Journal of Informetrics"},{"issue":"1","key":"3643_CR26","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/j.joi.2018.11.008","volume":"13","author":"C Demetrescu","year":"2019","unstructured":"Demetrescu, C., Lupia, F., Mendicelli, A., Ribichini, A., Scarcello, F., & Schaerf, M. (2019). On the Shapley value and its application to the Italian VQR research assessment exercise. Journal of Informetrics, 13(1), 87\u2013104. https:\/\/doi.org\/10.1016\/j.joi.2018.11.008.","journal-title":"Journal of Informetrics"},{"key":"3643_CR27","doi-asserted-by":"publisher","unstructured":"Franceschini, F., & Maisano, D. (2017a). A rejoinder to the comments of Benedetto et al. on the paper \u201cCritical remarks on the Italian research assessment exercise VQR 2011\u20132014\u201d. Journal of Informetrics, 11(2): 337\u2013357. Journal of Informetrics, 11(3):645\u2013646. https:\/\/doi.org\/10.1016\/j.joi.2017.05.013.","DOI":"10.1016\/j.joi.2017.05.013"},{"issue":"2","key":"3643_CR28","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1016\/j.joi.2017.02.005","volume":"11","author":"F Franceschini","year":"2017","unstructured":"Franceschini, F., & Maisano, D. (2017b). Critical remarks on the Italian research assessment exercise VQR 2011\u20132014. Journal of Informetrics, 11(2), 337\u2013357. https:\/\/doi.org\/10.1016\/j.joi.2017.02.005.","journal-title":"Journal of Informetrics"},{"issue":"2","key":"3643_CR29","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1016\/0272-7757(92)90005-N","volume":"11","author":"J Golden","year":"1992","unstructured":"Golden, J., & Carstensen, F. V. (1992). Academic research productivity, department size and organization: Further results, comment. Economics of Education Review, 11(2), 153\u2013160.","journal-title":"Economics of Education Review"},{"issue":"2","key":"3643_CR30","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1080\/09645299700000010","volume":"5","author":"K Hashimoto","year":"1997","unstructured":"Hashimoto, K., & Cohn, E. (1997). Economies of scale and scope in Japanese private universities. Education Economics, 5(2), 107\u2013115. https:\/\/doi.org\/10.1080\/09645299700000010.","journal-title":"Education Economics"},{"issue":"1","key":"3643_CR31","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1016\/S0272-7757(00)00044-3","volume":"21","author":"H Izadi","year":"2002","unstructured":"Izadi, H., Johnes, G., Oskrochi, R., & Crouchley, R. (2002). Stochastic frontier estimation of a CES cost function: The case of higher education in Britain. Economics of Education Review, 21(1), 63\u201371. https:\/\/doi.org\/10.1016\/S0272-7757(00)00044-3.","journal-title":"Economics of Education Review"},{"issue":"2","key":"3643_CR32","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1016\/0272-7757(88)90049-0","volume":"7","author":"JM Jordan","year":"1988","unstructured":"Jordan, J. M., Meador, M., & Walters, S. J. K. (1988). Effects of department size and organization on the research productivity of academic economists. Economics of Education Review, 7(2), 251\u2013255. https:\/\/doi.org\/10.1016\/0272-7757(88)90049-0.","journal-title":"Economics of Education Review"},{"issue":"4","key":"3643_CR33","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1016\/0272-7757(89)90020-4","volume":"8","author":"JM Jordan","year":"1989","unstructured":"Jordan, J. M., Meador, M., & Walters, S. J. K. (1989). Academic research productivity, department size and organization: Further results. Economics of Education Review, 8(4), 345\u2013352. https:\/\/doi.org\/10.1016\/0272-7757(89)90020-4.","journal-title":"Economics of Education Review"},{"key":"3643_CR34","series-title":"The IBM Research Symposia Series","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4684-2001-2_9","volume-title":"Complexity of Computer Computations","author":"RM Karp","year":"1972","unstructured":"Karp, R. M. (1972). Reducibility among combinatorial problems. In R. E. Miller, J. W. Thatcher, & J. D. Bohlinger (Eds.), Complexity of Computer Computations. The IBM Research Symposia Series. Boston, MA: Springer. https:\/\/doi.org\/10.1007\/978-1-4684-2001-2_9."},{"issue":"2","key":"3643_CR35","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1007\/s11192-010-0282-9","volume":"86","author":"R Kenna","year":"2011","unstructured":"Kenna, R., & Berche, B. (2011). Critical mass and the dependency of research quality on group size. Scientometrics, 86(2), 527\u2013540.","journal-title":"Scientometrics"},{"issue":"2","key":"3643_CR36","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1016\/S0272-7757(98)00035-1","volume":"18","author":"RK Koshal","year":"1999","unstructured":"Koshal, R. K., & Koshal, M. (1999). Economies of scale and scope in higher education: A case of comprehensive universities. Economics of Education Review, 18(2), 269\u2013277. https:\/\/doi.org\/10.1016\/S0272-7757(98)00035-1.","journal-title":"Economics of Education Review"},{"issue":"1","key":"3643_CR37","doi-asserted-by":"publisher","first-page":"172","DOI":"10.2307\/1061638","volume":"70","author":"DN Laband","year":"2003","unstructured":"Laband, D. N., & Lentz, B. F. (2003). New estimates of economies of scale and scope in higher education. Southern Economic Journal, 70(1), 172\u2013183.","journal-title":"Southern Economic Journal"},{"issue":"3","key":"3643_CR38","doi-asserted-by":"publisher","first-page":"519","DOI":"10.1007\/s11192-006-0127-8","volume":"68","author":"V Larivi\u00e8re","year":"2006","unstructured":"Larivi\u00e8re, V., Gingras, Y., & Archambault, \u00c9. (2006). Canadian collaboration networks: A comparative analysis of the natural sciences, social sciences and the humanities. Scientometrics, 68(3), 519\u2013533.","journal-title":"Scientometrics"},{"issue":"4","key":"3643_CR39","doi-asserted-by":"publisher","first-page":"505","DOI":"10.1016\/j.econedurev.2008.11.002","volume":"28","author":"H Longlong","year":"2009","unstructured":"Longlong, H., Fengliang, L., & Weifang, M. (2009). Multi-product total cost functions for higher education: The case of Chinese research universities. Economics of Education Review, 28(4), 505\u2013511. https:\/\/doi.org\/10.1016\/j.econedurev.2008.11.002.","journal-title":"Economics of Education Review"},{"issue":"4","key":"3643_CR40","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1023\/B:HIGH.0000046717.11717.06","volume":"48","author":"KJ Morgan","year":"2004","unstructured":"Morgan, K. J. (2004). The research assessment exercise in English universities, 2001. Higher Education, 48(4), 461\u2013482.","journal-title":"Higher Education"},{"key":"3643_CR41","doi-asserted-by":"publisher","DOI":"10.1007\/s11123-013-0378-3","author":"J Nemoto","year":"2014","unstructured":"Nemoto, J., & Furumatsu, N. (2014). Scale and scope economies of Japanese private universities revisited with an input distance function approach. Journal of Productivity Analysis. https:\/\/doi.org\/10.1007\/s11123-013-0378-3.","journal-title":"Journal of Productivity Analysis"},{"issue":"1","key":"3643_CR42","doi-asserted-by":"publisher","first-page":"140","DOI":"10.1002\/berj.3572","volume":"46","author":"M Pinar","year":"2020","unstructured":"Pinar, M., & Unlu, E. (2020). Evaluating the potential effect of the increased importance of the impact component in the Research Excellence Framework of the UK. British Educational Research Journal, 46(1), 140\u2013160. https:\/\/doi.org\/10.1002\/berj.3572.","journal-title":"British Educational Research Journal"},{"issue":"9","key":"3643_CR43","doi-asserted-by":"publisher","first-page":"1657","DOI":"10.1016\/j.respol.2013.06.009","volume":"42","author":"G Rebora","year":"2013","unstructured":"Rebora, G., & Turri, M. (2013). The UK and Italian research assessment exercises face to face. Research Policy, 42(9), 1657\u20131666. https:\/\/doi.org\/10.1016\/j.respol.2013.06.009.","journal-title":"Research Policy"},{"issue":"2","key":"3643_CR44","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1108\/OIR-01-2015-0021","volume":"39","author":"D Stuart","year":"2015","unstructured":"Stuart, D. (2015). Finding \u201cgood enough\u201d metrics for the UK\u2019s Research Excellence Framework. Online Information Review, 39(2), 265\u2013269.","journal-title":"Online Information Review"},{"key":"3643_CR45","doi-asserted-by":"publisher","DOI":"10.1016\/j.radi.2020.02.004","author":"E Sutton","year":"2020","unstructured":"Sutton, E. (2020). The increasing significance of impact within the Research Excellence Framework (REF). Radiography. https:\/\/doi.org\/10.1016\/j.radi.2020.02.004.","journal-title":"Radiography"},{"issue":"9","key":"3643_CR46","doi-asserted-by":"publisher","first-page":"1548","DOI":"10.1080\/03075079.2016.1266609","volume":"43","author":"P Tymms","year":"2018","unstructured":"Tymms, P., & Higgins, S. (2018). Judging research papers for research excellence. Studies in Higher Education, 43(9), 1548\u20131560. https:\/\/doi.org\/10.1080\/03075079.2016.1266609.","journal-title":"Studies in Higher Education"},{"issue":"4","key":"3643_CR47","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1007\/s10734-010-9337-3","volume":"61","author":"AC Worthington","year":"2011","unstructured":"Worthington, A. C., & Higgs, H. (2011). Economies of scale and scope in Australian higher education. Higher Education, 61(4), 387\u2013414.","journal-title":"Higher Education"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-020-03643-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-020-03643-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-020-03643-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,4]],"date-time":"2021-08-04T23:29:57Z","timestamp":1628119797000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-020-03643-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,5]]},"references-count":47,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,10]]}},"alternative-id":["3643"],"URL":"https:\/\/doi.org\/10.1007\/s11192-020-03643-x","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"type":"print","value":"0138-9130"},{"type":"electronic","value":"1588-2861"}],"subject":[],"published":{"date-parts":[[2020,8,5]]},"assertion":[{"value":"10 February 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 August 2020","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}