{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T20:13:27Z","timestamp":1767212007133,"version":"3.37.3"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2020,10,29]],"date-time":"2020-10-29T00:00:00Z","timestamp":1603929600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,10,29]],"date-time":"2020-10-29T00:00:00Z","timestamp":1603929600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003407","name":"Ministero dell\u2019Istruzione, dell\u2019Universit\u00e0 e della Ricerca","doi-asserted-by":"publisher","award":["PRIN Project N. 2015RJARX7"],"award-info":[{"award-number":["PRIN Project N. 2015RJARX7"]}],"id":[{"id":"10.13039\/501100003407","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004271","name":"Sapienza Universit\u00e0 di Roma","doi-asserted-by":"publisher","award":["Sapienza Awards no. PH11715C8239C105"],"award-info":[{"award-number":["Sapienza Awards no. PH11715C8239C105"]}],"id":[{"id":"10.13039\/501100004271","id-type":"DOI","asserted-by":"publisher"}]},{"name":"EU Horizon 2020","award":["RISIS2 Project (grant agreement N\u00b0 824091)"],"award-info":[{"award-number":["RISIS2 Project (grant agreement N\u00b0 824091)"]}]},{"name":"Universit\u00e0 degli Studi di Roma La Sapienza"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2020,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The heterogeneity of the Higher Education (HE) Institutions is one of the main critical issues in the assessment of their performance. This paper adopts a multi-level and multi-dimensional perspective, combining national (macro) and institution (micro) level data, and measuring both research and teaching activity, using performance indicators derived from the European Tertiary Education Register, CWTS Leiden Ranking, and PATSTAT patent database. Clustering and efficiency analysis are combined to characterize the heterogeneity of national HE systems in European countries, and reveal the potential of using micro level data to characterize national level performance. Large differences are observed between the European countries, partially due to the fact that they are in different phases of their scientific (and economic) development and of the re-structuring of their HE systems. Evidence is found that universities specializing either in teaching or in research tend to have a higher efficiency than those institutions balancing research and teaching. Tradeoffs are observed between undergraduate and post-graduate activities, and a \u201cMatthew cumulative effect\u201d seems in place on the European institutions analysed: high quality research is able to attract external funds that stimulate innovative and patenting activities that in turn are self-reinforcing to the scientific activities. The results reveal once more the limits and dangers of one-dimensional approaches to the performance of HEIs.<\/jats:p>","DOI":"10.1007\/s11192-020-03717-w","type":"journal-article","created":{"date-parts":[[2020,10,29]],"date-time":"2020-10-29T17:03:33Z","timestamp":1603991013000},"page":"1117-1144","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Studying the heterogeneity of European higher education institutions"],"prefix":"10.1007","volume":"125","author":[{"given":"Renato","family":"Bruni","sequence":"first","affiliation":[]},{"given":"Giuseppe","family":"Catalano","sequence":"additional","affiliation":[]},{"given":"Cinzia","family":"Daraio","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0714-3840","authenticated-orcid":false,"given":"Martina","family":"Gregori","sequence":"additional","affiliation":[]},{"given":"Henk F.","family":"Moed","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,10,29]]},"reference":[{"key":"3717_CR1","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1016\/j.techfore.2015.10.007","volume":"103","author":"I Abankina","year":"2016","unstructured":"Abankina, I., Aleskerov, F., Belousova, V., Gokhberg, L., Kiselgof, S., Petrushchenko, V., et al. (2016). From equality to diversity: Classifying Russian universities in a performance oriented system. Technological Forecasting and Social Change, 103, 228\u2013239.","journal-title":"Technological Forecasting and Social Change"},{"key":"3717_CR2","doi-asserted-by":"publisher","first-page":"834","DOI":"10.1093\/scipol\/scz033","volume":"46","author":"T Agasisti","year":"2019","unstructured":"Agasisti, T., & Bertoletti, A. (2019). Analysing the determinants of higher education systems\u2019 performance\u2013a structural equation modelling approach. Science and Public Policy, 46, 834\u2013852.","journal-title":"Science and Public Policy"},{"issue":"3","key":"3717_CR3","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1080\/13600800600980056","volume":"28","author":"T Agasisti","year":"2006","unstructured":"Agasisti, T., & Catalano, G. (2006). Governance models of university systems\u2014towards quasi-markets? Tendencies and perspectives: A European comparison. Journal of Higher Education Policy and Management, 28(3), 245\u2013262.","journal-title":"Journal of Higher Education Policy and Management"},{"issue":"61","key":"3717_CR4","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1111\/j.1468-0327.2009.00238.x","volume":"25","author":"P Aghion","year":"2010","unstructured":"Aghion, P., Dewatripont, M., Hoxby, C., Mas-Colell, A., & Sapir, A. (2010). The governance and performance of universities: evidence from Europe and the US. Economic Policy, 25(61), 7\u201359.","journal-title":"Economic Policy"},{"key":"3717_CR5","unstructured":"Barbato, G., & Turri, M. (2019). What do positioning paths of universities tell about the diversity of higher education systems? An exploratory study.\u00a0Studies in Higher Education, pp. 1\u201314."},{"key":"3717_CR6","doi-asserted-by":"crossref","DOI":"10.4337\/9781783472000","volume-title":"Knowledge Diversity and Performance in European Higher Education Changing Landscape","author":"A Bonaccorsi","year":"2014","unstructured":"Bonaccorsi, A. (2014). Knowledge Diversity and Performance in European Higher Education Changing Landscape. Cheltenham: Edward Elgar Publishing."},{"volume-title":"Universities and Strategic Knowledge Creation: Specialization and Performance in Europe. PRIME Series on Research and Innovation Policy in Europe","year":"2007","key":"3717_CR7","unstructured":"Bonaccorsi, A., & Daraio, C. (Eds.). (2007). Universities and Strategic Knowledge Creation: Specialization and Performance in Europe. PRIME Series on Research and Innovation Policy in Europe. Cheltenham: Edward Elgar."},{"issue":"10","key":"3717_CR8","doi-asserted-by":"publisher","first-page":"763","DOI":"10.3152\/030234209X475245","volume":"36","author":"A Bonaccorsi","year":"2009","unstructured":"Bonaccorsi, A., & Daraio, C. (2009). Characterizing the European university system: a preliminary classification using census microdata. Science and Public Policy, 36(10), 763\u2013775.","journal-title":"Science and Public Policy"},{"issue":"3","key":"3717_CR51","doi-asserted-by":"publisher","first-page":"1147","DOI":"10.1007\/s11192-017-2442-7","volume":"112","author":"A Bonaccorsi","year":"2017","unstructured":"Bonaccorsi, A., & Secondi, L. (2017). The determinants of research performance in European universities: A large scale multilevel analysis. Scientometrics, 112(3), 1147\u20131178.","journal-title":"Scientometrics"},{"key":"3717_CR9","unstructured":"Bruni R., Catalano G., Daraio C., Gregori M. & Moed H.F. (2019). Characterizing the Heterogeneity of European Higher Education Institutions Combining Cluster and Efficiency Analyses, in Catalano G., Daraio C., Gregori M., Moed H.F. and Ruocco G. (2019), Proceedings of the 17th International Conference on Scientometrics and Informetrics, 2\u20135 September 2019, Sapienza University of Rome, Italy. Edizioni Efesto, ISBN: 978-88-3381-118-5, August 2019, (pp. 2094\u20132105)."},{"volume-title":"Varieties of governance: Dynamics, strategies, capacities","year":"2015","key":"3717_CR10","unstructured":"Capano, G., Howlett, M., & Ramesh, M. (Eds.). (2015). Varieties of governance: Dynamics, strategies, capacities. UK: Palgrave MacMillan."},{"issue":"1","key":"3717_CR11","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1111\/hequ.12180","volume":"73","author":"G Capano","year":"2019","unstructured":"Capano, G., & Pritoni, A. (2019). Varieties of hybrid systemic governance in European higher education. Higher Education Quarterly, 73(1), 10\u201328.","journal-title":"Higher Education Quarterly"},{"key":"3717_CR12","unstructured":"Catalano, G., Daraio, C., Gregori, M., Moed, H. & Ruocco, G. (2017). A scaling approach to tackle the heterogeneity of HEIs, ISSI 2017-16th International Conference on Scientometrics and Informetrics, Conference Proceedings, (pp. 1805\u20131806)."},{"issue":"6","key":"3717_CR13","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1016\/0377-2217(78)90138-8","volume":"2","author":"A Charnes","year":"1978","unstructured":"Charnes, A., Cooper, W. W., & Rhodes, E. (1978). Measuring the efficiency of decision making units. European Journal of Operational Research, 2(6), 429\u2013444.","journal-title":"European Journal of Operational Research"},{"key":"3717_CR15","doi-asserted-by":"crossref","unstructured":"Daraio, C. (2019). Econometric approaches to the measurement of research productivity. In W. Gl\u00e4nzel, H. F., Moed, H. Schmoch and M. Thelwall (Eds) Springer handbook of science and technology indicators (pp. 633\u2013666).","DOI":"10.1007\/978-3-030-02511-3_24"},{"key":"3717_CR16","volume-title":"Advanced robust and nonparametric methods in efficiency analysis, methodology and Applications","author":"C Daraio","year":"2007","unstructured":"Daraio, C., & Simar, L. (2007). Advanced robust and nonparametric methods in efficiency analysis, methodology and Applications. New York (USA): Springer."},{"issue":"1","key":"3717_CR17","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1016\/j.respol.2010.10.009","volume":"40","author":"C Daraio","year":"2011","unstructured":"Daraio, C., Bonaccorsi, A., Geuna, A., Lepori, B., Bach, L., Bogetoft, P., et al. (2011). The European university landscape: A micro characterization based on evidence from the Aquameth project. Research Policy, 40(1), 148\u2013164.","journal-title":"Research Policy"},{"issue":"2","key":"3717_CR18","doi-asserted-by":"publisher","first-page":"508","DOI":"10.1002\/asi.23679","volume":"68","author":"C Daraio","year":"2017","unstructured":"Daraio, C., & Bonaccorsi, A. (2017). Beyond university rankings? Generating new indicators on universities by linking data in open platforms. Journal of the Association for Information Science and Technology, 68(2), 508\u2013529.","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"4","key":"3717_CR20","doi-asserted-by":"publisher","first-page":"388","DOI":"10.1093\/reseval\/rvy024","volume":"27","author":"EM de la Torre","year":"2018","unstructured":"de la Torre, E. M., Casani, F., & Sagarra, M. (2018). Defining typologies of universities through a DEA-MDS analysis: An institutional characterization for formative evaluation purposes. Research Evaluation, 27(4), 388\u2013403.","journal-title":"Research Evaluation"},{"key":"3717_CR21","first-page":"243","volume-title":"The Performance of Public Enterprises: Concepts and measurements","author":"D Deprins","year":"1984","unstructured":"Deprins, D., Simar, L., & Tulkens, H. (1984). Measuring labor inefficiency in post offices. In M. Marchand, P. Pestieau, & H. Tulkens (Eds.), The Performance of Public Enterprises: Concepts and measurements (pp. 243\u2013267). Amsterdam: North-Holland."},{"key":"3717_CR23","unstructured":"European Commission (2016). Education and Training 2020. Highlights from the Working Groups 2014\u20132015 (https:\/\/ec.europa.eu\/education\/policy\/strategic-framework\/expertgroups_en.htm)."},{"issue":"2","key":"3717_CR24","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1007\/s11024-013-9225-y","volume":"51","author":"T Fumasoli","year":"2013","unstructured":"Fumasoli, T., & Huisman, J. (2013). Strategic agency and system diversity: Conceptualizing institutional positioning in higher education. Minerva, 51(2), 155\u2013169.","journal-title":"Minerva"},{"issue":"3","key":"3717_CR50","first-page":"177","volume":"12","author":"A Garc\u00eda-Aracil","year":"2012","unstructured":"Garc\u00eda-Aracil, A., & Palomares-Montero, D. (2012). Agrupaci\u00f3n alternativa para la evaluaci\u00f3n de las universidades p\u00fablicas espa\u00f1olas. Regional and Sectoral Economic Studies, 12(3), 177\u2013192.","journal-title":"Regional and Sectoral Economic Studies"},{"issue":"4","key":"3717_CR25","doi-asserted-by":"publisher","first-page":"369","DOI":"10.1093\/reseval\/rvv021","volume":"24","author":"J Huisman","year":"2015","unstructured":"Huisman, J., Lepori, B., Seeber, M., Fr\u00f8lich, N., & Scordato, L. (2015). Measuring institutional diversity across higher education systems. Research Evaluation, 24(4), 369\u2013379.","journal-title":"Research Evaluation"},{"issue":"10","key":"3717_CR26","doi-asserted-by":"publisher","first-page":"e00223415","DOI":"10.1371\/journal.pone.0223415","volume":"14","author":"B Lepori","year":"2019","unstructured":"Lepori, B., Geuna, A., & Mira, A. (2019). Scientific output scales with resources. A comparison of US and European universities. PLoS ONE, 14(10), e00223415.","journal-title":"PLoS ONE"},{"issue":"2","key":"3717_CR27","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1007\/s11192-011-0398-6","volume":"88","author":"C L\u00f3pez-Illescas","year":"2011","unstructured":"L\u00f3pez-Illescas, C., de Moya-Aneg\u00f3n, F., & Moed, H. F. (2011). A ranking of universities should account for differences in their disciplinary specialization. Scientometrics, 88(2), 563\u2013574.","journal-title":"Scientometrics"},{"issue":"3","key":"3717_CR29","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1080\/21568235.2015.1044552","volume":"5","author":"R Pinheiro","year":"2015","unstructured":"Pinheiro, R., Langa, P. V., & Pausits, A. (2015). One and two equals three? The third mission of higher education institutions. European Journal of Higher Education, 5(3), 233\u2013249.","journal-title":"European Journal of Higher Education"},{"issue":"3","key":"3717_CR30","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1080\/03075070903050539","volume":"35","author":"F Rossi","year":"2010","unstructured":"Rossi, F. (2010). Massification, Competition and Organizational Diversity in Higher Education: Evidence from Italy. Studies in Higher Education, 35(3), 277\u2013300.","journal-title":"Studies in Higher Education"},{"key":"3717_CR31","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1016\/j.techfore.2016.12.013","volume":"123","author":"G Secundo","year":"2017","unstructured":"Secundo, G., Perez, S. E., Martinaitis, \u017d., & Leitner, K. H. (2017). An Intellectual Capital framework to measure universities' third mission activities. Technological Forecasting and Social Change, 123, 229\u2013239.","journal-title":"Technological Forecasting and Social Change"},{"issue":"3","key":"3717_CR32","doi-asserted-by":"publisher","first-page":"1331","DOI":"10.1007\/s11135-017-0524-5","volume":"52","author":"C Wang","year":"2018","unstructured":"Wang, C., & Zha, Q. (2018). Measuring Systemic Diversity of Chinese Universities: A Clustering-Method Approach. Quality and Quantity, 52(3), 1331\u20131347.","journal-title":"Quality and Quantity"},{"key":"3717_CR33","doi-asserted-by":"crossref","unstructured":"Zharova, A., H\u00e4rdle, W. K., & Lessmann, S. (2017). Is scientific performance a function of funds?, SFB 649 Discussion Paper-Economic Risk, Berlin.","DOI":"10.2139\/ssrn.3085865"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-020-03717-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-020-03717-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-020-03717-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,10]],"date-time":"2023-10-10T22:24:31Z","timestamp":1696976671000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-020-03717-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,29]]},"references-count":31,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,11]]}},"alternative-id":["3717"],"URL":"https:\/\/doi.org\/10.1007\/s11192-020-03717-w","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"type":"print","value":"0138-9130"},{"type":"electronic","value":"1588-2861"}],"subject":[],"published":{"date-parts":[[2020,10,29]]},"assertion":[{"value":"18 December 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 September 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 October 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}