{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T10:15:18Z","timestamp":1769163318103,"version":"3.49.0"},"reference-count":52,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2022,7,8]],"date-time":"2022-07-08T00:00:00Z","timestamp":1657238400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,8]],"date-time":"2022-07-08T00:00:00Z","timestamp":1657238400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100014440","name":"Ministerio de Ciencia, Innovaci\u00f3n y Universidades","doi-asserted-by":"publisher","award":["PID2019-104263RB-C42"],"award-info":[{"award-number":["PID2019-104263RB-C42"]}],"id":[{"id":"10.13039\/100014440","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011011","name":"Junta de Andaluc\u00eda","doi-asserted-by":"publisher","award":["P18-RT-1566"],"award-info":[{"award-number":["P18-RT-1566"]}],"id":[{"id":"10.13039\/501100011011","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011011","name":"Junta de Andaluc\u00eda","doi-asserted-by":"publisher","award":["UMA18-FEDERJA-065"],"award-info":[{"award-number":["UMA18-FEDERJA-065"]}],"id":[{"id":"10.13039\/501100011011","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100009473","name":"Universidad de M\u00e1laga","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100009473","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2022,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In our knowledge society, where universities are key players, the assessment of higher education institutions should meet the new demands of the present complex environment. This calls for the use of techniques that are able to manage this complexity. In this paper, we propose a novel combination of methodologies, jointly using a multi-criteria reference point scheme and the data envelopment analysis (DEA) for the assessment of universities. This combination allows us to take into account all the aspects regarded as relevant to assess university performance, and use them as outputs in the efficiency analysis. Our findings highlight the convenience to assess the university performance by using both compensatory and non-compensatory schemes. This way, the information provided allows to detect the actions needed to improve the performances of the universities, rather than just giving an overall performance measure. Furthermore, combining the use of composite indicators with the DEA analysis provides a more complete picture of the institutions assessed, allowing universities to check their efficiency and to detect their weaknesses and strengths accordingly. The approach is illustrated using data of 47 Spanish public universities for the academic year, 2016\u20132017.<\/jats:p>","DOI":"10.1007\/s11192-022-04436-0","type":"journal-article","created":{"date-parts":[[2022,7,8]],"date-time":"2022-07-08T03:27:54Z","timestamp":1657250874000},"page":"4363-4395","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Combining reference point based composite indicators with data envelopment analysis: application to the assessment of universities"],"prefix":"10.1007","volume":"127","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0763-7314","authenticated-orcid":false,"given":"Samira","family":"El Gibari","sequence":"first","affiliation":[]},{"given":"Trinidad","family":"G\u00f3mez","sequence":"additional","affiliation":[]},{"given":"Francisco","family":"Ruiz","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,7,8]]},"reference":[{"issue":"1","key":"4436_CR1","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/S0272-7757(01)00068-1","volume":"22","author":"M Abbott","year":"2003","unstructured":"Abbott, M., & Doucouliagos, C. (2003). The efficiency of Australian universities: A data envelopment analysis. Economics of Education Review, 22(1), 89\u201397.","journal-title":"Economics of Education Review"},{"key":"4436_CR2","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1016\/j.ejor.2009.03.050","volume":"202","author":"N Adler","year":"2010","unstructured":"Adler, N., & Yazhemsky, E. (2010). Improving discrimination in data envelopment analysis: PCA-DEA or variable reduction. European Journal of Operational Research, 202, 273\u2013284.","journal-title":"European Journal of Operational Research"},{"issue":"5","key":"4436_CR3","doi-asserted-by":"publisher","first-page":"819","DOI":"10.1111\/jors.12427","volume":"59","author":"T Agasisti","year":"2019","unstructured":"Agasisti, T., Barra, C., & Zotti, R. (2019). Research, knowledge transfer, and innovation: The effect of Italian universities\u2019 efficiency on local economic development 2006\u20132012. Journal of Regional Science, 59(5), 819\u2013849.","journal-title":"Journal of Regional Science"},{"key":"4436_CR4","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1007\/s10734-009-9235-8","volume":"59","author":"T Agasisti","year":"2010","unstructured":"Agasisti, T., & P\u00e9rez-Esparrells, C. (2010). Comparing efficiency in a cross-country perspective: the case of Italian and Spanish state universities. Higher Education, 59, 85\u2013103.","journal-title":"Higher Education"},{"issue":"2\u20133","key":"4436_CR5","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1080\/03797720802254031","volume":"33","author":"IF Aguillo","year":"2008","unstructured":"Aguillo, I. F., Ortega, J. L., & Fern\u00e1ndez, M. (2008). Webometric ranking of world universities: Introduction, methodology, and future developments. Higher Education in Europe, 33(2\u20133), 233\u2013244.","journal-title":"Higher Education in Europe"},{"key":"4436_CR6","doi-asserted-by":"publisher","first-page":"1186","DOI":"10.1016\/j.renene.2019.11.130","volume":"151","author":"N Akbari","year":"2020","unstructured":"Akbari, N., Jones, D., & Treloar, R. (2020). A cross-European efficiency assessment of offshore wind farms: A DEA. Renewable Energy, 151, 1186\u20131195.","journal-title":"Renewable Energy"},{"key":"4436_CR7","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1007\/s11192-014-1333-4","volume":"101","author":"O Alasehir","year":"2014","unstructured":"Alasehir, O., Perit-Cakir, M., Acarturk, C., Baykal, N., & Akbulut, U. (2014). URAP-TR: A national ranking for Turkish universities based on academic performance. Scientometrics, 101, 159\u2013178.","journal-title":"Scientometrics"},{"issue":"5","key":"4436_CR8","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1016\/j.technovation.2006.10.003","volume":"27","author":"TR Anderson","year":"2007","unstructured":"Anderson, T. R., Daim, T. U., & Lavoie, F. F. (2007). Measuring the efficiency of university technology transfer. Technovation, 27(5), 306\u2013318.","journal-title":"Technovation"},{"key":"4436_CR9","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1016\/j.jclepro.2017.07.131","volume":"165","author":"D Antanasijevic","year":"2017","unstructured":"Antanasijevic, D., Pocajt, V., Ristic, M., & Peric-Grujic, A. (2017). A differential multi-criteria analysis for the assessment of sustainability performance of European countries: Beyond country ranking. Journal of Cleaner Production, 165, 213\u2013220.","journal-title":"Journal of Cleaner Production"},{"issue":"2","key":"4436_CR10","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1016\/j.ejor.2017.07.064","volume":"264","author":"R Attardi","year":"2017","unstructured":"Attardi, R., Cerreta, M., Sannicandro, V., & Torre, C. M. (2017). Non-compensatory composite indicators for the evaluation of urban planning policy: The land-use policy efficiency index (LUPEI). European Journal of Operational Research, 264(2), 491\u2013507.","journal-title":"European Journal of Operational Research"},{"issue":"9","key":"4436_CR11","doi-asserted-by":"publisher","first-page":"1078","DOI":"10.1287\/mnsc.30.9.1078","volume":"30","author":"RD Banker","year":"1984","unstructured":"Banker, R. D., Charnes, A., & Cooper, W. W. (1984). Some models for estimating technical and scale inefficiencies in data envelopment analysis. Management Science, 30(9), 1078\u20131092.","journal-title":"Management Science"},{"key":"4436_CR12","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1016\/j.jengtecman.2018.01.003","volume":"47","author":"J Berbegal-Mirabent","year":"2018","unstructured":"Berbegal-Mirabent, J. (2018). The influence of regulatory frameworks on research and knowledge transfer outputs: An efficiency analysis of Spanish public universities. Journal of Engineering and Technology Management, 47, 68\u201380.","journal-title":"Journal of Engineering and Technology Management"},{"key":"4436_CR13","doi-asserted-by":"publisher","first-page":"2051","DOI":"10.1016\/j.jbusres.2013.02.031","volume":"66","author":"J Berbegal-Mirabent","year":"2013","unstructured":"Berbegal-Mirabent, J., Lafuente, E., & Sol\u00e9, F. (2013). The pursuit of knowledge transfer activities: An efficiency analysis of Spanish universities. Journal of Business Research, 66, 2051\u20132059.","journal-title":"Journal of Business Research"},{"key":"4436_CR14","doi-asserted-by":"publisher","first-page":"2158","DOI":"10.1016\/j.ecolecon.2010.06.016","volume":"69","author":"FJ Blancas","year":"2010","unstructured":"Blancas, F. J., Caballero, R., Gonz\u00e1lez, M., Lozano-Oyola, M., & P\u00e9rez, F. (2010). Goal programming synthetic indicators: An application for sustainable tourism in Andalusian coastal counties. Ecological Economics, 69, 2158\u20132172.","journal-title":"Ecological Economics"},{"issue":"3","key":"4436_CR15","doi-asserted-by":"publisher","first-page":"929","DOI":"10.1016\/j.ejor.2019.06.025","volume":"279","author":"V Charles","year":"2019","unstructured":"Charles, V., Aparicio, J., & Zhu, J. (2019). The curse of dimensionality of decision-making units: A simple approach to increase the discriminatory power of data envelopment analysis. European Journal of Operational Research, 279(3), 929\u2013940.","journal-title":"European Journal of Operational Research"},{"key":"4436_CR16","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1016\/0377-2217(78)90138-8","volume":"2","author":"A Charnes","year":"1978","unstructured":"Charnes, A., Cooper, W. W., & Rhodes, E. (1978). Measuring the efficiency of decision making units. European Journal of Operational Research, 2, 429\u2013444.","journal-title":"European Journal of Operational Research"},{"issue":"6","key":"4436_CR17","doi-asserted-by":"publisher","first-page":"668","DOI":"10.1287\/mnsc.27.6.668","volume":"27","author":"A Charnes","year":"1981","unstructured":"Charnes, A., Cooper, W. W., & Rhodes, E. (1981). Evaluating program and managerial efficiency: An application of data envelopment analysis to program follow through. Management Science, 27(6), 668\u2013697.","journal-title":"Management Science"},{"key":"4436_CR18","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1007\/s11233-018-09017-6","volume":"25","author":"J de Jorge Moreno","year":"2019","unstructured":"de Jorge Moreno, J., Gonz\u00e1lez Robles, A., Martinez, A., Minero Calvo, R., & Georgiana Miron, A. (2019). Assessing efficiency in the Spanish public universities through comparative non-radial and radial data envelopment analysis. Tertiary Education and Management, 25, 195\u2013210.","journal-title":"Tertiary Education and Management"},{"issue":"3","key":"4436_CR19","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1093\/reseval\/rvx022","volume":"26","author":"EM de la Torre","year":"2017","unstructured":"de la Torre, E. M., Agasisti, T., & P\u00e9rez-Esparrells, C. (2017a). The relevance of knowledge transfer for universities\u2019 efficiency scores: An empirical approximation on the Spanish public higher education system. Research Evaluation, 26(3), 211\u2013229.","journal-title":"Research Evaluation"},{"issue":"3","key":"4436_CR20","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1080\/13583883.2017.1296966","volume":"23","author":"EM de la Torre","year":"2017","unstructured":"de la Torre, E. M., G\u00f3mez-Sancho, J. M., & P\u00e9rez-Esparrells, C. (2017b). Comparing university performance by legal status: A Malmquist-type index approach for the case of the Spanish higher education system. Tertiary Education and Management, 23(3), 206\u2013221.","journal-title":"Tertiary Education and Management"},{"key":"4436_CR21","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1057\/jors.2015.92","volume":"68","author":"K De Witte","year":"2017","unstructured":"De Witte, K., & L\u00f3pez-Torres, L. (2017). Efficiency in education: A review of literature and a way forward. Journal of the Operational Research Society, 68, 339\u2013363.","journal-title":"Journal of the Operational Research Society"},{"issue":"2","key":"4436_CR22","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/S0377-2217(00)00149-1","volume":"132","author":"RG Dyson","year":"2001","unstructured":"Dyson, R. G., Allen, R., Camanho, V. V., Sarrico, C. S., & Shale, E. A. (2001). Pitfall and protocols in DEA. European Journal of Operational Research, 132(2), 245\u2013259.","journal-title":"European Journal of Operational Research"},{"issue":"4","key":"4436_CR23","doi-asserted-by":"publisher","first-page":"1235","DOI":"10.1016\/j.joi.2018.10.003","volume":"12","author":"S El Gibari","year":"2018","unstructured":"El Gibari, S., G\u00f3mez, T., & Ruiz, F. (2018). Evaluating university performance using reference point based composite indicators. Journal of Informetrics, 12(4), 1235\u20131250.","journal-title":"Journal of Informetrics"},{"key":"4436_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11573-018-0902-z","volume":"89","author":"S El Gibari","year":"2019","unstructured":"El Gibari, S., G\u00f3mez, T., & Ruiz, F. (2019). Building composite indicators using multicriteria methods: A review. Journal of Business Economics, 89, 1\u201324.","journal-title":"Journal of Business Economics"},{"key":"4436_CR25","doi-asserted-by":"publisher","first-page":"1108","DOI":"10.3145\/epi.2018.sep.14","volume":"27","author":"A Exp\u00f3sito-Garc\u00eda","year":"2018","unstructured":"Exp\u00f3sito-Garc\u00eda, A., & Velasco-Morente, F. (2018). How efficient are universities at publishing research? A data envelopment analysis of Spanish state universities. El profesional de la informaci\u00f3n, 27, 1108\u20131115.","journal-title":"El profesional de la informaci\u00f3n"},{"key":"4436_CR26","doi-asserted-by":"publisher","first-page":"253","DOI":"10.2307\/2343100","volume":"120","author":"M Farrell","year":"1957","unstructured":"Farrell, M. (1957). The measurement of productive efficiency. Journal of the Royal Statistical Society (Series A), 120, 253\u2013281.","journal-title":"Journal of the Royal Statistical Society (Series A)"},{"key":"4436_CR27","doi-asserted-by":"publisher","first-page":"488","DOI":"10.1016\/j.dss.2009.06.008","volume":"48","author":"C Giannoulis","year":"2010","unstructured":"Giannoulis, C., & Ishizaka, A. (2010). A web-based decision support system with ELECTRE III for a personalised ranking of British universities. Decision Support Systems, 48, 488\u2013497.","journal-title":"Decision Support Systems"},{"key":"4436_CR28","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1016\/j.ece.2019.06.003","volume":"29","author":"A Gonz\u00e1lez-Garay","year":"2019","unstructured":"Gonz\u00e1lez-Garay, A., Pozo, C., Gal\u00e1n-Mart\u00edn, A., Brechtelsbauer, C., Chachuat, B., Chadha, D., et al. (2019). Assessing the performance of UK universities in the field of chemical engineering using data envelopment analysis. Education for Chemical Engineers, 29, 29\u201341.","journal-title":"Education for Chemical Engineers"},{"issue":"2","key":"4436_CR29","first-page":"1","volume":"27","author":"MV Heitor","year":"2013","unstructured":"Heitor, M. V., & Horta, H. (2013). Democratizing higher education and access to science: The Portuguese reform 2006\u20132010. Higher Education Policy, 27(2), 1\u201319.","journal-title":"Higher Education Policy"},{"issue":"1","key":"4436_CR30","first-page":"1","volume":"9","author":"MH Huang","year":"2011","unstructured":"Huang, M. H. (2011). A comparison of three major academic rankings for world universities: From a research evaluation perspective. Journal of Library and Information Studies, 9(1), 1\u201325.","journal-title":"Journal of Library and Information Studies"},{"key":"4436_CR31","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1016\/j.econedurev.2005.02.005","volume":"25","author":"J Johnes","year":"2006","unstructured":"Johnes, J. (2006). Data envelopment analysis and its application to the measurement of efficiency in higher education. Economics of Education Review, 25, 273\u2013288.","journal-title":"Economics of Education Review"},{"key":"4436_CR32","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1016\/j.ecolind.2014.05.014","volume":"45","author":"SD Langhans","year":"2014","unstructured":"Langhans, S. D., Reichert, P., & Schuwirth, N. (2014). The method matters: A guide for indicator aggregation in ecological assessments. Ecological Indicators, 45, 494\u2013507.","journal-title":"Ecological Indicators"},{"key":"4436_CR33","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1177\/1028315307303544","volume":"11","author":"S Marginson","year":"2007","unstructured":"Marginson, S., & Van der Wende, M. (2007). To rank or to be ranked: The impact of global rankings in higher education. Journal of Studies in International Education, 11, 306\u2013329.","journal-title":"Journal of Studies in International Education"},{"key":"4436_CR34","doi-asserted-by":"publisher","first-page":"100771","DOI":"10.1016\/j.seps.2019.100771","volume":"71","author":"A Mart\u00ednez-Campillo","year":"2020","unstructured":"Mart\u00ednez-Campillo, A., & Fernandez-Santos, Y. (2020). The impact of the economic crisis on the (in)efficiency of public higher education institutions in Southern Europe: The case of Spanish universities. Socio-Economic Planning Sciences, 71, 100771.","journal-title":"Socio-Economic Planning Sciences"},{"key":"4436_CR35","doi-asserted-by":"publisher","first-page":"950","DOI":"10.1016\/j.omega.2007.12.005","volume":"36","author":"W Meng","year":"2008","unstructured":"Meng, W., Zhang, D., & Liu, W. (2008). Two-level DEA approaches in research evaluation. Omega, 36, 950\u2013957.","journal-title":"Omega"},{"key":"4436_CR36","doi-asserted-by":"publisher","first-page":"1819","DOI":"10.1007\/s10098-018-1575-6","volume":"20","author":"M Molinos-Senante","year":"2018","unstructured":"Molinos-Senante, M. (2018). Comparative energy efficiency of wastewater treatment technologies: A synthetic index approach. Clean Technologies and Environmental Policy, 20, 1819\u20131834.","journal-title":"Clean Technologies and Environmental Policy"},{"key":"4436_CR37","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1007\/s11205-007-9226-z","volume":"89","author":"P Murias","year":"2008","unstructured":"Murias, P., de Miguel, J. C., & Rodr\u00edguez, D. (2008). A composite indicator for university quality assessment: The case of Spanish higher education system. Social Indicators Research, 89, 129\u2013146.","journal-title":"Social Indicators Research"},{"key":"4436_CR38","volume-title":"Tools for composite indicators building. Technical report","author":"M Nardo","year":"2005","unstructured":"Nardo, M., Saisana, M., Saltelli, A., & Tarantola, S. (2005). Tools for composite indicators building. Technical report. Ispra: European Commission."},{"key":"4436_CR39","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1007\/978-3-030-75162-3_5","volume-title":"Data-enabled analytics","author":"BH Nguyen","year":"2021","unstructured":"Nguyen, B. H., & Zelenyuk, V. (2021). Aggregation of outputs and inputs for DEA analysis of hospital efficiency economics, operations research and data science perspectives. In J. Zhu & V. Charles (Eds.), Data-enabled analytics (pp. 123\u2013158). Springer."},{"key":"4436_CR40","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1057\/jors.2009.187","volume":"62","author":"F Ruiz","year":"2011","unstructured":"Ruiz, F., Cabello, J. M., & Luque, M. (2011). An application of reference point techniques to the calculation of synthetic sustainability indicators. Journal of the Operational Research Society, 62, 189\u2013197.","journal-title":"Journal of the Operational Research Society"},{"key":"4436_CR41","doi-asserted-by":"publisher","first-page":"102060","DOI":"10.1016\/j.omega.2019.04.003","volume":"95","author":"F Ruiz","year":"2020","unstructured":"Ruiz, F., El Gibari, S., Cabello, J. M., & G\u00f3mez, T. (2020). MRP-WSCI: Multiple reference point based weak and strong composite indicators. Omega, 95, 102060.","journal-title":"Omega"},{"key":"4436_CR42","doi-asserted-by":"publisher","first-page":"825","DOI":"10.1007\/s11192-019-03324-4","volume":"122","author":"M Salas-Velasco","year":"2020","unstructured":"Salas-Velasco, M. (2020a). Measuring and explaining the production efficiency of Spanish universities using a non-parametric approach and a bootstrapped-truncated regression. Scientometrics, 122, 825\u2013846.","journal-title":"Scientometrics"},{"key":"4436_CR43","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1007\/s10671-019-09254-5","volume":"19","author":"M Salas-Velasco","year":"2020","unstructured":"Salas-Velasco, M. (2020b). The technical efficiency performance of the higher education systems based on data envelopment analysis with an illustration for the Spanish case. Educational Research for Policy and Practice, 19, 159\u2013180.","journal-title":"Educational Research for Policy and Practice"},{"issue":"2","key":"4436_CR44","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1111\/hequ.12184","volume":"73","author":"A Szuwarzynski","year":"2018","unstructured":"Szuwarzynski, A. (2018). Benefit of the doubt approach to assessing the research performance of Australian universities. Higher Education Quarterly, 73(2), 235\u2013250.","journal-title":"Higher Education Quarterly"},{"key":"4436_CR45","doi-asserted-by":"crossref","unstructured":"Torres-Salinas, D., Moreno-Torres, J. G., Delgado-L\u00f3pez-C\u00f3zar, E., & Herrera, F. (2011). A methodology for institution-field ranking based on a bidimensional analysis: The IFQ$$^{2}$$A index. Scientometrics, 88, 771\u2013786.","DOI":"10.1007\/s11192-011-0418-6"},{"key":"4436_CR46","volume-title":"Exploratory data analysis","author":"WJ Tukey","year":"1977","unstructured":"Tukey, W. J. (1977). Exploratory data analysis. Addison-Wesley."},{"issue":"8","key":"4436_CR47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/su9081416","volume":"9","author":"D Visbal-Cadavid","year":"2017","unstructured":"Visbal-Cadavid, D., Mart\u00ednez-G\u00f3mez, M., & Guijarro, F. (2017). Assessing the efficiency of public universities through DEA. A case study. Sustainability, 9(8), 1\u201319.","journal-title":"Sustainability"},{"key":"4436_CR48","first-page":"468","volume-title":"Lecture notes in economics and mathematical systems","author":"AP Wierzbicki","year":"1980","unstructured":"Wierzbicki, A. P. (1980). The use of reference objectives in multiobjective optimization. In G. Fandel & T. Gal (Eds.), Lecture notes in economics and mathematical systems (Vol. 177, pp. 468\u2013486). Springer-Verlag."},{"key":"4436_CR49","volume-title":"Model-based decision support methodology with environmental applications","year":"2000","unstructured":"Wierzbicki, A. P., Makowski, M., & Wessels, J. (Eds.). (2000). Model-based decision support methodology with environmental applications. Kluwer Academic Publishers."},{"key":"4436_CR50","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.joi.2017.11.002","volume":"12","author":"GL Yang","year":"2018","unstructured":"Yang, G. L., Fukuyama, H., & Song, Y. Y. (2018). Measuring the inefficiency of Chinese research universities based on a two-stage network DEA model. Journal of Informetrics, 12, 10.","journal-title":"Journal of Informetrics"},{"issue":"4","key":"4436_CR51","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1016\/j.omega.2010.09.004","volume":"39","author":"W Zhong","year":"2011","unstructured":"Zhong, W., Yuan, W., Li, S. X., & Huang, Z. (2011). The performance evaluation of regional R &D investments in China: An application of DEA based on the first official China economic census data. OMEGA, 39(4), 447\u2013455.","journal-title":"OMEGA"},{"key":"4436_CR52","doi-asserted-by":"publisher","first-page":"360","DOI":"10.1016\/j.eswa.2009.05.039","volume":"37","author":"P Zhou","year":"2010","unstructured":"Zhou, P., Fan, L. W., & Zhou, D. Q. (2010). Data aggregation in constructing composite indicators: A perspective of information loss. Expert Systems with Applications, 37, 360\u2013365.","journal-title":"Expert Systems with Applications"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04436-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-022-04436-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04436-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,10]],"date-time":"2022-08-10T08:24:00Z","timestamp":1660119840000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-022-04436-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,8]]},"references-count":52,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2022,8]]}},"alternative-id":["4436"],"URL":"https:\/\/doi.org\/10.1007\/s11192-022-04436-0","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,8]]},"assertion":[{"value":"27 April 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 June 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 July 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}