{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,5]],"date-time":"2026-04-05T10:23:43Z","timestamp":1775384623628,"version":"3.50.1"},"reference-count":123,"publisher":"Wiley","issue":"5","license":[{"start":{"date-parts":[[2024,12,5]],"date-time":"2024-12-05T00:00:00Z","timestamp":1733356800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Int Trans Operational Res"],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Over recent decades, universities in England have transitioned from providing higher education (HE) for the elite to HE for the masses. Funding mechanisms have changed, cost\u2010sharing has shifted from public to private sources, and efficiency and productivity have been emphasized. Three excellence frameworks relating to research, teaching, and knowledge exchange have been introduced to assess performance. In this paper, we explore the systems of performance measurement and funding implemented in English HE and critically appraise these against the recommendations from the relevant literature. We conclude that these frameworks, by separately assessing performance in the three missions, inadequately account for synergies between activities, thereby ignoring the civic nature of universities and possibilities for economies of scale and scope. We conclude by highlighting some emerging areas for future research. While the focus of the paper is English HE, the themes and findings are relevant to all HE sectors around the world.<\/jats:p>","DOI":"10.1111\/itor.13583","type":"journal-article","created":{"date-parts":[[2024,12,6]],"date-time":"2024-12-06T05:40:12Z","timestamp":1733463612000},"page":"2677-2706","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["The quest for efficiency in higher education in England: lessons learned for developed economies"],"prefix":"10.1111","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1607-1810","authenticated-orcid":false,"given":"Jill","family":"Johnes","sequence":"first","affiliation":[{"name":"Huddersfield Business School University of Huddersfield  Queensgate, Huddersfield HD1 3DH UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4466-9825","authenticated-orcid":false,"given":"Carmen","family":"Perez\u2010Esparrells","sequence":"additional","affiliation":[{"name":"Autonomous University of Madrid Ciudad Universitaria Cantoblanco  Madrid 28049 Spain"},{"name":"UAM\u2010UC3M Research Institute for Higher Education and Science (INAECU)  Getafe 28903 Spain"}]}],"member":"311","published-online":{"date-parts":[[2024,12,5]]},"reference":[{"key":"e_1_2_7_2_1","doi-asserted-by":"publisher","DOI":"10.1093\/oep\/gpab039"},{"key":"e_1_2_7_3_1","doi-asserted-by":"publisher","DOI":"10.1111\/jors.12427"},{"key":"e_1_2_7_4_1","doi-asserted-by":"publisher","DOI":"10.1080\/00036846.2020.1803488"},{"key":"e_1_2_7_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10734-009-9235-8"},{"key":"e_1_2_7_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/0304-4076(77)90052-5"},{"key":"e_1_2_7_7_1","volume-title":"Independent Panel Report to the Review of Post\u201018 Education and Funding","author":"Augar S.P.","year":"2019"},{"key":"e_1_2_7_8_1","volume-title":"Shaping Higher Education: 50 Years After Robbins","author":"Barr N.","year":"2014"},{"key":"e_1_2_7_9_1","volume-title":"Peeling the DEA onion: Layering and rank\u2010ordering DMUs using tiered DEA","author":"Barr R.S.","year":"2000"},{"key":"e_1_2_7_10_1","volume-title":"Contestable Markets and the Theory of Industry Structure","author":"Baumol W.J.","year":"1982"},{"key":"e_1_2_7_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclepro.2021.126320"},{"key":"e_1_2_7_12_1","doi-asserted-by":"publisher","DOI":"10.1186\/s41239-020-00218-x"},{"key":"e_1_2_7_13_1","volume-title":"Education: historical statistics","author":"Bolton P.","year":"2012"},{"key":"e_1_2_7_14_1","volume-title":"Student loan statistics","author":"Bolton P.","year":"2023"},{"key":"e_1_2_7_15_1","doi-asserted-by":"publisher","DOI":"10.1080\/07294360.2017.1370441"},{"key":"e_1_2_7_16_1","first-page":"103","volume-title":"New Languages and Landscapes of Higher Education","author":"Callender C.","year":"2017"},{"key":"e_1_2_7_17_1","doi-asserted-by":"publisher","DOI":"10.1080\/00343404.2021.1901870"},{"key":"e_1_2_7_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/0377-2217(78)90138-8"},{"key":"e_1_2_7_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/0377-2217(79)90229-7"},{"issue":"1","key":"e_1_2_7_20_1","first-page":"11","article-title":"An evaluation of \u2018trade\u2010offs\u2019 implementation using canonical estimation of joint educational production functions","volume":"15","author":"Chizmar J.F.","year":"1984","journal-title":"Journal of Economic Education"},{"issue":"2","key":"e_1_2_7_21_1","first-page":"18","article-title":"Modeling multiple outputs in educational production functions","volume":"73","author":"Chizmar J.F.","year":"1983","journal-title":"American Economic Review"},{"key":"e_1_2_7_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/0272-7757(84)90006-2"},{"key":"e_1_2_7_23_1","doi-asserted-by":"publisher","DOI":"10.1057\/hep.2014.16"},{"key":"e_1_2_7_24_1","doi-asserted-by":"publisher","DOI":"10.1093\/reseval\/rvx022"},{"key":"e_1_2_7_25_1","doi-asserted-by":"publisher","DOI":"10.1080\/03075079.2018.1479847"},{"key":"e_1_2_7_26_1","doi-asserted-by":"publisher","DOI":"10.1057\/jors.2015.92"},{"key":"e_1_2_7_27_1","doi-asserted-by":"publisher","DOI":"10.1111\/itor.12762"},{"key":"e_1_2_7_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.respol.2019.05.002"},{"key":"e_1_2_7_29_1","volume-title":"The Development of Higher Education into the 1990s","author":"Department of Education and Science","year":"1985"},{"key":"e_1_2_7_30_1","unstructured":"Dixon M. February 28th 1976.More means better. The Financial Times.London."},{"key":"e_1_2_7_31_1","volume-title":"The Financial Times","author":"Dixon M.","year":"1985"},{"key":"e_1_2_7_32_1","volume-title":"The Financial Times","author":"Dixon M.","year":"1989"},{"key":"e_1_2_7_33_1","doi-asserted-by":"publisher","DOI":"10.2307\/2343100"},{"key":"e_1_2_7_34_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9299.2010.01867.x"},{"key":"e_1_2_7_35_1","doi-asserted-by":"publisher","DOI":"10.1002\/jae.3950100106"},{"key":"e_1_2_7_36_1","doi-asserted-by":"publisher","DOI":"10.1080\/09645299500000023"},{"key":"e_1_2_7_37_1","doi-asserted-by":"publisher","DOI":"10.4337\/9781784717728.00008"},{"key":"e_1_2_7_38_1","doi-asserted-by":"publisher","DOI":"10.1177\/0891242405283387"},{"key":"e_1_2_7_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jeconom.2004.05.003"},{"key":"e_1_2_7_40_1","doi-asserted-by":"publisher","DOI":"10.1057\/9781137446671"},{"key":"e_1_2_7_41_1","doi-asserted-by":"publisher","DOI":"10.4337\/9781788974981.00008"},{"key":"e_1_2_7_42_1","volume-title":"Times Higher Education","author":"Havergal C.","year":"2023"},{"key":"e_1_2_7_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.respol.2011.09.007"},{"key":"e_1_2_7_44_1","unstructured":"Higher Education Funding Council for England 2021. Guidance on Research Excellence Framework (REF) 2021 results. Available 19th October 2023 athttps:\/\/2021.ref.ac.uk\/."},{"key":"e_1_2_7_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/0361-3682(93)E0001-W"},{"issue":"5","key":"e_1_2_7_46_1","first-page":"957","article-title":"Real effects of academic research","volume":"79","author":"Jaffe A. B.","year":"1989","journal-title":"American Economic Review"},{"key":"e_1_2_7_47_1","volume-title":"Report of the Steering Committee for Efficiency Studies in Universities","author":"Jarratt A.","year":"1985"},{"key":"e_1_2_7_48_1","doi-asserted-by":"publisher","DOI":"10.1093\/oxrep\/8.2.19"},{"key":"e_1_2_7_49_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-0297.1997.tb00038.x"},{"key":"e_1_2_7_50_1","doi-asserted-by":"publisher","DOI":"10.1111\/1468-0297.00341"},{"key":"e_1_2_7_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0038-0121(97)00035-9"},{"key":"e_1_2_7_52_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9485.00145"},{"key":"e_1_2_7_53_1","doi-asserted-by":"publisher","DOI":"10.1093\/oxfordjournals.oep.a042095"},{"key":"e_1_2_7_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.econedurev.2008.02.001"},{"key":"e_1_2_7_55_1","doi-asserted-by":"publisher","DOI":"10.1093\/oxrep\/grw023"},{"key":"e_1_2_7_56_1","doi-asserted-by":"publisher","DOI":"10.1093\/oxrep\/grw023"},{"key":"e_1_2_7_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-815859-3.00014-7"},{"key":"e_1_2_7_58_1","doi-asserted-by":"publisher","DOI":"10.1080\/03075070802372901"},{"key":"e_1_2_7_59_1","unstructured":"Johnes G. Johnes J. Thanassoulis E. Lenton P. Emrouznejad A. 2005.An exploratory analysis of the cost structure of higher education in England. Research Report. 641 London Department for Education and Skills."},{"key":"e_1_2_7_60_1","doi-asserted-by":"publisher","DOI":"10.1080\/00036848700000033"},{"key":"e_1_2_7_61_1","doi-asserted-by":"publisher","DOI":"10.1080\/00036849000000023"},{"key":"e_1_2_7_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/0377-2217(94)00234-7"},{"key":"e_1_2_7_63_1","doi-asserted-by":"publisher","DOI":"10.1080\/02664769723738"},{"key":"e_1_2_7_64_1","doi-asserted-by":"publisher","DOI":"10.4337\/9781845421694.00021"},{"key":"e_1_2_7_65_1","doi-asserted-by":"crossref","unstructured":"Johnes J. 2010.\u201cEfficiency and Input \u2010 and Output \u2010 Substitutability in English Higher Education 1996\/97 to 2007\/08: A Parametric Distance Function Approach \u201d Working Papers 609689 Lancaster University Management School Economics Department.","DOI":"10.2139\/ssrn.1615512"},{"key":"e_1_2_7_66_1","doi-asserted-by":"publisher","DOI":"10.1111\/manc.12030"},{"key":"e_1_2_7_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2014.10.043"},{"key":"e_1_2_7_68_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-018-2666-1"},{"key":"e_1_2_7_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/0272-7757(95)00008-8"},{"key":"e_1_2_7_70_1","unstructured":"Johnes J. Johnes G. 2013.Efficiency in the higher education sector: a technical exploration. BIS Research Paper No. 113 Department for Business Innovation and Skills London."},{"key":"e_1_2_7_71_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00128423"},{"key":"e_1_2_7_72_1","doi-asserted-by":"publisher","DOI":"10.1080\/758522552"},{"key":"e_1_2_7_73_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00139181"},{"key":"e_1_2_7_74_1","volume-title":"Performance Indicators in Higher Education","author":"Johnes J.","year":"1990"},{"key":"e_1_2_7_75_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00133900"},{"key":"e_1_2_7_76_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-2273.1992.tb01585.x"},{"key":"e_1_2_7_77_1","doi-asserted-by":"publisher","DOI":"10.2307\/2982732"},{"key":"e_1_2_7_78_1","doi-asserted-by":"publisher","DOI":"10.1111\/manc.12262"},{"key":"e_1_2_7_79_1","doi-asserted-by":"publisher","DOI":"10.13060\/00380288.2003.39.3.04"},{"key":"e_1_2_7_80_1","doi-asserted-by":"publisher","DOI":"10.2307\/2283868"},{"key":"e_1_2_7_81_1","unstructured":"Lee B.L. Johnes J. 2022a.A comparison of the slacks based measure environmental efficiency ranking with the People and Planet's University League Ranking. 8th International Workshop on Efficiency in Education Health and other Public Services September 8\u20139 Pisa Italy."},{"key":"e_1_2_7_82_1","doi-asserted-by":"publisher","DOI":"10.1111\/hequ.12307"},{"key":"e_1_2_7_83_1","doi-asserted-by":"publisher","DOI":"10.1177\/0891242410366561"},{"key":"e_1_2_7_84_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11024-010-9143-1"},{"key":"e_1_2_7_85_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10961-017-9619-3"},{"key":"e_1_2_7_86_1","first-page":"25","article-title":"The resurgent interest in performance\u2010based funding for higher education","volume":"99","author":"McLendon M.K.","year":"2013","journal-title":"Academe"},{"key":"e_1_2_7_87_1","doi-asserted-by":"publisher","DOI":"10.1080\/13603108.2016.1246386"},{"key":"e_1_2_7_88_1","unstructured":"National Committee of Inquiry into Higher Education (NCIHE) 1997.Higher Education in the Learning Society. Dearing Report HMSO London."},{"key":"e_1_2_7_89_1","unstructured":"Office for Students 2022.Description of student outcome and experience measures used in OfS regulation. Office for Students 2022. Available 18th October 2023 athttps:\/\/www.officeforstudents.org.uk\/media\/6fec91a8\u20102826\u20104b15\u20109447\u20107e3de2dd7526\/description\u2010of\u2010student\u2010outcome\u2010and\u2010experience\u2010measures.pdf"},{"key":"e_1_2_7_90_1","doi-asserted-by":"publisher","DOI":"10.1080\/00036846.2016.1210780"},{"issue":"3","key":"e_1_2_7_91_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.9734\/jenrr\/2019\/v3i330097","article-title":"Modelling carbon emissions efficiency from UK higher education institutions using data envelopment analysis","volume":"3","author":"Oloruntoba A.","year":"2019","journal-title":"Journal of Energy Research and Reviews"},{"key":"e_1_2_7_92_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00181-003-0184-2"},{"key":"e_1_2_7_93_1","doi-asserted-by":"publisher","DOI":"10.1080\/14719030600853022"},{"key":"e_1_2_7_94_1","doi-asserted-by":"publisher","DOI":"10.1080\/03075079.2018.1450851"},{"key":"e_1_2_7_95_1","unstructured":"Perez\u2010Esparrells C. Bautista\u2010Puig N. Orduna\u2010Malea E. 2022.The public assessment of scientific research in the international context: possibilities and limits. Report I Agencia Canaria de Calidad Universitaria y Evaluaci\u00f3n Educativa ACCUEE."},{"key":"e_1_2_7_96_1","first-page":"323","volume-title":"Resilient Universities, Confronting Changes in a Challenging World","author":"Perez\u2010Esparrells C.","year":"2013"},{"key":"e_1_2_7_97_1","doi-asserted-by":"publisher","DOI":"10.1002\/berj.3572"},{"key":"e_1_2_7_98_1","doi-asserted-by":"publisher","DOI":"10.1080\/13603108.2022.2122623"},{"key":"e_1_2_7_99_1","doi-asserted-by":"publisher","DOI":"10.1515\/nispa-2017-0017"},{"key":"e_1_2_7_100_1","volume-title":"Public Management Reform: A Comparative Analysis into the Age of Austerity","author":"Pollitt C.","year":"2017"},{"key":"e_1_2_7_101_1","doi-asserted-by":"publisher","DOI":"10.1108\/14635771111121694"},{"key":"e_1_2_7_102_1","doi-asserted-by":"publisher","DOI":"10.1080\/03075079.2023.2184788"},{"key":"e_1_2_7_103_1","unstructured":"Research England. 2023a.Knowledge exchange framework. Available 18th October 2023 athttps:\/\/kef.ac.uk\/about"},{"key":"e_1_2_7_104_1","unstructured":"Research England. 2023b.Knowledge exchange framework. Decision for the third interaction. Available 20th June 2023 athttps:\/\/www.ukri.org\/wp\u2010content\/uploads\/2023\/06\/RE\u2010060623\u2010KEF\u2010Decisions\u2010for\u2010the\u2010third\u2010iteration.pdf"},{"key":"e_1_2_7_105_1","unstructured":"Robbins L. 1963.Higher Education (Robbins Report). CMND 2154 HMSO London."},{"key":"e_1_2_7_106_1","doi-asserted-by":"publisher","DOI":"10.7341\/20211718"},{"key":"e_1_2_7_107_1","doi-asserted-by":"publisher","DOI":"10.1093\/cje\/bex054"},{"key":"e_1_2_7_108_1","doi-asserted-by":"publisher","DOI":"10.1080\/03075079.2014.914914"},{"key":"e_1_2_7_109_1","doi-asserted-by":"publisher","DOI":"10.1108\/JEC-01-2017-0006"},{"key":"e_1_2_7_110_1","unstructured":"Schlump C. Brenner T. 2010.Universityeducation public research and employment growth in regions\u2014an empirical study of Germany. Working Papers on Innovation and Space No. 02.10 Philipps\u2010University Marburg Department of Geography Marburg."},{"key":"e_1_2_7_111_1","doi-asserted-by":"publisher","DOI":"10.1111\/pirs.12150"},{"key":"e_1_2_7_112_1","doi-asserted-by":"publisher","DOI":"10.1080\/01900699508525011"},{"key":"e_1_2_7_113_1","doi-asserted-by":"publisher","DOI":"10.1080\/09645290500251581"},{"key":"e_1_2_7_114_1","volume-title":"Cost\u2010Sharing and Accessibility in Higher Education: A Fairer Deal?","author":"Teixeira P.N.","year":"2008"},{"key":"e_1_2_7_115_1","doi-asserted-by":"publisher","DOI":"10.1007\/1-4020-2835-0"},{"key":"e_1_2_7_116_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-7684-0_12"},{"key":"e_1_2_7_117_1","doi-asserted-by":"publisher","DOI":"10.1057\/jors.2010.68"},{"key":"e_1_2_7_118_1","doi-asserted-by":"publisher","DOI":"10.1002\/jae.637"},{"key":"e_1_2_7_119_1","volume-title":"Knowledge exchange framework metrics: a cluster analysis of higher education institutions","author":"Ulrichsen T.C.","year":"2018"},{"key":"e_1_2_7_120_1","unstructured":"UKRI(2023).Knowledge exchange framework. Decisions for the third iteration. RE\u2010P\u20102023\u201002 Research England Bristol UK."},{"key":"e_1_2_7_121_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.econedurev.2018.09.001"},{"key":"e_1_2_7_122_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.seps.2018.01.004"},{"key":"e_1_2_7_123_1","article-title":"UK universities are a success story: they need help now","author":"Willetts D.","year":"2020","journal-title":"Financial Times"},{"key":"e_1_2_7_124_1","doi-asserted-by":"crossref","unstructured":"Worthington A.C. Higgs J. 2008.Anempirical note on factor price elasticities and substitution in Australian higher education. Available 18th October 2023 athttps:\/\/doi.org\/10.2139\/ssrn.1313527","DOI":"10.2139\/ssrn.1313527"}],"container-title":["International Transactions in Operational Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/itor.13583","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,10]],"date-time":"2025-04-10T15:55:41Z","timestamp":1744300541000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/itor.13583"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,5]]},"references-count":123,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,9]]}},"alternative-id":["10.1111\/itor.13583"],"URL":"https:\/\/doi.org\/10.1111\/itor.13583","archive":["Portico"],"relation":{},"ISSN":["0969-6016","1475-3995"],"issn-type":[{"value":"0969-6016","type":"print"},{"value":"1475-3995","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,5]]},"assertion":[{"value":"2024-02-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-11-13","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-05","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}