{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:25:53Z","timestamp":1740122753051,"version":"3.37.3"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2019,7,4]],"date-time":"2019-07-04T00:00:00Z","timestamp":1562198400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"},{"start":{"date-parts":[[2019,7,4]],"date-time":"2019-07-04T00:00:00Z","timestamp":1562198400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"funder":[{"name":"Funda\u00e7\u00e3o para a Ci\u00eancia e Tecnologia","award":["02\/INDICADORES\/2014","05\/INDICADORES\/2014"],"award-info":[{"award-number":["02\/INDICADORES\/2014","05\/INDICADORES\/2014"]}]},{"DOI":"10.13039\/501100008530","name":"Fundo Europeu de Desenvolvimento Regional","doi-asserted-by":"crossref","award":["POCI-01-0145-FEDER-029427-"],"award-info":[{"award-number":["POCI-01-0145-FEDER-029427-"]}],"id":[{"id":"10.13039\/501100008530","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Tert Educ Manag"],"published-print":{"date-parts":[[2020,9]]},"DOI":"10.1007\/s11233-019-09035-y","type":"journal-article","created":{"date-parts":[[2019,7,4]],"date-time":"2019-07-04T14:42:00Z","timestamp":1562251320000},"page":"281-294","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Performance indicators for research and cultural creation activities in polytechnic higher education institutions: a consensus building approach"],"prefix":"10.1007","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5596-6564","authenticated-orcid":false,"given":"Ricardo","family":"Biscaia","sequence":"first","affiliation":[]},{"given":"Ana I.","family":"Melo","sequence":"additional","affiliation":[]},{"given":"Isabel","family":"Machado","sequence":"additional","affiliation":[]},{"given":"Hugo","family":"Figueiredo","sequence":"additional","affiliation":[]},{"given":"Maria Jo\u00e3o","family":"Rosa","sequence":"additional","affiliation":[]},{"given":"Paula","family":"Rocha","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2019,7,4]]},"reference":[{"key":"9035_CR1","volume-title":"Knowledge exchange between academics and the business, public and third sectors","author":"M Abreu","year":"2009","unstructured":"Abreu, M., Grinevich, V., Hughes, A., & Kitson, M. (2009). Knowledge exchange between academics and the business, public and third sectors. London: University of Cambridge and Imperial College London."},{"key":"9035_CR2","volume-title":"The use of performance indicators in higher education: The challenge of the quality movement","author":"M Cave","year":"1997","unstructured":"Cave, M., Hanney, S., Henkel, M., & Kogan, M. (1997). The use of performance indicators in higher education: The challenge of the quality movement. London: Jessica Kingsley."},{"key":"9035_CR3","unstructured":"E3M (2010). \u201cNeeds and constraints analysis of the three dimensions of third mission activities\u201d, E3M: European indicators and ranking methodology for university third mission. \nwww.e3mproject.eu\/docs\/Three-dim-third-mission-act.pdf\n\n. Accessed 12 March 2018."},{"key":"9035_CR4","first-page":"165","volume-title":"Metodologia das Ci\u00eancias Sociais","author":"V Ferreira","year":"1999","unstructured":"Ferreira, V. (1999). O Inqu\u00e9rito por Question\u00e1rio na Constru\u00e7\u00e3o de Dados Sociol\u00f3gicos. In A. S. Silva & J. M. Pinto (Eds.), Metodologia das Ci\u00eancias Sociais (pp. 165\u2013196). Porto: Edi\u00e7\u00f5es Afrontamento."},{"key":"9035_CR5","volume-title":"Policy challenges for the Portuguese polytechnic sector: A report for the Portuguese polytechnics coordinating council (CCISP)","author":"J File","year":"2013","unstructured":"File, J., de Weert, E., Vossensteyn, H., Kaiser, F., Jongbloed, B., Goedegebuure, L., et al. (2013). Policy challenges for the Portuguese polytechnic sector: A report for the Portuguese polytechnics coordinating council (CCISP). Twente: CHEPS."},{"key":"9035_CR6","volume-title":"The new production of knowledge: The dynamics of science and research in contemporary societies","author":"M Gibbons","year":"1994","unstructured":"Gibbons, M., Nowotny, H., Schwartzman, S., Trow, M., Limoges, C., & Scott, P. (1994). The new production of knowledge: The dynamics of science and research in contemporary societies. London: Sage."},{"issue":"4","key":"9035_CR7","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1016\/j.techfore.2005.09.005","volume":"73","author":"T Gordon","year":"2006","unstructured":"Gordon, T., & Pease, A. (2006). RT Delphi: An efficient, \u201cround-less\u201d almost real time Delphi method. Technological Forecasting and Social Change, 73(4), 321\u2013333.","journal-title":"Technological Forecasting and Social Change"},{"key":"9035_CR8","doi-asserted-by":"publisher","first-page":"1695","DOI":"10.1016\/j.techfore.2011.04.005","volume":"78","author":"F Hasson","year":"2011","unstructured":"Hasson, F., & Keeney, S. (2011). Enhancing rigour in the Delphi technique research. Technological Forecasting and Social Change, 78, 1695\u20131704.","journal-title":"Technological Forecasting and Social Change"},{"key":"9035_CR9","first-page":"1","volume":"12","author":"C-C Hsu","year":"2007","unstructured":"Hsu, C.-C., & Sandford, B. A. (2007). The Delphi technique: Making sense of consensus. Practical Assessment, Research & Evaluation, 12, 1\u20138.","journal-title":"Practical Assessment, Research & Evaluation"},{"issue":"3","key":"9035_CR10","doi-asserted-by":"publisher","first-page":"723","DOI":"10.1093\/cje\/bes017","volume":"36","author":"A Hughes","year":"2012","unstructured":"Hughes, A., & Kitson, M. (2012). Pathways to impact and the strategic role of universities: New evidence on the breadth and depth of university knowledge exchange in the UK and the factors constraining its development. Cambridge Journal of Economics, 36(3), 723\u2013750.","journal-title":"Cambridge Journal of Economics"},{"issue":"3","key":"9035_CR11","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1080\/0379772042000331679","volume":"29","author":"S Kyvik","year":"2004","unstructured":"Kyvik, S. (2004). Structural changes in higher education systems in Western Europe. Higher Education in Europe, 29(3), 393\u2013409.","journal-title":"Higher Education in Europe"},{"issue":"5","key":"9035_CR12","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1016\/j.techfore.2005.09.002","volume":"73","author":"J Landeta","year":"2006","unstructured":"Landeta, J. (2006). Current validity of the Delphi method in social sciences. Technological Forecasting and Social Change, 73(5), 467\u2013482.","journal-title":"Technological Forecasting and Social Change"},{"key":"9035_CR13","unstructured":"Linstone, H. A., & Turoff, M. (Eds.) (2002). The Delphi method: Techniques and applications. New Jersey: \u201cAuthors\u201d."},{"key":"9035_CR14","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1007\/978-1-4020-8335-8_12","volume-title":"Non-university higher education in Europe","author":"M d L Machado","year":"2008","unstructured":"Machado, M. d. L., Brites Ferreira, J., Santiago, R., & Taylor, J. (2008). Reframing the non-university sector in Europe: Convergence or diversity? In J. Taylor, J. Brites Ferreira, M. d. L. Machado, & R. Santiago (Eds.), Non-university higher education in Europe (pp. 245\u2013260). Dordrecht: Springer."},{"key":"9035_CR15","first-page":"81","volume-title":"Incentives and performance","author":"AI Melo","year":"2015","unstructured":"Melo, A. I., & Sarrico, C. S. (2015). Performance management systems and their influence on the governance structures of Portuguese universities: A case study. In I. M. Welpe, J. Wollersheim, S. Ringelhan, & M. Osterloh (Eds.), Incentives and performance (pp. 81\u201397). Cham: Springer International Publishing Switzerland."},{"issue":"2","key":"9035_CR16","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1080\/14719031003616479","volume":"12","author":"AI Melo","year":"2010","unstructured":"Melo, A. I., Sarrico, C. S., & Radnor, Z. (2010). The influence of performance management systems on key actors in universities. Public Management Review, 12(2), 233\u2013254.","journal-title":"Public Management Review"},{"key":"9035_CR17","volume-title":"Programa de moderniza\u00e7\u00e3o e valoriza\u00e7\u00e3o dos institutos superiores polit\u00e9cnicos","author":"Minist\u00e9rio da Ci\u00eancia, Tecnologia e Ensino Superior","year":"2015","unstructured":"Minist\u00e9rio da Ci\u00eancia, Tecnologia e Ensino Superior. (2015). Programa de moderniza\u00e7\u00e3o e valoriza\u00e7\u00e3o dos institutos superiores polit\u00e9cnicos. Lisboa: Minist\u00e9rio da Ci\u00eancia, Tecnologia e Ensino Superior."},{"issue":"2","key":"9035_CR18","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1080\/03075077912331376927","volume":"4","author":"G Neave","year":"1979","unstructured":"Neave, G. (1979). Academic drift: Some views from Europe. Studies in Higher Education, 4(2), 143\u2013159.","journal-title":"Studies in Higher Education"},{"key":"9035_CR19","doi-asserted-by":"crossref","unstructured":"Perkmann, M., Tartari, V., McKelvey, M., Autio, E., Brostr\u00f6m, A., D\u2019Este, P., et al. (2013). Academic engagement and commercialisation: A review of the literature on university-industry relations. Research Policy, 42, 423\u2013442.","DOI":"10.1016\/j.respol.2012.09.007"},{"key":"9035_CR20","volume-title":"Public management reform","author":"C Pollitt","year":"2011","unstructured":"Pollitt, C., & Bouckaert, C. (2011). Public management reform. Oxford: Oxford University Press."},{"key":"9035_CR21","volume-title":"Assessment framework and guidance on submissions","author":"REF 2014","year":"2011","unstructured":"REF 2014. (2011). Assessment framework and guidance on submissions. Bristol: REF."},{"key":"9035_CR22","volume-title":"Funding systems and their effects on higher education systems \u2013 Country study \u2013 Portugal","author":"M Rosa","year":"2006","unstructured":"Rosa, M., Tavares, D., & Amaral, A. (2006). Funding systems and their effects on higher education systems \u2013 Country study \u2013 Portugal. Paris: OECD."},{"issue":"1","key":"9035_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11518-006-0151-5","volume":"13","author":"TL Saaty","year":"2004","unstructured":"Saaty, T. L. (2004). Decision making \u2013 The analytic hierarchy and network processes (ahp\/anp). Journal of Systems Science and Systems Engineering, 13(1), 1\u201335.","journal-title":"Journal of Systems Science and Systems Engineering"},{"issue":"2","key":"9035_CR24","first-page":"223","volume":"48","author":"E-M Samfira","year":"2015","unstructured":"Samfira, E.-M., & Ra\u0163\u0103, G. (2015). Assessing education needs at tertiary level: The focus group method. Animal Science and Biotechnologies, 48(2), 223\u2013227.","journal-title":"Animal Science and Biotechnologies"},{"key":"9035_CR25","unstructured":"Sarrico, C. (2010). Indicadores de Desempenho para Apoiar os Processos de Avalia\u00e7\u00e3o e Acredita\u00e7\u00e3o de Cursos. Lisboa: Gabinete de Estudos e An\u00e1lise, A3ES."},{"key":"9035_CR26","unstructured":"Stokes, D. E. (1997). Pasteur's quadrant: Basic science and technological innovation. Brookings Institution Press."},{"issue":"2","key":"9035_CR27","first-page":"119","volume":"8","author":"AS Tec\u0103u","year":"2015","unstructured":"Tec\u0103u, A. S., & Tesca\u015fiu, B. (2015). Nonverbal communication in the focus-group. Bulletin of the Transilvania University of Brasov \u2013 Series V: Economic Sciences, 8(2), 119\u2013125.","journal-title":"Bulletin of the Transilvania University of Brasov \u2013 Series V: Economic Sciences"},{"volume-title":"Public vices, private virtues \u2013 Assessing the effects of marketization in higher education","year":"2011","key":"9035_CR28","unstructured":"Teixeira, P., & Dill, D. (Eds.). (2011). Public vices, private virtues \u2013 Assessing the effects of marketization in higher education. Rotterdam: Sense Publishers."},{"issue":"1","key":"9035_CR29","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1080\/00220620.2015.974143","volume":"47","author":"M Tight","year":"2015","unstructured":"Tight, M. (2015). Theory development and application in higher education research: The case of academic drift. Journal of Educational Administration and History, 47(1), 84\u201399.","journal-title":"Journal of Educational Administration and History"},{"key":"9035_CR30","unstructured":"Van Vught, F. & Ziegele, F., (2010). U-Multirank: Design and testing the feasibility of a multi-dimensional global university ranking. Twente: University of Twente, CHEPS. \nhttps:\/\/www.eurashe.eu\/library\/modernising-phe\/mobility\/quality\/WG4%20R%20multirank_en%20final.pdf\n\n. Accessed 12 March 2018."},{"key":"9035_CR31","unstructured":"Van Vught, F,. Kaiser, F., File, J., Gaethgens, C., & D. Westerheijden (2010). U-Map: The European Classification of Higher Education Institutions. Twente, University of Twente, \nhttps:\/\/ris.utwente.nl\/ws\/portalfiles\/portal\/5141399\/U-MAP_final_report.pdf\n\n. CHEPS. Accessed 12 March 2018."},{"issue":"12","key":"9035_CR32","first-page":"54","volume":"1","author":"J Wright","year":"2000","unstructured":"Wright, J., & Giovinazzo, R. (2000). Delphi \u2013 Uma ferramenta de apoio ao planejamento prospectivo (Delphi \u2013 A support tool towards prospective planning). Cadernos de Pesquisas em Administra\u00e7\u00e3o, 1(12), 54\u201365.","journal-title":"Cadernos de Pesquisas em Administra\u00e7\u00e3o"}],"container-title":["Tertiary Education and Management"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11233-019-09035-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11233-019-09035-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11233-019-09035-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,8,25]],"date-time":"2020-08-25T08:05:27Z","timestamp":1598342727000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11233-019-09035-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,4]]},"references-count":32,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,9]]}},"alternative-id":["9035"],"URL":"https:\/\/doi.org\/10.1007\/s11233-019-09035-y","relation":{},"ISSN":["1358-3883","1573-1936"],"issn-type":[{"type":"print","value":"1358-3883"},{"type":"electronic","value":"1573-1936"}],"subject":[],"published":{"date-parts":[[2019,7,4]]},"assertion":[{"value":"2 May 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 May 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 July 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}