{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T00:55:11Z","timestamp":1776905711444,"version":"3.51.2"},"reference-count":70,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2022,2,21]],"date-time":"2022-02-21T00:00:00Z","timestamp":1645401600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,2,21]],"date-time":"2022-02-21T00:00:00Z","timestamp":1645401600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004834","name":"Universitat Jaume I","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004834","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2022,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The knowledge and stance of researchers regarding bibliometric indicators is a field of study that has gained weight in recent decades. In this paper we address this issue for the little explored areas of philosophy and ethics, and applied to a context, in this case Spain, where bibliometric indicators are widely used in evaluation processes. The study combines data from a self-administered questionnaire completed by 201 researchers and from 14 in-depth interviews with researchers selected according to their affiliation, professional category, gender and area of knowledge. The survey data suggest that researchers do not consider bibliometric indicators a preferred criterion of quality, while there is a fairly high self-perception of awareness of a number of indicators. The qualitative data points to a generalised perception of a certain rejection of the specific use of indicators, with four main positions being observed: (1) disqualification of the logic of metrics, (2) scepticism about the possibility of assessing quality with quantitative methods, (3) complaints about the incorporation of methods that are considered to belong to other disciplines, and (4) criticism of the consequences that this generates in the discipline of philosophy.<\/jats:p>","DOI":"10.1007\/s11192-022-04265-1","type":"journal-article","created":{"date-parts":[[2022,2,21]],"date-time":"2022-02-21T22:03:11Z","timestamp":1645480991000},"page":"2085-2103","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Philosophers\u2019 appraisals of bibliometric indicators and their use in evaluation: from recognition to knee-jerk rejection"],"prefix":"10.1007","volume":"127","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4775-8762","authenticated-orcid":false,"given":"Ram\u00f3n A.","family":"Feenstra","sequence":"first","affiliation":[]},{"given":"Emilio","family":"Delgado L\u00f3pez-C\u00f3zar","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,2,21]]},"reference":[{"issue":"2","key":"4265_CR1","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1093\/reseval\/rvv003","volume":"24","author":"K Aagaard","year":"2015","unstructured":"Aagaard, K., Bloch, C., & Schneider, J. W. (2015). Impacts of performance-based research funding systems: The case of the Norwegian Publication Indicator. Research Evaluation, 24(2), 106\u2013117. https:\/\/doi.org\/10.1093\/reseval\/rvv003","journal-title":"Research Evaluation"},{"issue":"6","key":"4265_CR2","doi-asserted-by":"publisher","first-page":"895","DOI":"10.1016\/j.respol.2009.02.001","volume":"38","author":"DW Aksnes","year":"2009","unstructured":"Aksnes, D. W., & Rip, A. (2009). Researchers\u2019 perceptions of citations. Research Policy, 38(6), 895\u2013905. https:\/\/doi.org\/10.1016\/j.respol.2009.02.001","journal-title":"Research Policy"},{"key":"4265_CR3","unstructured":"ANECA. (2019). M\u00e9ritos evaluables para la acreditaci\u00f3n nacional para el acceso a los cuerpos docentes universitarios: c\u00e1tedra de universidad. Ciencias Sociales. Madrid. Retrieved 18 July 2021, from: https:\/\/www.educacionyfp.gob.es\/dam\/jcr:d23eb60f-fa48-4f25-a6d3-342d3056f3f3\/criterios-sociales-juridicas.pdf"},{"issue":"3","key":"4265_CR4","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1007\/s11192-006-0115-z","volume":"68","author":"\u00c9 Archambault","year":"2006","unstructured":"Archambault, \u00c9., Vignola-Gagn\u00e9, \u00c9., C\u00f4t\u00e9, G., Lariviere, V., & Gingrasb, Y. (2006). Benchmarking scientific output in the social sciences and humanities: The limits of existing databases. Scientometrics, 68(3), 329\u2013342. https:\/\/doi.org\/10.1007\/s11192-006-0115-z","journal-title":"Scientometrics"},{"issue":"8","key":"4265_CR5","doi-asserted-by":"publisher","first-page":"872","DOI":"10.1002\/asi.24162","volume":"70","author":"HH Aung","year":"2019","unstructured":"Aung, H. H., Zheng, H., Erdt, M., Aw, A. S., Sin, S.-C.J., & Theng, Y.-L. (2019). Investigating familiarity and usage of traditional metrics and altmetrics. Journal of the Association for Information Science and Technology, 70(8), 872\u2013887. https:\/\/doi.org\/10.1002\/asi.24162","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"4","key":"4265_CR6","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1177\/1350508411403531","volume":"18","author":"JA Baum","year":"2011","unstructured":"Baum, J. A. (2011). Free-riding on power laws: Questioning the validity of the impact factor as a measure of research quality in organization studies. Organization, 18(4), 449\u2013466. https:\/\/doi.org\/10.1177\/1350508411403531","journal-title":"Organization"},{"key":"4265_CR7","doi-asserted-by":"publisher","DOI":"10.1093\/reseval\/rvaa021","author":"N Bautista-Puig","year":"2020","unstructured":"Bautista-Puig, N., Moreno Lorente, L., & Sanz-Casado, E. (2020). Proposed methodology for measuring the effectiveness of policies designed to further research. Research Evaluation. https:\/\/doi.org\/10.1093\/reseval\/rvaa021","journal-title":"Research Evaluation"},{"key":"4265_CR8","doi-asserted-by":"publisher","unstructured":"Bayer, F., Gorraiz, J., Gumpenberger, C., It\u00farbide, A., Iribarren-Maestro, I., & Reding, S. (2019). Investigating SSH research and publication practices in disciplinary and institutional contexts. A survey-based comparative approach in two universities.\u00a0Frontiers in Research Metrics and Analytics,\u00a04, 1. https:\/\/doi.org\/10.3389\/frma.2019.00001.","DOI":"10.3389\/frma.2019.00001"},{"key":"4265_CR9","unstructured":"BOE. (2015). Ministerio de Educaci\u00f3n, Cultura y Deporte, 17\/6\/2015, p. 50319\u201350337 https:\/\/www.boe.es\/buscar\/doc.php?id=BOE-A-2015-6705."},{"key":"4265_CR10","doi-asserted-by":"publisher","unstructured":"Borrego, \u00c1., & Urbano, C. (2006). La evaluaci\u00f3n de revistas cient\u00edficas en Ciencias Sociales y Humanidades. Informaci\u00f3n, cultura y sociedad, 14, 11\u201327. https:\/\/doi.org\/10.34096\/ics.i14.886.","DOI":"10.34096\/ics.i14.886"},{"issue":"2","key":"4265_CR11","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1007\/s11192-012-0676-y","volume":"92","author":"G Buela-Casal","year":"2012","unstructured":"Buela-Casal, G., & Zych, I. (2012). What do the scientists think about the impact factor? Scientometrics, 92(2), 281\u2013292. https:\/\/doi.org\/10.1007\/s11192-012-0676-y","journal-title":"Scientometrics"},{"key":"4265_CR12","doi-asserted-by":"publisher","unstructured":"Butler, L. (2004). What happens when funding is linked to publication counts? In\u00a0Handbook of quantitative science and technology research\u00a0(pp. 389\u2013405). Springer. https:\/\/doi.org\/10.1007\/1-4020-2755-9_18.","DOI":"10.1007\/1-4020-2755-9_18"},{"issue":"1","key":"4265_CR13","doi-asserted-by":"publisher","first-page":"39","DOI":"10.3152\/147154403781776780","volume":"12","author":"L Butler","year":"2003","unstructured":"Butler, L. (2003). Modifying publication practices in response to funding formulas. Research Evaluation, 12(1), 39\u201346. https:\/\/doi.org\/10.3152\/147154403781776780","journal-title":"Research Evaluation"},{"issue":"8","key":"4265_CR14","doi-asserted-by":"publisher","first-page":"565","DOI":"10.3152\/030234207X254404","volume":"34","author":"L Butler","year":"2007","unstructured":"Butler, L. (2007). Assessing university research: A plea for a balanced approach. Science and Public Policy, 34(8), 565\u2013574. https:\/\/doi.org\/10.3152\/030234207X254404","journal-title":"Science and Public Policy"},{"issue":"6","key":"4265_CR15","doi-asserted-by":"publisher","first-page":"775","DOI":"10.1093\/scipol\/scy025","volume":"45","author":"C Ca\u00f1ibano","year":"2018","unstructured":"Ca\u00f1ibano, C., Vilardell, I., Corona, C., & Benito-Amat, C. (2018). The evaluation of research excellence and the dynamics of knowledge production in the humanities: The case of history in Spain. Science and Public Policy, 45(6), 775\u2013789. https:\/\/doi.org\/10.1093\/scipol\/scy025","journal-title":"Science and Public Policy"},{"key":"4265_CR16","unstructured":"Delgado-L\u00f3pez-C\u00f3zar, E. (2010). Claroscuros de la evaluaci\u00f3n cient\u00edfica en Espa\u00f1a. Medes: Medicina en Espa\u00f1ol, 4, 25\u201329."},{"key":"4265_CR17","unstructured":"Delgado-L\u00f3pez-C\u00f3zar, E.; Feenstra, R.A.; Pallar\u00e9s-Dom\u00ednguez, D. (2020). Investigaci\u00f3n en \u00c9tica y Filosof\u00eda en Espa\u00f1a. Asociaci\u00f3n Espa\u00f1ola de \u00c9tica y Filosof\u00eda Pol\u00edtica, Sociedad Acad\u00e9mica de Filosof\u00eda, Red Espa\u00f1ola de Filosof\u00eda. Retrieved 13 May 2021, from: http:\/\/hdl.handle.net\/10234\/189924"},{"key":"4265_CR18","unstructured":"Derrick, G. E., & Gillespie, J. (2013). \u2018A number you just can\u2019t get away from\u2019: Characteristics of adoption and the social construction of metrics use by researchers. In Hinze, S. & Lottman, A. (Eds.) Proceedings of the 18th international conference on science and technology indicators (pp. 104\u2013116)"},{"issue":"5","key":"4265_CR19","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1093\/scipol\/sct007","volume":"40","author":"GE Derrick","year":"2013","unstructured":"Derrick, G. E., & Pavone, V. (2013). Democratising research evaluation: Achieving greater public engagement with bibliometrics-informed peer review. Science and Public Policy, 40(5), 563\u2013575. https:\/\/doi.org\/10.1093\/scipol\/sct007","journal-title":"Science and Public Policy"},{"key":"4265_CR70","doi-asserted-by":"publisher","unstructured":"Feenstra, R., Delgado L\u00f3pez-C\u00f3zar, E., & Pallar\u00e9s-Dom\u00ednguez, D. (2021). Research misconduct in the fields of ethics and philosophy: Researchers\u2019 perceptions in Spain. Science and Engineering Ethics, 27(1), 1\u201321. https:\/\/doi.org\/10.1007\/s11948-021-00278-w","DOI":"10.1007\/s11948-021-00278-w"},{"key":"4265_CR20","doi-asserted-by":"crossref","unstructured":"Feenstra, R. A., & L\u00f3pez-C\u00f3zar, E. D. (2021a). The footprint of a metrics-based research evaluation system on Spanish philosophical scholarship: An analysis of researchers perceptions. ArXiv, 2103.11987. (https:\/\/arxiv.org\/abs\/2103.11987).","DOI":"10.1093\/reseval\/rvac020"},{"key":"4265_CR21","doi-asserted-by":"publisher","unstructured":"Feenstra, R. A., & L\u00f3pez-C\u00f3zar, E. D. (2021b). Spanish philosophers perceptions of pay to publish and open access: books versus journals, more than a financial dilemma. Learned Publishing, 1\u201312. https:\/\/doi.org\/10.1002\/leap.1426 (online first)","DOI":"10.1002\/leap.1426"},{"key":"4265_CR22","unstructured":"Fern\u00e1ndez Esquinas, M., D\u00edaz Catal\u00e1n, C., & Ramos Vielba, I. (2011). Evaluaci\u00f3n y pol\u00edtica cient\u00edfica en Espa\u00f1a: el origen y la implantaci\u00f3n de las pr\u00e1cticas de evaluaci\u00f3n cient\u00edfica en el sistema p\u00fablico de I+ D (1975\u20131994). In: Gonz\u00e1lez de la Fe, T., & L\u00f3pez Pel\u00e1ez, A. (eds) Innovaci\u00f3n, conocimiento cient\u00edfico y cambio social: ensayos de sociolog\u00eda ib\u00e9rica de la ciencia y la tecnolog\u00eda (pp. 93\u2013130). Centro de Investigaciones Sociol\u00f3gicas."},{"key":"4265_CR23","first-page":"148","volume-title":"Radiograf\u00eda de la investigaci\u00f3n p\u00fablica en Espa\u00f1a","author":"M Fern\u00e1ndez Esquinas","year":"2006","unstructured":"Fern\u00e1ndez Esquinas, M., P\u00e9rez Yruela, M., & Merch\u00e1n Hern\u00e1ndez, C. (2006). El sistema de incentivos y recompensas en la ciencia p\u00fablica espa\u00f1ola. In J. Sebasti\u00e1n & E. Mu\u00f1oz (Eds.), Radiograf\u00eda de la investigaci\u00f3n p\u00fablica en Espa\u00f1a (pp. 148\u2013206). Biblioteca Nueva."},{"key":"4265_CR24","doi-asserted-by":"publisher","unstructured":"Galleron, I., Ochsner, M., Spaapen, J., & Williams, G. (2017). Valorizing SSH research: Towards a new approach to evaluate SSH research\u2019s value for society.\u00a0fteval Journal for Research and Technology Policy Evaluation,\u00a044, 35\u201341. https:\/\/doi.org\/10.22163\/fteval.2017.274.","DOI":"10.22163\/fteval.2017.274"},{"issue":"1","key":"4265_CR25","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1086\/629874","volume":"50","author":"E Garfield","year":"1980","unstructured":"Garfield, E. (1980). Is information retrieval in the arts and humanities inherently different from that in science? The effect that ISI\u2019s citation index for the arts and humanities is expected to have on future scholarship. The Library Quarterly, 50(1), 40\u201357. https:\/\/doi.org\/10.1086\/629874","journal-title":"The Library Quarterly"},{"issue":"4","key":"4265_CR26","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1023\/B:MINE.0000005155.70870.bd","volume":"41","author":"A Geuna","year":"2003","unstructured":"Geuna, A., & Martin, B. R. (2003). University research evaluation and funding: An international comparison. Minerva, 41(4), 277\u2013304. https:\/\/doi.org\/10.1023\/B:MINE.0000005155.70870.bd","journal-title":"Minerva"},{"key":"4265_CR27","volume-title":"El malestar de los investigadores ante su evaluaci\u00f3n","author":"E Gim\u00e9nez-Toledo","year":"2016","unstructured":"Gim\u00e9nez-Toledo, E. (2016). El malestar de los investigadores ante su evaluaci\u00f3n. Iberoamericana."},{"issue":"22","key":"4265_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/publications9020022","volume":"9","author":"AV Grin\u00ebv","year":"2021","unstructured":"Grin\u00ebv, A. V., Bylieva, D. S., & Lobatyuk, V. V. (2021). Russian university teachers\u2019 perceptions of scientometrics. Publications, 9(22), 1\u201316. https:\/\/doi.org\/10.3390\/publications9020022","journal-title":"Publications"},{"issue":"1","key":"4265_CR29","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1002\/asi.24097","volume":"70","author":"G Haddow","year":"2019","unstructured":"Haddow, G., & Hammarfelt, B. (2019). Quality, impact, and quantification: Indicators and metrics use by social scientists. Journal of the Association for Information Science and Technology, 70(1), 16\u201326. https:\/\/doi.org\/10.1002\/asi.24097","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"5","key":"4265_CR30","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1002\/bul2.2017.1720430508","volume":"43","author":"B Hammarfelt","year":"2017","unstructured":"Hammarfelt, B. (2017). Four claims on research assessment and metric use in the humanities. Bulletin of the Association for Information Science and Technology, 43(5), 33\u201338. https:\/\/doi.org\/10.1002\/bul2.2017.1720430508","journal-title":"Bulletin of the Association for Information Science and Technology"},{"issue":"7","key":"4265_CR31","doi-asserted-by":"publisher","first-page":"924","DOI":"10.1002\/asi.24043","volume":"69","author":"B Hammarfelt","year":"2018","unstructured":"Hammarfelt, B., & Haddow, G. (2018). Conflicting measures and values: How humanities scholars in Australia and Sweden use and react to bibliometric indicators. Journal of the Association for Information Science and Technology, 69(7), 924\u2013935. https:\/\/doi.org\/10.1002\/asi.24043","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"3","key":"4265_CR32","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1093\/reseval\/rvx018","volume":"26","author":"B Hammarfelt","year":"2017","unstructured":"Hammarfelt, B., & Rushforth, A. D. (2017). Indicators as judgment devices: An empirical study of citizen bibliometrics in research evaluation. Research Evaluation, 26(3), 169\u2013180. https:\/\/doi.org\/10.1093\/reseval\/rvx018","journal-title":"Research Evaluation"},{"key":"4265_CR33","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1016\/0049-089x(90)90006-5","volume":"19","author":"LL Hargens","year":"1990","unstructured":"Hargens, L. L., & Schuman, H. (1990). Citation counts and social comparisons: Scientists\u2019 use and evaluation of citation index data. Social Science Research, 19, 205\u2013222. https:\/\/doi.org\/10.1016\/0049-089x(90)90006-5","journal-title":"Social Science Research"},{"key":"4265_CR34","doi-asserted-by":"publisher","unstructured":"Hicks, D. (2004). The four literatures of social sciences. In Moed, H. Gl\u00e4nzel, W. & Schmoch, U. (eds.), The handbook of quantitative science and technology research (pp. 473\u2013496). Kluwer. https:\/\/doi.org\/10.1007\/1-4020-2755-9_22.","DOI":"10.1007\/1-4020-2755-9_22"},{"key":"4265_CR35","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1007\/bf02457380","volume":"44","author":"D Hicks","year":"1999","unstructured":"Hicks, D. (1999). The difficulty of achieving full coverage of international social science literature and the bibliometric consequences. Scientometrics, 44, 193\u2013215. https:\/\/doi.org\/10.1007\/bf02457380","journal-title":"Scientometrics"},{"issue":"7548","key":"4265_CR36","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1038\/520429a","volume":"520","author":"D Hicks","year":"2015","unstructured":"Hicks, D., Wouters, P., Waltman, L., De Rijcke, S., & Rafols, I. (2015). Bibliometrics: The Leiden Manifesto for research metrics. Nature News, 520(7548), 429. https:\/\/doi.org\/10.1038\/520429a","journal-title":"Nature News"},{"issue":"1","key":"4265_CR37","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/978-3-658-05969-9_13","volume":"10","author":"SE Hug","year":"2014","unstructured":"Hug, S. E., Ochsner, M., & Daniel, H. D. (2014). A framework to explore and develop criteria for assessing research quality in the humanities. International Journal of Education Law and Policy, 10(1), 55\u201368. https:\/\/doi.org\/10.1007\/978-3-658-05969-9_13","journal-title":"International Journal of Education Law and Policy"},{"key":"4265_CR38","doi-asserted-by":"publisher","unstructured":"Jamali, H. R., Nicholas, D., Herman, E., Boukacem\u2010Zeghmouri, C., Abrizah, A., Rodr\u00edguez\u2010Bravo, B., Xu, J., \u015awigon\u2019, M., Polezhaeva, T., & Watkinson, A. (2020). National comparisons of early career researchers' scholarly communication attitudes and behaviours. Learned Publishing, 33(4), 370\u2013384. https:\/\/doi.org\/10.1002\/leap.1313.","DOI":"10.1002\/leap.1313"},{"issue":"1","key":"4265_CR39","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1016\/S0048-7333(02)00008-2","volume":"32","author":"E Jim\u00e9nez-Contreras","year":"2003","unstructured":"Jim\u00e9nez-Contreras, E., de Moya Aneg\u00f3n, F., & Delgado-L\u00f3pez-C\u00f3zar, E. (2003). The evolution of research activity in Spain: The impact of the National Commission for the Evaluation of Research Activity (CNEAI). Research Policy, 32(1), 123\u2013142. https:\/\/doi.org\/10.1016\/S0048-7333(02)00008-2","journal-title":"Research Policy"},{"issue":"6892","key":"4265_CR40","doi-asserted-by":"publisher","first-page":"898","DOI":"10.1038\/417898b","volume":"417","author":"E Jim\u00e9nez-Contreras","year":"2002","unstructured":"Jim\u00e9nez-Contreras, E., Delgado-L\u00f3pez-C\u00f3zar, E., Ruiz-P\u00e9rez, R., & Fern\u00e1ndez, V. M. (2002). Impact-factor rewards affect Spanish research. Nature, 417(6892), 898\u2013898. https:\/\/doi.org\/10.1038\/417898b","journal-title":"Nature"},{"issue":"3","key":"4265_CR41","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1080\/13600800600980130","volume":"28","author":"G Laudel","year":"2006","unstructured":"Laudel, G., & Gl\u00e4ser, J. (2006). Tensions between evaluations and communication practices. Journal of Higher Education Policy and Management, 28(3), 289\u2013295. https:\/\/doi.org\/10.1080\/13600800600980130","journal-title":"Journal of Higher Education Policy and Management"},{"key":"4265_CR42","doi-asserted-by":"publisher","first-page":"777","DOI":"10.1002\/asi.24445","volume":"72","author":"S Lemke","year":"2021","unstructured":"Lemke, S., Mazarakis, A., & Peters, I. (2021). Conjoint analysis of researchers\u2019 hidden preferences for bibliometrics, Altmetrics, and usage metrics. Journal of the Association for Information Science and Technology., 72, 777\u2013792. https:\/\/doi.org\/10.1002\/asi.24445","journal-title":"Journal of the Association for Information Science and Technology."},{"issue":"2","key":"4265_CR43","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1080\/21568235.2018.1428649","volume":"8","author":"G Marini","year":"2018","unstructured":"Marini, G. (2018). Tools of individual evaluation and prestige recognition in Spain: How sexenio \u2018mints the golden coin of authority.\u2019 European Journal of Higher Education, 8(2), 201\u2013214. https:\/\/doi.org\/10.1080\/21568235.2018.1428649","journal-title":"European Journal of Higher Education"},{"key":"4265_CR44","doi-asserted-by":"publisher","first-page":"2175","DOI":"10.1007\/s11192-018-2820-9","volume":"116","author":"A Mart\u00edn-Mart\u00edn","year":"2018","unstructured":"Mart\u00edn-Mart\u00edn, A., Ordu\u00f1a-Malea, E., & Delgado L\u00f3pez-C\u00f3zar, E. (2018). Coverage of highly-cited documents in Google Scholar, Web of Science, and Scopus: A multidisciplinary comparison. Scientometrics, 116, 2175\u20132188. https:\/\/doi.org\/10.1007\/s11192-018-2820-9","journal-title":"Scientometrics"},{"key":"4265_CR45","doi-asserted-by":"publisher","first-page":"871","DOI":"10.1007\/s11192-020-03690-4","volume":"126","author":"A Mart\u00edn-Mart\u00edn","year":"2021","unstructured":"Mart\u00edn-Mart\u00edn, A., Thelwall, M., Orduna-Malea, E., & Delgado-L\u00f3pez-C\u00f3zar, E. (2021). Google scholar, microsoft academic, scopus, dimensions, web of science, and OpenCitations\u2019 COCI: A multidisciplinary comparison of coverage via citations. Scientometrics, 126, 871\u2013906. https:\/\/doi.org\/10.1007\/s11192-020-03690-4","journal-title":"Scientometrics"},{"key":"4265_CR46","volume-title":"Citation analysis in research evaluation","author":"HF Moed","year":"2005","unstructured":"Moed, H. F. (2005). Citation analysis in research evaluation. Springer."},{"key":"4265_CR47","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1038\/381186a0","volume":"381","author":"HF Moed","year":"1996","unstructured":"Moed, H. F., & Van Leeuwen, T. N. (1996). Impact Factors Can Mislead. Nature, 381, 186. https:\/\/doi.org\/10.1038\/381186a0","journal-title":"Nature"},{"key":"4265_CR48","doi-asserted-by":"publisher","unstructured":"Molas-Gallart, J. (2012). Research Governance and the Role of Evaluation. A Comparative Study. American Journal of Evaluation, 33(4), 583\u2013598. https:\/\/doi.org\/10.1177\/1098214012450938.","DOI":"10.1177\/1098214012450938"},{"issue":"1","key":"4265_CR49","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1515\/opis-2018-0013","volume":"2","author":"B Narayan","year":"2018","unstructured":"Narayan, B., Luca, E. J., Tiffen, B., England, A., Booth, M., & Boateng, H. (2018). Scholarly communication practices in humanities and social sciences: A study of researchers\u2019 attitudes and awareness of open access. Open Information Science, 2(1), 168\u2013180. https:\/\/doi.org\/10.1515\/opis-2018-0013","journal-title":"Open Information Science"},{"issue":"1","key":"4265_CR50","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1007\/s11192-006-0007-2","volume":"66","author":"AJ Nederhof","year":"2006","unstructured":"Nederhof, A. J. (2006). Bibliometric monitoring of research performance in the social sciences and the humanities: A review. Scientometrics, 66(1), 81\u2013100. https:\/\/doi.org\/10.1007\/s11192-006-0007-2","journal-title":"Scientometrics"},{"issue":"3","key":"4265_CR51","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1093\/reseval\/rvaa004","volume":"29","author":"D Nicholas","year":"2020","unstructured":"Nicholas, D., Herman, E., Jamali, H. R., Abrizah, A., Boukacem-Zeghmouri, C., Xu, J., Rodr\u00edguez-Bravo, B., Watkinson, A., Polezhaeva, T., & \u015awigon, M. (2020). Millennial researchers in a metric-driven scholarly world: An international study. Research Evaluation, 29(3), 263\u2013274. https:\/\/doi.org\/10.1093\/reseval\/rvaa004","journal-title":"Research Evaluation"},{"issue":"2","key":"4265_CR52","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1002\/leap.1284","volume":"33","author":"D Nicholas","year":"2020","unstructured":"Nicholas, D., Watkinson, A., Abrizah, A., Rodr\u00edguez-Bravo, B., Boukacem-Zeghmouri, C., Xu, J., \u015awigo\u0144, M., & Herman, E. (2020). Does the scholarly communication system satisfy the beliefs and aspirations of new researchers? Summarizing the Harbingers Research. Learned Publishing, 33(2), 132\u2013141. https:\/\/doi.org\/10.1002\/leap.1284","journal-title":"Learned Publishing"},{"issue":"2","key":"4265_CR53","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1093\/reseval\/rvs039","volume":"22","author":"M Ochsner","year":"2013","unstructured":"Ochsner, M., Hug, S. E., & Daniel, H.-D. (2013). Four Types of research in the humanities: setting the stage for research quality criteria in the humanities. Research Evaluation, 22(2), 79\u201392. https:\/\/doi.org\/10.1093\/reseval\/rvs039","journal-title":"Research Evaluation"},{"issue":"1","key":"4265_CR54","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1057\/palcomms.2017.20","volume":"3","author":"M Ochsner","year":"2017","unstructured":"Ochsner, M., Hug, S., & Galleron, I. (2017). The future of research assessment in the humanities: Bottom-up assessment procedures. Palgrave Communications, 3(1), 1\u201312. https:\/\/doi.org\/10.1057\/palcomms.2017.20","journal-title":"Palgrave Communications"},{"issue":"3","key":"4265_CR55","doi-asserted-by":"publisher","first-page":"575","DOI":"10.1007\/s11192-010-0312-7","volume":"86","author":"C Osuna","year":"2011","unstructured":"Osuna, C., Cruz-Castro, L., & Sanz-Men\u00e9ndez, L. (2011). Overturning some assumptions about the effects of evaluation systems on publication performance. Scientometrics, 86(3), 575\u2013592. https:\/\/doi.org\/10.1007\/s11192-010-0312-7","journal-title":"Scientometrics"},{"key":"4265_CR56","doi-asserted-by":"publisher","unstructured":"Penny, D. (2016). What matters where? Cultural and Geographical Factors in Science. https:\/\/doi.org\/10.6084\/m9.figshare.3969012.v1","DOI":"10.6084\/m9.figshare.3969012.v1"},{"issue":"2","key":"4265_CR57","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1093\/reseval\/rvv038","volume":"25","author":"SD Rijcke","year":"2016","unstructured":"Rijcke, S. D., Wouters, P. F., Rushforth, A. D., Franssen, T. P., & Hammarfelt, B. (2016). Evaluation practices and effects of indicator use\u2014a literature review. Research Evaluation, 25(2), 161\u2013169. https:\/\/doi.org\/10.1093\/reseval\/rvv038","journal-title":"Research Evaluation"},{"issue":"2","key":"4265_CR58","doi-asserted-by":"publisher","DOI":"10.3145\/epi.2019.mar.03","volume":"28","author":"B Rodr\u00edguez-Bravo","year":"2018","unstructured":"Rodr\u00edguez-Bravo, B., & Nicholas, D. (2018). Reputaci\u00f3n y comunicaci\u00f3n cient\u00edfica: Investigadores espa\u00f1oles en el inicio de su carrera. El Profesional De La Informaci\u00f3n, 28(2), e280203. https:\/\/doi.org\/10.3145\/epi.2019.mar.03","journal-title":"El Profesional De La Informaci\u00f3n"},{"issue":"5","key":"4265_CR59","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3145\/epi.2020.sep.03","volume":"29","author":"B Rodr\u00edguez-Bravo","year":"2020","unstructured":"Rodr\u00edguez-Bravo, B., & Nicholas, D. (2020). Descubrir, leer, publicar, compartir y monitorizar el progreso: Comportamiento de los investigadores junior espa\u00f1oles. El Profesional De La Informaci\u00f3n, 29(5), 1\u201316. https:\/\/doi.org\/10.3145\/epi.2020.sep.03","journal-title":"El Profesional De La Informaci\u00f3n"},{"issue":"3","key":"4265_CR60","doi-asserted-by":"publisher","first-page":"480","DOI":"10.3145\/epi.2017.may.14","volume":"26","author":"S Rousseau","year":"2017","unstructured":"Rousseau, S., & Rousseau, R. (2017). Being metric-wise: Heterogeneity in bibliometric knowledge. El Profesional De La Informaci\u00f3n, 26(3), 480\u2013487. https:\/\/doi.org\/10.3145\/epi.2017.may.14","journal-title":"El Profesional De La Informaci\u00f3n"},{"key":"4265_CR61","unstructured":"Sivertsen, G. (2014). Scholarly publication patterns in the social sciences and humanities and their coverage in Scopus and Web of Science. In\u00a0Proceedings of the science and technology indicators conference\u00a0(pp. 598\u2013604). Universiteit Leiden."},{"key":"4265_CR62","doi-asserted-by":"publisher","unstructured":"Thelwall, M., & Kousha, K. (2015). Web indicators for research evaluation. Part 1: Citations and links to academic articles from the Web. El Profesional de la Informaci\u00f3n, 24(5), 587\u2013606. https:\/\/doi.org\/10.3145\/epi.2015.sep.08.","DOI":"10.3145\/epi.2015.sep.08"},{"key":"4265_CR63","doi-asserted-by":"publisher","unstructured":"Thelwall, M. (2018). Altmetric prevalence in the social sciences, arts and humanities: Where are the online discussions? Journal of Altmetrics, 1(1), 4. https:\/\/doi.org\/10.29024\/joa.6.","DOI":"10.29024\/joa.6"},{"issue":"4","key":"4265_CR64","doi-asserted-by":"publisher","first-page":"817","DOI":"10.1108\/JD-02-2015-002","volume":"71","author":"M Thelwall","year":"2015","unstructured":"Thelwall, M., & Delgado, M. M. (2015). Arts and humanities research evaluation: No metrics please, just data. Journal of Documentation. Journal of Documentation, 71(4), 817\u2013833. https:\/\/doi.org\/10.1108\/JD-02-2015-002","journal-title":"Journal of Documentation"},{"key":"4265_CR65","doi-asserted-by":"publisher","unstructured":"van den Akker, W. (2016). Yes we should; research assessment in the humanities. In Ochsner, M.,. Hug, S. E & Daniel H.-D. (Eds.), Research Assessment in the Humanities (pp. 23\u201329). Springer International Publishing. https:\/\/doi.org\/10.1007\/978-3-319-29016-4_3.","DOI":"10.1007\/978-3-319-29016-4_3"},{"key":"4265_CR66","doi-asserted-by":"publisher","unstructured":"Whitley, R. (2007). Changing governance of the public sciences. In Whitley, R. & Gl\u00e4ser, J. (Eds.), The changing governance of the sciences (pp. 3\u201327). Springer. https:\/\/doi.org\/10.1007\/978-1-4020-6746-4_1.","DOI":"10.1007\/978-1-4020-6746-4_1"},{"issue":"4","key":"4265_CR67","doi-asserted-by":"publisher","first-page":"3063","DOI":"10.1007\/s11192-021-03896-0","volume":"126","author":"M Wijewickrema","year":"2021","unstructured":"Wijewickrema, M. (2021). Authors\u2019 perception on abstracting and indexing databases in different subject domains. Scientometrics, 126(4), 3063\u20133089. https:\/\/doi.org\/10.1007\/s11192-021-03896-0","journal-title":"Scientometrics"},{"key":"4265_CR68","doi-asserted-by":"publisher","unstructured":"Wouters, P. (2014). The citation: From culture to infrastructure. In Cronin, B., & Sugimoto C. R. (Eds.), Beyond bibliometrics: Harnessing multidimensional indicators of scholarly impact (pp. 47\u201366). MIT press. https:\/\/doi.org\/10.7551\/mitpress\/9445.003.0006.","DOI":"10.7551\/mitpress\/9445.003.0006"},{"key":"4265_CR69","unstructured":"Wouters, P., Thelwall, M., Kousha, K., Waltman, L., de Rijcke, S., Rushforth, A., & Franssen T. (2015). The metric tide: Literature review. Supplementary report I to the independent review of the role of metrics in research assessment and management. HEFCE."}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04265-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-022-04265-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04265-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,27]],"date-time":"2023-01-27T16:36:02Z","timestamp":1674837362000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-022-04265-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,21]]},"references-count":70,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,4]]}},"alternative-id":["4265"],"URL":"https:\/\/doi.org\/10.1007\/s11192-022-04265-1","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,21]]},"assertion":[{"value":"25 September 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 January 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 February 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no financial or proprietary interests in any material discussed in this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Prior to answering the survey, participants were informed about the nature of the study and that their anonymity would be preserved; they were only asked to state their affiliation, area of knowledge and academic status. Verbal informed consent was obtained from the participants in the interviews. An anonymised summary of the data gathered during the research was shared with the participants and published in an open report. This report has been endorsed by the three main Spanish philosophy and ethics associations: SAF, AEEFP and REF.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical statement"}}]}}