{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T18:15:28Z","timestamp":1754158528399,"version":"3.41.2"},"reference-count":35,"publisher":"Emerald","issue":"1","license":[{"start":{"date-parts":[[2021,1,25]],"date-time":"2021-01-25T00:00:00Z","timestamp":1611532800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["EL"],"published-print":{"date-parts":[[2021,5,18]]},"abstract":"<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title>\n<jats:p>This paper aims to propose a set of quantitative statistical indicators for measuring the scientific relevance of research groups and researchers, based on high-impact open-access digital production repositories.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title>\n<jats:p>An action research (AR) methodology is proposed in which research is associated with the practice; research informs practice and practice is responsible for informing research in a cooperative way. AR is divided into five phases, beginning with the definition of the problematic scenario and an analysis of the state of the art and ending with conducting tests and publishing the results.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Findings<\/jats:title>\n<jats:p>The proposed indicators were used to characterise group and individual output in a major public university in south-eastern Mexico. University campuses hosting a large number of high-impact research groups. These indicators were very useful in generating information that confirmed specific assumptions about the scientific production of the university.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Research limitations\/implications<\/jats:title>\n<jats:p>The data used here were retrieved from Scopus and open access national repository of Mexico. It would be possible to use other data sources to calculate these indicators.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Practical implications<\/jats:title>\n<jats:p>The system used to implement the proposed indicators is independent of any particular technological tool and is based on standards for metadata description and exchange, thus facilitating the easy integration of new elements for evaluation.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Social implications<\/jats:title>\n<jats:p>Many organisations evaluate researchers according to specific criteria, one of which is the prestige of journals. Although the guidelines differ between evaluation bodies, relevance is measured based on elements that can be adapted and where some have greater weight than others, including the prestige of the journal, the degree of collaboration with other researchers and individual production, etc. The proposed indicators can be used by various entities to evaluate researchers and research groups. Each country has its own organisations that are responsible for evaluation, using various criteria based on the impact of the publications.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title>\n<jats:p>The proposed indicators assess based on the importance of the types of publications and the degree of collaborations. However, they can be adapted to other similar scenarios.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/el-06-2020-0160","type":"journal-article","created":{"date-parts":[[2021,2,11]],"date-time":"2021-02-11T22:17:30Z","timestamp":1613081850000},"page":"33-58","source":"Crossref","is-referenced-by-count":2,"title":["An indexing system for the relevance of academic production and research from digital repositories and metadata"],"prefix":"10.1108","volume":"39","author":[{"given":"Jared David Tadeo","family":"Guerrero-Sosa","sequence":"first","affiliation":[]},{"given":"V\u00edctor Hugo","family":"Men\u00e9ndez-Dom\u00ednguez","sequence":"additional","affiliation":[]},{"given":"Mar\u00eda Enriqueta","family":"Castellanos-Bola\u00f1os","sequence":"additional","affiliation":[]}],"member":"140","published-online":{"date-parts":[[2021,1,25]]},"reference":[{"issue":"1\/2","key":"key2021052011244055900_ref001","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1108\/LR-05-2013-0058","article-title":"Institutional repositories as complementary tools to evaluate the quantity and quality of research outputs","volume":"63","year":"2014","journal-title":"Library Review"},{"issue":"1","key":"key2021052011244055900_ref002","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1002\/asi.20729","article-title":"Applying successive H indices in the institutional evaluation: a case study","volume":"59","year":"2008","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"1","key":"key2021052011244055900_ref003","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1145\/291469.291479","article-title":"Action research","volume":"42","year":"1999","journal-title":"Communications of the Acm"},{"issue":"1","key":"key2021052011244055900_ref004","article-title":"Three options for citation tracking: Google scholar, scopus and web of science","volume":"3","year":"2006","journal-title":"Biomedical Digital Libraries"},{"issue":"4","key":"key2021052011244055900_ref005","doi-asserted-by":"crossref","first-page":"219","DOI":"10.3163\/1536-5050.103.4.014","article-title":"Bibliometric indicators: opportunities and limits","volume":"103","year":"2015","journal-title":"Journal of the Medical Library Association: Jmla"},{"key":"key2021052011244055900_ref006","unstructured":"CONACYT (2018), \u201cInteroperabilidad con el metabuscador del repositorio nacional\u201d, available at: www.repositorionacionalcti.mx\/docs\/manualesInteroperabilidad\/manual_de_Interoperabilidad_Repositorio_Nacional_ver.3.pdf (accessed 11 April 2020)."},{"key":"key2021052011244055900_ref007","unstructured":"CONACYT (2020), \u201cSistema nacional de investigadores\u201d, available at: www.conacyt.gob.mx\/index.php\/el-conacyt\/sistema-nacional-de-investigadores (accessed 20 March 2020)."},{"key":"key2021052011244055900_ref008","unstructured":"DGESU (2020), \u201cPrograma Para el desarrollo profesional docente, Para el tipo superior (PRODEP)\u201d, available at: www.dgesu.ses.sep.gob.mx\/PRODEP.htm (accessed 20 March 2020)."},{"issue":"3","key":"key2021052011244055900_ref009","doi-asserted-by":"crossref","first-page":"1303","DOI":"10.1007\/s11192-020-03364-1","article-title":"Exploring the limitations of the h-index and h-type indexes in measuring the research performance of authors","volume":"122","year":"2020","journal-title":"Scientometrics"},{"issue":"2","key":"key2021052011244055900_ref010","article-title":"Comparison of PubMed, Scopus, Web of Science, and Google Scholar: strengths and weaknesses","volume":"22","year":"2007","journal-title":"The FASEB Journal"},{"issue":"9","key":"key2021052011244055900_ref011","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1002\/asi.1121","article-title":"Analysis of publications and citations from a geophysics research institute","volume":"52","year":"2001","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"key2021052011244055900_ref012","unstructured":"G\u00f3mez Due\u00f1as, L. (2010), \u201cModelos de interoperabilidad En bibliotecas digitales y repositorios documentales: Caso biblioteca digital colombiana\u201d, available at: http:\/\/eprints.rclis.org\/14878\/1\/MODELOS_DE_interoperabilidad_BDCOL.pdf (accessed 7 March 2018)."},{"issue":"3","key":"key2021052011244055900_ref013","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1016\/j.joi.2010.03.002","article-title":"A new approach to the metric of journals\u2019 scientific prestige: the SJR indicator","volume":"4","year":"2010","journal-title":"Journal of Informetrics"},{"key":"key2021052011244055900_ref014","first-page":"6292","article-title":"Tools for interoperability between repositories of digital resources","volume-title":"Proceedings of INTED '19, IATED","year":"2019"},{"key":"key2021052011244055900_ref015","first-page":"6","article-title":"Indicadores de calidad en investigaciones cient\u00edficas: Antecedentes","volume":"19","year":"2018","journal-title":"Abstraction and Application"},{"key":"key2021052011244055900_ref016","first-page":"45","article-title":"Sistema de \u00edndices Para valorar la calidad de la producci\u00f3n acad\u00e9mica y la investigaci\u00f3n, a partir de repositorios digitales y metadatos","volume-title":"X Conferencia Conjunta Internacional Sobre Tecnolog\u00edas y Aprendizaje, CIATA.org-UCLM","year":"2018"},{"article-title":"Use of graph theory for the representation of scientific collaboration","volume-title":"11th International Conference on Computational Collective Intelligence","year":"2019","key":"key2021052011244055900_ref017"},{"issue":"9","key":"key2021052011244055900_ref018","doi-asserted-by":"crossref","first-page":"1424","DOI":"10.1109\/TLA.2019.8931135","article-title":"Use of an ontological model to assess the relevance of scientific production","volume":"17","year":"2019","journal-title":"IEEE Latin America Transactions"},{"key":"key2021052011244055900_ref019","first-page":"129","article-title":"Document database for scientific production","volume-title":"8th International Workshop on ADVANCEs in ICT Infrastructures and Services","year":"2020"},{"issue":"2","key":"key2021052011244055900_ref020","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1007\/s11192-015-1798-9","article-title":"Google scholar, scopus and the web of science: a longitudinal and cross-disciplinary comparison","volume":"106","year":"2016","journal-title":"Scientometrics"},{"first-page":"580","article-title":"What is a learning object, technically?","year":"2001","key":"key2021052011244055900_ref021"},{"issue":"9","key":"key2021052011244055900_ref022","first-page":"1537","article-title":"As we may search - Comparison of major features of the web of science, scopus, and google scholar citation-based and citation-enhanced databases","volume":"89","year":"2005","journal-title":"Current Science"},{"article-title":"Entities and identities in research information systems","volume-title":"E-Infrastructures for Research and Innovation - Linking Information Systems to Improve Scientific Knowledge Production \u2013 11th International Conf. on Current Research Information Systems","year":"2012","key":"key2021052011244055900_ref023"},{"issue":"3","key":"key2021052011244055900_ref024","doi-asserted-by":"crossref","first-page":"1659","DOI":"10.1007\/s11192-017-2450-7","article-title":"Measuring, analysis and visualization of research capacity of university at the level of departments and staff members","volume":"112","year":"2017","journal-title":"Scientometrics"},{"key":"key2021052011244055900_ref025","unstructured":"Lagoze, C. Van de Sompel, H. Nelson, M. and Warner, S. (2005), \u201cOpen archives Initiative - Protocol for metadata Harvesting \u2013 Guidelines for repository implementers\u201d, available at: www.openarchives.org\/OAI\/2.0\/guidelines-repository.htm (accessed 6 November 2017)."},{"issue":"4","key":"key2021052011244055900_ref026","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1108\/OCLC-04-2014-0022","article-title":"The role of institutional repositories in developing the communication of scholarly research","volume":"31","year":"2015","journal-title":"OCLC Systems and Services: International Digital Library Perspectives"},{"key":"key2021052011244055900_ref027","first-page":"1","article-title":"Modern challenges in bibliographic metadata identification","volume-title":"3rd Russian-Pacific Conference on Computer Technology and Applications (RPC '18)","year":"2018"},{"issue":"2","key":"key2021052011244055900_ref028","doi-asserted-by":"crossref","first-page":"84","DOI":"10.3145\/epi.2006.mar.01","article-title":"Dublin core, metadatos y vocabularios","volume":"15","year":"2006","journal-title":"El Profesional de La Informacion"},{"key":"key2021052011244055900_ref029","unstructured":"NSF (2018), \u201cOpen archives initiative protocol for metadata harvesting\u201d, available at: www.openarchives.org\/pmh\/ (accessed 1 April 2020)."},{"key":"key2021052011244055900_ref030","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1016\/j.forpol.2019.01.009","article-title":"Research trend: Hidden diamonds \u2013 the values and risks of online repository documents for Forest policy and governance analysis","volume":"100","year":"2019","journal-title":"Forest Policy and Economics"},{"issue":"2","key":"key2021052011244055900_ref031","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/j.mjafi.2017.03.008","article-title":"Bibliometric indices of scientific journals: Time to overcome the obsession and think beyond the impact factor","volume":"73","year":"2017","journal-title":"Medical Journal Armed Forces India"},{"article-title":"OpenAIRE","year":"2018","author":"RECOLECTA","key":"key2021052011244055900_ref032"},{"issue":"3","key":"key2021052011244055900_ref033","doi-asserted-by":"crossref","first-page":"204","DOI":"10.3103\/S0147688219030109","article-title":"The impact of errors in the s\u0441opus database on the research assessment","volume":"46","year":"2019","journal-title":"Scientific and Technical Information Processing"},{"issue":"2","key":"key2021052011244055900_ref034","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1590\/S0100-19652003000200011","article-title":"El concepto de metadato: algo m\u00e1s que descripci\u00f3n de recursos electr\u00f3nicos","volume":"32","year":"2003","journal-title":"Ci\u00eancia Da Informa\u00e7\u00e3o"},{"key":"key2021052011244055900_ref035","unstructured":"UADY (2019), \u201cUniversidad aut\u00f3noma de yucat\u00e1n\u201d, available at: www.uady.mx\/nuestra-universidad (accessed 25 March 2020)."}],"container-title":["The Electronic Library"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/EL-06-2020-0160\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/EL-06-2020-0160\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T01:07:27Z","timestamp":1753405647000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/el\/article\/39\/1\/33-58\/242543"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,25]]},"references-count":35,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,1,25]]},"published-print":{"date-parts":[[2021,5,18]]}},"alternative-id":["10.1108\/EL-06-2020-0160"],"URL":"https:\/\/doi.org\/10.1108\/el-06-2020-0160","relation":{},"ISSN":["0264-0473","0264-0473"],"issn-type":[{"type":"print","value":"0264-0473"},{"type":"print","value":"0264-0473"}],"subject":[],"published":{"date-parts":[[2021,1,25]]}}}