{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T01:59:46Z","timestamp":1776736786800,"version":"3.51.2"},"reference-count":61,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,7,25]],"date-time":"2023-07-25T00:00:00Z","timestamp":1690243200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Res. Metr. Anal."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Altmetrics have been demonstrated as a promising tool for analyzing scientific communication on social media. Nevertheless, its application for research evaluation remains underdeveloped, despite the advancement of research in the study of diverse scientific interactions.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>This paper develops a method for applying altmetrics in the evaluation of researchers, focusing on a case study of the Environment\/Ecology ESI field publications by researchers at the University of Granada. We considered Twitter as a mirror of social attention, news outlets as media, and Wikipedia as educational, exploring mentions from these three sources and the associated actors in their respective media, contextualizing them using various metrics.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Our analysis evaluated different dimensions such as the type of audience, local attention, engagement generated around the mention, and the profile of the actor. Our methodology effectively provided dashboards that gave a comprehensive view of the different instances of social attention at the author level.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>The use of altmetrics for research evaluation presents significant potential, as shown by our case study. While this is a novel method, our results suggest that altmetrics could provide valuable insights into the social attention that researchers garner. This can be an important tool for research evaluation, expanding our understanding beyond traditional metrics.<\/jats:p><\/jats:sec>","DOI":"10.3389\/frma.2023.1188131","type":"journal-article","created":{"date-parts":[[2023,7,25]],"date-time":"2023-07-25T08:10:58Z","timestamp":1690272658000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Evaluative altmetrics: is there evidence for its application to research evaluation?"],"prefix":"10.3389","volume":"8","author":[{"given":"Wenceslao","family":"Arroyo-Machado","sequence":"first","affiliation":[]},{"given":"Daniel","family":"Torres-Salinas","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,7,25]]},"reference":[{"key":"B1","unstructured":"Wikinformetrics: construction and description of an open Wikipedia knowledge graph data set for informetric purposes931952 Arroyo-MachadoW. Torres-SalinasD. CostasR. 10.1162\/qss_a_00226Quant. Sci. Stud.32022"},{"key":"B2","doi-asserted-by":"publisher","first-page":"e0228713","DOI":"10.1371\/journal.pone.0228713","article-title":"Science through Wikipedia: a novel representation of open knowledge through co-citation networks","volume":"15","author":"Arroyo-Machado","year":"2020","journal-title":"PLoS ONE"},{"key":"B3","doi-asserted-by":"publisher","first-page":"9267","DOI":"10.1007\/s11192-021-04167-8","article-title":"Identifying and characterizing social media communities: a socio-semantic network approach to altmetrics","volume":"126","author":"Arroyo-Machado","year":"2021","journal-title":"Scientometrics"},{"key":"B4","doi-asserted-by":"publisher","first-page":"895","DOI":"10.1016\/j.joi.2014.09.005","article-title":"Do altmetrics point to the broader impact of research? an overview of benefits and disadvantages of altmetrics","volume":"8","author":"Bornmann","year":"2014","journal-title":"J. Informetr."},{"key":"B5","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1016\/j.joi.2019.01.008","article-title":"Do altmetrics assess societal impact in a comparable way to case studies? an empirical test of the convergent validity of altmetrics based on data from the UK research excellence framework (REF)","volume":"13","author":"Bornmann","year":"2019","journal-title":"J. Informetr."},{"key":"B6","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1002\/bult.2013.1720390411","article-title":"Are alternative metrics still alternative?","volume":"39","author":"Buschman","year":"2013","journal-title":"Bull. Am. Soc. Inf. Sci. Technol."},{"key":"B7","doi-asserted-by":"publisher","first-page":"108596","DOI":"10.1016\/j.biocon.2020.108596","article-title":"A global parasite conservation plan","volume":"250","author":"Carlson","year":"2020","journal-title":"Biol. Conserv."},{"key":"B8","unstructured":"\u201cLarge scale author name disambiguation using rule-based scoring and clustering: International conference on science and technology indicators,\u201d7986 CaronE. van EckN. -J. LeidenUniversiteit LeidenProceedings of the Science and Technology Indicators Conference 20142014"},{"key":"B9","doi-asserted-by":"publisher","first-page":"714","DOI":"10.1038\/s41559-019-0887-1","article-title":"Reply to \u2018dating on its own cannot resolve hominin occupation patterns' and \u2018no reliable evidence for a very early Aurignacian in Southern Iberia.'","volume":"3","author":"Cort\u00e9s-S\u00e1nchez","year":"2019","journal-title":"Nat. Ecol. Evol."},{"key":"B10","doi-asserted-by":"publisher","first-page":"595","DOI":"10.1002\/asi.24427","article-title":"\u201cHeterogeneous couplings\u201d: operationalizing network perspectives to study science-society interactions through social media metrics","volume":"72","author":"Costas","year":"2020","journal-title":"J. Assoc. Inf. Sci. Technol."},{"key":"B11","doi-asserted-by":"publisher","first-page":"2003","DOI":"10.1002\/asi.23309","article-title":"Do \u201caltmetrics\u201d correlate with citations? extensive comparison of altmetric indicators with citations from a multidisciplinary perspective","volume":"66","author":"Costas","year":"2015","journal-title":"J. Assoc. Inf. Sci. Technol."},{"key":"B12","doi-asserted-by":"publisher","first-page":"e0216408","DOI":"10.1371\/journal.pone.0216408","article-title":"Towards a second generation of \u2018social media metrics': characterizing Twitter communities of attention around science","volume":"14","author":"D\u00edaz-Faes","year":"2019","journal-title":"PLoS ONE"},{"key":"B13","volume-title":"Next-Generation","author":"European Commission Directorate-General for Research Innovation","year":"2017"},{"key":"B14","author":"Schomberg","year":"2019","journal-title":"Indicator Frameworks for Fostering Open Knowledge Practices in Science and Scholarship"},{"key":"B15","doi-asserted-by":"publisher","first-page":"2519","DOI":"10.1007\/s11192-020-03564-9","article-title":"An extensive analysis of the presence of altmetric data for Web of Science publications across subject fields and research topics","volume":"124","author":"Fang","year":"2020","journal-title":"Scientometrics"},{"key":"B16","doi-asserted-by":"publisher","first-page":"918","DOI":"10.1002\/asi.24458","article-title":"How is science clicked on Twitter? click metrics for bitly short links to scientific publications","volume":"72","author":"Fang","year":"2021","journal-title":"J. Assoc. Inf. Sci. Technol."},{"key":"B17","doi-asserted-by":"publisher","first-page":"4523","DOI":"10.1007\/s11192-022-04468-6","article-title":"User engagement with scholarly tweets of scientific papers: a large-scale and cross-disciplinary analysis","volume":"127","author":"Fang","year":"","journal-title":"Scientometrics"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1192","DOI":"10.1002\/asi.24624","article-title":"Facing the volatility of tweets in altmetric research","volume":"73","author":"Fang","year":"","journal-title":"J. Assoc. Inf. Sci. Technol."},{"key":"B19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.29024\/joa.38","article-title":"Large-scale comparison of authorship, citations and tweets of web of science authors","volume":"4","author":"Ferreira","year":"2021","journal-title":"J. Altmetrics"},{"key":"B20","unstructured":"Identifying science in the news: an assessment of the precision and recall of Altmetric.com news mention data61096123 FleerackersA. NehringL. MaggioL. A. EnkhbayarA. MoorheadL. AlperinJ. P. 10.1007\/s11192-022-04510-736212767Scientometrics1272022"},{"key":"B21","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1038\/nclimate1329","article-title":"Continent-wide response of mountain vegetation to climate change","volume":"2","author":"Gottfried","year":"2012","journal-title":"Nat. Clim. Change"},{"key":"B22","doi-asserted-by":"publisher","first-page":"977","DOI":"10.1007\/s11192-016-1991-5","article-title":"The ecstasy and the agony of the altmetric score","volume":"108","author":"Gumpenberger","year":"2016","journal-title":"Scientometrics"},{"key":"B23","unstructured":"Sobre InfluScience. Plataforma Influscience2022"},{"key":"B24","unstructured":"A large-scale comparison of coverage and mentions captured by the two altmetric aggregators: Altmetric.com and PlumX44654489 KarmakarM. BanshalS. K. SinghV. K. 10.1007\/s11192-021-03941-yScientometrics1262021"},{"key":"B25","doi-asserted-by":"publisher","first-page":"6616","DOI":"10.1111\/gcb.15123","article-title":"SoilTemp: a global database of near-surface temperature","volume":"26","author":"Lembrechts","year":"2020","journal-title":"Glob. Change Biol."},{"key":"B26","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1007\/978-3-319-67642-5_47","article-title":"\u201cAnalysis of references across Wikipedia languages,\u201d","volume-title":"in Information and Software Technologies","author":"Lewoniewski","year":"2017"},{"key":"B27","doi-asserted-by":"publisher","first-page":"e0190046","DOI":"10.1371\/journal.pone.0190046","article-title":"Wikipedia as a gateway to biomedical research: the relative distribution and use of citations in the english Wikipedia","volume":"12","author":"Maggio","year":"2017","journal-title":"PLoS ONE"},{"key":"B28","doi-asserted-by":"publisher","first-page":"e290329","DOI":"10.3145\/epi.2020.may.29","article-title":"Academic impact and perceived value of Wikipedia as a primary learning resource in higher education","volume":"29","author":"Meseguer-Artola","year":"2020","journal-title":"Profesional de la informaci\u00f3n."},{"key":"B29","doi-asserted-by":"publisher","first-page":"412","DOI":"10.1111\/cobi.13702","article-title":"Using Wikipedia to measure public interest in biodiversity and conservation","volume":"35","author":"Mittermeier","year":"2021","journal-title":"Conserv. Biol"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-60522-7","author":"Moed","year":"2017","journal-title":"Applied Evaluative Informetrics"},{"key":"B31","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1016\/0048-7333(85)90012-5","article-title":"The use of bibliometric data for the measurement of university research performance","volume":"14","author":"Moed","year":"1985","journal-title":"Res. Policy"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1162\/qss_a_00250","author":"Mongeon","year":"2022","journal-title":"An Open Dataset of Scholars on Twitter"},{"key":"B33","unstructured":"NISO RP-25-2016 Outputs of the NISO Alternative Assessment Metrics Project. NISO website. Baltimore, MD2016"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.5210\/fm.v12i8.1997","author":"Nielsen","year":"2007","journal-title":"Scientific Citations in Wikipedia"},{"key":"B35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1629\/uksg.593","article-title":"The Twitter accounts of scientific journals: a dataset","volume":"36","author":"Nishikawa-Pacher","year":"2023","journal-title":"Insights UKSG J."},{"key":"B36","unstructured":"Reliability and accuracy of altmetric providers: a comparison among Altmetric.com, PlumX and crossref event data21232138 OrtegaJ. L. 10.1007\/s11192-018-2838-zScientometrics1162018"},{"key":"B37","doi-asserted-by":"publisher","first-page":"101175","DOI":"10.1016\/j.joi.2021.101175","article-title":"How do media mention research papers? structural analysis of blogs and news networks using citation coupling","volume":"15","author":"Ortega","year":"2021","journal-title":"J. Informetr."},{"key":"B38","unstructured":"PriemJ. PiwowarH. The Launch of ImpactStory: Using Altmetrics to Tell Data-Driven Stories. Impact of Social Sciences2012"},{"key":"B39","unstructured":"PriemJ. PiwowarH. A. HemmingerB. M. Altmetrics in the Wild: Using Social Media to Explore Scholarly Impact. ArXiv.org2012"},{"key":"B40","unstructured":"PriemJ. TaraborelliD. GrothP. NeylonC. 36147419Altmetrics: A manifesto. Altmetrics2010"},{"key":"B41","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1093\/reseval\/rvy030","article-title":"SandT indicators in the wild: contextualization and participation for responsible metrics","volume":"28","author":"R\u00e0fols","year":"2019","journal-title":"Res. Eval."},{"key":"B42","doi-asserted-by":"publisher","first-page":"815","DOI":"10.1093\/scipol\/scy024","article-title":"Using altmetrics for contextualised mapping of societal impact: from hits to networks","volume":"45","author":"Robinson-Garcia","year":"2018","journal-title":"Sci. Public Policy"},{"key":"B43","doi-asserted-by":"publisher","first-page":"110223","DOI":"10.1016\/j.envres.2020.110223","article-title":"The spread of SARS-CoV-2 in Spain: hygiene habits, sociodemographic profile, mobility patterns and comorbidities","volume":"192","author":"Rodr\u00edguez-Barranco","year":"2021","journal-title":"Environ. Res."},{"key":"B44","doi-asserted-by":"publisher","first-page":"2725","DOI":"10.1145\/3340531.3412698","article-title":"\u201cDetection of novel social bots by ensembles of specialized classifiers,\u201d","author":"Sayyadiharikandeh","year":"2020","journal-title":"Proceedings of the 29th ACM International Conference on Information and Knowledge Management"},{"key":"B45","doi-asserted-by":"publisher","first-page":"1499","DOI":"10.1007\/s11192-020-03551-0","article-title":"Communities of shared interests and cognitive bridges: the case of the anti-vaccination movement on Twitter","volume":"152","author":"Schalkwyk","year":"2020","journal-title":"Scientometrics"},{"key":"B46","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1038\/s41586-021-03740-8","article-title":"The contribution of insects to global forest deadwood decomposition","volume":"597","author":"Seibold","year":"2021","journal-title":"Nature"},{"key":"B47","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1016\/j.iheduc.2015.08.004","article-title":"Students' use of Wikipedia as an academic resource\u2014patterns of use and perceptions of usefulness","volume":"28","author":"Selwyn","year":"2016","journal-title":"Internet Higher Educ."},{"key":"B48","unstructured":"SugimotoC. 2015"},{"key":"B49","doi-asserted-by":"publisher","first-page":"2037","DOI":"10.1002\/asi.23833","article-title":"Scholarly use of social media and altmetrics: a review of the literature","volume":"68","author":"Sugimoto","year":"2017","journal-title":"J. Assoc. Inf. Sci. Technol."},{"key":"B50","doi-asserted-by":"publisher","first-page":"1231","DOI":"10.1007\/s11192-018-2715-9","article-title":"Early mendeley readers correlate with later citation counts","volume":"115","author":"Thelwall","year":"","journal-title":"Scientometrics"},{"key":"B51","first-page":"11","author":"Thelwall","year":""},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.1111\/joes.12381","article-title":"Measuring societal impacts of research with altmetrics? common problems and mistakes","author":"Thelwall","year":"","journal-title":"J. Econ. Surv."},{"key":"B53","doi-asserted-by":"crossref","DOI":"10.29024\/sar.10","volume-title":"The Pros and Cons of the Use of Altmetrics in Research Assessment","author":"Thelwall","year":""},{"key":"B54","doi-asserted-by":"publisher","first-page":"e64841","DOI":"10.1371\/journal.pone.0064841","article-title":"Do altmetrics work? twitter and ten other social web services","volume":"8","author":"Thelwall","year":"2013","journal-title":"PLoS ONE"},{"key":"B55","doi-asserted-by":"publisher","first-page":"53","DOI":"10.3916\/C41-2013-05","article-title":"Altmetrics: nuevos indicadores para la comunicaci\u00f3n cient\u00edfica en la Web 2.0 - altmetrics: new indicators for scientific communication in web 2.0","volume":"21","author":"Torres-Salinas","year":"2013","journal-title":"Rev. Comun."},{"key":"B56","doi-asserted-by":"crossref","unstructured":"Torres-SalinasD. DocampoD. Arroyo-MachadoW. Robinson-GarciaN. The Many Publics of Science: Using Altmetrics to Identify Common Communication Channels by Scientific field2023","DOI":"10.1007\/s11192-024-05077-1"},{"key":"B57","doi-asserted-by":"publisher","first-page":"e310220","DOI":"10.3145\/epi.2022.mar.20","article-title":"Coverage and distribution of altmetric mentions in Spain: a cross-country comparison in 22 research fields","volume":"31","author":"Torres-Salinas","year":"2022","journal-title":"Profesional de la informaci\u00f3n."},{"key":"B58","unstructured":"Torres-SalinasD. Robinson-GarciaN. Jim\u00e9nez-ContrerasE. Can We Use Altmetrics At the Institutional Level? A Case Study Analysing the Coverage by Research Areas of Four Spanish Universities. in (Valencia, Spain)2016"},{"key":"B59","doi-asserted-by":"publisher","first-page":"1511","DOI":"10.1007\/s42001-022-00177-5","article-title":"Botometer 101: social bot practicum for computational social scientists","volume":"5","author":"Yang","year":"2022","journal-title":"J. Comput. Soc. Sci."},{"key":"B60","doi-asserted-by":"publisher","first-page":"101347","DOI":"10.1016\/j.joi.2022.101347","article-title":"Exploring country's preference over news mentions to academic papers","volume":"16","author":"Yu","year":"2022","journal-title":"J. Informetr."},{"key":"B61","doi-asserted-by":"publisher","first-page":"e0197326","DOI":"10.1371\/journal.pone.0197326","article-title":"General discussion of data quality challenges in social media metrics: extensive comparison of four major altmetric data aggregators","volume":"13","author":"Zahedi","year":"2018","journal-title":"PLoS ONE"}],"updated-by":[{"DOI":"10.3389\/frma.2023.1295959","type":"corrigendum","label":"Corrigendum","source":"publisher","updated":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T00:00:00Z","timestamp":1697500800000}}],"container-title":["Frontiers in Research Metrics and Analytics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frma.2023.1188131\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T23:04:54Z","timestamp":1729811094000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frma.2023.1188131\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,25]]},"references-count":61,"alternative-id":["10.3389\/frma.2023.1188131"],"URL":"https:\/\/doi.org\/10.3389\/frma.2023.1188131","relation":{"corrigendum":[{"id-type":"doi","id":"10.3389\/frma.2023.1295959","asserted-by":"object"}]},"ISSN":["2504-0537"],"issn-type":[{"value":"2504-0537","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,25]]},"article-number":"1188131"}}