{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T06:15:07Z","timestamp":1777097707979,"version":"3.51.4"},"reference-count":47,"publisher":"MIT Press","issue":"3","license":[{"start":{"date-parts":[[2024,7,11]],"date-time":"2024-07-11T00:00:00Z","timestamp":1720656000000},"content-version":"vor","delay-in-days":192,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100012818","name":"Comunidad de Madrid","doi-asserted-by":"publisher","award":["EPUC3M02"],"award-info":[{"award-number":["EPUC3M02"]}],"id":[{"id":"10.13039\/100012818","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002322","name":"Coordena\u00e7\u00e3o de Aperfei\u00e7oamento de Pessoal de N\u00edvel Superior","doi-asserted-by":"publisher","award":["88887.831119\/2023-00"],"award-info":[{"award-number":["88887.831119\/2023-00"]}],"id":[{"id":"10.13039\/501100002322","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,8,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>For the last 50 years, the journal impact factor (IF) has been the most prominent of all bibliometric indicators. Since the first Journal Citation Report was launched, the IF has been used, often improperly, to evaluate institutions, publications, and individuals. Its well-known significant technical limitations have not detracted from its popularity, and they contrast with the lack of consensus over the numerous alternatives suggested as complements or replacements. This paper presents a percentile-distribution-based proposal for assessing the influence of scientific journals and publications that corrects several of the IF\u2019s main technical limitations using the same set of documents as is used to calculate the IF. Nearly 400 journals of Library Science and Information Science and Biochemistry and Molecular Biology categories were analyzed for this purpose. The results show that the new indicator retains many of its predecessor\u2019s advantages and adds benefits of its own: It is more accurate, more gaming resistant, more complete, and less influenced by the citation window or extreme observations.<\/jats:p>","DOI":"10.1162\/qss_a_00316","type":"journal-article","created":{"date-parts":[[2024,7,11]],"date-time":"2024-07-11T15:14:55Z","timestamp":1720710895000},"page":"778-804","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":3,"title":["Real influence: A novel approach to characterize the visibility of journals and publications"],"prefix":"10.1162","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1188-3481","authenticated-orcid":true,"given":"Antonio","family":"Perianes-Rodr\u00edguez","sequence":"first","affiliation":[{"name":"DIVALab, Departamento de Biblioteconom\u00eda y Documentaci\u00f3n, Universidad Carlos III de Madrid, Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7913-4084","authenticated-orcid":true,"given":"Bianca S.","family":"Mira","sequence":"additional","affiliation":[{"name":"Faculdade de Filosofia e Ci\u00eancias, Universidade Estadual Paulista\u2014UNESP, Marilia, Sao Paulo, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2236-553X","authenticated-orcid":true,"given":"Daniel","family":"Mart\u00ednez-\u00c1vila","sequence":"additional","affiliation":[{"name":"Facultad de Filosof\u00eda y Letras, Universidad de Le\u00f3n, Le\u00f3n, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8003-0386","authenticated-orcid":true,"given":"Maria Cl\u00e1udia Cabrini","family":"Gr\u00e1cio","sequence":"additional","affiliation":[{"name":"Faculdade de Filosofia e Ci\u00eancias, Universidade Estadual Paulista\u2014UNESP, Marilia, Sao Paulo, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2024,8,1]]},"reference":[{"issue":"3","key":"2024093020302705400_bib1","doi-asserted-by":"publisher","first-page":"635","DOI":"10.1007\/s11192-007-2036-x","article-title":"History of the journal impact factor: Contingencies and consequences","volume":"79","author":"Archambault","year":"2009","journal-title":"Scientometrics"},{"issue":"7611","key":"2024093020302705400_bib2","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1038\/535201a","article-title":"Watch out for cheats in citation game","volume":"535","author":"Biagioli","year":"2016","journal-title":"Nature"},{"issue":"1","key":"2024093020302705400_bib3","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1016\/j.joi.2016.12.001","article-title":"Skewness of citation impact data and covariates of citation distributions: A large-scale empirical analysis based on Web of Science data","volume":"11","author":"Bornmann","year":"2017","journal-title":"Journal of Informetrics"},{"issue":"7","key":"2024093020302705400_bib4","doi-asserted-by":"publisher","first-page":"1861","DOI":"10.1007\/s00296-011-2276-1","article-title":"Diversity, value and limitations of the journal impact factor and alternative metrics","volume":"32","author":"Bornmann","year":"2012","journal-title":"Rheumatology International"},{"issue":"suppl. 1","key":"2024093020302705400_bib5","doi-asserted-by":"publisher","first-page":"5192","DOI":"10.1073\/pnas.0307509100","article-title":"Mapping knowledge domains: Characterizing PNAS","volume":"101","author":"Boyack","year":"2004","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"4","key":"2024093020302705400_bib6","first-page":"479","article-title":"Choosing physiology journals","volume":"32","author":"Brodman","year":"1944","journal-title":"Bulletin of the Medical Library Association"},{"issue":"7593","key":"2024093020302705400_bib7","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1136\/bmj.39142.454086.AD","article-title":"How impact factors changed medical publishing\u2014and science","volume":"334","author":"Brown","year":"2007","journal-title":"British Medical Journal"},{"key":"2024093020302705400_bib8","volume-title":"Indicators handbook","author":"Clarivate","year":"2018"},{"key":"2024093020302705400_bib9","volume-title":"Journal Citation Reports reference guide","author":"Clarivate","year":"2023"},{"key":"2024093020302705400_bib10","doi-asserted-by":"publisher","first-page":"180259","DOI":"10.1038\/sdata.2018.259","article-title":"A data citation roadmap for scientific publishers","volume":"5","author":"Cousijn","year":"2018","journal-title":"Scientific Data"},{"key":"2024093020302705400_bib11","volume-title":"Data and software citation deposit guide","author":"CrossRef","year":"2022"},{"key":"2024093020302705400_bib12","volume-title":"Participation reports","author":"CrossRef","year":"2023"},{"issue":"1","key":"2024093020302705400_bib13","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1086\/617501","article-title":"Characteristics of the research literature used by chemists and physicists in the United States. Part I","volume":"19","author":"Fussler","year":"1949","journal-title":"Library Quarterly"},{"issue":"2","key":"2024093020302705400_bib14","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1086\/617524","article-title":"Characteristics of the research literature used by chemists and physicists in the United States. Part II","volume":"19","author":"Fussler","year":"1949","journal-title":"Library Quarterly"},{"issue":"3159","key":"2024093020302705400_bib15","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1126\/science.122.3159.108","article-title":"Citation indexes for science","volume":"122","author":"Garfield","year":"1955","journal-title":"Science"},{"issue":"4060","key":"2024093020302705400_bib16","doi-asserted-by":"publisher","first-page":"471","DOI":"10.1126\/science.178.4060.471","article-title":"Citation analysis as a tool in journal evaluation","volume":"178","author":"Garfield","year":"1972","journal-title":"Science"},{"issue":"4","key":"2024093020302705400_bib17","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1007\/BF02019306","article-title":"Is citation analysis a legitimate evaluation tool?","volume":"1","author":"Garfield","year":"1979","journal-title":"Scientometrics"},{"key":"2024093020302705400_bib18","first-page":"5","article-title":"How ISI selects journals for coverage: Quantitative and qualitative considerations","volume":"22","author":"Garfield","year":"1990","journal-title":"Current Contents"},{"issue":"2","key":"2024093020302705400_bib19","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1023\/A:1014848323806","article-title":"Journal impact measures in bibliometric research","volume":"53","author":"Gl\u00e4nzel","year":"2002","journal-title":"Scientometrics"},{"issue":"2","key":"2024093020302705400_bib20","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1007\/s11192-011-0345-6","article-title":"A priori vs. a posteriori normalisation of citation indicators. The case of journal ranking","volume":"87","author":"Gl\u00e4nzel","year":"2011","journal-title":"Scientometrics"},{"issue":"12","key":"2024093020302705400_bib21","doi-asserted-by":"publisher","first-page":"7229","DOI":"10.1007\/s11192-022-04295-9","article-title":"Measuring the excellence contribution at the journal level: An alternative to Garfield\u2019s impact factor","volume":"127","author":"Gorraiz","year":"2022","journal-title":"Scientometrics"},{"issue":"1713","key":"2024093020302705400_bib22","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1126\/science.66.1713.385","article-title":"College libraries and chemical education","volume":"66","author":"Gross","year":"1927","journal-title":"Science"},{"key":"2024093020302705400_bib23","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.8371197","article-title":"Metrics literacy: Special session","volume":"23","author":"Haustein","year":"2023","journal-title":"Science and Technology Indicators"},{"key":"2024093020302705400_bib24","volume-title":"Reports 2023: Supporting research integrity with trusted tools and data","author":"Heaney","year":"2023"},{"issue":"7548","key":"2024093020302705400_bib25","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1038\/520429a","article-title":"Bibliometrics: The Leiden Manifesto for research metrics","volume":"520","author":"Hicks","year":"2015","journal-title":"Nature"},{"issue":"9","key":"2024093020302705400_bib26","doi-asserted-by":"publisher","first-page":"e13151","DOI":"10.1111\/eci.13151","article-title":"A user\u2019s guide to inflated and manipulated impact factors","volume":"49","author":"Ioannidis","year":"2019","journal-title":"European Journal of Clinical Investigation"},{"issue":"2","key":"2024093020302705400_bib27","doi-asserted-by":"publisher","first-page":"264","DOI":"10.1177\/1536867X1601600202","article-title":"Assessing inequality using percentile shares","volume":"16","author":"Jann","year":"2016","journal-title":"Stata Journal"},{"issue":"2","key":"2024093020302705400_bib28","doi-asserted-by":"publisher","first-page":"1249","DOI":"10.1007\/s11192-020-03812-y","article-title":"Citation inequality and the Journal Impact Factor: Median, mean, (does it) matter?","volume":"126","author":"Kiesslich","year":"2021","journal-title":"Scientometrics"},{"issue":"12","key":"2024093020302705400_bib29","doi-asserted-by":"publisher","first-page":"2449","DOI":"10.2106\/00004623-200312000-00028","article-title":"Understanding the limitations of the Journal Impact Factor","volume":"85","author":"Kurmis","year":"2003","journal-title":"Journal of Bone and Joint Surgery"},{"key":"2024093020302705400_bib30","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-02511-3_1","article-title":"The Journal Impact Factor: A brief history, critique, and discussion of adverse effects","volume-title":"Springer handbook of science and technology indicators","author":"Larivi\u00e8re","year":"2019"},{"issue":"11","key":"2024093020302705400_bib31","doi-asserted-by":"publisher","first-page":"2133","DOI":"10.1002\/asi.21609","article-title":"Integrated impact indicators compared with impact factors: An alternative research design with policy implications","volume":"62","author":"Leydesdorff","year":"2011","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"11","key":"2024093020302705400_bib32","doi-asserted-by":"publisher","first-page":"2365","DOI":"10.1002\/asi.21371","article-title":"Scopus\u2019s Source Normalized Impact per Paper (SNIP) versus a Journal Impact Factor based on fractional counting of citations","volume":"61","author":"Leydesdorff","year":"2010","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"1","key":"2024093020302705400_bib33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.respol.2015.09.001","article-title":"Editors\u2019 JIF-boosting stratagems\u2014Which are appropriate and which not?","volume":"45","author":"Martin","year":"2016","journal-title":"Research Policy"},{"issue":"6","key":"2024093020302705400_bib35","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1002\/(SICI)1097-4571(199507)46:6&lt;461::AID-ASI5&gt;3.0.CO;2-G","article-title":"Improving the accuracy of Institute for Scientific Information\u2019s Journal Impact Factors","volume":"46","author":"Moed","year":"1995","journal-title":"Journal of the American Society for Information Science"},{"issue":"3","key":"2024093020302705400_bib36","doi-asserted-by":"publisher","first-page":"575","DOI":"10.1007\/BF02459613","article-title":"Towards appropriate indicators of journal impact","volume":"46","author":"Moed","year":"1999","journal-title":"Scientometrics"},{"issue":"2","key":"2024093020302705400_bib37","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1016\/j.joi.2011.12.006","article-title":"Skewed citation distributions and bias factors: Solutions to two core problems with the journal impact factor","volume":"6","author":"Mutz","year":"2012","journal-title":"Journal of Informetrics"},{"issue":"6","key":"2024093020302705400_bib38","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1525\/bio.2010.60.6.9","article-title":"Not so fast: Inflation in impact factors contributes to apparent improvements in journal quality","volume":"60","author":"Neff","year":"2010","journal-title":"BioScience"},{"issue":"1","key":"2024093020302705400_bib39","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1177\/0193841X14524957","article-title":"Ranking games","volume":"39","author":"Osterloh","year":"2015","journal-title":"Evaluation Review"},{"key":"2024093020302705400_bib40","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.10869819","article-title":"Real influence: A novel approach to characterise the visibility of journals and publications","author":"Perianes-Rodr\u00edguez","year":"2024","journal-title":"Zenodo"},{"issue":"2","key":"2024093020302705400_bib41","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1007\/s11024-015-9274-5","article-title":"Accounting for impact? The Journal Impact Factor and the making of biomedical research in the Netherlands","volume":"53","author":"Rushforth","year":"2015","journal-title":"Minerva"},{"key":"2024093020302705400_bib42","article-title":"Nobel winner declares boycott of top science journals","author":"Sample","year":"2013","journal-title":"The Guardian"},{"issue":"7079","key":"2024093020302705400_bib43","doi-asserted-by":"publisher","first-page":"498","DOI":"10.1136\/bmj.314.7079.497","article-title":"Why the impact factor of journals should not be used for evaluating research","volume":"314","author":"Seglen","year":"1997","journal-title":"British Medical Journal"},{"issue":"3","key":"2024093020302705400_bib44","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1007\/s11024-022-09468-7","article-title":"China\u2019s research evaluation reform: What are the consequences for global science?","volume":"60","author":"Shu","year":"2022","journal-title":"Minerva"},{"issue":"2","key":"2024093020302705400_bib45","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1016\/j.joi.2015.02.004","article-title":"Geometric journal impact factors correcting for individual highly cited articles","volume":"9","author":"Thelwall","year":"2015","journal-title":"Journal of Informetrics"},{"issue":"9","key":"2024093020302705400_bib46","doi-asserted-by":"publisher","first-page":"5357","DOI":"10.1007\/s11192-023-04787-2","article-title":"Bibliometric denialism","volume":"128","author":"Torres-Salinas","year":"2023","journal-title":"Scientometrics"},{"issue":"2","key":"2024093020302705400_bib47","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1016\/j.joi.2016.02.007","article-title":"A review of the literature on citation impact indicators","volume":"10","author":"Waltman","year":"2016","journal-title":"Journal of Informetrics"},{"key":"2024093020302705400_bib48","doi-asserted-by":"publisher","DOI":"10.13140\/RG.2.1.4929.1363","volume-title":"The Metric Tide: Report of the independent review of the role of metrics in research assessment and management","author":"Wilsdon","year":"2015"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/5\/3\/778\/2472718\/qss_a_00316.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/5\/3\/778\/2472718\/qss_a_00316.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,30]],"date-time":"2024-09-30T16:30:40Z","timestamp":1727713840000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/5\/3\/778\/123589\/Real-influence-A-novel-approach-to-characterize"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024]]},"references-count":47,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,8,1]]}},"URL":"https:\/\/doi.org\/10.1162\/qss_a_00316","relation":{"has-review":[{"id-type":"doi","id":"10.1162\/QSS_A_00316\/v2\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00316\/v2\/response1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00316\/v2\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00316\/v1\/review2","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00316\/v1\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00316\/v1\/decision1","asserted-by":"object"}]},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024]]},"published":{"date-parts":[[2024]]}}}