{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T17:19:13Z","timestamp":1785777553106,"version":"3.56.0"},"reference-count":54,"publisher":"MIT Press","issue":"2","license":[{"start":{"date-parts":[[2021,3,29]],"date-time":"2021-03-29T00:00:00Z","timestamp":1616976000000},"content-version":"vor","delay-in-days":87,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003329","name":"Ministerio de Econom\u00eda y Competitividad","doi-asserted-by":"publisher","award":["FIS2017-83709-R"],"award-info":[{"award-number":["FIS2017-83709-R"]}],"id":[{"id":"10.13039\/501100003329","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,7,15]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This study uses the data provided by the Leiden Ranking 2020 to support the claim that percentile-based indicators are linked by a power law function. A constant calculated from this function, ep, and the total number of papers fully characterize the percentile distribution of publications. According to this distribution, the probability that a publication from a country or institution is in the global xth percentile can be calculated from a simple equation: P = ep(2\u2212lgx). By taking the Leiden Ranking PPtop 10%\/100 as an approximation of the ep constant, our results demonstrate that other PPtop x% indicators can be calculated applying this equation. Consequently, given a PPtop x% indicator, all the others are redundant. Even accepting that the total number of papers and a single PPtop x% indicator are sufficient to fully characterize the percentile distribution of papers, the results of comparisons between universities and research institutions differ depending on the percentile selected for the comparison. We discuss which Ptop x% and PPtop x% indicators are the most convenient for these comparisons to obtain reliable information that can be used in research policy.<\/jats:p>","DOI":"10.1162\/qss_a_00130","type":"journal-article","created":{"date-parts":[[2021,3,29]],"date-time":"2021-03-29T15:50:21Z","timestamp":1617033021000},"page":"544-559","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":9,"title":["Total number of papers and in a single percentile fully describes research impact\u2014Revisiting concepts and applications"],"prefix":"10.1162","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0462-223X","authenticated-orcid":true,"given":"Alonso","family":"Rodr\u00edguez-Navarro","sequence":"first","affiliation":[{"name":"Departamento de Biotecnolog\u00eda-Biolog\u00eda Vegetal, Universidad Polit\u00e9cnica de Madrid, Avenida Puerta de Hierro 2, 28040, Madrid, Spain"},{"name":"Departamento de Estructura de la Materia, F\u00edsica T\u00e9rmica y Electr\u00f3nica y GISC, Universidad Complutense de Madrid, Plaza de las Ciencias 3, 28040, Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8488-6472","authenticated-orcid":true,"given":"Ricardo","family":"Brito","sequence":"additional","affiliation":[{"name":"Departamento de Estructura de la Materia, F\u00edsica T\u00e9rmica y Electr\u00f3nica y GISC, Universidad Complutense de Madrid, Plaza de las Ciencias 3, 28040, Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2021,7,15]]},"reference":[{"key":"2021072016152421300_bib1","doi-asserted-by":"crossref","first-page":"646","DOI":"10.1016\/j.joi.2016.04.006","article-title":"A farewell to the MNCS and like size-independent indicators","volume":"10","author":"Abramo","year":"2016","journal-title":"Journal of Informetrics"},{"key":"2021072016152421300_bib2","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1016\/j.joi.2016.01.011","article-title":"A farewell to the MNCS and like size-independent indicators: Rejoinder","volume":"10","author":"Abramo","year":"2016","journal-title":"Journal of Informetrics"},{"key":"2021072016152421300_bib3","doi-asserted-by":"crossref","DOI":"10.1177\/2158244019829575","article-title":"Citations, citation indicators, and research quality: An overview of basic concepts and theories","author":"Aksnes","year":"2019","journal-title":"SAGE Open"},{"key":"2021072016152421300_bib4","doi-asserted-by":"crossref","first-page":"625","DOI":"10.1016\/j.joi.2017.04.008","article-title":"The Herrero-Villar approach to citation impact","volume":"11","author":"Albarr\u00e1n","year":"2017","journal-title":"Journal of Informetrics"},{"key":"2021072016152421300_bib5","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1016\/j.joi.2010.04.004","article-title":"Towards an ideal method of measuring research performance: Some comments to the Opthof and Leydesdorff (2010) paper","volume":"4","author":"Bornmann","year":"2010","journal-title":"Journal of Informetrics"},{"key":"2021072016152421300_bib6","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1002\/asi.22792","article-title":"How to analyze percentile citation impact data meaningfully in bibliometrics: The statistical analysis of distributions, percentile rank classes, and top-cited papers","volume":"64","author":"Bornmann","year":"2013","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2021072016152421300_bib7","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.joi.2012.10.001","article-title":"The use of percentile rank classes in the analysis of bibliometric data: Opportunities and limits","volume":"7","author":"Bornmann","year":"2013","journal-title":"Journal of Informetrics"},{"key":"2021072016152421300_bib8","doi-asserted-by":"crossref","first-page":"933","DOI":"10.1016\/j.joi.2013.09.003","article-title":"Which percentile-based appoach should be preferred for calculating normalized citation impact values? An empirical comparison of five approaches including a newly developed citation-rank approach (P100)","volume":"7","author":"Bornmann","year":"2013","journal-title":"Journal of Informetrics"},{"key":"2021072016152421300_bib9","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.joi.2010.10.009","article-title":"Further steps towards an ideal method of measuring citation performance: The avoidance of citation (ratio) averages in field-normalization","volume":"5","author":"Bornmann","year":"2011","journal-title":"Journal of Informetrics"},{"key":"2021072016152421300_bib10","doi-asserted-by":"crossref","first-page":"1187","DOI":"10.1007\/s11192-019-03071-6","article-title":"How well does I3 perform for impact measurement compared to other bibliometric indicators? The convergent validity of several (field-normalized) indicators","volume":"119","author":"Bornmann","year":"2019","journal-title":"Scientometrics"},{"key":"2021072016152421300_bib11","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1108\/JD-07-2017-0108","article-title":"Identifying landmark publications in the long run using field-normalized citation data","volume":"74","author":"Bornmann","year":"2018","journal-title":"Journal of Documentation"},{"key":"2021072016152421300_bib12","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1016\/j.joi.2018.01.011","article-title":"Research assessment by percentile-based double rank analysis","volume":"12","author":"Brito","year":"2018","journal-title":"Journal of Informetrics"},{"key":"2021072016152421300_bib13","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1016\/j.joi.2019.01.009","article-title":"Evaluating research and researchers by the journal impact factor: Is it better than coin flipping?","volume":"13","author":"Brito","year":"2019","journal-title":"Journal of Informetrics"},{"key":"2021072016152421300_bib14","doi-asserted-by":"crossref","first-page":"154","DOI":"10.5530\/jscires.9.2.19","article-title":"The USA dominates world research in basic medicine and biotechnology","volume":"9","author":"Brito","year":"2020","journal-title":"Journal of Scientometric Research"},{"key":"2021072016152421300_bib15","volume-title":"Bibliometrics and Citation Analysis \u2013 From the Science Citation Index to Cybermetrics","author":"De Bellis","year":"2009"},{"key":"2021072016152421300_bib16","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1186\/s12934-019-1236-4","article-title":"Metrics and evaluation of scientific productivity: Would it be useful to normalize the data taking in consideration the investments?","volume":"18","author":"De Marco","year":"2019","journal-title":"Microbial Cell Factories"},{"key":"2021072016152421300_bib17","doi-asserted-by":"crossref","first-page":"eaao0185","DOI":"10.1126\/science.aao0185","article-title":"Science of science","volume":"359","author":"Fortunato","year":"2018","journal-title":"Science"},{"key":"2021072016152421300_bib18","first-page":"5","article-title":"Premature discovery or delayed recognition \u2013 Why?","volume":"21","author":"Garfield","year":"1980","journal-title":"Current Contents"},{"key":"2021072016152421300_bib19","first-page":"321","article-title":"Citation data: Their use as quantitative indicators for science and technology evaluation and policy-making","volume":"19","author":"Garfield","year":"1992","journal-title":"Science and Public Policy"},{"key":"2021072016152421300_bib20","doi-asserted-by":"crossref","first-page":"658","DOI":"10.1016\/j.joi.2016.04.008","article-title":"Productivity, performance, efficiency, impact \u2013 What do we measure anyway? Some comments on the paper \u201cA farewell to the MNCS and like size-independent indicators\u201d by Abramo and D\u2019Angelo","volume":"10","author":"Gl\u00e4nzel","year":"2016","journal-title":"Journal of Informetrics"},{"key":"2021072016152421300_bib21","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1016\/S0048-7333(02)00032-X","article-title":"The emergence of S&T indicators: Why did governments supplement statistics with indicators?","volume":"32","author":"Godin","year":"2003","journal-title":"Research Policy"},{"key":"2021072016152421300_bib22","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1007\/s11192-009-0409-z","article-title":"Open access scientometrics and the UK research assessment exercise","volume":"79","author":"Harnad","year":"2009","journal-title":"Scientometrics"},{"key":"2021072016152421300_bib23","article-title":"The Metric Tide: Correlation analysis of REF2014 scores and metrics (Supplementary Report II to the independent Review of the Role of Metrics in Research Assessment and Management)","author":"HEFCE","year":"2015"},{"issue":"7","key":"2021072016152421300_bib24","doi-asserted-by":"crossref","first-page":"e04415","DOI":"10.1016\/j.heliyon.2020.e04415","article-title":"The k-index is introduced to replace the h-index to evaluate better the scientific excellence of individuals","volume":"6","author":"Kaptay","year":"2020","journal-title":"Heliyon"},{"key":"2021072016152421300_bib25","doi-asserted-by":"crossref","first-page":"2133","DOI":"10.1002\/asi.21609","article-title":"Integrated impact indicators compared with impact factors: An alternative research design with policy implications","volume":"62","author":"Leydesdorff","year":"2011","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2021072016152421300_bib26","doi-asserted-by":"crossref","first-page":"1901","DOI":"10.1002\/asi.22641","article-title":"Percentile ranks and the integrated impact indicator (I3)","volume":"63","author":"Leydesdorff","year":"2012","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2021072016152421300_bib27","doi-asserted-by":"crossref","first-page":"1669","DOI":"10.1007\/s11192-019-03099-8","article-title":"The integrated impact indicator revised (I3): A non-parametric alternative to the journal impact factor","volume":"119","author":"Leydesdorff","year":"2019","journal-title":"Scientometrics"},{"key":"2021072016152421300_bib28","doi-asserted-by":"crossref","first-page":"1370","DOI":"10.1002\/asi.21534","article-title":"Turning the tables on citation analysis one more time: Principles for comparing sets of documents","volume":"62","author":"Leydesdorff","year":"2011","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2021072016152421300_bib29","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1002\/(SICI)1097-4571(198909)40:5<342::AID-ASI7>3.0.CO;2-U","article-title":"Problems of citation analysis: A crtical review","volume":"40","author":"MacRoberts","year":"1989","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"4","key":"2021072016152421300_bib30","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1109\/TEM.1983.6448622","article-title":"Programmatic evaluation and comparison based on standardized citation scores","volume":"EM-30","author":"Mcallister","year":"1983","journal-title":"IEEE Transactions on Engineering Management"},{"key":"2021072016152421300_bib31","volume-title":"Citation analysis in research evaluation","author":"Moet","year":"2005"},{"key":"2021072016152421300_bib32","volume-title":"Evaluative bibliometrics: The use of publication and citation analysis in the evaluation of scientific activity","author":"Narin","year":"1976"},{"key":"2021072016152421300_bib33","volume-title":"Science and engineering indicators","author":"National Science Board","year":"2010"},{"key":"2021072016152421300_bib34","volume-title":"Science and engineering indicators 2018","author":"National Science Board","year":"2018"},{"key":"2021072016152421300_bib35","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1016\/j.joi.2010.02.003","article-title":"Caveats for the journal and field normalizations in the CWTS (\u201cLeiden\u201d) evaluations of research performance","volume":"4","author":"Opthof","year":"2010","journal-title":"Journal of Informetrics"},{"key":"2021072016152421300_bib36","doi-asserted-by":"crossref","first-page":"17268","DOI":"10.1073\/pnas.0806977105","article-title":"Universality of citation distributions: Toward an objective measure of scientific impact","volume":"105","author":"Radicchi","year":"2008","journal-title":"Proceedings of the National Academy of Sciences of the USA"},{"key":"2021072016152421300_bib37","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.joi.2017.11.004","article-title":"Double rank analysis for research assessment","volume":"12","author":"Rodr\u00edguez-Navarro","year":"2018","journal-title":"Journal of Informetrics"},{"key":"2021072016152421300_bib38","doi-asserted-by":"crossref","first-page":"718","DOI":"10.1016\/j.joi.2018.06.009","article-title":"Technological research in the EU is less efficient than the world average. EU research policy risks Europeans\u2019 future","volume":"12","author":"Rodr\u00edguez-Navarro","year":"2018","journal-title":"Journal of Informetrics"},{"key":"2021072016152421300_bib39","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1007\/s11192-019-03022-1","article-title":"Probability and expected frequency of breakthroughs \u2013 basis and use of a robust method of research assessment","volume":"119","author":"Rodr\u00edguez-Navarro","year":"2019","journal-title":"Scientometrics"},{"key":"2021072016152421300_bib40","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1093\/reseval\/rvaa002","article-title":"Like-for-like bibliometric substitutes for peer review: Advantages and limits of indicators calculated from the ep index","volume":"29","author":"Rodr\u00edguez-Navarro","year":"2020","journal-title":"Research Evaluation"},{"key":"2021072016152421300_bib41","first-page":"872","article-title":"Might Europe one day again be a global scientific powerhouse? Analysis of ERC publications suggests it will not be possible without changes in research policy","volume":"1","author":"Rodr\u00edguez-Navarro","year":"2020","journal-title":"Quantitative Science Studies"},{"key":"2021072016152421300_bib42","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1016\/j.joi.2016.04.004","article-title":"Research output indicators are not productivity indicators","volume":"10","author":"Ruiz-Castillo","year":"2016","journal-title":"Journal of Informetrics"},{"key":"2021072016152421300_bib43","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1007\/s11192-013-0984-x","article-title":"How much do different ways of calculating percentiles influence the derived performance indicators?","volume":"97","author":"Schreiber","year":"2013","journal-title":"Scientometrics"},{"key":"2021072016152421300_bib44","doi-asserted-by":"crossref","first-page":"13896","DOI":"10.1073\/pnas.2001064117","article-title":"Three dimensions of scientific impact","volume":"117","author":"Siudem","year":"2020","journal-title":"Proceedings of the National Academy of Sciences USA"},{"key":"2021072016152421300_bib45","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1023\/A:1016082432660","article-title":"Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference?","volume":"54","author":"Tijssen","year":"2002","journal-title":"Scientometrics"},{"key":"2021072016152421300_bib46","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1057\/s41599-019-0233-x","article-title":"Systematic analysis of agreement between metrics and peer review in the UK REF","volume":"5","author":"Traag","year":"2019","journal-title":"Palgrave Communications"},{"key":"2021072016152421300_bib47","doi-asserted-by":"crossref","first-page":"1963","DOI":"10.1002\/asi.21600","article-title":"Application of the distribution of citations among publications in scientometric evaluation","volume":"62","author":"Vinkler","year":"2011","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2021072016152421300_bib48","doi-asserted-by":"crossref","first-page":"2419","DOI":"10.1002\/asi.22708","article-title":"The Leiden ranking 2011\/2012: Data collection, indicators, and interpretation","volume":"63","author":"Waltman","year":"2012","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2021072016152421300_bib49","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1002\/asi.22775","article-title":"On the calculation of percentile-based bibliometric indicators","volume":"64","author":"Waltman","year":"2013","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2021072016152421300_bib50","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1016\/j.joi.2015.12.008","article-title":"The elephant in the room: The problems of quantifying productivity in evaluative scientometrics","volume":"10","author":"Waltman","year":"2016","journal-title":"Journal of Informetrics"},{"key":"2021072016152421300_bib51","doi-asserted-by":"crossref","first-page":"1416","DOI":"10.1016\/j.respol.2017.06.006","article-title":"Bias against novelty in science: A cautionary tale for users of bibliometric indicators","volume":"46","author":"Wang","year":"2017","journal-title":"Research Policy"},{"key":"2021072016152421300_bib52","article-title":"Pearson Correlation (v1.0.13) in Free Statistics Software (v1.2.1)","author":"Wessa","year":"2017"},{"key":"2021072016152421300_bib53","article-title":"Spearman Rank Correlation (v1.0.3) in Free Statistics Software (v1.2.1)","author":"Wessa","year":"2017"},{"key":"2021072016152421300_bib54","doi-asserted-by":"crossref","DOI":"10.4135\/9781473978782","article-title":"The metric tide: Report of the independent review of the role of metrics in research assessment and management","author":"Wilsdon","year":"2015"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/qss\/article-pdf\/2\/2\/544\/1930717\/qss_a_00130.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/qss\/article-pdf\/2\/2\/544\/1930717\/qss_a_00130.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,22]],"date-time":"2022-12-22T19:57:48Z","timestamp":1671739068000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/2\/2\/544\/98538\/Total-number-of-papers-and-in-a-single-percentile"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":54,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,7,15]]}},"URL":"https:\/\/doi.org\/10.1162\/qss_a_00130","relation":{},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021]]},"published":{"date-parts":[[2021]]}}}