{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:15:33Z","timestamp":1760242533881,"version":"build-2065373602"},"reference-count":39,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2017,9,21]],"date-time":"2017-09-21T00:00:00Z","timestamp":1505952000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministerio de Economia, Industria y Competitividad, Spain","award":["CSO2015-65594-C2-1R Y 2R","MTM2016-77054-C2-1-P"],"award-info":[{"award-number":["CSO2015-65594-C2-1R Y 2R","MTM2016-77054-C2-1-P"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Publications"],"abstract":"<jats:p>Journal rankings of specific research fields are often used for evaluation purposes, both of authors and institutions. These rankings can be defined by means of several methods, as expert assessment, scholarly-based agreements, or by the ordering induced by a numeric index associated to the prestige of the journals. In order to be efficient and accepted by the research community, it must preserve the ordering over time, at least up to a point. Otherwise, the procedure for defining the ranking must be revised to assure that it reflects the presumably stable characteristic \u201cprestige\u201d that it claims to be quantifying. A mathematical model based on fractional p-variations of the values of the order number of each journal in a time series of journal rankings is explained, and its main properties are shown. As an example, we study the evolution of two given ordered lists of journals through an eleven-year series. These journal ranks are defined by using the 2-year Impact Factor of Thomson-Reuters (nowadays Clarivate Analytics) lists for MATHEMATICS and PHYSICS, APPLIED from 2002 to 2013. As an application of our model, we define an index that precludes the use of journal ranks for evaluation purposes when some minimal requirements on the associated fractional p-variations are not satisfied. The final conclusion is that the list of mathematics does not satisfy the requirements on the p-variations, while the list of applied physics does.<\/jats:p>","DOI":"10.3390\/publications5030021","type":"journal-article","created":{"date-parts":[[2017,9,21]],"date-time":"2017-09-21T12:17:40Z","timestamp":1505996260000},"page":"21","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Measuring Time-Dynamics and Time-Stability of Journal Rankings in Mathematics and Physics by Means of Fractional p-Variations"],"prefix":"10.3390","volume":"5","author":[{"given":"Antonia","family":"Ferrer-Sapena","sequence":"first","affiliation":[{"name":"Instituto de Dise\u00f1o y Fabricaci\u00f3n, Universitat Polit\u00e8cnica de Val\u00e8ncia, 46022 Valencia, Spain"}]},{"given":"Susana","family":"D\u00edaz-Novillo","sequence":"additional","affiliation":[{"name":"Florida Universitaria, Rey En Jaume I, 2, Catarroja, 46470 Valencia, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8854-3154","authenticated-orcid":false,"given":"Enrique","family":"S\u00e1nchez-P\u00e9rez","sequence":"additional","affiliation":[{"name":"Instituto Universitario de Matem\u00e1tica Pura y Aplicada, Universitat Polit\u00e8cnica de Val\u00e8ncia, 46022 Valencia, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2017,9,21]]},"reference":[{"key":"ref_1","first-page":"41","article-title":"Assessing publications through a bibliometric indicator: The case of comprehensive evaluation of scientific units in Poland","volume":"26","author":"Kulczycki","year":"2017","journal-title":"Res. Eval."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1007\/s11192-017-2261-x","article-title":"Does an expert-based evaluation allow us to go beyond the Impact Factor? Experiences from building a ranking of national journals in Poland","volume":"111","author":"Kulczycki","year":"2017","journal-title":"Scientometrics"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1126\/science.178.4060.471","article-title":"Citation analysis as a tool in journal evaluation","volume":"178","author":"Garfield","year":"1972","journal-title":"Science"},{"key":"ref_4","first-page":"65","article-title":"The evolution of the Science Citation Index","volume":"10","author":"Garfield","year":"2007","journal-title":"Int. Microbiol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1177\/016555158701300501","article-title":"A review of bibliometric and other science indicators and their role in research evaluation","volume":"13","author":"King","year":"1987","journal-title":"J. Inf. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1023\/A:1014800407876","article-title":"Advantages and limitations in the use of impact factor measures for the assessment of research performance","volume":"53","author":"Bordons","year":"2002","journal-title":"Scientometrics"},{"key":"ref_7","unstructured":"Moed, H.F. (2005). Citation Analysis in Research Evaluation, Springer."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1001\/jama.295.1.90","article-title":"The History and Meaning of the Journal Impact Factor","volume":"293","author":"Garfield","year":"2006","journal-title":"J. Am. Med. Assoc."},{"key":"ref_9","first-page":"4","article-title":"Scientific journals impact factor: Limitations and alternative indicators","volume":"16","year":"2007","journal-title":"Prof. Inf."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1007\/s11192-007-2036-x","article-title":"History of the journal impact factor: Contingencies and consequences","volume":"79","author":"Archambault","year":"2009","journal-title":"Scientometrics"},{"key":"ref_11","first-page":"434","article-title":"Nefarious Numbers","volume":"58","author":"Arnold","year":"2011","journal-title":"Not. AMS"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/S0165-4608(97)00459-7","article-title":"The journal \u201cimpact factor\u201d: A misnamed, misleading, misused measure","volume":"104","author":"Hecht","year":"1998","journal-title":"Cancer Genet. Cytogenet."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1016\/S0010-9452(08)70603-8","article-title":"Some Misuses of Journal Impact Factor in Research Evaluation","volume":"37","year":"2001","journal-title":"Cortex"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1093\/rev\/2.3.143","article-title":"How representative is the journal impact factor","volume":"2","author":"Seglen","year":"1992","journal-title":"Res. Eval."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1136\/bmj.314.7079.497","article-title":"Why the impact factor of journals should not be used for evaluating research","volume":"314","author":"Seglen","year":"1997","journal-title":"Br. J. Med."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1023\/A:1014812810602","article-title":"Development and application of journal impact measures in the Dutch science system","volume":"53","author":"Moed","year":"2002","journal-title":"Scientometrics"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1007\/s11192-012-0677-x","article-title":"Discussing some basic critique on Journal Impact Factors: Revision of earlier comment","volume":"92","year":"2012","journal-title":"Scientometrics"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1093\/reseval\/rvv041","article-title":"The impact factor as a measuring tool of the prestige of the journals in research assessment in mathematics","volume":"25","author":"Peset","year":"2016","journal-title":"Res. Eval."},{"key":"ref_19","unstructured":"IMU-Joint Committee on Quantitative Assessment of Research (2008). Citation Statistics: A Report From the International Mathematical Union (IMU) in Cooperation With the International Council of Industrial and Applied Mathematics (ICIAM) and the Institute of Mathematical Statistics (IMS), International Mathematical Union."},{"key":"ref_20","unstructured":"(2017, September 19). San Francisco Declaration on Research Assessment (DORA). Available online: http:\/\/www.ascb.org\/dora\/."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Wilsdon, J., Allen, L., Belfiore, E., and Johnson, B. (2015). The Metric Tide: Report of the Independent Review of the Role of Metrics in Research Assessment and Management. Tech. Rep., 111.","DOI":"10.4135\/9781473978782"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1038\/520429a","article-title":"The Leiden Manifesto for research metrics","volume":"520","author":"Hicks","year":"2015","journal-title":"Nature"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sivertsen, G. (2017). Unique, but still best practice? The Research Excellence Framework (REF) from an international perspective. Palgrave Commun., 3.","DOI":"10.1057\/palcomms.2017.78"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"990","DOI":"10.1016\/j.joi.2015.08.005","article-title":"On the stability of citation-based journal rankings","volume":"9","year":"2015","journal-title":"J. Informetr."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1007\/s11192-017-2262-9","article-title":"A multiple-link, mutually reinforced journal-ranking model to measure the prestige of journals","volume":"111","author":"Yu","year":"2017","journal-title":"Scientometrics"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Anderson, D.L., and Tressler, J. (2017). Researcher rank stability across alternative output measurement schemes in the context of a time limited research evaluation: The New Zealand case. Appl. Econ., 1\u201312.","DOI":"10.1080\/00036846.2017.1284997"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"546","DOI":"10.1016\/j.joi.2014.04.006","article-title":"Contents and time sensitive document ranking of scientific literature","volume":"8","author":"Xu","year":"2014","journal-title":"J. Informetr."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1016\/j.joi.2012.02.002","article-title":"Time-aware PageRank for bibliographic networks","volume":"6","author":"Fiala","year":"2012","journal-title":"J. Informetr."},{"key":"ref_29","unstructured":"Pudovkin, A.I., and Garfield, E. (2004, January 12\u201317). Rank-normalized impact factor: Away compare journal performance across subject categories. Proceedings of the 67th Annual Meeting of the American Society for Information Science and Technology, Providence, RI, USA."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.joi.2007.01.001","article-title":"On the behavior of journal impact factor rank-order distribution","volume":"1","author":"Mansilla","year":"2007","journal-title":"J. Informetr."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/j.joi.2009.10.001","article-title":"Ranking marketing journals using the Google Scholar-based hg-index","volume":"4","author":"Moussa","year":"2010","journal-title":"J. Informetr."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1016\/j.joi.2011.01.007","article-title":"Comparing impact factors from two different citation databases: The Case of Computer Science","volume":"5","author":"Sicilia","year":"2011","journal-title":"J. Informetr."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2089","DOI":"10.1007\/s11192-015-1741-0","article-title":"Mathematical properties of weighted impact factors based on measures of prestige of the citing journals","volume":"105","author":"Peset","year":"2015","journal-title":"Scientometrics"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1016\/j.joi.2011.06.002","article-title":"Comparing the expert survey and citation impact journal ranking methods: Example from the field of Artificial Intelligence","volume":"5","author":"Serenko","year":"2011","journal-title":"J. Informetr."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"723","DOI":"10.1108\/OIR-05-2014-0102","article-title":"How variable are the journal impact measures?","volume":"38","author":"Haghdoost","year":"2014","journal-title":"Online Inf. Rev."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1002\/asi.20936","article-title":"Differences in impact factor across fields and over time","volume":"60","author":"Althouse","year":"2009","journal-title":"J. Assoc. Inf. Sci. Technol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/BF02018486","article-title":"Increasing the between-year stability of the impact factor in the Science Citation Index","volume":"35","author":"Aguillo","year":"1996","journal-title":"Scientometrics"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1007\/BF02095762","article-title":"A quick and easy method to estimate the random effect on citation measures","volume":"13","author":"Nieuwenhuysen","year":"1988","journal-title":"Scientometrics"},{"key":"ref_39","first-page":"80","article-title":"How much do core journals change over a decade?","volume":"56","author":"Black","year":"2012","journal-title":"Libr. Resour. Tech. Serv."}],"container-title":["Publications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2304-6775\/5\/3\/21\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:45:28Z","timestamp":1760208328000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2304-6775\/5\/3\/21"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,9,21]]},"references-count":39,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2017,9]]}},"alternative-id":["publications5030021"],"URL":"https:\/\/doi.org\/10.3390\/publications5030021","relation":{},"ISSN":["2304-6775"],"issn-type":[{"type":"electronic","value":"2304-6775"}],"subject":[],"published":{"date-parts":[[2017,9,21]]}}}