{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T09:19:38Z","timestamp":1769937578486,"version":"3.49.0"},"reference-count":46,"publisher":"Emerald","issue":"6","license":[{"start":{"date-parts":[[2014,9,9]],"date-time":"2014-09-09T00:00:00Z","timestamp":1410220800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2014,9,9]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-heading\">Purpose<\/jats:title><jats:p>\u2013 The purpose of this paper is to examine the variability of the impact factor (IF) and additional metrics in biomedical journals to provide some clues to the reliability of journal citation indicators.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Design\/methodology\/approach<\/jats:title><jats:p>\u2013 Having used ISI Journal Citation Reports, from 2005 to 2011, the authors extracted 62 subject categories related to biomedical sciences. The category lists and citation profile for each journal were then downloaded and extracted. Coefficient of variation was applied to estimate the overall variability of the journal citation indicators.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Findings<\/jats:title><jats:p>\u2013 Total citation indicators for 3,411 journals were extracted and examined. The overall variability of IFs and other journal citation measures in basic, clinical or translational, open access or subscription journals decreased while the quality and prestige of those journals developed. Interestingly, journal citation measures produced dissimilar variability trends and thus highlighted the importance of using multiple instead of just one measure in evaluating the performance and influence of biomedical journals. Eigenfactor\u2122, Article's Influence and Cited Half Life proposed as more reliable indicators.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Originality\/value<\/jats:title><jats:p>\u2013 The relative variability of the journal citation measures in biomedical journals would decrease with a development in the impact and quality of journals. Eigenfactor\u2122 and Cited Half Life are suggested as more reliable measures indicating few changes during the study period and across different impact level journals. These findings will be useful for librarians, researchers and decision makers who need to use citation measures as evaluative tools.<\/jats:p><\/jats:sec>","DOI":"10.1108\/oir-05-2014-0102","type":"journal-article","created":{"date-parts":[[2014,10,7]],"date-time":"2014-10-07T05:56:07Z","timestamp":1412661367000},"page":"723-737","source":"Crossref","is-referenced-by-count":14,"title":["How variable are the journal impact measures?"],"prefix":"10.1108","volume":"38","author":[{"given":"Aliakbar","family":"Haghdoost","sequence":"first","affiliation":[]},{"given":"Morteza","family":"Zare","sequence":"additional","affiliation":[]},{"given":"Azam","family":"Bazrafshan","sequence":"additional","affiliation":[]}],"member":"140","reference":[{"key":"key2020122902032763700_b1","unstructured":"Amin, M. and Mabe, M. (2000), \u201cImpact factors: use and abuse\u201d, Perspectives in Publishing, No. 1, pp 1-6."},{"key":"key2020122902032763700_b2","doi-asserted-by":"crossref","unstructured":"Bjork, B.-C. and Solomon, D. (2012), \u201cOpen access versus subscription journals: a comparison of scientific impact\u201d, BMC Medicine, Vol. 10 No. 1, p. -.","DOI":"10.1186\/1741-7015-10-73"},{"key":"key2020122902032763700_b3","doi-asserted-by":"crossref","unstructured":"Bornmann, L. , Marx, W. , Gasparyan, A.Y. and Kitas, G.D. (2011), \u201cDiversity, value and limitations of the journal impact factor and alternative metrics\u201d, Rheumatology International, Vol. 32 No. 7, pp. 1861-1867.","DOI":"10.1007\/s00296-011-2276-1"},{"key":"key2020122902032763700_b4","doi-asserted-by":"crossref","unstructured":"Campanario, J.M. (2010), \u201cEmpirical study of journal impact factors obtained using the classical two-year citation window versus a five-year citation window\u201d, Scientometrics, Vol. 87 No. 1, pp. 189-204.","DOI":"10.1007\/s11192-010-0334-1"},{"key":"key2020122902032763700_b5","doi-asserted-by":"crossref","unstructured":"Chang, C.-L. , Mcaleer, M. and Oxley, L. (2011), \u201cHow are journal impact, prestige and article influence related? An application to neuroscience\u201d, Journal of Applied Statistics, Vol. 38 No. 11, pp. 2563-2573.","DOI":"10.1080\/02664763.2011.559212"},{"key":"key2020122902032763700_b6","doi-asserted-by":"crossref","unstructured":"Chen, K. and Guan, J. (2011), \u201cA bibliometric investigation of research performance in emerging nanobiopharmaceuticals\u201d, Journal of Informetrics, Vol. 5 No. 2, pp. 233-247.","DOI":"10.1016\/j.joi.2010.10.007"},{"key":"key2020122902032763700_b7","doi-asserted-by":"crossref","unstructured":"Colliander, C. and Ahlgren, P. (2011), \u201cThe effects and their stability of field normalization baseline on relative performance with respect to citation impact: a case study of 20 natural science departments\u201d, Journal of Informetrics, Vol. 5 No. 1, pp. 101-113.","DOI":"10.1016\/j.joi.2010.09.003"},{"key":"key2020122902032763700_b8","doi-asserted-by":"crossref","unstructured":"Davis, P.M. (2009), \u201cAuthor-choice open-access publishing in the biological and medical literature: a citation analysis\u201d, Journal of the American Society for Information Science and Technology, Vol. 60 No. 1, pp. 3-8.","DOI":"10.1002\/asi.20965"},{"key":"key2020122902032763700_b9","unstructured":"De Solla Price, D.J. (1970), \u201cCitation measures of hard science, soft science, technology, and nonscience\u201d, in Carnot, E.N. and Pollack, D. (Eds), Communication among Scientists and Engineers, Heath Lexington Books, Lexington, MA, pp. 3-22."},{"key":"key2020122902032763700_b10","doi-asserted-by":"crossref","unstructured":"Eysenbach, G. (2006), \u201cCitation advantage of open access articles\u201d, PLoS Biology, Vol. 4 No. 5, p. -.","DOI":"10.1371\/journal.pbio.0040157"},{"key":"key2020122902032763700_b11","unstructured":"Farlex Inc. (2012), Regression Coefficient, Farlex Inc., Princeton University, Princeton, NJ."},{"key":"key2020122902032763700_b12","doi-asserted-by":"crossref","unstructured":"Franceschet, M. (2010), \u201cJournal influence factors\u201d, Journal of Informetrics, Vol. 4 No. 3, pp. 239-248.","DOI":"10.1016\/j.joi.2009.12.002"},{"key":"key2020122902032763700_b13","unstructured":"Garfield, E. (2005), \u201cThe agony and the ecstasy \u2013 the history and meaning of the journal impact factor\u201d, International Congress on Peer Review and Biomedical Publication, Chicago, IL, 16 September."},{"key":"key2020122902032763700_b14","unstructured":"Garrard, J. (2013), Health Sciences Literature Review Made Easy, Jones & Bartlett Publishers, Mississauga."},{"key":"key2020122902032763700_b15","doi-asserted-by":"crossref","unstructured":"Gl\u00e4nzel, W. and Moed, H.F. (2002), \u201cJournal impact measures in bibliometric research\u201d, Scientometrics, Vol. 53 No. 2, pp. 171-193.","DOI":"10.1023\/A:1014848323806"},{"key":"key2020122902032763700_b16","doi-asserted-by":"crossref","unstructured":"Ha, T.C. , Tan, S.B. and Soo, K.C. (2006), \u201cThe journal impact factor: too much of an impact?\u201d, Annals \u2013 Academy Of Medicine Singapore, Vol. 35 No. 12, pp. 911-916.","DOI":"10.47102\/annals-acadmedsg.V35N12p911"},{"key":"key2020122902032763700_b17","doi-asserted-by":"crossref","unstructured":"Hack, T.F. , Crooks, D. , Plohman, J. and Kepron, E. (2010), \u201cResearch citation analysis of nursing academics in Canada: identifying success indicators\u201d, Journal of Advanced Nursing, Vol. 66 No. 11, pp. 2542-2549.","DOI":"10.1111\/j.1365-2648.2010.05429.x"},{"key":"key2020122902032763700_b18","doi-asserted-by":"crossref","unstructured":"Hack, T.F. , Crooks, D. , Plohman, J. and Kepron, E. (2014), \u201cCitation analysis of Canadian psycho-oncology and supportive care researchers\u201d, Supportive Care in Cancer, Vol. 22 No. 2, pp. 315-324.","DOI":"10.1007\/s00520-013-1966-5"},{"key":"key2020122902032763700_b19","doi-asserted-by":"crossref","unstructured":"Jones, T.H. , Donovan, C. and Hanney, S. (2012), \u201cTracing the wider impacts of biomedical research: a literature search to develop a novel citation categorisation technique\u201d, Scientometrics, Vol. 93 No. 1, pp. 125-134.","DOI":"10.1007\/s11192-012-0642-8"},{"key":"key2020122902032763700_b20","doi-asserted-by":"crossref","unstructured":"Kaur, J. , Radicchi, F. and Menczer, F. (2013), \u201cUniversality of scholarly impact metrics\u201d, Journal of Informetrics, Vol. 7 No. 4, pp. 924-932.","DOI":"10.1016\/j.joi.2013.09.002"},{"key":"key2020122902032763700_b21","unstructured":"Krell, F.-T. (2012), \u201cThe journal impact factor as a performance indicator\u201d, European Science Editing, Vol. 38 No. 1, pp. 3-6."},{"key":"key2020122902032763700_b22","doi-asserted-by":"crossref","unstructured":"Kuo, W. and Rupe, J. (2007), \u201cR-impact factor: reliability-based citation impact factor\u201d, IEEE Transaction on Reliability, Vol. 56 No. 3, pp. 366-367.","DOI":"10.1109\/TR.2007.902789"},{"key":"key2020122902032763700_b23","doi-asserted-by":"crossref","unstructured":"Kurmis, A.P. (2003), \u201cUnderstanding the limitations of the journal impact factor\u201d, The Journal of Bone and Joint Surgery, Vol. 85 No. 12, pp. 2449-2454.","DOI":"10.2106\/00004623-200312000-00028"},{"key":"key2020122902032763700_b24","doi-asserted-by":"crossref","unstructured":"Ladwig, J.P. and Sommese, A.J. (2005), \u201cUsing cited half-life to adjust download statistics\u201d, College & Research Libraries, Vol. 66 No. 6, pp. 527-542.","DOI":"10.5860\/crl.66.6.527"},{"key":"key2020122902032763700_b25","doi-asserted-by":"crossref","unstructured":"Leydesdorff, L. (2008), \u201cCaveats for the use of citation indicators in research and journal evaluations\u201d, Journal of the American Society for Information Science and Technology, Vol. 59 No. 2, pp. 278-287.","DOI":"10.1002\/asi.20743"},{"key":"key2020122902032763700_b26","unstructured":"Nature Materials (2013), \u201cBeware the impact factor\u201d, Nature Materials, Vol. 12 No. 2, p. -, available at: www.nature.com\/nmat\/journal\/v12\/n2\/pdf\/nmat3566.pdf (accessed 28 July 2014)."},{"key":"key2020122902032763700_b27","unstructured":"Nederhof, A.J. , Zwaan, R.A. , De Bruin, R.E. and Dekker, P.J. (1989), \u201cAssessing the usefulness of bibliometric indicators for the humanities and the social and behavioural sciences: a comparative study\u201d, Scientometrics, Vol. 15 Nos 5-6, pp. 423-435."},{"key":"key2020122902032763700_b28","doi-asserted-by":"crossref","unstructured":"Neff, B.D. and Olden, J.D. (2010), \u201cNot so fast: inflation in impact factors contributes to apparent improvements in journal quality\u201d, BioScience, Vol. 60 No. 6, pp. 455-459.","DOI":"10.1525\/bio.2010.60.6.9"},{"key":"key2020122902032763700_b29","unstructured":"Ogden, T.L. and Bartley, D.L. (2008), \u201cThe ups and downs of journal impact factors\u201d, Annals of Occupational Hygiene, Vol. 52 No. 2, pp. 73-82."},{"key":"key2020122902032763700_b30","doi-asserted-by":"crossref","unstructured":"Owlia, P. , Vasei, M. , Goliaei, B. and Nassiri, I. (2011), \u201cNormalized impact factor (NIF): an adjusted method for calculating the citation rate of biomedical journals\u201d, Journal of Biomedical Informatics, Vol. 44 No. 2, pp. 216-220.","DOI":"10.1016\/j.jbi.2010.11.002"},{"key":"key2020122902032763700_b31","doi-asserted-by":"crossref","unstructured":"Pagel, P.S. and Hudetz, J.A. (2011a), \u201cAn analysis of scholarly productivity in United States academic anaesthesiologists by citation bibliometrics\u201d, Anaesthesia, Vol. 66 No. 10, pp. 873-878.","DOI":"10.1111\/j.1365-2044.2011.06860.x"},{"key":"key2020122902032763700_b32","doi-asserted-by":"crossref","unstructured":"Pagel, P.S. and Hudetz, J.A. (2011b), \u201cBibliometric analysis of anaesthesia journal editorial board members: correlation between journal impact factor and the median H-index of its board members\u201d, British Journal of Anaesthesia, Vol. 107 No. 3, pp. 357-361.","DOI":"10.1093\/bja\/aer191"},{"key":"key2020122902032763700_b33","doi-asserted-by":"crossref","unstructured":"Patel, V.M. , Ashrafian, H. , Ahmed, K. , Arora, S. , Jiwan, S. , Nicholson, J.K. , Darzi, A. and Athanasiou, T. (2011), \u201cHow has healthcare research performance been assessed? A systematic review\u201d, Journal of the Royal Society of Medicine, Vol. 104 No. 6, pp. 251-261.","DOI":"10.1258\/jrsm.2011.110005"},{"key":"key2020122902032763700_b34","doi-asserted-by":"crossref","unstructured":"PLoS Medicine (2006), \u201cImpact factor game\u201d, PLoS Med., Vol. 3 No. 6, p. -.","DOI":"10.1371\/journal.pmed.0030291"},{"key":"key2020122902032763700_b35","doi-asserted-by":"crossref","unstructured":"Radicchi, F. and Castellano, C. (2012), \u201cTesting the fairness of citation indicators for comparison across scientific domains: the case of fractional citation counts\u201d, Journal of Informetrics, Vol. 6 No. 1, pp. 121-130.","DOI":"10.1016\/j.joi.2011.09.002"},{"key":"key2020122902032763700_b36","doi-asserted-by":"crossref","unstructured":"Rizkallah, J. and Sin, D.D. (2010), \u201cIntegrative approach to quality assessment of medical journals using impact factor, eigenfactor, and article influence scores\u201d, PloS One, Vol. 5 No. 4, p. -.","DOI":"10.1371\/journal.pone.0010204"},{"key":"key2020122902032763700_b37","doi-asserted-by":"crossref","unstructured":"Schubert, A. and Gl\u00e4nzel, W. (1983), \u201cStatistical reliability of comparisons based on the citation impact of scientific publications\u201d, Scientometrics, Vol. 5 No. 1, pp. 59-74.","DOI":"10.1007\/BF02097178"},{"key":"key2020122902032763700_b38","doi-asserted-by":"crossref","unstructured":"Sharma, B. , Boet, S. , Grantcharov, T. , Shin, E. , Barrowman, N.J. and Bould, M.D. (2013), \u201cThe H-index outperforms other bibliometrics in the assessment of research performance in general surgery: a province-wide study\u201d, Surgery, Vol. 153 No. 4, pp. 493-501.","DOI":"10.1016\/j.surg.2012.09.006"},{"key":"key2020122902032763700_b39","doi-asserted-by":"crossref","unstructured":"Siebelt, M. , Siebelt, T. , Pilot, P. , Bloem, R.M. , Bhandari, M. and Poolman, R.W. (2010), \u201cCitation analysis of orthopaedic literature: 18 major orthopaedic journals compared for Impact Factor and SCImago\u201d, BMC Musculoskeletal Disorders, Vol. 11 No. 4, p. -.","DOI":"10.1186\/1471-2474-11-4"},{"key":"key2020122902032763700_b40","doi-asserted-by":"crossref","unstructured":"Van Eck, N.J. , Waltman, L. , Van Raan, A.F.J. , Klautz, R.J.M. and Peul, W.C. (2013), \u201cCitation analysis may severely underestimate the impact of clinical research as compared to basic research\u201d, PloS One, Vol. 8 No. 4, p. -.","DOI":"10.1371\/journal.pone.0062395"},{"key":"key2020122902032763700_b41","doi-asserted-by":"crossref","unstructured":"Vanclay, J.K. (2012), \u201cImpact Factor: outdated artefact or stepping-stone to journal certification?\u201d, Scientometrics, Vol. 92 No. 2, pp. 211-238.","DOI":"10.1007\/s11192-011-0561-0"},{"key":"key2020122902032763700_b42","doi-asserted-by":"crossref","unstructured":"Walters, W.H. and Linvill, A. (2010), \u201cCharacteristics of open access journals in six subject areas\u201d, College & Research Libraries, Vol. 72 No. 4, pp. 372-392.","DOI":"10.5860\/crl-132"},{"key":"key2020122902032763700_b43","doi-asserted-by":"crossref","unstructured":"Waltman, L. and Van Eck, N.J. (2013), \u201cA systematic empirical comparison of different approaches for normalizing citation impact indicators\u201d, Journal of Informetrics, Vol. 7 No. 4, pp. 833-849.","DOI":"10.1016\/j.joi.2013.08.002"},{"key":"key2020122902032763700_b44","doi-asserted-by":"crossref","unstructured":"West, J.D. , Bergstrom, T.C. and Bergstrom, C.T. (2010), \u201cThe Eigenfactor MetricsTM: a network approach to assessing scholarly journals\u201d, College & Research Libraries, Vol. 71 No. 3, pp. 236-244.","DOI":"10.5860\/0710236"},{"key":"key2020122902032763700_b45","doi-asserted-by":"crossref","unstructured":"Yu, G. , Yang, D.H. and Liang, W. (2010), \u201cReliability-based citation impact factor and the manipulation of impact factor\u201d, Scientometrics, Vol. 83 No. 1, pp. 259-270.","DOI":"10.1007\/s11192-009-0083-1"},{"key":"key2020122902032763700_b46","doi-asserted-by":"crossref","unstructured":"Zacca-Gonz\u00e1lez, G. , Chinchilla-Rodr\u00edguez, Z. , Vargas-Quesada, B. and De Moya-Aneg\u00f3n, F.L. (2014), \u201cBibliometric analysis of regional Latin America's scientific output in Public Health through SCImago Journal and Country Rank\u201d, BMC Public Health, Vol. 14 No. 1, p. -.","DOI":"10.1186\/1471-2458-14-632"}],"container-title":["Online Information Review"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/OIR-05-2014-0102","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/OIR-05-2014-0102\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/OIR-05-2014-0102\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:42:55Z","timestamp":1753396975000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/oir\/article\/38\/6\/723-737\/316082"}},"subtitle":[],"editor":[{"given":"Dr","family":"David Stuart","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2014,9,9]]},"references-count":46,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2014,9,9]]}},"alternative-id":["10.1108\/OIR-05-2014-0102"],"URL":"https:\/\/doi.org\/10.1108\/oir-05-2014-0102","relation":{},"ISSN":["1468-4527"],"issn-type":[{"value":"1468-4527","type":"print"}],"subject":[],"published":{"date-parts":[[2014,9,9]]}}}