{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T22:52:36Z","timestamp":1759963956346,"version":"3.41.2"},"reference-count":54,"publisher":"Emerald","issue":"4","license":[{"start":{"date-parts":[[2014,7,15]],"date-time":"2014-07-15T00:00:00Z","timestamp":1405382400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2014,7,15]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-heading\">Purpose<\/jats:title><jats:p>\u2013 The purpose of this paper is to show that the journal impact factor (IF) is not able to reflect the full impact of scholarly journals and provides an overview of alternative and complementary methods in journal evaluation.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Design\/methodology\/approach<\/jats:title><jats:p>\u2013 Aslib Proceedings (AP) is exemplarily analyzed with a set of indicators from five dimensions of journal evaluation, i.e. journal output, content, perception and usage, citations and management to accurately reflect its various strengths and weaknesses beyond the IF.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Findings<\/jats:title><jats:p>\u2013 AP has become more international in terms of authors and more diverse regarding its topics. Citation impact is generally low and, with the exception of a special issue on blogs, remains world average. However, an evaluation of downloads and Mendeley readers reveals that the journal is an important source of information for professionals and students and certain topics are frequently read but not cited.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Research limitations\/implications<\/jats:title><jats:p>\u2013 The study is limited to one journal.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Practical implications<\/jats:title><jats:p>\u2013 An overview of various indicators and methods is provided that can be applied in the quantitative evaluation of scholarly journals (and also to articles, authors and institutions).<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Originality\/value<\/jats:title><jats:p>\u2013 After a publication history of more than 60 years, this analysis takes stock of AP, highlighting strengths and weaknesses and developments over time. The case study provides an example and overview of the possibilities of multidimensional journal evaluation.<\/jats:p><\/jats:sec>","DOI":"10.1108\/ajim-11-2013-0127","type":"journal-article","created":{"date-parts":[[2014,7,10]],"date-time":"2014-07-10T13:29:44Z","timestamp":1404998984000},"page":"358-380","source":"Crossref","is-referenced-by-count":13,"title":["A multidimensional analysis of Aslib proceedings \u2013 using everything but the impact factor"],"prefix":"10.1108","volume":"66","author":[{"given":"Stefanie","family":"Haustein","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vincent","family":"Larivi\u00e8re","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"key":"key2020123002300550300_b1","doi-asserted-by":"crossref","unstructured":"Adam, D. (2002), \u201cThe counting house\u201d, Nature, Vol. 415 No. 6873, pp. 726-729.","DOI":"10.1038\/415726a"},{"key":"key2020123002300550300_b2","doi-asserted-by":"crossref","unstructured":"Archambault, \u00c9. and Larivi\u00e8re, V. (2009), \u201cHistory of the journal impact factor: contingencies and consequences\u201d, Scientometrics, Vol. 79 No. 3, pp. 635-649.","DOI":"10.1007\/s11192-007-2036-x"},{"key":"key2020123002300550300_b3","doi-asserted-by":"crossref","unstructured":"Bonacich, P. (1972), \u201cFactoring and weighting approaches to clique identification\u201d, Journal of Mathematical Sociology, Vol. 2 No. 1, pp. 113-120.","DOI":"10.1080\/0022250X.1972.9989806"},{"key":"key2020123002300550300_b4","unstructured":"Bradford, S.C. (1934), \u201cSources of information on specific subjects\u201d, Engineering, Vol. 137, pp. 85-86."},{"key":"key2020123002300550300_b5","doi-asserted-by":"crossref","unstructured":"Brin, S. and Page, L. (1998), \u201cThe anatomy of a large-scale hypertextual web search engine\u201d, Computer Networks and ISDN Systems, Vol. 30 Nos 1-7, pp. 107-117.","DOI":"10.1016\/S0169-7552(98)00110-X"},{"key":"key2020123002300550300_b6","doi-asserted-by":"crossref","unstructured":"Coleman, A. (2007), \u201cAssessing the value of a journal beyond the impact factor\u201d, Journal of the American Society for Information Science and Technology, Vol. 58 No. 8, pp. 1148-1161.","DOI":"10.1002\/asi.20599"},{"key":"key2020123002300550300_b7","unstructured":"DORA (2013), \u201cSan Francisco declaration on research assessment\u201d, available at: http:\/\/am.ascb.org\/dora (accessed November 28, 2013)."},{"key":"key2020123002300550300_b8","doi-asserted-by":"crossref","unstructured":"Falagas, M.E. , Kouranos, V.D. , Arencibia-Jorge, R. and Karageorgopoulos, D.E. (2008), \u201cComparison of SCImago journal rank indicator with journal impact factor\u201d, FASEB Journal, Vol. 22 No. 8, pp. 2623-2628.","DOI":"10.1096\/fj.08-107938"},{"key":"key2020123002300550300_b9","doi-asserted-by":"crossref","unstructured":"Garfield, E. (1955), \u201cCitation indexes for science. A new dimension in documentation in association of ideas\u201d, Science, Vol. 122 No. 3159, pp. 108-111.","DOI":"10.1126\/science.122.3159.108"},{"key":"key2020123002300550300_b10","doi-asserted-by":"crossref","unstructured":"Garfield, E. (1972), \u201cCitation analysis as a tool in journal evaluation. Journals can be ranked by frequency and impact of citations for science policy studies\u201d, Science, Vol. 178 No. 4060, pp. 471-479.","DOI":"10.1126\/science.178.4060.471"},{"key":"key2020123002300550300_b11","doi-asserted-by":"crossref","unstructured":"Garfield, E. and Sher, I.H. (1963), \u201cNew factors in evaluation of scientific literature through citation indexing\u201d, American Documentation, Vol. 14 No. 3, pp. 195-201.","DOI":"10.1002\/asi.5090140304"},{"key":"key2020123002300550300_b12","doi-asserted-by":"crossref","unstructured":"Gl\u00e4nzel, W. and Moed, H. (2002), \u201cJournal impact measures in bibliometric research\u201d, Scientometrics, Vol. 53 No. 2, pp. 171-193.","DOI":"10.1023\/A:1014848323806"},{"key":"key2020123002300550300_b13","doi-asserted-by":"crossref","unstructured":"Gonzalez-Pereira, B. , Guerrero-Bote, V.P. and de Moya-Anegon, F. (2010), \u201cA new approach to the metric of journals\u2019 scientific prestige: the SJR indicator\u201d, Journal of Informetrics, Vol. 4 No. 3, pp. 379-391.","DOI":"10.1016\/j.joi.2010.03.002"},{"key":"key2020123002300550300_b52","unstructured":"Grazia Colonia (2002), Informationswissenschaftliche Zeitschriften in szientometrischer Anlayse, K\u00f6lner Arbeitspapiere zur Bibliotheks- und Informationswissenschaft, 33, Cologne, available at: http:\/\/opus.bibl.fh-koeln.de\/volltexte\/2003\/36\/pdf\/grazia.pdf (accessed November 28, 2013)."},{"key":"key2020123002300550300_b14","doi-asserted-by":"crossref","unstructured":"Gross, P.L.K. and Gross, E.M. (1927), \u201cCollege libraries and chemical education\u201d, Science, Vol. 66 No. 1713, pp. 385-389.","DOI":"10.1126\/science.66.1713.385"},{"key":"key2020123002300550300_b15","doi-asserted-by":"crossref","unstructured":"Gunn, W. (2013), \u201cSocial signals reflect academic impact: what it means when a scholar adds a paper to Mendeley\u201d, Information Standards Quarterly, Vol. 25 No. 2, pp. 33-39.","DOI":"10.3789\/isqv25no2.2013.06"},{"key":"key2020123002300550300_b16","doi-asserted-by":"crossref","unstructured":"Haustein, S. (2012), Multidimensional Journal Evaluation. Analyzing Scientific Periodicals Beyond the Impact Factor, De Gruyter Saur, Berlin and Boston, MA.","DOI":"10.1515\/9783110255553"},{"key":"key2020123002300550300_b17","doi-asserted-by":"crossref","unstructured":"Haustein, S. (in press), \u201cReadership metrics\u201d, in Cronin, B. and Sugimoto, C.R. (Eds), Bibliometrics and Beyond: Metrics-Based Evaluation of Scholarly Research, MIT Press, Cambridge, MA, pp. 327-344.","DOI":"10.7551\/mitpress\/9445.003.0022"},{"key":"key2020123002300550300_b18","unstructured":"Haustein, S. , Larivi\u00e8re, V. , Thelwall, M. , Amyot, D. and Peters, I. (in press), \u201cTweets vs Mendeley readers: how do these two social media metrics differ?\u201d, IT \u2013 Information Technology."},{"key":"key2020123002300550300_b21","unstructured":"Juchem, K. , Schl\u00f6gl, C. and Stock, W.G. (2006), \u201cDimensionen der Zeitschriftenszientometrie am Beispiel von \u2018Buch und Bibliothek\u2019\u201d, Information. Wissenschaft & Praxis, Vol. 57 No. 1, pp. 31-37."},{"key":"key2020123002300550300_b22","doi-asserted-by":"crossref","unstructured":"Leydesdorff, L. and Opthof, T. (2010), \u201cNormalization on the field level: fractional counting of citations\u201d, Journal of Informetrics, Vol. 4 No. 4, pp. 644-646.","DOI":"10.1016\/j.joi.2010.05.003"},{"key":"key2020123002300550300_b23","doi-asserted-by":"crossref","unstructured":"Li, X. , Thelwall, M. and Giustini, D. (2012), \u201cValidating online reference managers for scholarly impact measurement\u201d, Scientometrics, Vol. 91 No. 2, pp. 461-471.","DOI":"10.1007\/s11192-011-0580-x"},{"key":"key2020123002300550300_b24","doi-asserted-by":"crossref","unstructured":"Mabe, M.A. and Amin, M. (2002), \u201cDr Jekyll and Dr Hyde: author-reader asymmetries in scholarly publishing\u201d, Aslib Proceedings, Vol. 54 No. 3, pp. 149-157.","DOI":"10.1108\/00012530210441692"},{"key":"key2020123002300550300_b25","unstructured":"Moed, H.F. (2005), Citation Analysis in Research Evaluation, Springer, Dordrecht."},{"key":"key2020123002300550300_b250","doi-asserted-by":"crossref","unstructured":"Moed, H.F. (2010), \u201cMeasuring contextual citation impact of scientific journals\u201d, Journal of Informetrics, Vol. 4 No. 3, pp. 265-277.","DOI":"10.1016\/j.joi.2010.01.002"},{"key":"key2020123002300550300_b26","doi-asserted-by":"crossref","unstructured":"Moed, H.F. and van Leeuwen, T.N. (1995), \u201cImproving the accuracy of Institute for Scientific Information's journal impact factors\u201d, Journal of the American Society for Information Science, Vol. 46 No. 6, pp. 461-467.","DOI":"10.1002\/(SICI)1097-4571(199507)46:6<461::AID-ASI5>3.0.CO;2-G"},{"key":"key2020123002300550300_b27","doi-asserted-by":"crossref","unstructured":"Moed, H.F. , van Leeuwen, T.N. and Reedijk, J. (1998), \u201cA new classification system to describe the ageing of scientific journals and their impact factors\u201d, Journal of Documentation, Vol. 54 No. 4, pp. 387-419.","DOI":"10.1108\/EUM0000000007175"},{"key":"key2020123002300550300_b28","doi-asserted-by":"crossref","unstructured":"Mohammadi, E. and Thelwall, M. (in press), \u201cMendeley readership altmetrics for the social sciences and humanities: research evaluation and knowledge flows\u201d, Journal of the American Society for Information Science and Technology, doi: 10.1002\/asi.23071.","DOI":"10.1002\/asi.23071"},{"key":"key2020123002300550300_b29","unstructured":"Mohammadi, E. , Thelwall, M. , Haustein, S. and Larivi\u00e8re, V. (in press), \u201cWho reads research articles? an altmetrics analysis of Mendeley user categories\u201d, Journal of the Association for Information Science and Technology."},{"key":"key2020123002300550300_b31","doi-asserted-by":"crossref","unstructured":"Nicholas, D. and Rowlands, I. (2008), \u201cAslib Proceedings is 60 years old\u201d, Aslib Proceedings, Vol. 60 No. 4.","DOI":"10.1108\/ap.2008.27660daa.001"},{"key":"key2020123002300550300_b30","doi-asserted-by":"crossref","unstructured":"Nicholas, D. , Huntington, P. , Jamali, H.R. , Rowlands, I. , Dobrowolski, T. and Tenopir, C. (2008), \u201cViewing and reading behaviour in a virtual environment \u2013 the fulltext download and what can be read into it\u201d, Aslib Proceedings, Vol. 60 No. 3, pp. 185-198.","DOI":"10.1108\/00012530810879079"},{"key":"key2020123002300550300_b32","doi-asserted-by":"crossref","unstructured":"Nisonger, T.E. (1999), \u201cJASIS and library and information science journal rankings: a review and analysis of the last half-century\u201d, Journal of the American Society of Information Science, Vol. 50 No. 11, pp. 1004-1019.","DOI":"10.1002\/(SICI)1097-4571(1999)50:11<1004::AID-ASI6>3.0.CO;2-K"},{"key":"key2020123002300550300_b33","doi-asserted-by":"crossref","unstructured":"Pinski, G. and Narin, F. (1976), \u201cCitation influence for journal aggregates of scientific publications \u2013 theory with application to literature of physics\u201d, Information Processing & Management, Vol. 12 No. 5, pp. 297-312.","DOI":"10.1016\/0306-4573(76)90048-0"},{"key":"key2020123002300550300_b34","unstructured":"Project COUNTER (2008), \u201cThe COUNTER code of practice. Journals and databases release 3\u201d, available at: www.projectcounter.org\/r3\/Release3D9.pdf (assessed September 11, 2013)."},{"key":"key2020123002300550300_b35","unstructured":"Rousseau, R. (2002), \u201cJournal evaluation: technical and practical issues\u201d, Library Trends, Vol. 50 No. 3, pp. 418-439."},{"key":"key2020123002300550300_b36","doi-asserted-by":"crossref","unstructured":"Rowlands, I. and Nicholas, D. (2007), \u201cThe missing link: journal usage metrics\u201d, Aslib Proceedings, Vol. 59 No. 3, pp. 222-228.","DOI":"10.1108\/00012530710752025"},{"key":"key2020123002300550300_b38","unstructured":"Schl\u00f6gl, C. , Gorraiz, J. , Gumpenberger, C. , Jack, K. and Kraker, P. (2013), \u201cDownload vs citation vs. readership data: the case of an Information Systems journal\u201d, Proceedings of the 14th International Society of Scientometrics and Informetrics Conference, Vol. 1 pp. 626-634."},{"key":"key2020123002300550300_b39","unstructured":"Schmid, H. (1994), \u201cProbabilistic part-of-speech tagging using decision trees\u201d, Proceedings of the International Conference on New Methods in Language Processing, Manchester, pp. 44-49."},{"key":"key2020123002300550300_b40","unstructured":"SCImago Research Group (2007), \u201cDescription of SCImago Journal Rank Indicator\u201d, available at: www.scimagojr.com\/SCImagoJournalRank.pdf (assessed November 28, 2013)."},{"key":"key2020123002300550300_b41","doi-asserted-by":"crossref","unstructured":"Small, H. (1973), \u201cCo-citation in scientific literature \u2013 new measure of relationship between 2 documents\u201d, Journal of the American Society for Information Science, Vol. 24 No. 4, pp. 265-269.","DOI":"10.1002\/asi.4630240406"},{"key":"key2020123002300550300_b42","unstructured":"Small, H. and Sweeney, E. (1985), \u201cClustering the science citation index using co-citations I. A comparison of methods\u201d, Scientometrics, Vol. 7 Nos 3-6, pp. 391-409."},{"key":"key2020123002300550300_b43","doi-asserted-by":"crossref","unstructured":"The PLoS Medicine Editors (2006), \u201cThe impact factor game \u2013 it is time to find a better way to assess the scientific literature\u201d, PLoS Medicine, Vol. 3 No. 6, p. -.","DOI":"10.1371\/journal.pmed.0030291"},{"key":"key2020123002300550300_b44","doi-asserted-by":"crossref","unstructured":"Todorov, R. and Gl\u00e4nzel, W. (1988), \u201cJournal citation measures \u2013 a concise review\u201d, Journal of Information Science, Vol. 14 No. 1, pp. 47-56.","DOI":"10.1177\/016555158801400106"},{"key":"key2020123002300550300_b45","doi-asserted-by":"crossref","unstructured":"van Eck, N.J. and Waltman, L. (2009), \u201cHow to normalize cooccurrence data? An analysis of some well-known similarity measures\u201d, Journal of the American Society for Information Science and Technology, Vl. 60 No. 8, pp. 1635-1651.","DOI":"10.1002\/asi.21075"},{"key":"key2020123002300550300_b46","doi-asserted-by":"crossref","unstructured":"van Eck, N.J. and Waltman, L. (2010), \u201cSoftware survey: VOSviewer, a computer program for bibliometric mapping\u201d, Scientometrics, Vol. 84 No. 2, pp. 523-538.","DOI":"10.1007\/s11192-009-0146-3"},{"key":"key2020123002300550300_b47","doi-asserted-by":"crossref","unstructured":"van Eck, N.J. , Waltman, L. , Noyons, E.C.M. and Buter, R.K. (2010), \u201cAutomatic term identification for bibliometric mapping\u201d, Scientometrics, Vol. 82 No. 3, pp. 581-596.","DOI":"10.1007\/s11192-010-0173-0"},{"key":"key2020123002300550300_b48","doi-asserted-by":"crossref","unstructured":"Van Leeuwen, T.N. and Moed, H.F. (2002), \u201cDevelopment and application of journal impact measures in the Dutch science system\u201d, Scientometrics, Vol. 53 No. 2, pp. 249-266.","DOI":"10.1023\/A:1014808709694"},{"key":"key2020123002300550300_b49","doi-asserted-by":"crossref","unstructured":"Waltman, L. and van Eck, N.J. (2010), \u201cThe relation between eigenfactor, audience factor, and influence weight\u201d, Journal of the American Society for Information Science and Technology, Vol. 61 No. 7, pp. 1476-1486.","DOI":"10.1002\/asi.21354"},{"key":"key2020123002300550300_b50","unstructured":"Zahedi, Z. , Costas, R. and Wouters, P. (2013), \u201cWhat is the impact of the publications read by the different Mendeley users? Could they help to identify alternative types of impact?\u201d, presentation held at the PLoS ALM Workshop 2013, San Francisco, CA, available at: http:\/\/lanyrd.com\/2013\/alm13\/scrdpk\/ (accessed November 28, 2013)."},{"key":"key2020123002300550300_b51","doi-asserted-by":"crossref","unstructured":"Zitt, M. (2010), \u201cCiting-side normalization of journal impact: a robust variant of the audience factor\u201d, Journal of Informetrics, Vol. 4 No. 3, pp. 392-406.","DOI":"10.1016\/j.joi.2010.03.004"},{"key":"key2020123002300550300_b251","doi-asserted-by":"crossref","unstructured":"Zitt, M. (2011), \u201cBehind citing-side normalization of citations: some properties of the journal impact factor\u201d, Scientometrics, Vol. 89 No. 1, pp. 329-344.","DOI":"10.1007\/s11192-011-0441-7"},{"key":"key2020123002300550300_frd1","doi-asserted-by":"crossref","unstructured":"Haustein, S. and Peters, I. (2012), \u201cUsing social bookmarks and tags as alternative indicators of journal content description\u201d, First Monday, Vol. 17 No. 11, available at: http:\/\/firstmonday.org\/ojs\/index.php\/fm\/article\/view\/4110 (accessed November 28, 2013).","DOI":"10.5210\/fm.v17i11.4110"},{"key":"key2020123002300550300_frd2","doi-asserted-by":"crossref","unstructured":"Haustein, S. , Peters, I. , Sugimoto, C.R. , Thelwall, M. and Larivi\u00e8re, V. (2014), \u201cTweeting biomedicine: an analysis of tweets and citations in the biomedical literature\u201d, Journal of the Association for Information Science and Technology, Vol. 65 No. 4, pp. 113-120.","DOI":"10.1002\/asi.23101"},{"key":"key2020123002300550300_frd3","unstructured":"Salton, G. and McGill, M.J. (1987), Introduction to Modern Information Retrieval, McGraw-Hill, New York, NY."}],"container-title":["Aslib Journal of Information Management"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/AJIM-11-2013-0127","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/AJIM-11-2013-0127\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/AJIM-11-2013-0127\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T23:01:23Z","timestamp":1753398083000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/ajim\/article\/66\/4\/358-380\/41438"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,7,15]]},"references-count":54,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2014,7,15]]}},"alternative-id":["10.1108\/AJIM-11-2013-0127"],"URL":"https:\/\/doi.org\/10.1108\/ajim-11-2013-0127","relation":{},"ISSN":["2050-3806"],"issn-type":[{"type":"print","value":"2050-3806"}],"subject":[],"published":{"date-parts":[[2014,7,15]]}}}