{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T17:53:39Z","timestamp":1754157219127,"version":"3.41.2"},"reference-count":27,"publisher":"Emerald","issue":"2","license":[{"start":{"date-parts":[[2010,6,1]],"date-time":"2010-06-01T00:00:00Z","timestamp":1275350400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2010,6,1]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-heading\">Purpose<\/jats:title><jats:p>Usually the impact of research and researchers is quantified by using citation data: either by journal\u2010centered citation data as in the case of the journal impact factor (JIF) or by author\u2010centered citation data as in the case of the Hirsch\u2010 or h\u2010index. This paper aims to discuss a range of impact measures, especially usage\u2010based metrics, and to report the results of two surveys.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Design\/methodology\/approach<\/jats:title><jats:p>The first part of the article analyzes both citation\u2010based and usage\u2010based metrics. The second part is based on the findings of the surveys: one in the form of a brainstorming session with information professionals and scientists at the OAI6 conference in Geneva, the second in the form of expert interviews, mainly with scientists.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Findings<\/jats:title><jats:p>The results of the surveys indicate an interest in the social aspects of science, like visualizations of social graphs both for persons and their publications. Furthermore, usage data are considered an appropriate measure to describe quality and coverage of scientific documents; admittedly, the consistence of usage information among repositories has to be kept in mind. The scientists who took part in the survey also asked for community services, assuming these might help to identify relevant scientific information more easily. Some of the other topics of interest were personalization or easy submission procedures.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Originality\/value<\/jats:title><jats:p>This paper delineates current discussions about citation\u2010based and usage\u2010based metrics. Based on the results of the surveys, it depicts which functionalities could enhance repositories, what features are required by scientists and information professionals, and whether usage\u2010based services are considered valuable. These results also outline some elements of future repository research.<\/jats:p><\/jats:sec>","DOI":"10.1108\/10650751011048506","type":"journal-article","created":{"date-parts":[[2010,6,5]],"date-time":"2010-06-05T07:07:04Z","timestamp":1275721624000},"page":"133-145","source":"Crossref","is-referenced-by-count":1,"title":["How to assess the impact of an electronic document? And what does impact mean anyway?"],"prefix":"10.1108","volume":"26","author":[{"given":"Ulrich","family":"Herb","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eva","family":"Kranz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tobias","family":"Leidinger","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bj\u00f6rn","family":"Mittelsdorf","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"key":"key2022031520002730100_b1","unstructured":"Appelt, W. (2001), \u201cWhat groupware functionality do users really use? Analysis of the usage of the BSCW system\u201d, Parallel and Distributed Processing, 2001, Proceedings of the Ninth Euromicro Workshop on Parallel and Distributed Processing, Mantova, Italy, February 7\u20109."},{"key":"key2022031520002730100_b2","unstructured":"Bogner, A., Littig, B. and Menz, W. (2005), Das Experteninterview: Theorie, Methode, Anwendung, VS Verlag f\u00fcr Sozialwissenschaften, Wiesbaden."},{"key":"key2022031520002730100_b3","doi-asserted-by":"crossref","unstructured":"Bollen, J., Van de Sompel, H. and Rodriguez, M.A. (2008), \u201cTowards usage\u2010based impact metrics: first results from the MESUR project\u201d, Proceedings of the 8th ACM\/IEEE\u2010CS Joint Conference on Digital Libraries, Pittsburgh, PA, pp. 231\u201040.","DOI":"10.1145\/1378889.1378928"},{"key":"key2022031520002730100_b4","doi-asserted-by":"crossref","unstructured":"Brumback, R.A. (2009), \u201cImpact factor wars: episode V \u2013 the empire strikes back\u201d, Journal of Child Neurology, Vol. 24 No. 3, pp. 260\u20102.","DOI":"10.1177\/0883073808331366"},{"key":"key2022031520002730100_b5","doi-asserted-by":"crossref","unstructured":"Davis, P.M. and Price, J.S. (2006), \u201ceJournal interface can influence usage statistics: implications for libraries, publishers, and Project COUNTER\u201d, Journal of the American Society for Information Science and Technology, Vol. 57 No. 9, pp. 1243\u20108.","DOI":"10.1002\/asi.20405"},{"key":"key2022031520002730100_b6","doi-asserted-by":"crossref","unstructured":"Galyani Moghaddam, G. and Moballeghi, M. (2008), \u201cHow do we measure use of scientific journals? A note on research methodologies\u201d, Scientometrics, Vol. 76 No. 1, pp. 125\u201033.","DOI":"10.1007\/s11192-007-1901-y"},{"key":"key2022031520002730100_b7","doi-asserted-by":"crossref","unstructured":"Garfield, E. (2006), \u201cThe history and meaning of the journal impact factor\u201d, Journal of the American Medical Association, Vol. 295 No. 1, pp. 90\u20103.","DOI":"10.1001\/jama.295.1.90"},{"key":"key2022031520002730100_b8","unstructured":"Ghaphery, J. and Ream, D. (2000), \u201cVCU's my library: librarians love it \u2026 users? Well, maybe\u201d, Information Technology and Libraries, Vol. 19 No. 4, pp. 186\u201090."},{"key":"key2022031520002730100_b9","doi-asserted-by":"crossref","unstructured":"Harnad, S. (2008), \u201cValidating research performance metrics against peer rankings\u201d, Inter\u2010research Ethics in Science and Environmental Politics, Vol. 8, pp. 103\u20107.","DOI":"10.3354\/esep00088"},{"key":"key2022031520002730100_b10","unstructured":"IRS (2007), IRS: Interoperable Repository Statistics, available at: http:\/\/irs.eprints.org\/ (accessed 17 July 2009)."},{"key":"key2022031520002730100_b11","doi-asserted-by":"crossref","unstructured":"Jensen, P., Rouquier, J.\u2010B. and Croissant, Y. (2009), \u201cTesting bibliometric indicators by their prediction of scientists promotions\u201d, Scientometrics, Vol. 78 No. 3, pp. 467\u201079.","DOI":"10.1007\/s11192-007-2014-3"},{"key":"key2022031520002730100_b12","unstructured":"Ketchell, D.S. (2000), \u201cToo many channels: making sense out of portals and personalization\u201d, Information Technology and Libraries, Vol. 19 No. 4, pp. 175\u20109."},{"key":"key2022031520002730100_b14","doi-asserted-by":"crossref","unstructured":"McWilliams, A., Siegel, D. and Van Fleet, D.D. (2005), \u201cScholarly journals as producers of knowledge: theory and empirical evidence based on data envelopment analysis\u201d, Organizational Research Methods, Vol. 8 No. 2, pp. 185\u2010201.","DOI":"10.1177\/1094428105275377"},{"key":"key2022031520002730100_b13","doi-asserted-by":"crossref","unstructured":"Mabel, C., Villanueva, E.V. and Van Der Weyden, M.B. (2007), \u201cLife and times of the impact factor: retrospective analysis of trends for seven medical journals (1994\u20102005) and their Editors' views\u201d, Journal of the Royal Society of Medicine, Vol. 100 No. 3, pp. 142\u201050.","DOI":"10.1258\/jrsm.100.3.142"},{"key":"key2022031520002730100_b15","unstructured":"Mittelsdorf, B. and Herb, U. (2009), \u201cBreakout group 6. Access data mining: a new foundation for added\u2010value services in full text repositories\u201d, available at: http:\/\/indico.cern.ch\/contributionDisplay.py?contribId=72&confId=48321 (accessed 17 August 2009)."},{"key":"key2022031520002730100_b16","doi-asserted-by":"crossref","unstructured":"Moed, H.F. (2005a), \u201cStatistical relationships between downloads and citations at the level of individual documents within a single journal\u201d, Journal of the American Society for Information Science and Technology, Vol. 56 No. 10, pp. 1088\u201097.","DOI":"10.1002\/asi.20200"},{"key":"key2022031520002730100_b17","unstructured":"Moed, H.F. (2005b), Citation Analysis in Research Evaluation, Springer, Dordrecht."},{"key":"key2022031520002730100_b18","doi-asserted-by":"crossref","unstructured":"Montaner, M., L\u00f3pez, B. and De La Rosa, J.L. (2003), \u201cA taxonomy of recommender agents on the internet\u201d, Arti\ufb01cial Intelligence Review, Vol. 19 No. 4, pp. 285\u2010330.","DOI":"10.1023\/A:1022850703159"},{"key":"key2022031520002730100_b20","doi-asserted-by":"crossref","unstructured":"Nicholas, D., Huntington, P. and Watkinson, A. (2005), \u201cScholarly journal usage: the results of deep log analysis\u201d, Journal of Documentation, Vol. 61 No. 2, pp. 248\u201080.","DOI":"10.1108\/00220410510585214"},{"key":"key2022031520002730100_b19","doi-asserted-by":"crossref","unstructured":"Nicholas, D., Huntington, P., Lievesley, N. and Withey, R. (1999), \u201cCracking the code: web log analysis\u201d, Online & CD\u2010ROM Review, Vol. 23 No. 5, pp. 263\u20109.","DOI":"10.1108\/14684529910334074"},{"key":"key2022031520002730100_b21","unstructured":"Project COUNTER (2008), COUNTER Codes of Practice, available at: www.projectcounter.org\/code_practice.html (accessed 17 July 2009)."},{"key":"key2022031520002730100_b22","unstructured":"Putz, M. (2002), Wandel der Informationsvermittlung in wissenschaftlichen Bibliotheken, University of Applied Sciences for Library and Information Management, Eisenstadt, 17 July."},{"key":"key2022031520002730100_b23","doi-asserted-by":"crossref","unstructured":"Sikkel, K., Gommer, L. and Van der Veen, J. (2002), \u201cUsing shared workspaces in higher education\u201d, Innovations in Education and Teaching International, Vol. 39 No. 1, pp. 26\u201045.","DOI":"10.1080\/13558000110097073"},{"key":"key2022031520002730100_b24","unstructured":"Shepherd, P. (2007), Final Report on the Investigation into the Feasibility of Developing and Implementing Journal Usage Factors, available at: www.uksg.org\/sites\/uksg.org\/files\/FinalReportUsageFactorProject.pdf (accessed 17 July 2009)."},{"key":"key2022031520002730100_b26","unstructured":"Shepherd, P. and Needham, P.A.S. (2009), PIRUS Final Report, available at: www.jisc.ac.uk\/media\/documents\/programmes\/pals3\/pirus_finalreport.pdf (accessed 17 August 2009)."},{"key":"key2022031520002730100_b27","doi-asserted-by":"crossref","unstructured":"Stassopoulou, A. and Dikaiakos, M.D. (2007), \u201cA probabilistic reasoning approach for discovering web crawler sessions\u201d, Lecture Notes in Computer Science, Vol. 4505 No. 1, pp. 265\u201072.","DOI":"10.1007\/978-3-540-72524-4_29"},{"key":"key2022031520002730100_frg1","doi-asserted-by":"crossref","unstructured":"Shepherd, P. and Wallace, J.M. (2009), \u201cPEER: a European project to monitor the effects of widespread open access archiving of journal articles\u201d, Serials, Vol. 22 No. 1, pp. 19\u201023.","DOI":"10.1629\/2219"}],"container-title":["OCLC Systems &amp; Services: International digital library perspectives"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/10650751011048506","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/10650751011048506\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/10650751011048506\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T23:39:12Z","timestamp":1753400352000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/dlp\/article\/26\/2\/133-145\/311099"}},"subtitle":["Reliable usage statistics in heterogeneous repository communities"],"editor":[{"given":"Bradford","family":"Lee Eden","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2010,6,1]]},"references-count":27,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2010,6,1]]}},"alternative-id":["10.1108\/10650751011048506"],"URL":"https:\/\/doi.org\/10.1108\/10650751011048506","relation":{},"ISSN":["1065-075X"],"issn-type":[{"type":"print","value":"1065-075X"}],"subject":[],"published":{"date-parts":[[2010,6,1]]}}}