{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T17:36:49Z","timestamp":1760981809824,"version":"3.41.2"},"reference-count":109,"publisher":"Emerald","issue":"6","license":[{"start":{"date-parts":[[2006,11,1]],"date-time":"2006-11-01T00:00:00Z","timestamp":1162339200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2006,11,1]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-heading\">Purpose<\/jats:title><jats:p>The main objective of this paper is to review work on the usability and impact of digital libraries.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Design\/methodology\/approach<\/jats:title><jats:p>Work on the usability and impact of digital libraries is reviewed. Specific studies on the usability and impact of digital libraries in specific domains are also discussed in order to identify general and specific usability and impact measures.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Findings<\/jats:title><jats:p>The usability studies reviewed in this paper show that a number of approaches have been used to assess usability. In addition to the technical aspects of digital library design (e.g. architecture, interfaces and search tools), there are a number of usability issues such as globalisation, localisation, language, culture issues, content and human information behaviour. Digital libraries should, however, be evaluated primarily with respect to their target users, applications and contexts.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Research limitations\/implications<\/jats:title><jats:p>Although a digital library evaluation study may have several objectives, ranging from the evaluation of its design and architecture to the evaluation of its usability and its impact on the target users, this paper focuses on usability and impact.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Originality\/value<\/jats:title><jats:p>This paper provides insights into the state\u2010of\u2010the art in relation to the usability and impact of digital libraries.<\/jats:p><\/jats:sec>","DOI":"10.1108\/14684520610716153","type":"journal-article","created":{"date-parts":[[2007,1,15]],"date-time":"2007-01-15T14:33:36Z","timestamp":1168871616000},"page":"656-680","source":"Crossref","is-referenced-by-count":55,"title":["Usability and impact of digital libraries: a review"],"prefix":"10.1108","volume":"30","author":[{"given":"Sudatta","family":"Chowdhury","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Monica","family":"Landoni","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Forbes","family":"Gibb","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"key":"key2022031720121899600_b1","doi-asserted-by":"crossref","unstructured":"Adams, A. and Blandford, A. (2005), \u201cDigital libraries support for the user's \u2018Information Journey\u2019\u201d, 5th ACM\/IEEE Joint Conference on Digital Libraries (JCDL 2005), Denver, CO, June 7\u201011, pp. 160\u20109, available at: www.uclic.ucl.ac.uk\/annb\/docs\/aaabJCDL05preprint.pdf.","DOI":"10.1145\/1065385.1065424"},{"key":"key2022031720121899600_b2","doi-asserted-by":"crossref","unstructured":"Allen, M. (2002), \u201cA case study of the usability testing of the University of South Florida's virtual library interface design\u201d, Online Information Review, Vol. 26 No. 1, pp. 40\u201053.","DOI":"10.1108\/14684520210418374"},{"key":"key2022031720121899600_b3","doi-asserted-by":"crossref","unstructured":"Anand, S.S. and Mobasher, B. (2005), \u201cIntelligent techniques for web personalization\u201d, in Mobasher, B. and Anand, S.S. (Eds), Intelligent Techniques for Web Personalization, Lecture Notes in Artificial Intelligence (LNAI), Vol. 3169, Springer\u2010Verlag, Berlin, pp. 1\u201036, available at: http:\/\/maya.cs.depaul.edu\/\u223cmobasher\/papers\/am\u2010itwp\u2010springer05.pdf.","DOI":"10.1007\/11577935_1"},{"key":"key2022031720121899600_b4","unstructured":"Baker, S.L. and Lancaster, F.W. (1991), Measurement and Evaluation of Library Services, 2nd ed., Information Resources Press, Arlington, VA."},{"key":"key2022031720121899600_b5","unstructured":"Banwell, L. and Coulson, G. (2004), \u201cUsers and use study methodology: the JUBILEE project\u201d, Paper 167, Information Research, Vol. 9 No. 2, available at: http:\/\/InformationR.net\/ir\/9\u20102\/paper167.html."},{"key":"key2022031720121899600_b6","unstructured":"Bertot, J.C. (2004), \u201cAssessing digital libraries: approaches, issues and considerations\u201d, available at: www.kc.tsukuba.ac.jp\/dlkc\/e\u2010proceedings\/papers\/dlkc04pp72.pdf."},{"key":"key2022031720121899600_b7","doi-asserted-by":"crossref","unstructured":"Billsus, D. and Pazzani, M.J. (2000), \u201cUser modelling for adaptive news access\u201d, User Modelling and User\u2010adapted Interaction, Vol. 10, pp. 147\u201080.","DOI":"10.1023\/A:1026501525781"},{"key":"key2022031720121899600_b8","doi-asserted-by":"crossref","unstructured":"Bishop, A.P., Peterson, L.J., Neumann, S.L., Star, M.C., Ignacio, E. and Sandusky, R.J. (2000), \u201cDigital libraries: situating use in changing information infrastructure\u201d, Journal of the American Society for Information Science, Vol. 51 No. 4, pp. 394\u2010413.","DOI":"10.1002\/(SICI)1097-4571(2000)51:4<394::AID-ASI8>3.0.CO;2-Q"},{"key":"key2022031720121899600_b9","unstructured":"Blandford, A. (2004), \u201cUnderstanding user's experiences: evaluation of digital libraries\u201d, paper presented at the DELOS Workshop on Evaluation of Digital Libraries, Padova, Italy, available at: www.delos.info\/eventlist\/wp7_ws_2004\/Blandford.pdf."},{"key":"key2022031720121899600_b10","doi-asserted-by":"crossref","unstructured":"Blandford, A. and Buchanan, G. (2003), \u201cUsability of digital libraries: a source of creative tensions with technical developments\u201d, TCDL Bulletin, available at: www.ieee\u2010tcdl.org\/Bulletin\/current\/blandford\/blandford.html.","DOI":"10.1145\/544220.544374"},{"key":"key2022031720121899600_b11","doi-asserted-by":"crossref","unstructured":"Blandford, A., Keith, S., Connell, I. and Edwards, H. (2004), \u201cAnalytical usability evaluation for digital libraries: a case study\u201d, Proceedings of the 2004 Joint ACM\/IEEE Conference on Digital Libraries, available at: http:\/\/portal.acm.org.","DOI":"10.1145\/996350.996360"},{"key":"key2022031720121899600_b12","doi-asserted-by":"crossref","unstructured":"Bollen, J. and Luce, R. (2002), \u201cEvaluation of digital library impact and user communities by analysis of usage patterns\u201d, D\u2010Lib Magazine, Vol. 8 No. 6, available at: www.dlib.org\/dlib\/june02\/bollen\/06bollen.html.","DOI":"10.1045\/june2002-bollen"},{"key":"key2022031720121899600_b14","doi-asserted-by":"crossref","unstructured":"Borgman, C.L. (2000), From Gutenberg to the Global Information Structure: Access to Information in the Networked World, ACM Press, New York, NY.","DOI":"10.7551\/mitpress\/3131.001.0001"},{"key":"key2022031720121899600_b15","unstructured":"Borgman, C.L. (2004), \u201cEvaluating the uses of digital libraries\u201d, paper presented at the DELOS Workshop on Evaluation of Digital Libraries, Padova, Italy, available at: http:\/\/dlib.ionio.gr\/wp7\/WS2004_Borgman.pdf."},{"key":"key2022031720121899600_b13","doi-asserted-by":"crossref","unstructured":"Borgman, C. and Rasmussen, E. (2005), \u201cUsability of digital libraries in a multicultural environment\u201d, in Theng, Y.\u2010L. and Foo, S. (Eds), Design and Usability of Digital Libraries: Case Studies in the Asia\u2010Pacific, Information Science Publishing, London, pp. 270\u201084.","DOI":"10.4018\/978-1-59140-441-5.ch015"},{"key":"key2022031720121899600_b16","unstructured":"Borgman, C.L., Gilliland\u2010Swetland, A.J., Leazer, G.L., Mayer, R., Gwynn, D., Gazan, R. and Mautone, P. (2000), \u201cEvaluating digital libraries for teaching and learning in undergraduate education: a case study of the Alexandria Digital Earth Prototype (ADEPT)\u201d, Library Trends, Vol. 49 No. 2, special issue: Assessing Digital Library Services, pp. 228\u201050."},{"key":"key2022031720121899600_b17","doi-asserted-by":"crossref","unstructured":"Borgman, C.L., Leazer, G.H., Gilliland\u2010Swetland, A., Millwood, K., Champeny, L., Finley, J. and Smart, L.J. (2004), \u201cHow geography professors select materials for classroom lectures: implications for the design of digital libraries\u201d, Proceedings of the 4th ACM\/IEEE\u2010CS Joint Conference on Digital Libraries, Tucson, Arizona, pp. 179\u201085.","DOI":"10.1145\/996350.996390"},{"key":"key2022031720121899600_b18","doi-asserted-by":"crossref","unstructured":"Borgman, C.L., Smart, L.J., Millwood, K.A., Finley, J.R., Champeny, L., Gilliland, A.J. and Leazer, G.H. (2005), \u201cComparing faculty information seeking in teaching and research: implications for the design of digital libraries\u201d, Journal of the American Society for Information Science, Vol. 56 No. 6, pp. 636\u201057.","DOI":"10.1002\/asi.20154"},{"key":"key2022031720121899600_b19","doi-asserted-by":"crossref","unstructured":"Champeny, L., Borgman, C.L., Leazer, G.H., Gilliland\u2010Swetland, A.J., Millwood, K.A., D'Avolio, L., Finley, J.R., Smart, L.J., Mautone, P.D., Mayer, R.E., Johnson, R.A., Chen, H., Christel, M. and Lim, E.\u2010P. (2004), \u201cDeveloping a digital learning environment: an evaluation of design and implementation processes\u201d, Proceedings of the 2004 Joint ACM\/IEEE Conference on Digital Libraries, Tucson, Arizona, ACM, New York, NY, pp. 37\u201046.","DOI":"10.1145\/996350.996361"},{"key":"key2022031720121899600_b20","doi-asserted-by":"crossref","unstructured":"Choudhury, S., Hobbs, B., Lone, M. and Flores, N. (2002), \u201cA framework for evaluating digital library services\u201d, D\u2010Lib Magazine, Vol. 8 Nos 7\/8, available at: http:\/\/dlib.org\/dlib\/july02\/choudhury\/07choudhury.html.","DOI":"10.1045\/july2002-choudhury"},{"key":"key2022031720121899600_b21","unstructured":"Chowdhury, G.G. (2004a), Introduction to Modern Information Retrieval, Facet Publishing, London."},{"key":"key2022031720121899600_b22","unstructured":"Chowdhury, G.G. (2004b), \u201cAccess and usability issues of scholarly electronic publications\u201d, in Gorman, G.E. and Rowland, F. (Eds), Scholarly Publishing in an Electronic Era. International Yearbook of Library and Information Management, 2004\/2005, Facet Publishing, London, pp. 77\u201098."},{"key":"key2022031720121899600_b23","doi-asserted-by":"crossref","unstructured":"Chowdhury, G.G. and Chowdhury, S. (1999), \u201cDigital library research: major issues and trends\u201d, Journal of Documentation, Vol. 55 No. 4, pp. 409\u201048.","DOI":"10.1108\/EUM0000000007154"},{"key":"key2022031720121899600_b24","unstructured":"Chowdhury, G.G. and Chowdhury, S. (2003), Introduction to Digital Libraries, Facet Publishing, London."},{"key":"key2022031720121899600_b25","unstructured":"Coleman, A. and Sumner, T. (2004), \u201cDigital libraries and user needs: negotiating the future\u201d, Journal of Digital Information, Vol. 5 No. 3, special issue, available at: http:\/\/jodi.tamu.edu\/Articles\/v05\/i03\/editorial\/."},{"key":"key2022031720121899600_b26","unstructured":"Department of Information Engineering (2004), \u201cDELOS workshop on the evaluation of digital libraries\u201d, Department of Information Engineering, University of Padua, available at: http:\/\/dlib.ionio.gr\/wp7\/workshop2004.html."},{"key":"key2022031720121899600_b27","unstructured":"Dickstein, R. and Mills, V. (2000), \u201cUsability testing at the University of Arizona Library: how to let the users in on the design\u201d, Information Technology and Libraries, Vol. 19 No. 3, pp. 144\u201051."},{"key":"key2022031720121899600_b28","unstructured":"Dillon, A. (1994), Designing Usable Electronic Text: Ergonomic Aspects of Human Information Usage, Taylor and Francis, Bristol."},{"key":"key2022031720121899600_b29","doi-asserted-by":"crossref","unstructured":"Dillon, A. (1999), \u201cEvaluating on TIME: a framework for the expert evaluation of digital interface usability\u201d, draft of a paper published in the International Journal on Digital Libraries, Vol. 2 Nos 2\/3, available at www.ischool.utexas.edu\/\u223cadillon\/publications\/evaluating.html.","DOI":"10.1007\/s007990050045"},{"key":"key2022031720121899600_b30","unstructured":"Dillon, A. (2005), \u201cEvaluating on time: a framework for the expert evaluation of digital library interface usability\u201d, available at: www.ischool.utexas.edu\/\u223cadillon\/publications\/evaluating.html."},{"key":"key2022031720121899600_b31","doi-asserted-by":"crossref","unstructured":"Dorward, J., Reinke, D. and Recker, M. (2002), \u201cAn evaluation model for a digital library services tool\u201d, Proceedings of the 2002 Joint ACM\/IEEE Conference on Digital Libraries, Portland, Oregon, ACM, New York, NY, pp. 322\u20103.","DOI":"10.1145\/544220.544298"},{"key":"key2022031720121899600_b32","doi-asserted-by":"crossref","unstructured":"Duncker, E., Theng, Y.L. and Mohd\u2010Nasir, N. (2000), \u201cCultural usability in digital libraries\u201d, Bulletin of the American Society for Information Science, Vol. 26 No. 4, pp. 21\u20102, available at: www.asis.org\/Bulletin\/May\u201000\/duncker__et_al.html.","DOI":"10.1002\/bult.162"},{"key":"key2022031720121899600_b33","unstructured":"Dunn, P. and Marinetti, A. (n.d.), \u201cCultural adaptation: necessity for global elearning\u201d, available at: www.linezine.com\/7.2\/articles\/pdamca.htm."},{"key":"key2022031720121899600_b34","unstructured":"Evidence Base (2004), \u201ceValued: an evaluation toolkit for e\u2010library developments\u201d, available at: www.evalued.uce.ac.uk\/tutorial\/index.htm."},{"key":"key2022031720121899600_b35","doi-asserted-by":"crossref","unstructured":"Fan, W., Gordon, M.D. and Pathak, P. (2005), \u201cEffective profiling of consumer information retrieval needs: a unified framework and empirical comparison\u201d, Decision Support Systems, Vol. 40 No. 2, pp. 213\u201033.","DOI":"10.1016\/j.dss.2004.02.003"},{"key":"key2022031720121899600_b36","unstructured":"Feeney, M. and Grieves, M. (Eds) (1994), The Value and Impact of Information, Bowker\u2010Saur, London."},{"key":"key2022031720121899600_b37","doi-asserted-by":"crossref","unstructured":"Frias\u2010Martinez, E., Magoulas, G.D., Chen, S.Y. and Macredie, R.D. (2006), \u201cAutomated user modeling for personalized digital libraries\u201d, International Journal of Information Management, Vol. 26 No. 3, pp. 234\u201048.","DOI":"10.1016\/j.ijinfomgt.2006.02.006"},{"key":"key2022031720121899600_b38","unstructured":"Gibb, F. (2002), \u201cResource selection and data fusion for multimedia international digital libraries: an overview of the MIND project\u201d, Proceedings of the EU\/NSF All Projects Meeting, Rome, 25\u201026 March, 2002, ERCIM\u201002\u2010W02, ERCIM, Sophia\u2010Antipolis, pp. 51\u20106."},{"key":"key2022031720121899600_b39","unstructured":"Giersch, S., Butcher, K. and Reeves, T. (2003), \u201cAnnotated bibliography of evaluating the educational impact of digital libraries\u201d, available at: http:\/\/eduimpact.comm.nsdl.org\/evalworkshop\/eval_ann\u2010bib_09\u201029\u201003.doc."},{"key":"key2022031720121899600_b40","unstructured":"Hansen, P. (1998), \u201cEvaluations of IR user interface: implications for user interface design\u201d, Human IT: Tildskrift f\u00f6r Studier av IT ur ett Humanvetenskapligt Perspektiv, Vol. 2, available at: www.hb.se\/bhs\/ith\/2\u201098\/ph.htm."},{"key":"key2022031720121899600_b41","unstructured":"Heinstr\u00f6m, J. (2003), \u201cFive personality dimensions and their influence on information behaviour\u201d, Information Research, Vol. 9 No. 1, paper 165, available at: http:\/\/InformationR.net\/ir\/9\u20101\/paper165.html."},{"key":"key2022031720121899600_b42","doi-asserted-by":"crossref","unstructured":"Hicks, D. (2003), \u201cSupporting personalization and customization\u201d, Computers in Industry, Vol. 52 No. 1, pp. 71\u20109.","DOI":"10.1016\/S0166-3615(03)00070-8"},{"key":"key2022031720121899600_b43","unstructured":"Hill, M.W. (1999), The Impact of Information on Society: An Examination of Its Nature, Value and Usage, Bowker Saur, London, available at: http:\/\/wotan.liu.edu\/dois\/data\/Articles\/aibbolaibv:40:y:2000:i:1:p:112.html."},{"key":"key2022031720121899600_b44","unstructured":"HyLiFe (2002), \u201cThe HyLiFe hybrid library toolkit; information landscapes\u201d, available at: http:\/\/hylife.unn.ac.uk\/toolkit\/infoland2.htmlyes."},{"key":"key2022031720121899600_b45","unstructured":"Ingwersen, P. (2001), \u201cCognitive information retrieval\u201d, in Williams, M.E. (Ed.), Annual Review of Information Science and Technology, Vol. 34, Information Today for the American Society for Information Science and Technology, Medford, NJ, pp. 3\u201052."},{"key":"key2022031720121899600_b46","doi-asserted-by":"crossref","unstructured":"Jeng, J. (2004), \u201cUsability of digital libraries: an evaluation model\u201d, Proceedings of the 2004 Joint ACM\/IEEE Conference on Digital Libraries (JCDL2004), Tucson, Arizona, ACM, New York, NY.","DOI":"10.1145\/996350.996473"},{"key":"key2022031720121899600_b47","doi-asserted-by":"crossref","unstructured":"Jeng, J. (2005), \u201cWhat is usability in the context of the digital library and how can it be measured?\u201d, Information Technology & Libraries, Vol. 24 No. 2, pp. 47\u201057.","DOI":"10.6017\/ital.v24i2.3365"},{"key":"key2022031720121899600_b48","unstructured":"Jones, C. and Sumner, T. (2002), \u201cEvaluation of the National Science Digital Library\u201d, in Blandford, A. and Buchanan, G. (Eds), JCDL'02 Workshop on Usability of Digital Libraries, pp. 5\u20107, available at: www.uclic.ucl.ac.uk\/annb\/DLUsability\/JCDL02.html."},{"key":"key2022031720121899600_b49","doi-asserted-by":"crossref","unstructured":"Jones, C., Zenios, M. and Griffiths, J. (2004), \u201cAcademic use of digital resources: disciplinary differences and the issue of progression\u201d, Proceedings of the Networked Learning Conference, available at: www.shef.ac.uk\/nlc2004\/Proceedings\/symposia\/.","DOI":"10.54337\/nlc.v4.9640"},{"key":"key2022031720121899600_b50","doi-asserted-by":"crossref","unstructured":"Keith, S., Blandford, A., Fields, B. and Theng, Y.L. (2002), \u201cAn investigation into the application of claims analysis to evaluate usability of a digital library interface\u201d, in Blandford, A. and Buchanan, G. (Eds), JCDL'02 Workshop on Usability of Digital Libraries, available at: www.uclic.ucl.ac.uk\/annb\/DLUsability\/JCDL02.html.","DOI":"10.1145\/544220.544374"},{"key":"key2022031720121899600_b51","unstructured":"Kim, K. (2002), \u201cA model\u2010based approach to usability evaluation for digital libraries\u201d, in Blandford, A. and Buchanan, G. (Eds), JCDL'02 Workshop on Usability of Digital Libraries, available at: www.uclic.ucl.ac.uk\/annb\/DLUsability\/JCDL02.html."},{"key":"key2022031720121899600_b52","unstructured":"Koychev, I. and Schwab, L. (2000), \u201cAdapting to drifting user's interests\u201d, available at: www.cs.ubc.ca\/\u223cmike\/papers\/KoySch00.pdf."},{"key":"key2022031720121899600_b53","unstructured":"Kuhlthau, C. (1988), \u201cLongitudinal case studies of the information search process of users in libraries\u201d, Library and Information Science Research, Vol. 10 No. 3, pp. 257\u2010304."},{"key":"key2022031720121899600_b54","unstructured":"Lancaster, F.W. (1993), If You Want to Evaluate Your Library, 2nd ed., University of Illinois, Graduate School of Library and Information Science, Champaign, IL."},{"key":"key2022031720121899600_b55","unstructured":"Larsen, R. and Borgman, C. (2003), \u201cDigital library evaluation \u2013 metrics, testbeds, and processes\u201d, Notes from the Workshop at ECDL 2003 Trondheim, Norway, available at: www.sis.pitt.edu\/\u223cecdl2003\/result_1.htm."},{"key":"key2022031720121899600_b56","doi-asserted-by":"crossref","unstructured":"Leazer, G.H., Gilliland\u2010Swetland, A.J. and Borgman, C.L. (2000a), \u201cEvaluating the use of a geographic digital library in undergraduate classrooms: ADEPT\u201d, Proceedings of the 5th ACM Conference on Digital Libraries, San Antonio, Texas, ACM, New York, NY, pp. 248\u20109.","DOI":"10.1145\/336597.336682"},{"key":"key2022031720121899600_b57","unstructured":"Leazer, G.H., Gilliland\u2010Swetland, A.J., Borgman, C.L. and Mayer, R.E. (2000b), \u201cClassroom evaluation of the Alexandria Digital Earth Prototype (ADEPT)\u201d, Proceedings of the American Society for Information Science 2000 Annual Conference, ASIS, Chicago, IL, pp. 334\u201040, available at: http:\/\/is.gseis.ucla.edu\/adept\/pubs\/asisadept.htm."},{"key":"key2022031720121899600_b58","doi-asserted-by":"crossref","unstructured":"Liew, C.L. (2005), \u201cCross\u2010cultural design and usability of a digital library supporting access to Maori cultural heritage resources\u201d, in Theng, Y.\u2010L. and Foo, S. (Eds), Design and Usability of Digital Libraries: Case Studies in the Asia\u2010Pacific, Information Science Publishing, London, pp. 284\u201097.","DOI":"10.4018\/978-1-59140-441-5.ch016"},{"key":"key2022031720121899600_b59","unstructured":"McCallum, A. and Nigam, K. (1998), \u201cA comparison of event models for na\u00efve Bayes text classification\u201d, available at: www.cs.cmu.edu\/\u223cknigam\/papers\/multinomial\u2010aaaiws98.pdf."},{"key":"key2022031720121899600_b60","unstructured":"Madle, G., Kostkova, P., Mani\u2010Saada, J. and Weinberg, J. (2003), \u201cDevelopment of a methodology to evaluate the impact of a medical digital library on user knowledge, attitude and behaviour\u201d, available at: www.hon.ch\/Mednet2003\/abstracts\/491753869.html."},{"key":"key2022031720121899600_b61","unstructured":"Maly, K., Nelson, M., Shen, S., Zeil, S. and Zubair, M. (n.d.), \u201cDigital library for undergraduate science education evaluation framework\u201d, available at: http:\/\/dlib.cs.odu.edu\/completed\u2010projects\/ndif\/nsf\/ dlib2\/udifplan\/evaluationframework\/evaluation.doc."},{"key":"key2022031720121899600_b62","doi-asserted-by":"crossref","unstructured":"Marchionini, G. (1995), Information Seeking in Electronic Environments, Cambridge University Press, Cambridge.","DOI":"10.1017\/CBO9780511626388"},{"key":"key2022031720121899600_b63","unstructured":"Marchionini, G. (2000), \u201cEvaluating digital libraries: a longitudinal and multifaceted view\u201d, Library Trends, Vol. 49 No. 2, pp. 304\u201033."},{"key":"key2022031720121899600_b64","unstructured":"Marchionini, G. and Komlodi, A. (1998), \u201cDesign of interfaces for information seeking\u201d, Annual Review of Information Science and Technology, Vol. 33, pp. 89\u2010130."},{"key":"key2022031720121899600_b65","doi-asserted-by":"crossref","unstructured":"Meyyappan, N., Chowdhury, G.G. and Foo, S. (2001), \u201cUse of a digital work environment (DWE) prototype to create a user\u2010centred university digital library\u201d, Journal of Information Science, Vol. 27 No. 4, pp. 249\u201064.","DOI":"10.1177\/016555150102700408"},{"key":"key2022031720121899600_b66","doi-asserted-by":"crossref","unstructured":"Meyyappan, N., Foo, S. and Chowdhury, G.G. (2004), \u201cDesign and evaluation of a task\u2010based digital library for the academic community\u201d, Journal of Documentation, Vol. 60 No. 4, pp. 449\u201075.","DOI":"10.1108\/00220410410548162"},{"key":"key2022031720121899600_b67","unstructured":"Mitchell, S. (1999), \u201cInterface design considerations in libraries\u201d, in Stern, D. (Ed.), Digital Libraries: Philosophies, Technical Design Considerations, and Example Scenarios, Haworth Press, Binghamton, NY, pp. 131\u201081."},{"key":"key2022031720121899600_b68","unstructured":"Neuhaus, C. (2005), \u201cDigital library: evaluation and assessment bibliography\u201d, available at: www.uni.edu\/neuhaus\/digitalbibeval.html."},{"key":"key2022031720121899600_b69","doi-asserted-by":"crossref","unstructured":"Nicholas, D., Huntington, P. and Williams, P. (2003), \u201cMicro\u2010mining log files: a method for enriching the data yield from internet log files\u201d, Journal of Information Science, Vol. 29, Summer, pp. 391\u2010404.","DOI":"10.1177\/01655515030295005"},{"key":"key2022031720121899600_b70","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1993a), \u201cIterative user interface design\u201d, IEEE Computer, Vol. 26 No. 11, pp. 32\u201041.","DOI":"10.1109\/2.241424"},{"key":"key2022031720121899600_b71","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1993b), Usability Engineering, Academic Press, Boston, MA.","DOI":"10.1016\/B978-0-08-052029-2.50007-3"},{"key":"key2022031720121899600_b72","doi-asserted-by":"crossref","unstructured":"Nielsen, J. and Levy, J. (1994), \u201cMeasuring usability preference vs performance\u201d, Communications of the ACM, Vol. 37 No. 4, pp. 66\u201076.","DOI":"10.1145\/175276.175282"},{"key":"key2022031720121899600_b73","doi-asserted-by":"crossref","unstructured":"Norlin, E. (2000), \u201cReference evaluation: a three\u2010step approach\u2010surveys, unobtrusive observations, and focus groups\u201d, College and Research Libraries, Vol. 61 No. 6, pp. 546\u201053.","DOI":"10.5860\/crl.61.6.546"},{"key":"key2022031720121899600_b74","doi-asserted-by":"crossref","unstructured":"Pan, B., Gay, G., Saylor, J., Hembrooke, H. and Henderson, D. (2004), \u201cUsability, learning, and subjective experience: user evaluation of K\u2010MODDL in an undergraduate class\u201d, Proceedings of the 2004 Joint ACM\/IEEE Conference on Digital Libraries, Tucson, Arizona, ACM, New York, NY, pp. 188\u20109.","DOI":"10.1145\/996350.996392"},{"key":"key2022031720121899600_b75","doi-asserted-by":"crossref","unstructured":"Park, S. (2000), \u201cUsability, user preferences, effectiveness, and user behaviours when searching individual and integrated full\u2010text databases: implications for digital libraries\u201d, Journal of the American Society for Information Science, Vol. 51 No. 5, pp. 456\u201068.","DOI":"10.1002\/(SICI)1097-4571(2000)51:5<456::AID-ASI6>3.0.CO;2-O"},{"key":"key2022031720121899600_b76","doi-asserted-by":"crossref","unstructured":"Peng, L.K., Ramaiah, C.K. and Foo, S. (2004), \u201cHeuristic\u2010based user interface evaluation at Nanyang Technological University in Singapore\u201d, Program, Vol. 38 No. 1, pp. 42\u201059.","DOI":"10.1108\/00330330410519198"},{"key":"key2022031720121899600_b77","unstructured":"Reeves, T.C., Apedoe, X. and Woo, Y.H. (2003), Evaluating Digital Libraries: A User\u2010friendly Guide, NSDL.ORG, University of Georgia, Athens, GA."},{"key":"key2022031720121899600_b78","doi-asserted-by":"crossref","unstructured":"Renda, M.E. and Straccia, U. (2005), \u201cA personalized collaborative digital library environment: a model and an application\u201d, Information Processing & Management, An Asian Digital Libraries Perspective, Vol. 41 No. 1, pp. 5\u201021.","DOI":"10.1016\/j.ipm.2004.04.007"},{"key":"key2022031720121899600_b79","unstructured":"Sandusky, R.J. (2002), \u201cDigital library attributes: framing usability research\u201d, in Blandford, A. and Buchanan, G. (Eds), JCDL'02 Workshop on Usability of Digital Libraries, pp. 5\u20107, available at: www.uclic.ucl.ac.uk\/annb\/DLUsability\/JCDL02.html."},{"key":"key2022031720121899600_b80","unstructured":"Saracevic, T. (2000), \u201cDigital library evaluation: toward evolution of concepts \u2013 1 \u2013 evaluation criteria for design and management of digital libraries\u201d, Library Trends. Assessing Digital Library Services, Vol. 49 No. 2, pp. 350\u201069, available at: www.scils.rutgers.edu\/\u223ctefko\/LibraryTrends2000.pdf."},{"key":"key2022031720121899600_b81","unstructured":"Saracevic, T. (2004), \u201cEvaluation of digital libraries: an overview, presented at the DELOS Workshop on the Evaluation of Digital Libraries\u201d, available at: http:\/\/dlib.ionio.gr\/wp7\/ws2004_Saracevic.pdf."},{"key":"key2022031720121899600_b82","unstructured":"Saracevic, T. (2005), \u201cHow were digital libraries evaluated? Presentations at the course and conference Libraries in the Digital Age (LIDA 2005), Dubrovnik, Croatia, 30 May\u20103 June\u201d, available at: www.scils.rutgers.edu\/\u223ctefko\/DL_evaluation_LIDA.pdf."},{"key":"key2022031720121899600_b83","doi-asserted-by":"crossref","unstructured":"Shahabi, C. and Chen, Y.\u2010S. (2003), \u201cWeb information personalization: challenges and approaches\u201d, Proceedings of Databases in Networked Information Systems: 3rd International Workshop, DNIS 2003, Aizu, Japan, September 22\u201024, Lecture Notes in Computer Science, Springer, Berlin, pp. 5\u201015.","DOI":"10.1007\/978-3-540-39845-5_2"},{"key":"key2022031720121899600_b84","unstructured":"Shneiderman, B. (1998), Designing the User Interface: Strategies for Effective Human\u2010Computer Interaction, 3rd ed., Addison\u2010Wesley, Reading, MA."},{"key":"key2022031720121899600_b85","doi-asserted-by":"crossref","unstructured":"Snead, J.T., Bertot, J.C., Jaeger, P.T. and McClure, C.R. (2005), \u201cDeveloping multi\u2010method, iterative, and user\u2010centered evaluation strategies for digital libraries: functionality, usability, and accessibility\u201d, available at: www.ii.fsu.edu\/presentations\/digilib_asist2005.pdf.","DOI":"10.1002\/meet.14504201161"},{"key":"key2022031720121899600_b86","doi-asserted-by":"crossref","unstructured":"Spink, A., Wilson, T., Ford, N., Foster, A. and Ellis, D. (2002), \u201cInformation\u2010seeking and mediated searching, part 1, theoretical framework and research design\u201d, Journal of the American Society for Information Science and Technology, Vol. 53 No. 9, pp. 695\u2010703.","DOI":"10.1002\/asi.10081"},{"key":"key2022031720121899600_b87","unstructured":"Stelmaszewska, H. and Blandford, A. (2002), \u201cPatterns of interactions: user behaviour in response to search results\u201d, available at: www.uclic.ucl.ac.uk\/annb\/DLUsability\/Stelmaszewska29.pdf."},{"key":"key2022031720121899600_b88","unstructured":"Stewart, B. (2004), \u201cNo free lunch: the web and information aggregators\u201d, SCIP, Vol. 7 No. 3, available at: www.dialog.com\/products\/productline\/profound.shtml."},{"key":"key2022031720121899600_b89","doi-asserted-by":"crossref","unstructured":"Sumner, T. (2005), \u201cReport on the Fifth ACM\/IEEE Joint Conference on Digital Libraries \u2013 cyber infrastructure for research and education, June 7\u201011, 2005, Denver, Colorado\u201d, D\u2010Lib Magazine, Vol. 11 No. 7\/8, July\/August, available at: www.dlib.org\/dlib\/july05\/sumner\/07sumner.html.","DOI":"10.1045\/july2005-sumner"},{"key":"key2022031720121899600_b90","doi-asserted-by":"crossref","unstructured":"Sumner, T. and Marlino, M. (2004), \u201cDigital libraries and educational practice: a case for new models\u201d, Proceedings of JCDL'04, Tucson, Arizona, June 7\u201011, pp. 170\u20108.","DOI":"10.1145\/996350.996389"},{"key":"key2022031720121899600_b91","doi-asserted-by":"crossref","unstructured":"Sutcliffe, A. and Ennis, M. (1998), \u201cTowards a cognitive theory of information retrieval\u201d, Interacting with Computers, Vol. 10 No. 3, pp. 321\u201051.","DOI":"10.1016\/S0953-5438(98)00013-7"},{"key":"key2022031720121899600_b92","doi-asserted-by":"crossref","unstructured":"Theng, Y.L., Mohd\u2010Nasir, N. and Thimbleby, H. (2000), \u201cPurpose and usability of digital libraries\u201d, Proceedings of the 5th ACM Conference on Digital Libraries, ACM, New York, NY, pp. 238\u20109.","DOI":"10.1145\/336597.336674"},{"key":"key2022031720121899600_b93","doi-asserted-by":"crossref","unstructured":"Van House, N.A., Butler, M.H., Ogle, V. and Schiff, L. (1996), \u201cUser\u2010centred iterative design for digital libraries\u201d, D\u2010Lib Magazine, available at www.dlib.org\/dlib\/february96\/02vanhouse.html.","DOI":"10.1045\/february96-vanhouse"},{"key":"key2022031720121899600_b94","unstructured":"Waters, D. (2001), \u201cDeveloping digital libraries: four principles for higher education\u201d, EDUCAUSE Review, September\/October, pp. 58\u20109."},{"key":"key2022031720121899600_b95","unstructured":"Wilson, B. (2002), \u201cUsability and evaluation, editorial\u201d, D\u2010Lib Magazine, Vol. 8 No. 10."},{"key":"key2022031720121899600_b96","doi-asserted-by":"crossref","unstructured":"Wilson, T. (1999), Models of information behaviour research, Journal of Documentation, Vol. 55 No. 3, pp. 249\u201070.","DOI":"10.1108\/EUM0000000007145"},{"key":"key2022031720121899600_b97","doi-asserted-by":"crossref","unstructured":"Wilson, T., Ford, N., Ellis, D., Foster, A. and Spink, A. (2002), \u201cInformation seeking and mediated searching, part 2, uncertainty and its correlates\u201d, Journal of the American Society for Information Science and Technology, Vol. 53 No. 9, pp. 704\u201015.","DOI":"10.1002\/asi.10082"},{"key":"key2022031720121899600_b98","doi-asserted-by":"crossref","unstructured":"Wu, S., Crestani, F. and Gibb, F. (2004), \u201cNew methods for results merging in distributed information retrieval\u201d, Proceedings of the ACM SIGIR 2003 Workshop on Distributed Information Retrieval, Toronto, Canada, August, Lecture Notes in Computer Science, 2924, Springer\u2010Verlag, Heidelberg, pp. 84\u2010100.","DOI":"10.1007\/978-3-540-24610-7_7"},{"key":"key2022031720121899600_b99","unstructured":"Zhang, Y. (2004), \u201cDigital library evaluation\u201d, available at: www.scils.rutgers.edu\/\u223cmiceval\/research\/DL_eval.html."},{"key":"key2022031720121899600_frg1","unstructured":"Borgman, C.L. (1999), \u201cWhat are digital libraries?\u201d, Competing Visions. Information Processing and Management, Vol. 35 No. 3, pp. 227\u201043."},{"key":"key2022031720121899600_frg2","unstructured":"Dai, H. and Mobasher, B. (2005), \u201cIntegrating semantic knowledge with web usage mining for personalization\u201d, in Scime, A. (Ed.), Web Mining: Applications and Techniques, Idea Group Publishing, Medford, NJ, Ch. 13."},{"key":"key2022031720121899600_frg3","unstructured":"Hartland\u2010Fox, B. and Dalton, P. (2002), \u201ceVALUEd \u2013 an evaluation model for e\u2010library developments\u201d, Ariadne, Vol. 31, available at: www.ariadne.ac.uk\/issue31\/evalued\/."},{"key":"key2022031720121899600_frg4","doi-asserted-by":"crossref","unstructured":"Saracevic, T. (1999), \u201cInformation science\u201d, Journal of the American Society for Information Science, Vol. 50 No. 12, pp. 1051\u201063.","DOI":"10.1002\/(SICI)1097-4571(1999)50:12<1051::AID-ASI2>3.0.CO;2-Z"},{"key":"key2022031720121899600_frg5","unstructured":"Saracevic, T. and Dalbello, M. (2001), \u201cA survey of digital library education\u201d, available at: www.ffzg.hr\/lida\/lida2001\/present\/saracevic_dalbello.doc."},{"key":"key2022031720121899600_frg6","doi-asserted-by":"crossref","unstructured":"Shneiderman, B., Byrd, D. and Croft, W.B. (1998), \u201cSorting out searching: a user\u2010interface framework for text searches\u201d, Communications of the ACM, Vol. 41 No. 4, pp. 95\u20108.","DOI":"10.1145\/273035.273069"},{"key":"key2022031720121899600_frg7","doi-asserted-by":"crossref","unstructured":"Spink, A. and Cool, C. (1999), \u201cEducation for digital libraries\u201d, D\u2010Lib Magazine, Vol. 5 No. 5, available at: www.dlib.org\/dlib\/may99\/05spink.html.","DOI":"10.1045\/may99-spink"},{"key":"key2022031720121899600_frg8","doi-asserted-by":"crossref","unstructured":"Wilson, R. and Landoni, M. (2003), \u201cEvaluating the usability of portable electronic books\u201d, Proceedings of the 2003 ACM Symposium on Applied Computing (SAC), Melbourne, March 9\u201012, ACM, New York, NY, pp. 564\u20108.","DOI":"10.1145\/952532.952644"},{"key":"key2022031720121899600_frg9","doi-asserted-by":"crossref","unstructured":"Wilson, R., Landoni, M. and Gibb, F. (2003), \u201cThe Web Book experiments in electronic textbook design\u201d, Journal of Documentation, Vol. 59 No. 4, pp. 454\u201077.","DOI":"10.1108\/00220410310485721"},{"key":"key2022031720121899600_frg10","doi-asserted-by":"crossref","unstructured":"Wilson, R., Shortreed, J. and Landoni, M. (2004), \u201cA study into the usability of e\u2010encyclopaedias\u201d, in Haddad, H., Omicini, A., Wainwright, R.L. and Liebrock, L.M. (Eds), Proceedings of the 2004 ACM Symposium on Applied Computing (SAC), Nicosia, Cyprus, March 14\u201017, pp. 1688\u201092.","DOI":"10.1145\/967900.968235"}],"container-title":["Online Information Review"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/14684520610716153","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/14684520610716153\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/14684520610716153\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T00:40:40Z","timestamp":1753404040000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/oir\/article\/30\/6\/656-680\/314933"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,11,1]]},"references-count":109,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2006,11,1]]}},"alternative-id":["10.1108\/14684520610716153"],"URL":"https:\/\/doi.org\/10.1108\/14684520610716153","relation":{},"ISSN":["1468-4527"],"issn-type":[{"type":"print","value":"1468-4527"}],"subject":[],"published":{"date-parts":[[2006,11,1]]}}}