{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T14:01:09Z","timestamp":1775656869993,"version":"3.50.1"},"reference-count":40,"publisher":"Emerald","issue":"1","license":[{"start":{"date-parts":[[2018,1,15]],"date-time":"2018-01-15T00:00:00Z","timestamp":1515974400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["AJIM"],"published-print":{"date-parts":[[2018,1,15]]},"abstract":"<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title>\n<jats:p>The purpose of this paper is to evaluate the usability of the National Library of Turkey website developed for all citizens in the country to retrieve information available in a wide range of areas.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title>\n<jats:p>The evaluation performed by 57 undergraduate university students involved the identification and analysis of usability problems in the selected website. The assessment process was mainly based on Nielsen\u2019s Heuristics. The data obtained in the evaluation process were enriched using the System Usability Scale (SUS) and the Net Promoter Score (NPS) to conduct a more detailed analysis.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Findings<\/jats:title>\n<jats:p>The participants identified many usability problems concerning the evaluated website and considered it as having low usability characteristics. The most violated heuristic item was found to be \u201cconsistency and standards\u201d whereas the least violated heuristic item was \u201cmatch between system and the real world.\u201d The total number of the usability problems in heuristic evaluation correlated significantly and negatively with the SUS and the NPS results indicating that the more participants identified usability problems, the less they considered the website as usable and recommendable.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Research limitations\/implications<\/jats:title>\n<jats:p>The participants were not usability experts, however they were selected from among the students who received the Human Computer Interaction course to ensure that they had sufficient information and experience concerning the evaluation of a website with heuristics. Besides, the study was limited to a small number of university students. The implication is that results of this study have potential to guide libraries, which plan to adapt themselves to the digital world by delivering web services, by addressing critical points influencing users\u2019 points of views toward library websites and their usability evaluation result.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Practical implications<\/jats:title>\n<jats:p>Depending on the changes in user habits regarding the retrieval of information, libraries have made considerable investments in web technologies to meet their users\u2019 demands, and recently, digital libraries have begun to take over physical libraries. Users always need to perform tasks efficiently, effectively and satisfactorily when using websites. As one of the most crucial sources of digital materials, library websites are expected to have usable characteristics that satisfactorily meet user requirements. Therefore, the practical implication is that the findings of the study will guide designers, developers and practitioners in the development of library websites.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title>\n<jats:p>In the context of usability evaluation of digital libraries, this is the first study to analyze effects of usability problems identified by users during the heuristic inspection on their overall evaluation score and willingness to recommend the website to their friends or colleagues.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/ajim-09-2017-0216","type":"journal-article","created":{"date-parts":[[2018,1,5]],"date-time":"2018-01-05T09:23:44Z","timestamp":1515144224000},"page":"66-77","source":"Crossref","is-referenced-by-count":21,"title":["University students\u2019 heuristic usability \u0131nspection of the national library of Turkey website"],"prefix":"10.1108","volume":"70","author":[{"given":"Yavuz","family":"Inal","sequence":"first","affiliation":[]}],"member":"140","reference":[{"issue":"1\/2","key":"key2020100100575065900_ref001","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1108\/03074800810845985","article-title":"Heuristic evaluation applied to library web services","volume":"109","year":"2008","journal-title":"New Library World"},{"key":"key2020100100575065900_ref002","article-title":"Evaluating the usability of Saudi digital library\u2019s interface (SDL)","year":"2013"},{"issue":"6","key":"key2020100100575065900_ref003","first-page":"2225","article-title":"Usability dimensions for mobile applications-a review","volume":"5","year":"2013","journal-title":"Research Journal of Applied Sciences, Engineering and Technology"},{"issue":"3","key":"key2020100100575065900_ref004","first-page":"114","article-title":"Determining what individual SUS scores mean: adding an adjective rating scale","volume":"4","year":"2009","journal-title":"Journal of Usability Studies"},{"issue":"3","key":"key2020100100575065900_ref005","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/S0099-1333(01)00180-X","article-title":"Usability testing of an academic library web site: a case study","volume":"27","year":"2001","journal-title":"The Journal of Academic Librarianship"},{"issue":"1","key":"key2020100100575065900_ref006","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1108\/14678040610654828","article-title":"Functionality, usability, and accessibility: Iterative user\u2010centered evaluation strategies for digital libraries","volume":"7","year":"2006","journal-title":"Performance Measurement and Metrics"},{"key":"key2020100100575065900_ref007","article-title":"Usability of digital libraries: a source of creative tensions with technical developments","year":"2003"},{"key":"key2020100100575065900_ref008","article-title":"Software user experience and likelihood to recommend: linking UX and NPS","year":"2012"},{"issue":"2","key":"key2020100100575065900_ref009","doi-asserted-by":"crossref","first-page":"146","DOI":"10.5860\/crl.67.2.146","article-title":"Usability testing of a customizable library web portal","volume":"67","year":"2006","journal-title":"Collage & Research Libraries"},{"issue":"194","key":"key2020100100575065900_ref010","first-page":"4","article-title":"SUS-A quick and dirty usability scale","volume":"189","year":"1996","journal-title":"Usability Evaluation in Industry"},{"issue":"9","key":"key2020100100575065900_ref011","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1108\/00242530910997928","article-title":"Evaluating the usability and usefulness of a digital library","volume":"58","year":"2009","journal-title":"Library Review"},{"issue":"1","key":"key2020100100575065900_ref012","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.acalib.2005.11.001","article-title":"A survey of the usability of digital reference services on academic health science library web sites","volume":"32","year":"2006","journal-title":"The Journal of Academic Librarianship"},{"issue":"3","key":"key2020100100575065900_ref013","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1046\/j.1365-2532.2003.00450.x","article-title":"Usability evaluation of an NHS library website","volume":"20","year":"2003","journal-title":"Health Information and Libraries Journal"},{"issue":"4","key":"key2020100100575065900_ref014","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1108\/10650750510631695","article-title":"Usability of digital libraries: a study based on the areas of information science and human\u2010computer\u2010interaction","volume":"21","year":"2005","journal-title":"OCLC Systems & Services: International Digital Library Perspectives"},{"issue":"5","key":"key2020100100575065900_ref015","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1016\/j.acalib.2016.06.004","article-title":"Heuristic usability evaluation of University of Hong Kong Libraries\u2019 mobile website","volume":"42","year":"2016","journal-title":"The Journal of Academic Librarianship"},{"issue":"3","key":"key2020100100575065900_ref016","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1108\/10650750510612371","article-title":"Usability testing and design of a library website: an iterative approach","volume":"21","year":"2005","journal-title":"OCLC Systems & Services: International Digital Library Perspectives"},{"issue":"2","key":"key2020100100575065900_ref041","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/j.intcom.2006.10.001","article-title":"Heuristic evaluation: comparing ways of finding and reporting usability problems","volume":"19","year":"2007","journal-title":"Interacting With Computers"},{"key":"key2020100100575065900_ref017","first-page":"1","article-title":"Usability evaluation of an academic library website: a case of the University of the Punjab","volume":"13","year":"2012","journal-title":"Pakistan Journal of Library & Information Science"},{"issue":"5","key":"key2020100100575065900_ref018","first-page":"1","article-title":"User friendly locations of error messages in web forms: an eye tracking study","volume":"9","year":"2016","journal-title":"Journal of Eye Movement Research"},{"issue":"4","key":"key2020100100575065900_ref019","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1108\/02640471111156777","article-title":"Measuring the usability of academic digital libraries: instrument development and validation","volume":"29","year":"2011","journal-title":"The Electronic Library"},{"issue":"2","key":"key2020100100575065900_ref020","first-page":"11","article-title":"A usability evaluation model for academic library websites: efficiency, effectiveness and learnability","volume":"9","year":"2011","journal-title":"Journal of Library and Information Studies"},{"issue":"6","key":"key2020100100575065900_ref021","doi-asserted-by":"crossref","first-page":"934","DOI":"10.1016\/j.ergon.2009.08.005","article-title":"The usability analysis with heuristic evaluation and analytic hierarchy process","volume":"39","year":"2009","journal-title":"International Journal of Industrial Ergonomics"},{"issue":"4","key":"key2020100100575065900_ref022","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1016\/j.acalib.2004.04.002","article-title":"Applying web usability techniques to assess student awareness of library web resources","volume":"30","year":"2004","journal-title":"The Journal of Academic Librarianship"},{"issue":"1","key":"key2020100100575065900_ref023","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1108\/00907320110366732","article-title":"Usability testing in a library web site redesign project","volume":"29","year":"2001","journal-title":"Reference Services Review"},{"issue":"1-2","key":"key2020100100575065900_ref024","doi-asserted-by":"crossref","first-page":"133","DOI":"10.3366\/ijhac.2012.0044","article-title":"Perceptions of usability and usefulness of digital libraries","volume":"6","year":"2012","journal-title":"International Journal of Humanities and Arts Computing"},{"issue":"1","key":"key2020100100575065900_ref025","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1080\/09737766.2012.10700931","article-title":"Web usability evaluation of Iran national library website","volume":"6","year":"2012","journal-title":"COLLNET Journal of Scientometrics and Information Management"},{"issue":"4","key":"key2020100100575065900_ref026","first-page":"1","article-title":"Usability evaluation of laboratory and radiology information systems integrated into a hospital information system","volume":"38","year":"2014","journal-title":"Journal of Medical Systems"},{"key":"key2020100100575065900_ref027","first-page":"373","article-title":"Finding usability problems through heuristic evaluation","year":"1992"},{"key":"key2020100100575065900_ref028","unstructured":"Nielsen, J. (1995), \u201c10 usability heuristics for user interface design\u201d, available at: www.nngroup.com\/articles\/ten-usability-heuristics\/ (accessed August 5, 2017)."},{"issue":"3","key":"key2020100100575065900_ref029","first-page":"246","article-title":"Exploring the usability of the central library websites of medical sciences universities","volume":"49","year":"2016","journal-title":"Journal of Librarianship and Information Science"},{"issue":"5","key":"key2020100100575065900_ref030","doi-asserted-by":"crossref","first-page":"896","DOI":"10.1108\/EL-04-2014-0067","article-title":"Usability evaluation of an academic library website: experience with the central science library, university of Delhi","volume":"33","year":"2015","journal-title":"The Electronic Library"},{"issue":"12","key":"key2020100100575065900_ref031","first-page":"46","article-title":"The one number you need to grow","volume":"81","year":"2003","journal-title":"Harvard Business Review"},{"key":"key2020100100575065900_ref032","volume-title":"The Ultimate Question 2.0 (revised and expanded edition): How Net Promoter Companies Thrive in A Customer-Driven World","year":"2011"},{"issue":"1","key":"key2020100100575065900_ref033","first-page":"1","article-title":"The challenges and opportunities of measuring the user experience","volume":"12","year":"2016","journal-title":"Journal of Usability Studies"},{"issue":"1","key":"key2020100100575065900_ref034","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.acalib.2005.10.011","article-title":"A usability survey at the university of Mississippi libraries for the improvement of the library home page","volume":"32","year":"2006","journal-title":"The Journal of Academic Librarianship"},{"issue":"2","key":"key2020100100575065900_ref035","first-page":"67","article-title":"Evaluation of web-based library instruction programs","volume":"34","year":"2000","journal-title":"INSPEL"},{"key":"key2020100100575065900_ref036","volume-title":"Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics","year":"2008"},{"issue":"5","key":"key2020100100575065900_ref037","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1080\/0044929031000","article-title":"Retrospective vs. concurrent think-aloud protocols: testing the usability of an online library catalogue","volume":"22","year":"2003","journal-title":"Behaviour & Information Technology"},{"key":"key2020100100575065900_ref038","article-title":"Usability analysis of homepage of websites of national libraries in Asia","year":"2013","journal-title":"Library Philosophy and Practice (e-journal)"},{"issue":"3","key":"key2020100100575065900_ref039","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.acalib.2009.03.011","article-title":"An exploratory usability evaluation of Colorado State University libraries\u2019 digital collections and the Western waters digital library web sites","volume":"35","year":"2009","journal-title":"The Journal of Academic Librarianship"}],"container-title":["Aslib Journal of Information Management"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/AJIM-09-2017-0216\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/AJIM-09-2017-0216\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T23:01:14Z","timestamp":1753398074000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/ajim\/article\/70\/1\/66-77\/16707"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,1,15]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,1,15]]}},"alternative-id":["10.1108\/AJIM-09-2017-0216"],"URL":"https:\/\/doi.org\/10.1108\/ajim-09-2017-0216","relation":{},"ISSN":["2050-3806"],"issn-type":[{"value":"2050-3806","type":"print"}],"subject":[],"published":{"date-parts":[[2018,1,15]]}}}