{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T18:33:11Z","timestamp":1768588391768,"version":"3.49.0"},"reference-count":75,"publisher":"Emerald","issue":"7","license":[{"start":{"date-parts":[[2023,2,28]],"date-time":"2023-02-28T00:00:00Z","timestamp":1677542400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JD"],"published-print":{"date-parts":[[2023,12,18]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>The field of website quality evaluation attracts the interest of a range of disciplines, each bringing its own particular perspective to bear. This study aims to identify the main characteristics \u2013 methods, techniques and tools \u2013 of the instruments of evaluation described in this literature, with a specific concern for the factors analysed, and based on these, a multipurpose model is proposed for the development of new comprehensive instruments.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>Following a systematic bibliographic review, 305 publications on website quality are examined, the field's leading authors, their disciplines of origin and the sectors to which the websites being assessed belong are identified, and the methods they employ characterised.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>Evaluations of website quality tend to be conducted with one of three primary focuses: strategic, functional or experiential. The technique of expert analysis predominates over user studies and most of the instruments examined classify the characteristics to be evaluated \u2013 for example, usability and content \u2013 into factors that operate at different levels, albeit that there is little agreement on the names used in referring to them.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>Based on the factors detected in the 50 most cited works, a model is developed that classifies these factors into 13 dimensions and more than 120 general parameters. The resulting model provides a comprehensive evaluation framework and constitutes an initial step towards a shared conceptualization of the discipline of website quality.<\/jats:p><\/jats:sec>","DOI":"10.1108\/jd-11-2022-0246","type":"journal-article","created":{"date-parts":[[2023,2,27]],"date-time":"2023-02-27T10:19:51Z","timestamp":1677493191000},"page":"95-114","source":"Crossref","is-referenced-by-count":16,"title":["Website quality evaluation: a\u00a0model for developing comprehensive assessment instruments based on\u00a0key\u00a0quality factors"],"prefix":"10.1108","volume":"79","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5681-8683","authenticated-orcid":false,"given":"Alejandro","family":"Morales-Vargas","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6918-6910","authenticated-orcid":false,"given":"Rafael","family":"Pedraza-Jimenez","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7020-1631","authenticated-orcid":false,"given":"Llu\u00eds","family":"Codina","sequence":"additional","affiliation":[]}],"member":"140","published-online":{"date-parts":[[2023,2,28]]},"reference":[{"key":"key2024010911250469900_ref001","first-page":"186","article-title":"Usability evaluation of academic websites using automated tools","year":"2014"},{"key":"key2024010911250469900_ref002","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1016\/j.ijhm.2013.10.002","article-title":"A hybrid multi-criteria decision making model to evaluate hotel websites","volume":"36","year":"2014","journal-title":"International Journal of Hospitality Management"},{"issue":"6","key":"key2024010911250469900_ref003","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1016\/S0378-7206(01)00113-6","article-title":"Developing and validating an instrument for measuring user-perceived web quality","volume":"39","year":"2002","journal-title":"Information and Management"},{"issue":"11","key":"key2024010911250469900_ref004","doi-asserted-by":"crossref","first-page":"2282","DOI":"10.1016\/j.jbusres.2014.06.016","article-title":"Website design quality and usage behavior: unified theory of acceptance and use of technology","volume":"67","year":"2014","journal-title":"Journal of Business Research"},{"issue":"12","key":"key2024010911250469900_ref005","article-title":"A study on website quality models","volume":"4","year":"2014","journal-title":"International Journal of Scientific and Research Publications"},{"key":"key2024010911250469900_ref006","volume-title":"Human Interface Guidelines","author":"Apple","year":"2018"},{"key":"key2024010911250469900_ref007","doi-asserted-by":"crossref","unstructured":"Bevan, N., Carter, J. and Harker, S. (2015), \u201cISO 9241-11 Revised: what have we learnt about usability since 1998?\u201d, in Kurosu, M. (Ed.), Human-Computer Interaction: Design and Evaluation, Springer International Publishing, Cham, pp.\u00a0143-151.","DOI":"10.1007\/978-3-319-20901-2_13"},{"key":"key2024010911250469900_ref008","volume-title":"Systematic Approaches to a Successful Literature Review","year":"2016","edition":"2nd ed."},{"issue":"2","key":"key2024010911250469900_ref009","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1097\/JCN.0000000000000324","article-title":"Quality and health literacy demand of online heart failure information","volume":"32","year":"2017","journal-title":"Journal of Cardiovascular Nursing"},{"issue":"3","key":"key2024010911250469900_ref010","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1016\/j.jdmm.2016.01.005","article-title":"A study of e-commerce adoption by tourism websites in China","volume":"5","year":"2016","journal-title":"Journal of Destination Marketing and Management"},{"issue":"5-6","key":"key2024010911250469900_ref011","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1016\/j.im.2010.06.002","article-title":"A strategic framework for website evaluation based on a review of the literature from 1995\u20132006","volume":"47","year":"2010","journal-title":"Information and Management"},{"issue":"12","key":"key2024010911250469900_ref012","doi-asserted-by":"crossref","first-page":"2399","DOI":"10.1002\/asi.23543","article-title":"Web credibility assessment: conceptualization, operationalization, variability, and models","volume":"66","year":"2015","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"key2024010911250469900_ref013","volume-title":"Revisiones bibliogr\u00e1ficas sistematizadas: procedimientos generales y framework para ciencias humanas y sociales","year":"2018"},{"key":"key2024010911250469900_ref014","unstructured":"Codina, L. and Pedraza-Jim\u00e9nez, R. (2016), \u201cCaracter\u00edsticas y componentes de un sistema de an\u00e1lisis de medios digitales: el SAAMD\u201d, in Pedraza-Jim\u00e9nez, R., Codina, L. and Guallar, J. (Eds), Calidad en sitios web: M\u00e9todo de an\u00e1lisis general, e-commerce, im\u00e1genes, hemerotecas y turismo, Editorial UOC, Barcelona, pp.\u00a015-40."},{"issue":"1","key":"key2024010911250469900_ref015","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1007\/s10209-016-0454-3","article-title":"Critical factors in the evaluation of online media: creation and implementation of a measurement scale (e-SQ-Media)","volume":"16","year":"2017","journal-title":"Universal Access in the Information Society"},{"issue":"9","key":"key2024010911250469900_ref016","doi-asserted-by":"crossref","first-page":"1884","DOI":"10.1007\/s11606-019-05109-0","article-title":"Can patients trust online health information? A meta-narrative systematic review addressing the quality of health information on the internet","volume":"34","year":"2019","journal-title":"Journal of General Internal Medicine"},{"key":"key2024010911250469900_ref017","doi-asserted-by":"publisher","first-page":"37","DOI":"10.3389\/frobt.2018.00037","article-title":"A systematic review of 10 years of augmented reality usability studies: 2005 to 2014","volume":"5","year":"2018","journal-title":"Frontiers in Robotics and AI"},{"issue":"3","key":"key2024010911250469900_ref018","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1016\/j.jvoice.2017.11.002","article-title":"Quality and readability of English-language internet information for voice disorders","volume":"33","year":"2019","journal-title":"Journal of Voice"},{"issue":"4","key":"key2024010911250469900_ref019","first-page":"758","article-title":"A hybrid banking websites quality evaluation model using AHP and COPRAS-G: a\u00a0Turkey case","volume":"20","year":"2014","journal-title":"Technological and Economic Development of Economy"},{"key":"key2024010911250469900_ref020","article-title":"Europa web guide","author":"European Commission","year":"2016","journal-title":"The EU Internet Handbook"},{"key":"key2024010911250469900_ref021","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1016\/j.tmp.2013.10.003","article-title":"Web Quality Index (WQI) for official tourist destination websites. Proposal for an assessment system","volume":"9","year":"2014","journal-title":"Tourism Management Perspectives"},{"key":"key2024010911250469900_ref022","volume-title":"The Elements of User Experience: User-Centered Design for the Web and beyond","year":"2011","edition":"2nd ed."},{"key":"key2024010911250469900_ref023","volume-title":"An Introduction to Systematic Reviews","year":"2017","edition":"2nd ed."},{"issue":"2","key":"key2024010911250469900_ref024","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1111\/j.1471-1842.2009.00848.x","article-title":"A typology of reviews: an analysis of 14 review types and associated methodologies","volume":"26","year":"2009","journal-title":"Health Information and Libraries Journal"},{"issue":"1","key":"key2024010911250469900_ref025","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10660-010-9044-2","article-title":"The relationship between website quality, trust and price premiums at online auctions","volume":"10","year":"2010","journal-title":"Electronic Commerce Research"},{"issue":"3","key":"key2024010911250469900_ref026","first-page":"179","article-title":"Evaluating the usability of educational websites based on students\u2019 preferences of design characteristics","volume":"3","year":"2014","journal-title":"International Arab Journal of E-Technology"},{"key":"key2024010911250469900_ref027","volume-title":"Principles: the HON Code of Conduct for Medical and Health Web Sites","author":"Health On the Net","year":"2017"},{"issue":"4","key":"key2024010911250469900_ref028","doi-asserted-by":"crossref","first-page":"584","DOI":"10.1016\/j.giq.2014.07.002","article-title":"Usability and credibility of e-government websites","volume":"31","year":"2014","journal-title":"Government Information Quarterly"},{"issue":"4","key":"key2024010911250469900_ref029","doi-asserted-by":"crossref","first-page":"987","DOI":"10.1007\/s10209-016-0490-z","article-title":"Web site accessibility and quality in use: a comparative study of government web sites in Kyrgyzstan, Azerbaijan, Kazakhstan and Turkey","volume":"16","year":"2017","journal-title":"Universal Access in the Information Society"},{"key":"key2024010911250469900_ref030","article-title":"Terms & definitions","author":"ISO","year":".","journal-title":"Online Browsing Platform (OBP)"},{"key":"key2024010911250469900_ref031","article-title":"ISO 9241-151:2008 ergonomics of human-system interaction. Part 151: guidance on World wide web user interfaces","author":"ISO","year":"2008","journal-title":"International Organization for Standardization"},{"key":"key2024010911250469900_ref032","doi-asserted-by":"crossref","unstructured":"Jainari, M.H., Baharum, A., Deris, F.D., Mat Noor, N.A., Ismail, R. and Mat Zain, N.H. (2022), \u201cA standard content for university websites using heuristic evaluation\u201d, in Arai, K. (Ed.), Intelligent Computing. SAI 2022. Lecture Notes in Networks and Systems, Springer, Cham, Vol.\u00a0506, doi: 10.1007\/978-3-031-10461-9_19.","DOI":"10.1007\/978-3-031-10461-9_19"},{"issue":"9","key":"key2024010911250469900_ref033","first-page":"81","article-title":"An intelligent method to assess webpage quality using extreme learning machine","volume":"16","year":"2016","journal-title":"International Journal of Computer Science and Network Security"},{"issue":"2","key":"key2024010911250469900_ref034","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1108\/ITP-07-2013-0130","article-title":"Accessibility as an integral factor in e-government web site evaluation: the case of Dubai e-government","volume":"27","year":"2014","journal-title":"Information Technology and People"},{"issue":"3","key":"key2024010911250469900_ref035","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1016\/j.ijinfomgt.2013.11.004","article-title":"Evaluating websites from a public value perspective: a review of Turkish local government websites","volume":"34","year":"2014","journal-title":"International Journal of Information Management"},{"key":"key2024010911250469900_ref036","first-page":"7","article-title":"Key aspects to evaluate the performance of a commercial website","year":"2014"},{"key":"key2024010911250469900_ref037","volume-title":"Web Analytics 2.0: the Art of Online Accountability & Science of Customer Centricity","year":"2010"},{"issue":"2","key":"key2024010911250469900_ref038","article-title":"Evaluating the quality of health information in a changing digital ecosystem","volume":"21","year":"2019","journal-title":"Journal of Medical Internet Research"},{"issue":"4","key":"key2024010911250469900_ref039","doi-asserted-by":"crossref","first-page":"72","DOI":"10.3390\/fi12040072","article-title":"Aggregated indices in website quality assessment","volume":"12","year":"2020","journal-title":"Future Internet"},{"key":"key2024010911250469900_ref040","volume-title":"Don't Make Me Think, Revisited: A Common Sense Approach to Web and Mobile Usability","year":"2014","edition":"3rd ed., New Ri"},{"key":"key2024010911250469900_ref041","doi-asserted-by":"crossref","unstructured":"Kurosu, M. (2015), Human-computer Interaction: Design and Evaluation, in Kurosu, M. (Ed.), Springer International Publishing, Cham.","DOI":"10.1007\/978-3-319-20901-2"},{"key":"key2024010911250469900_ref042","volume-title":"Encyclopedia of Survey Research Methods","year":"2008","edition":"5th ed."},{"key":"key2024010911250469900_ref043","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.ijhm.2018.06.005","article-title":"Evaluation of hotel websites: progress and future developments","volume":"76","year":"2019","journal-title":"International Journal of Hospitality Management"},{"issue":"3","key":"key2024010911250469900_ref044","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1016\/j.tourman.2009.11.007","article-title":"Progress in tourism management: a review of website evaluation in tourism research","volume":"31","year":"2010","journal-title":"Tourism Management"},{"key":"key2024010911250469900_ref045","volume-title":"Research-based Web Design & Usability Guidelines","year":"2006","edition":"2nd ed."},{"issue":"2","key":"key2024010911250469900_ref046","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1016\/j.giq.2019.01.003","article-title":"Using government websites to enhance democratic E-governance: a conceptual model for evaluation","volume":"36","year":"2019","journal-title":"Government Information Quarterly"},{"issue":"9","key":"key2024010911250469900_ref047","doi-asserted-by":"crossref","first-page":"1268","DOI":"10.1080\/10548408.2015.1117408","article-title":"A modified model for hotel website functionality evaluation","volume":"33","year":"2016","journal-title":"Journal of Travel and Tourism Marketing"},{"issue":"1","key":"key2024010911250469900_ref048","first-page":"1","article-title":"Off-page SEO and link building: general strategies and authority transfer in the digital news media","volume":"28","year":"2019","journal-title":"Profesional de la Informaci\u00f3n"},{"key":"key2024010911250469900_ref049","doi-asserted-by":"crossref","unstructured":"Maia, C.L.B. and Furtado, E.S. (2016), \u201cA systematic review about user experience evaluation\u201d, in\u00a0Marcus, A. (Ed.), Design, User Experience, and Usability: Design Thinking and Methods, Springer International Publishing, Cham, pp.\u00a0445-455.","DOI":"10.1007\/978-3-319-40409-7_42"},{"issue":"01","key":"key2024010911250469900_ref050","doi-asserted-by":"crossref","first-page":"031","DOI":"10.3766\/jaaa.17070","article-title":"Quality and readability of English-language internet information for tinnitus","volume":"30","year":"2019","journal-title":"Journal of the American Academy of Audiology"},{"issue":"4","key":"key2024010911250469900_ref051","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.1016\/j.joi.2018.09.002","article-title":"Google Scholar, Web of Science, and Scopus: a systematic comparison of citations in 252 subject categories","volume":"12","year":"2018","journal-title":"Journal of Informetrics"},{"issue":"5","key":"key2024010911250469900_ref052","first-page":"e290508","article-title":"Website quality: an analysis of scientific production","volume":"29","year":"2020","journal-title":"Profesional de la Informaci\u00f3n"},{"key":"key2024010911250469900_ref053","unstructured":"Nielsen, J. (2020), \u201c10 usability heuristics for user interface design\u201d, Nielsen Norman Group, available at: https:\/\/www.nngroup.com\/articles\/ux-research-cheat-sheet\/ (accessed 3 May 2021)."},{"key":"key2024010911250469900_ref054","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1108\/EL-06-2019-0140","article-title":"Aspect-based sentiment analysis of reviews in the domain of higher education","volume":"38","year":"2020","journal-title":"Electronic Library"},{"key":"key2024010911250469900_ref055","volume-title":"Cibermetr\u00eda: Midiendo El Espacio Red","year":"2014"},{"key":"key2024010911250469900_ref056","first-page":"546","article-title":"Heuristic evaluation as a complement to usability testing: a case study in web domain","year":"2015"},{"key":"key2024010911250469900_ref057","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.csi.2017.03.009","article-title":"How to develop usability heuristics: a systematic literature review","volume":"53","year":"2017","journal-title":"Computer Standards and Interfaces"},{"key":"key2024010911250469900_ref058","first-page":"585","article-title":"Quality evaluation of web sites: a comparative study of some multiple criteria decision making methods","year":"2015"},{"issue":"1","key":"key2024010911250469900_ref059","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/j.ijinfomgt.2017.06.007","article-title":"Assessing web sites quality: a systematic literature review by text and association rules mining","volume":"38","year":"2018","journal-title":"International Journal of Information Management"},{"issue":"3","key":"key2024010911250469900_ref060","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1108\/14684521211241404","article-title":"Framework for a global quality evaluation of a website","volume":"36","year":"2012","journal-title":"Online Information Review"},{"key":"key2024010911250469900_ref061","volume-title":"User Experience Careers: What a Career in UX Looks Like Today","year":"2020"},{"issue":"4","key":"key2024010911250469900_ref062","first-page":"1","article-title":"Double-entry analysis system (DEAS) for comprehensive quality evaluation of websites: case study in the tourism sector","volume":"29","year":"2020","journal-title":"Profesional de la Informaci\u00f3n"},{"key":"key2024010911250469900_ref063","volume-title":"Quantifying the User Experience: Practical Statistics for User Research","year":"2016","edition":"2nd ed."},{"key":"key2024010911250469900_ref064","doi-asserted-by":"crossref","unstructured":"Semer\u00e1dov\u00e1, T. and Weinlich, P. (2020), \u201cLooking for the definition of website quality\u201d, in Semer\u00e1dov\u00e1, T. and Weinlich, P. (Eds), Website Quality and Shopping Behavior: Quantitative and Qualitative Evidence, SpringerBriefs in Business, Cham, pp.\u00a05-27.","DOI":"10.1007\/978-3-030-44440-2_2"},{"key":"key2024010911250469900_ref065","article-title":"The eight golden rules of interface design","year":"2016"},{"key":"key2024010911250469900_ref066","volume-title":"Designing the User Interface: Strategies for Effective Human-Computer Interaction","year":"2016","edition":"6th ed."},{"issue":"5","key":"key2024010911250469900_ref067","article-title":"Consumer evaluation of the quality of online health information: systematic literature review of relevant criteria and indicators","volume":"21","year":"2019","journal-title":"Journal of Medical Internet Research"},{"issue":"4","key":"key2024010911250469900_ref068","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1080\/07370024.2017.1421954","article-title":"Facets of website content","volume":"34","year":"2019","journal-title":"Human\u2013Computer Interaction"},{"key":"key2024010911250469900_ref069","article-title":"First principles of interaction design (revised and expanded)","year":"2014","journal-title":"askTog"},{"key":"key2024010911250469900_ref070","unstructured":"Toxboe, A. (2018), \u201cDesign patterns\u201d, UI Patterns: User Interface Design Patterns Library, available at: http:\/\/ui-patterns.com\/patterns (accessed 17 June 2018)."},{"key":"key2024010911250469900_ref071","volume-title":"Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics","year":"2013","edition":"2nd ed."},{"key":"key2024010911250469900_ref072","article-title":"Web design and applications standards","author":"W3C","year":"2016","journal-title":"World Wide Web Consortium"},{"key":"key2024010911250469900_ref073","unstructured":"Whitenton, K. (2021), \u201cTriangulation: get better research results by using multiple UX methods\u201d, Nielsen Norman Group, available at: https:\/\/www.nngroup.com\/articles\/triangulation-better-research-results-using-multiple-ux-methods\/ (accessed 4 March 2021)."},{"key":"key2024010911250469900_ref074","first-page":"194","article-title":"Web Site Evaluation Index: a systematic methodology and a metric system for the assessment of the quality of web sites","year":"2009"},{"key":"key2024010911250469900_ref075","volume-title":"Qualitative Research Form Start to Finish","year":"2015","edition":"2nd ed."}],"container-title":["Journal of Documentation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JD-11-2022-0246\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JD-11-2022-0246\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:35:30Z","timestamp":1753396530000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/jd\/article\/79\/7\/95-114\/195061"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,28]]},"references-count":75,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,2,28]]},"published-print":{"date-parts":[[2023,12,18]]}},"alternative-id":["10.1108\/JD-11-2022-0246"],"URL":"https:\/\/doi.org\/10.1108\/jd-11-2022-0246","relation":{},"ISSN":["0022-0418"],"issn-type":[{"value":"0022-0418","type":"print"}],"subject":[],"published":{"date-parts":[[2023,2,28]]}}}