{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T15:24:47Z","timestamp":1781105087910,"version":"3.54.1"},"reference-count":54,"publisher":"IGI Global Scientific Publishing","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,1]]},"abstract":"<jats:p>Heuristic evaluation (HE) is a widely used method for assessing software systems. Several studies have sought to improve the effectiveness of HE by developing its heuristics and procedures. However, few studies have involved the end-user, and to the best of the authors' knowledge, no HE studies involving end-users with non-expert evaluators have been reported. Therefore, the aim of this study is to investigate the impact of end-users on the results obtained by a non-expert evaluator within the HE process, and through that, to explore the number of usability problems and their severity. This article proposes introducing two sessions within the HE process: a user exploration session (UES-HE) and a user review session (URS-HE). The outcomes are compared with two solid benchmarks in the usability-engineering field: the traditional HE and the usability testing (UT) methods. The findings show that the end-user has a significant impact on non-expert evaluator results in both sessions. In the UES-HE method, the results outperformed all usability evaluation methods (UEMs) regarding the usability problems identified, and it tended to identify more major, minor, and cosmetic problems than other methods.<\/jats:p>","DOI":"10.4018\/ijossp.2018010104","type":"journal-article","created":{"date-parts":[[2018,5,30]],"date-time":"2018-05-30T07:53:53Z","timestamp":1527666833000},"page":"62-81","source":"Crossref","is-referenced-by-count":5,"title":["Effect of User Sessions on the Heuristic Usability Method"],"prefix":"10.4018","volume":"9","author":[{"given":"Jehad","family":"Alqurni","sequence":"first","affiliation":[{"name":"School of Mathematical and Computer Sciences, Heriot-Watt University, Edinburgh, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1585-2962","authenticated-orcid":true,"given":"Roobaea","family":"Alroobaea","sequence":"additional","affiliation":[{"name":"College of Computers and Information Technology, Taif University, Taif, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammed","family":"Alqahtani","sequence":"additional","affiliation":[{"name":"College of Computer Science and Information Technology, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2432","reference":[{"key":"IJOSSP.2018010104-0","unstructured":"\u00c4ij\u00f6, R., & Mantere, J. (2001). Are non-expert usability evaluations valuable? Paper presented at the 18th International Symposium on Human Factors in Telecommunications (HfT 2001), Bergen, Norway."},{"key":"IJOSSP.2018010104-1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2005.10.004"},{"issue":"3","key":"IJOSSP.2018010104-2","article-title":"The influence of end-users on non-expert evaluator output within the heuristic usability method","volume":"4","author":"J.Alqurni","year":"2016","journal-title":"International Review of Basic and Applied Sciences"},{"issue":"2","key":"IJOSSP.2018010104-3","first-page":"88","article-title":"Generating a domain specific inspection evaluation method through an adaptive framework: a comparative study on educational websites.","volume":"4","author":"R.AlRoobaea","year":"2013","journal-title":"International Journal of Human-Computer Interaction"},{"key":"IJOSSP.2018010104-4","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45348-2_14"},{"key":"IJOSSP.2018010104-5","doi-asserted-by":"publisher","DOI":"10.1145\/2535597.2535601"},{"key":"IJOSSP.2018010104-6","doi-asserted-by":"publisher","DOI":"10.4156\/ijiip.vol3.issue1.1"},{"key":"IJOSSP.2018010104-7","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijinfomgt.2005.08.008"},{"key":"IJOSSP.2018010104-8","unstructured":"Cheng, L. C. & Mustafa, M. (2014). A Reference to Usability Inspection Methods."},{"key":"IJOSSP.2018010104-9","doi-asserted-by":"publisher","DOI":"10.1177\/154193129303701702"},{"key":"IJOSSP.2018010104-10","author":"J. S.Dumas","year":"1999","journal-title":"A practical guide to usability testing"},{"key":"IJOSSP.2018010104-11","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2008.06.002"},{"key":"IJOSSP.2018010104-12","doi-asserted-by":"publisher","DOI":"10.3758\/BF03195514"},{"key":"IJOSSP.2018010104-13","doi-asserted-by":"publisher","DOI":"10.1109\/sbes.2012.30"},{"key":"IJOSSP.2018010104-14","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2011.02.007"},{"key":"IJOSSP.2018010104-15","doi-asserted-by":"publisher","DOI":"10.1080\/02699050110113688"},{"key":"IJOSSP.2018010104-16","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci1303_2"},{"key":"IJOSSP.2018010104-17","unstructured":"Group, M. M. (2016). Internet World Stats. Retrieved from http:\/\/www.internetworldstats.com\/"},{"key":"IJOSSP.2018010104-18","doi-asserted-by":"publisher","DOI":"10.1207\/S15327590IJHC1501_13"},{"key":"IJOSSP.2018010104-19","doi-asserted-by":"publisher","DOI":"10.1145\/1297144.1297200"},{"key":"IJOSSP.2018010104-20","doi-asserted-by":"publisher","DOI":"10.1145\/1039539.1039541"},{"key":"IJOSSP.2018010104-21","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2009.02.003"},{"key":"IJOSSP.2018010104-22","first-page":"499","article-title":"What makes evaluators to find more usability problems?: A meta-analysis for individual detection rates. Human-Computer Interaction, Pt 1","volume":"4550","author":"W.Hwang","year":"2007","journal-title":"Proceedings"},{"key":"IJOSSP.2018010104-23","unstructured":"ISO. (1998). 9241-11 Ergonomic requirements for office work with visual display terminals (VDTs) - Part 11: Guidance on usability: ISO."},{"key":"IJOSSP.2018010104-24","doi-asserted-by":"publisher","DOI":"10.1145\/70609.70624"},{"key":"IJOSSP.2018010104-25","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2011.02.005"},{"key":"IJOSSP.2018010104-26","article-title":"On the performance of novice evaluators in usability evaluations.","author":"P.Koutsabasis","year":"2007","journal-title":"Proc. PCI, Patra"},{"key":"IJOSSP.2018010104-27","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240839"},{"key":"IJOSSP.2018010104-28","doi-asserted-by":"crossref","unstructured":"Muller, M. J., Matheson, L., Page, C., & Gallup, R. (1998). Methods & tools: participatory heuristic evaluation. interactions, 5(5), 13-18.","DOI":"10.1145\/285213.285219"},{"key":"IJOSSP.2018010104-29","unstructured":"Nielsen. J. (2001). Did Poor Usability Kill E-Commerce? Retrieved from http:\/\/www.nngroup.com\/articles\/did-poor-usability-kill-e-commerce\/"},{"key":"IJOSSP.2018010104-30","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1992). Finding usability problems through heuristic evaluation. Paper presented at theSIGCHI Conference on Human Factors in Computing Systems, Monterey, CA.","DOI":"10.1145\/142750.142834"},{"key":"IJOSSP.2018010104-31","author":"J.Nielsen","year":"1993","journal-title":"Usability Engineering"},{"key":"IJOSSP.2018010104-32","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1994a). Enhancing the explanatory power of usability heuristics. Paper presented at theSIGCHI Conference on Human Factors in Computing Systems, Boston, M USA.","DOI":"10.1145\/259963.260333"},{"key":"IJOSSP.2018010104-33","unstructured":"Nielsen, J. (1994b). Heuristic evaluation. In N. Jakob & L. M. Robert (Eds.), Usability inspection methods (pp. 25-62). John Wiley &amp; Sons, Inc."},{"key":"IJOSSP.2018010104-34","doi-asserted-by":"publisher","DOI":"10.1145\/291469.291470"},{"key":"IJOSSP.2018010104-35","unstructured":"Nielsen, J. (2000). Why you only need to test with 5 users. Retrieved from https:\/\/www.nngroup.com"},{"key":"IJOSSP.2018010104-36","unstructured":"Nielsen, J. (2006). Quantitative Studies: How Many Users to Test? Retrieved from https:\/\/www.nngroup.com"},{"key":"IJOSSP.2018010104-37","unstructured":"Oracle. (2012). FAQ: How to conduct Heuristic Evaluation."},{"key":"IJOSSP.2018010104-38","unstructured":"Osterbauer, C., K\u03c6hle, M., Grechenig, T., & Tscheligi, M. (2000). Web Usability Testing: A case study of usability testing of chosen sites (banks, daily newspapers, insurances). In the Sixth Australian World Wide Web Conference."},{"key":"IJOSSP.2018010104-39","doi-asserted-by":"crossref","unstructured":"Paz, F., Paz, F. A., Villanueva, D., & Pow-Sang, J. A. (2015, April 13-15). Heuristic Evaluation as a Complement to Usability Testing: A Case Study in Web Domain. Paper presented at the 2015 12th International Conference on Information Technology - New Generations (ITNG).","DOI":"10.1109\/ITNG.2015.92"},{"key":"IJOSSP.2018010104-40","unstructured":"Preece, J., Sharp, H., & Rogers, Y. (2015). Interaction design: beyond human-computer interaction (4th ed.). Chichester: John Wiley & Sons."},{"key":"IJOSSP.2018010104-41","author":"J.Rubin","year":"2008","journal-title":"Handbook of usability testing: How to plan, design, and conduct effective tests"},{"key":"IJOSSP.2018010104-42","doi-asserted-by":"publisher","DOI":"10.1207\/s15327590ijhc0903_2"},{"key":"IJOSSP.2018010104-43","author":"P.Sherman","year":"2009","journal-title":"UPA Salary Survey"},{"key":"IJOSSP.2018010104-44","unstructured":"Shneiderman, B. (1998). Designing the user interface: strategies for effective human-computer interaction (3rd ed.). Addison-Wesley."},{"key":"IJOSSP.2018010104-45","doi-asserted-by":"publisher","DOI":"10.1145\/632716.632902"},{"key":"IJOSSP.2018010104-46","unstructured":"Sova, D. H., & Nielsen, J. (2003). 234 Tips and Tricks for Recruiting Users as Participants in Usability Studies."},{"key":"IJOSSP.2018010104-47","unstructured":"Turner, C. W., Lewis, J. R., & Nielsen, J. (2006). Determining usability test sample size. International encyclopedia of ergonomics and human factors, 3, 3084-3088."},{"key":"IJOSSP.2018010104-48","doi-asserted-by":"publisher","DOI":"10.1109\/IPCC.2005.1494192"},{"key":"IJOSSP.2018010104-49","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2004.07.007"},{"key":"IJOSSP.2018010104-50","doi-asserted-by":"publisher","DOI":"10.1177\/001872089203400407"},{"key":"IJOSSP.2018010104-51","article-title":"Knowledge resources in usability inspection.","author":"A.Woolrych","year":"2005","journal-title":"Proceedings of the HCI 2005"},{"key":"IJOSSP.2018010104-52","doi-asserted-by":"publisher","DOI":"10.1108\/10650741211192046"},{"key":"IJOSSP.2018010104-53","first-page":"209","article-title":"Usability Evaluation","author":"Z.Zhijun","year":"2007","journal-title":"Human Computer Interaction Research in Web Design and Evaluation"}],"container-title":["International Journal of Open Source Software and Processes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=206887","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,6]],"date-time":"2022-05-06T10:03:19Z","timestamp":1651831399000},"score":1,"resource":{"primary":{"URL":"http:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/IJOSSP.2018010104"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[2018,1]]},"references-count":54,"journal-issue":{"issue":"1"},"URL":"https:\/\/doi.org\/10.4018\/ijossp.2018010104","relation":{},"ISSN":["1942-3926","1942-3934"],"issn-type":[{"value":"1942-3926","type":"print"},{"value":"1942-3934","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,1]]}}}