{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T16:25:34Z","timestamp":1774628734649,"version":"3.50.1"},"reference-count":57,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2024,12,2]],"date-time":"2024-12-02T00:00:00Z","timestamp":1733097600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>This paper discusses the design and evaluation of a set of heuristics (U + A) to assess the usability and accessibility of interactive systems in terms of cognitive diversity in an integrated way. Method: An analysis of the usability and accessibility aspects that have the greatest impact on people with cognitive disabilities is presented. A set of cognitive usability and accessibility heuristics targeted at people with cognitive disabilities is generated with the support of generative artificial intelligence (GenAI). Result: Several interactive systems are evaluated to validate the U + A heuristics. A quantitative classification of the evaluated systems is obtained, i.e., the \u201cU + A-index\u201d, which reveals the most and least usable and accessible systems for people with cognitive and learning disabilities. Conclusions: This study demonstrates that it is possible to carry out a classification of heuristic criteria considering accessibility, usability, and cognitive disability. The results also show that the selection of criteria proposed by GenAI is optimal and that this technology can be used to improve usability and accessibility of interactive systems in a practical way. Yet, further evaluations are needed to support the results of the analyzed proposal.<\/jats:p>","DOI":"10.3390\/info15120769","type":"journal-article","created":{"date-parts":[[2024,12,4]],"date-time":"2024-12-04T06:38:25Z","timestamp":1733294305000},"page":"769","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Towards Designing a Set of Usability and Accessibility Heuristics Focused on Cognitive Diversity: An Exploratory Case Study with Generative Artificial Intelligence"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2368-755X","authenticated-orcid":false,"given":"Afra","family":"Pascual Almenara","sequence":"first","affiliation":[{"name":"Department of Computer Engineering and Digital Design, Escola Polit\u00e8cnica Superior, University of Lleida, Jaume II, 25001 Lleida, Catalunya, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5227-1246","authenticated-orcid":false,"given":"Sergio","family":"Sayago Barrantes","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering and Digital Design, Escola Polit\u00e8cnica Superior, University of Lleida, Campus Igualada, Av. Pla de la Massa 08, 08700 Igualada, Catalunya, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2024,12,2]]},"reference":[{"key":"ref_1","unstructured":"(2024, October 25). Digital 2024: Global Overview Report. Available online: https:\/\/datareportal.com\/reports\/digital-2024-global-overview-report."},{"key":"ref_2","unstructured":"(2024, October 25). World Report on Disability 2011. Available online: https:\/\/www.who.int\/teams\/noncommunicable-diseases\/sensory-functions-disability-and-rehabilitation\/world-report-on-disability."},{"key":"ref_3","unstructured":"(2024, October 25). World Health Organization: Summary World Report on Disability. Available online: https:\/\/cutt.ly\/ZrDBPje."},{"key":"ref_4","unstructured":"Eser, A. (2024, October 25). Intellectual Disability Statistics: Key Facts on Global Impact Revealed. World Metrics. Available online: https:\/\/worldmetrics.org\/intellectual-disability-statistics\/."},{"key":"ref_5","unstructured":"(2024, October 25). Universal Declaration of Human Rights. Available online: https:\/\/www.un.org\/es\/about-us\/universal-declaration-of-human-rights."},{"key":"ref_6","unstructured":"Novak, M.E., and Paciello, M.G. (2002). La Conquista de la Accesibilidad de X-Windows: Desarrollo para Personas con Discapacidades, The Paciello Group."},{"key":"ref_7","unstructured":"Hudson, R., Weakley, R., and Firminger, P. (2024, October 25). Una Frontera de Accesibilidad: Discapacidades Cognitivas y Dificultades de Aprendizaje. Webusability\u2014Servicios de Accesibilidad y Usabilidad. Available online: https:\/\/usability.com.au\/2004\/12\/an-accessibility-frontier-cognitive-disabilities-and-learning-difficulties-2004\/."},{"key":"ref_8","unstructured":"(1998). Ergonomics of Human-System Interaction\u2013Part 11: Guidance on Usability (Standard No. ISO\/CD 9241-11). Available online: http:\/\/www.iso.org\/iso\/catalogue_detail.htm?csnumber=63500."},{"key":"ref_9","unstructured":"(2024, October 25). Introduction to Web Accessibility. Available online: https:\/\/www.w3.org\/standards\/webdesign\/accessibility."},{"key":"ref_10","unstructured":"(2024, October 25). Evaluating Web Accessibility Overview. Available online: https:\/\/www.w3.org\/WAI\/test-evaluate\/."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1007\/s10209-020-00726-7","article-title":"Measuring and improving the quality of development processes based on usability and accessibility","volume":"20","author":"Quintal","year":"2021","journal-title":"Univ. Access Inf. Soc."},{"key":"ref_12","unstructured":"Gonz\u00e1lez, M.P., Pascual, A., and Lor\u00e9s, J. (2001). Evaluaci\u00f3n heur\u00edstica. Introducci\u00f3n a la Interacci\u00f3n Persona-Ordenador, AIPO: Asociaci\u00f3n Interacci\u00f3n Persona-Ordenador. Available online: https:\/\/aipo.es\/wp-content\/uploads\/2022\/02\/LibroAIPO.pdf."},{"key":"ref_13","unstructured":"(2024, October 25). WCAG 2 Overview. Available online: https:\/\/www.w3.org\/WAI\/standards-guidelines\/wcag\/."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Hollingsed, T., and Novick, D.G. (2007, January 22\u201324). Usability inspection methods after 15 years of research and practice. Proceedings of the 25th Annual ACM International Conference on Design of Communication (SIGDOC \u201807), El Paso, TX, USA.","DOI":"10.1145\/1297144.1297200"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Or, C.K., and Chan, A.H.S. (2024). Inspection methods for usability evaluation. User Experience Methods and Tools in Human-Computer Interaction, CRC Press. [1st ed.].","DOI":"10.1201\/9781003495161-7"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1207","DOI":"10.1080\/00140139.2020.1774080","article-title":"Usability, user experience and accessibility: Towards an integrative model","volume":"63","author":"Sauer","year":"2020","journal-title":"Ergonomics"},{"key":"ref_17","unstructured":"Cockton, G. (2024, October 25). Usability Evaluation. Interaction Design Foundation\u2014IxDF. Available online: https:\/\/www.interaction-design.org\/literature\/book\/the-encyclopedia-of-human-computer-interaction-2nd-ed\/usability-evaluation."},{"key":"ref_18","unstructured":"(2024, October 25). La Interacci\u00f3n Persona Ordenador. Asociaci\u00f3n en Interacci\u00f3n Persona Ordenador. Available online: https:\/\/aipo.es\/educacion\/material-editado-por-aipo\/?id_rec=2."},{"key":"ref_19","unstructured":"Polson, P., Rieman, J., Wharton, C., Olson, J., and Kitajima, M. (1992, January 10\u201312). Usability inspection methods: Rationale and examples. Proceedings of the 8th Human Interface Symposium (HIS92), Kawasaki, Japan."},{"key":"ref_20","unstructured":"Jeffries, R., Miller, J.R., Wharton, C., and Uyeda, K. (May, January 27). User interface evaluation in the real world: A comparison of four techniques. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1992, January 3\u20137). Finding usability problems through heuristic evaluation. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Monterey, CA, USA.","DOI":"10.1145\/142750.142834"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Jimenez, C., Lozada, P., and Rosas, P. (2016, January 27\u201330). Usability heuristics: A systematic review. Proceedings of the 2016 IEEE 11th Colombian Computing Conference (CCC), Popayan, Colombia.","DOI":"10.1109\/ColumbianCC.2016.7750805"},{"key":"ref_23","unstructured":"Nielsen, J. (2024, October 25). 10 Usability Heuristics for User Interface Design. Available online: https:\/\/www.nngroup.com\/articles\/ten-usability-heuristics\/."},{"key":"ref_24","unstructured":"Dourado, D., Antonio, M., and Canedo, E.D. (2018, January 21\u201324). Usability Heuristics for Mobile Applications\u2014A Systematic Review. Proceedings of the 20th International Conference on Enterprise Information Systems\u2014Volume 2, ICEIS, Funchal, Portugal."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Kuhail, M., Shawar, B.A., and Hammad, R. (2023). Recent Developments in Chatbot Usability and Design Methodologies. Trends, Applications, and Challenges of Chatbot Technology, IGI Global.","DOI":"10.4018\/978-1-6684-6234-8"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"427","DOI":"10.15388\/infedu.2019.20","article-title":"Heuristic Evaluation on Usability of Educational Games: A Systematic Review","volume":"18","author":"Vieira","year":"2019","journal-title":"Inform. Educ."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Omar, K., Fakhouri, H., Zraqou, J., and Marx G\u00f3mez, J. (2024). Usability Heuristics for Metaverse. Computers, 13.","DOI":"10.3390\/computers13090222"},{"key":"ref_28","first-page":"823","article-title":"Design of mobile applications for people with intellectual disabilities","volume":"535","author":"Dekelver","year":"2015","journal-title":"Commun. Comput. Inf. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Abou-Zahra, S., Brewer, J., and Cooper, M. (2017, January 2\u20134). Web Standards to Enable an Accessible and Inclusive Internet of Things (IoT). Proceedings of the 14th International Web for All Conference (W4A \u201817), Perth, Australia. Article 9.","DOI":"10.1145\/3058555.3058568"},{"key":"ref_30","unstructured":"Gonz\u00e1lez, M., Masip, L., Granollers, T., and Oliva, M. (2008, January 9\u201311). An\u00e1lisis Cuantitativo en un Experimento de Evaluaci\u00f3n Heur\u00edstica. Proceedings of the IX Congreso Internacional Interacci\u00f3n, Albacete, Spain."},{"key":"ref_31","unstructured":"Bonastre, L., and Granollers, T. (2021, January 24\u201329). A set of heuristics for user experience evaluation in Ecommerce websites. Proceedings of the Seventh International Conference on Advances in Computer-Human Interactions, ACHI 2014, Virtual Event."},{"key":"ref_32","unstructured":"Granollers, T., and Albets, M. (2024, October 25). Heuristic Evaluations New Proposal. Available online: https:\/\/web.archive.org\/web\/20240713190018\/."},{"key":"ref_33","unstructured":"Tognazzini, B. (2024, October 25). First Principles, HCI Design, Human Computer Interaction (HCI), Principles of HCI Design, Usability Testing. Available online: http:\/\/www.asktog.com\/basics\/firstPrinciples.html."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"615","DOI":"10.5753\/jis.2024.4078","article-title":"Enhancing Usability Assessment with a Novel Heuristics-Based Approach Validated in an Actual Business Setting","volume":"15","author":"Saltiveri","year":"2024","journal-title":"J. Interact. Syst."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Akg\u00fcl, Y. (2022). A Systematic Review of Web Accessibility Metrics. App and Website Accessibility Developments and Compliance Strategies, IGI Global.","DOI":"10.4018\/978-1-7998-7848-3"},{"key":"ref_36","unstructured":"Masri, F., and Luj\u00e1n-Mora, S. (2011, January 24\u201326). A Combined Agile Methodology for the Evaluation of Web Accessibility. Proceedings of the IADIS International Conference Interfaces and Human Computer Interaction 2011 (IHCI 2011), Rome, Italy."},{"key":"ref_37","unstructured":"(2024, October 25). Web Accessibility Evaluation Tools List. Available online: https:\/\/www.w3.org\/WAI\/test-evaluate\/tools\/list\/."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Brajnik, G., and Vigo, M. (2019). Automatic Web Accessibility Metrics: Where We Were and Where We Went. Web Accessibility, Springer.","DOI":"10.1007\/978-1-4471-7440-0_27"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Freire, A.P., Fortes, R.P.M., Turine, M.A.S., and Paiva, D.M.B. (2008, January 22\u201324). An evaluation of web accessibility metrics based on their attributes. Proceedings of the 26th Annual ACM International Conference on Design of Communication (SIGDOC \u201808), Lisbon, Portugal.","DOI":"10.1145\/1456536.1456551"},{"key":"ref_40","unstructured":"(2024, October 25). Making Content Usable for People with Cognitive and Learning Disabilities. Available online: https:\/\/www.w3.org\/TR\/coga-usable."},{"key":"ref_41","unstructured":"(2024, October 25). Web Content Accessibility Guidelines 2.2 (WCAG). World Wide Web Consortium (W3C). Available online: http:\/\/www.w3.org\/TR\/WCAG22\/."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Dias, A.L., de Mattos Fortes, R.P., and Masiero, P.C. (2014, January 7). Heua: A heuristic evaluation with usability and accessibility requirements to assess web systems. Proceedings of the 11th Web for All Conference, Seoul, Republic of Korea.","DOI":"10.1145\/2596695.2596706"},{"key":"ref_43","first-page":"63","article-title":"A Checklist for the Evaluation of Web Accessibility and Usability for Brazilian Older Adults","volume":"19","author":"Rodrigues","year":"2020","journal-title":"J. Web Eng. (JWE)"},{"key":"ref_44","unstructured":"Tateo, L. (2021, January 5\u20136). Web accessibility and usability: Limits and perspectives. Proceedings of the Workshop on Technology Enhanced Learning Environments for Blended Education, Foggia, Italy."},{"key":"ref_45","unstructured":"Moreno, L., Martinez, P., and Ru\u00edz-Mezcua, B. (2009, January 9\u201310). A Bridge to Web Accessibility from the Usability Heuristics. Proceedings of the 5th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2009, Linz, Austria."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Bisante, A., Datla, V.S.V., Panizzi, E., Trasciatti, G., and Zeppieri, S. (2024, January 3\u20137). Enhancing Interface Design with AI: An Exploratory Study on a ChatGPT-4-Based Tool for Cognitive Walkthrough Inspired Evaluations. Proceedings of the 2024 International Conference on Advanced Visual Interfaces (AVI \u201824), Arenzano, Italy. Article 41.","DOI":"10.1145\/3656650.3656676"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Acosta-Vargas, P., Acosta-Vargas, G., Salvador-Acosta, B., and Jad\u00e1n-Guerrero, J. (2024, January 24\u201326). Addressing Web Accessibility Challenges with Generative Artificial Intelligence Tools for Inclusive Education. Proceedings of the 2024 Tenth International Conference on eDemocracy & eGovernment (ICEDEG), Lucerne, Switzerland.","DOI":"10.1109\/ICEDEG61611.2024.10702085"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"York, E. (2023, January 26\u201328). Evaluating ChatGPT: Generative AI in UX Design and Web Development Pedagogy. Proceedings of the 41st ACM International Conference on Design of Communication (SIGDOC \u201823), Orlando, FL, USA.","DOI":"10.1145\/3615335.3623035"},{"key":"ref_49","unstructured":"Interactions (2024, October 25). Volume XXXI.1 January\u2014February 2024. Available online: https:\/\/interactions.acm.org\/archive\/toc\/january-february-2024\/."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1093\/eurheartj\/ehad766","article-title":"ChatGPT hallucinating: Can it get any more humanlike?","volume":"45","author":"Siontis","year":"2024","journal-title":"Eur. Heart J."},{"key":"ref_51","unstructured":"Ruiz, P.H., Agredo-Delgado, V., and Kawamoto, A.L.S. (2021). Combining two inspection methods: Usability heuristic evaluation and WCAG guidelines to assess e-commerce web-sites. Human-Computer Interaction, Springer International Publishing."},{"key":"ref_52","unstructured":"(2024, October 25). WCAG 2.2 Understanding Docs. Available online: https:\/\/www.w3.org\/WAI\/WCAG22\/Understanding\/."},{"key":"ref_53","unstructured":"Casare, A., Guimar\u00e3es da Silva, C., Martins, P., and Moraes, R. (2019, January 7\u20139). Mapping WCAG Guidelines to Nielsen\u2019s Heuristics. Proceedings of the 16th International Conference on Applied Computing, Cagliary, Italy."},{"key":"ref_54","unstructured":"Garc\u00eda Mu\u00f1oz, O. (2024, October 25). Pautas de Accesibilidad Cognitiva Web. Garc\u00eda Mu\u00f1oz, O (Plena Inclusi\u00f3n Madrid). Available online: https:\/\/plenainclusionmadrid.org\/wp-content\/uploads\/2020\/12\/Guia-Pautas-Accesibilidad-2020-final.pdf."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"91676","DOI":"10.1109\/ACCESS.2020.2994288","article-title":"Empirical Studies on Web Accessibility of Educational Websites: A Systematic Literature Review","volume":"8","year":"2020","journal-title":"IEEE Access"},{"key":"ref_56","unstructured":"Nielsen, J., and Tahir, M. (2001). Homepage Usability: 50 Websites Deconstructed, New Riders Press."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Jordan, P.W., Thomas, B., Weerdmeester, A., and McClelland, I.I. (1996). SUS: A \u2018quick and dirty\u2019 usability scale. Usability Evaluation in Industry, Taylor & Francis.","DOI":"10.1201\/9781498710411"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/12\/769\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:45:22Z","timestamp":1760114722000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/12\/769"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,2]]},"references-count":57,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["info15120769"],"URL":"https:\/\/doi.org\/10.3390\/info15120769","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,2]]}}}