{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,20]],"date-time":"2026-02-20T21:04:06Z","timestamp":1771621446934,"version":"3.50.1"},"reference-count":46,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2025,10,2]],"date-time":"2025-10-02T00:00:00Z","timestamp":1759363200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>The rapid development of generative artificial intelligence (GenAI) has revolutionized how individuals and organizations interact with technology. These systems, ranging from conversational agents to creative tools, are increasingly embedded in daily life. However, their effectiveness relies heavily on the usability of their graphical user interfaces (GUIs), which serve as the primary medium for user interaction. Moreover, the design of these interfaces must align with ethical principles such as transparency, fairness, and user autonomy to ensure responsible usage. This study evaluates the usability of GUIs for three widely-used GenAI applications, including ChatGPT (GPT-4), Gemini (1.5), and Claude (3.5 Sonnet), using a heuristics-based and user-based testing approach (experimental-qualitative investigation). A total of 12 participants from a research organization in Australia, participated in structured usability evaluations, applying 14 usability heuristics to identify key issues and ethical concerns. The results indicate that Claude\u2019s GUI is the most usable among the three, particularly due to its clean and minimalistic design. However, all applications demonstrated specific usability issues, such as insufficient error prevention, lack of shortcuts, and limited customization options, affecting the efficiency and effectiveness of user interactions. Despite these challenges, each application exhibited unique strengths, suggesting that while functional, significant enhancements are needed to fully support user satisfaction and ethical usage. The insights of this study can guide organizations in designing GenAI systems that are not only user-friendly but also ethically sound.<\/jats:p>","DOI":"10.3390\/computers14100418","type":"journal-article","created":{"date-parts":[[2025,10,2]],"date-time":"2025-10-02T08:20:28Z","timestamp":1759393228000},"page":"418","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Evaluating the Usability and Ethical Implications of Graphical User Interfaces in Generative AI Systems"],"prefix":"10.3390","volume":"14","author":[{"given":"Amna","family":"Batool","sequence":"first","affiliation":[{"name":"Commonwealth Scientific and Industrial Research Organisation (CSIRO), Data61, Clayton, Melbourne, VIC 3168, Australia"}]},{"given":"Waqar","family":"Hussain","sequence":"additional","affiliation":[{"name":"Commonwealth Scientific and Industrial Research Organisation (CSIRO), Data61, Clayton, Melbourne, VIC 3168, Australia"}]}],"member":"1968","published-online":{"date-parts":[[2025,10,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Sengar, S.S., Hasan, A.B., Kumar, S., and Carroll, F. (2024). Generative Artificial Intelligence: A Systematic Review and Applications. arXiv.","DOI":"10.1007\/s11042-024-20016-1"},{"key":"ref_2","unstructured":"OpenAI (2024, September 05). ChatGPT. Available online: https:\/\/openai.com\/chatgpt."},{"key":"ref_3","unstructured":"Google (2024, September 05). Google Gemini. Available online: https:\/\/gemini.google.com\/app."},{"key":"ref_4","unstructured":"Anthropic (2024, September 05). Claude AI by Anthropic. Available online: https:\/\/www.anthropic.com\/claude."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Perkins, M., Furze, L., Roe, J., and MacVaugh, J. (2024). The Artificial Intelligence Assessment Scale (AIAS): A framework for ethical integration of generative AI in educational assessment. J. Univ. Teach. Learn. Pract., 21.","DOI":"10.53761\/q3azde36"},{"key":"ref_6","unstructured":"Holmes, W., and Miao, F. (2023). Guidance for Generative AI in Education and Research, UNESCO Publishing."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"e48009","DOI":"10.2196\/48009","article-title":"Ethical considerations of using ChatGPT in health care","volume":"25","author":"Wang","year":"2023","journal-title":"J. Med. Internet Res."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Oswal, S.K., and Oswal, H.K. (2024, January 14\u201317). Examining the Accessibility of Generative AI Website Builder Tools for Blind and Low Vision Users: 21 Best Practices for Designers and Developers. Proceedings of the 2024 IEEE International Professional Communication Conference (ProComm), Pittsburgh, PA, USA.","DOI":"10.1109\/ProComm61427.2024.00030"},{"key":"ref_9","first-page":"92","article-title":"\u201cI look at it as the king of knowledge\u201d: How Blind People Use and Understand Generative AI Tools","volume":"16","author":"Adnin","year":"2024","journal-title":"People"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Weisz, J.D., Muller, M., He, J., and Houde, S. (2023). Toward general design principles for generative AI applications. arXiv.","DOI":"10.1145\/3613904.3642466"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.ijhcs.2005.06.002","article-title":"Current practice in measuring usability: Challenges to usability studies and research","volume":"64","year":"2006","journal-title":"Int. J.-Hum.-Comput. Stud."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Alvarez-Cortes, V., Zayas-Perez, B.E., Zarate-Silva, V.H., and Uresti, J.A.R. (2007, January 25\u201328). Current trends in adaptive user interfaces: Challenges and applications. Proceedings of the Electronics, Robotics and Automotive Mechanics Conference (CERMA 2007), Cuernavaca, Mexico.","DOI":"10.1109\/CERMA.2007.4367705"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"179891","DOI":"10.1109\/ACCESS.2024.3502628","article-title":"UI\/UX for Generative AI: Taxonomy, Trend, and Challenge","volume":"12","author":"Kim","year":"2024","journal-title":"IEEE Access"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yamani, A.Z., Al-Shammare, H.A., and Baslyman, M. (2024, January 11\u201316). Establishing Heuristics for Improving the Usability of GUI Machine Learning Tools for Novice Users. Proceedings of the CHI Conference on Human Factors in Computing Systems, New York, NY, USA.","DOI":"10.1145\/3613904.3642087"},{"key":"ref_15","unstructured":"Ribeiro, R. (2024). Conversational Generative AI Interface Design: Exploration of a Hybrid Graphical User Interface and Conversational User Interface for Interaction with ChatGPT, Malm\u00f6 University (Faculty of Culture and Society, School of Arts and Communication)."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Skjuve, M., F\u00f8lstad, A., and Brandtzaeg, P.B. (2023, January 19\u201321). The user experience of ChatGPT: Findings from a questionnaire study of early users. Proceedings of the 5th International Conference on Conversational User Interfaces, Eindhoven, The Netherlands.","DOI":"10.1145\/3571884.3597144"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.iotcps.2023.04.003","article-title":"ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope","volume":"3","author":"Ray","year":"2023","journal-title":"Internet Things-Cyber-Phys. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1233","DOI":"10.1056\/NEJMsr2214184","article-title":"Benefits, limits, and risks of GPT-4 as an AI chatbot for medicine","volume":"388","author":"Lee","year":"2023","journal-title":"N. Engl. J. Med."},{"key":"ref_19","unstructured":"Perera, H., Hussain, W., Whittle, J., Nurwidyantoro, A., Mougouei, D., Shams, R.A., and Oliver, G. (July, January 27). A study on the prevalence of human values in software engineering publications, 2015\u20132018. Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering, Seoul, Republic of Korea."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3265","DOI":"10.1007\/s43681-024-00653-w","article-title":"AI governance: A systematic literature review","volume":"5","author":"Batool","year":"2025","journal-title":"AI Ethics"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Batool, A., Zowghi, D., and Bano, M. (2023). Responsible AI governance: A systematic literature review. arXiv.","DOI":"10.21203\/rs.3.rs-4784792\/v1"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Beltran, M.A., Ruiz Mondragon, M.I., and Han, S.H. (2024, January 11\u201314). Comparative Analysis of Generative AI Risks in the Public Sector. Proceedings of the 25th Annual International Conference on Digital Government Research, New York, NY, USA.","DOI":"10.1145\/3657054.3657125"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3573","DOI":"10.1007\/s00146-024-02104-w","article-title":"Knowledge and support for AI in the public sector: A deliberative poll experiment","volume":"40","author":"Arnesen","year":"2024","journal-title":"AI Soc."},{"key":"ref_24","unstructured":"Ahmed, A., and Imran, A.S. (2025). The role of large language models in UI\/UX design: A systematic literature review. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1109\/TAI.2023.3318183","article-title":"Ethical aspects of ChatGPT in software engineering research","volume":"6","author":"Akbar","year":"2023","journal-title":"IEEE Trans. Artif. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1007\/s11023-024-09694-w","article-title":"Mapping the ethics of generative AI: A comprehensive scoping review","volume":"34","author":"Hagendorff","year":"2024","journal-title":"Minds Mach."},{"key":"ref_27","unstructured":"Mohanty, S.N., Garcia Diaz, V., and Satish Kumar, G.A.E. (2023). Bias analysis in stable diffusion and MidJourney models. Intelligent Systems and Machine Learning, Springer."},{"key":"ref_28","unstructured":"Hillmann, S., Kowol, P., Ahmad, A., Tang, R., and M\u00f6ller, S. (2024, January 6\u20138). Usability and User Experience of a Chatbot for Student Support. Proceedings of the Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35, Konferenz, Regensburg."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Pinto, G., De Souza, C., Rocha, T., Steinmacher, I., Souza, A., and Monteiro, E. (2024, January 14\u201315). Developer Experiences with a Contextualized AI Coding Assistant: Usability, Expectations, and Outcomes. Proceedings of the IEEE\/ACM 3rd International Conference on AI Engineering-Software Engineering for AI, Lisbon, Portugal.","DOI":"10.1145\/3644815.3644949"},{"key":"ref_30","first-page":"3591","article-title":"\u201cYour friendly AI assistant\u201d: The anthropomorphic self-representations of ChatGPT and its implications for imagining AI","volume":"40","author":"Nguyen","year":"2024","journal-title":"AI Soc."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3557","DOI":"10.1007\/s00146-024-02111-x","article-title":"Critical questions on the emergence of text-to-image artificial intelligence in architectural design pedagogy","volume":"40","author":"Iranmanesh","year":"2024","journal-title":"AI Soc."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Al-kfairy, M., Mustafa, D., Kshetri, N., Insiew, M., and Alfandi, O. (2024). Ethical challenges and solutions of generative AI: An interdisciplinary perspective. Informatics, 11.","DOI":"10.2139\/ssrn.4833030"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"e2421","DOI":"10.7717\/peerj-cs.2421","article-title":"User-centric AI: Evaluating the usability of generative AI applications through user reviews on app stores","volume":"10","author":"Alabduljabbar","year":"2024","journal-title":"PeerJ Comput. Sci."},{"key":"ref_34","unstructured":"Mugunthan, T. (2023). Researching the Usability of Early Generative-AI Tools, Nielsen Norman Group."},{"key":"ref_35","unstructured":"Nielsen, J., and Mack, R.L. (1994). The cognitive walkthrough method: A practitioner\u2019s guide. Usability Inspection Methods, John Wiley & Sons."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Nielsen, J., and Mack, R.L. (1994). Usability Inspection Methods, Wiley.","DOI":"10.1145\/259963.260531"},{"key":"ref_37","unstructured":"Brooke, J. (1996). SUS: A \u201cquick and dirty\u201d usability scale. Usability Evaluation in Industry, Taylor & Francis."},{"key":"ref_38","unstructured":"Preece, J., Rogers, Y., and Sharp, H. (2015). Interaction Design: Beyond Human-Computer Interaction, John Wiley & Sons. [4th ed.]."},{"key":"ref_39","unstructured":"MacKenzie, I.S. (2013). Human-Computer Interaction: An Empirical Research Perspective, Elsevier. [1st ed.]."},{"key":"ref_40","unstructured":"Kuppens, D., and Verbert, K. (2023, January 23\u201328). Conversational User Interfaces: A review of usability methods. Proceedings of the ACM Conference on Human Factors in Computing Systems, Hamburg, Germany."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1038\/s42256-019-0114-4","article-title":"Principles alone cannot guarantee ethical AI","volume":"1","author":"Mittelstadt","year":"2019","journal-title":"Nat. Mach. Intell."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Nielsen, J., and Molich, R. (1990, January 1\u20135). Heuristic evaluation of user interfaces. Proceedings of the Eighth ACM SIGCHI Conference on Human Factors in Computing Systems (CHI \u201990), Seattle, WA, USA.","DOI":"10.1145\/97243.97281"},{"key":"ref_43","unstructured":"Rubin, J., and Chisnell, D. (2008). Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests, Wiley. [2nd ed.]."},{"key":"ref_44","unstructured":"Nielsen, J. (2000). Why You Only Need to Test with 5 Users, Nielsen Norman Group. Available online: https:\/\/www.nngroup.com\/articles\/why-you-only-need-to-test-with-5-users\/."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1177\/160940690600500107","article-title":"Demonstrating rigor using thematic analysis: A hybrid approach of inductive and deductive coding and theme development","volume":"5","author":"Fereday","year":"2006","journal-title":"Int. J. Qual. Methods"},{"key":"ref_46","unstructured":"(2025, September 21). Australian Government, Department of Industry, Science and Resources, Australia\u2019s AI Ethics Principles, Available online: https:\/\/www.industry.gov.au\/publications\/australias-artificial-intelligence-ethics-principles."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/10\/418\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,15]],"date-time":"2025-10-15T06:21:17Z","timestamp":1760509277000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/10\/418"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,2]]},"references-count":46,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2025,10]]}},"alternative-id":["computers14100418"],"URL":"https:\/\/doi.org\/10.3390\/computers14100418","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,2]]}}}