{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T15:45:07Z","timestamp":1781797507027,"version":"3.54.5"},"reference-count":39,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2022,11,30]],"date-time":"2022-11-30T00:00:00Z","timestamp":1669766400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this study, we tested the ability of a machine-learning model (ML) to evaluate different user interface designs within the defined boundaries of some given software. Our approach used ML to automatically evaluate existing and new web application designs and provide developers and designers with a benchmark for choosing the most user-friendly and effective design. The model is also useful for any other software in which the user has different options to choose from or where choice depends on user knowledge, such as quizzes in e-learning. The model can rank accessible designs and evaluate the accessibility of new designs. We used an ensemble model with a custom multi-channel convolutional neural network (CNN) and an ensemble model with a standard architecture with multiple versions of down-sampled input images and compared the results. We also describe our data preparation process. The results of our research show that ML algorithms can estimate the future performance of completely new user interfaces within the given elements of user interface design, especially for color\/contrast and font\/layout.<\/jats:p>","DOI":"10.3390\/s22239336","type":"journal-article","created":{"date-parts":[[2022,11,30]],"date-time":"2022-11-30T08:46:41Z","timestamp":1669798001000},"page":"9336","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["The Application of Deep Learning for the Evaluation of User Interfaces"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8330-029X","authenticated-orcid":false,"given":"Ana","family":"Keselj","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering and Computing, University of Dubrovnik, 20000 Dubrovnik, Croatia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8877-4689","authenticated-orcid":false,"given":"Mario","family":"Milicevic","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computing, University of Dubrovnik, 20000 Dubrovnik, Croatia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7786-454X","authenticated-orcid":false,"given":"Krunoslav","family":"Zubrinic","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computing, University of Dubrovnik, 20000 Dubrovnik, Croatia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zeljka","family":"Car","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering and Computing, University of Zagreb, 10000 Zagreb, Croatia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"79","DOI":"10.17509\/ijal.v8i1.11467","article-title":"Traditional versus virtual learning: How engaged are the students in learning English literature?","volume":"8","author":"Halili","year":"2018","journal-title":"Indones. J. Appl. Linguist."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.promfg.2019.03.006","article-title":"Hybrid learning environments by data-driven augmented reality","volume":"31","author":"Sonntag","year":"2019","journal-title":"Procedia Manuf."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2149","DOI":"10.1177\/13623613211046688","article-title":"What do we really mean by \u201cinclusion?\u201d: The importance of terminology when discussing approaches to community engagement","volume":"25","author":"Weaver","year":"2021","journal-title":"Autism"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"766","DOI":"10.1002\/asi.20557","article-title":"Can interactivity make a difference? Effects of interactivity on the comprehension of and attitudes toward online health content","volume":"58","author":"Lustria","year":"2007","journal-title":"J. Am. Soc. Inf. Sci. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bachmann, D., Weichert, F., and Rinkenauer, G. (2018). Review of Three-Dimensional Human-Computer Interaction with Focus on the Leap Motion Controller. Sensors, 18.","DOI":"10.3390\/s18072194"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"\u0160umak, B., Brdnik, S., and Pu\u0161nik, M. (2022). Sensors and Artificial Intelligence Methods and Algorithms for Human\u2013Computer Intelligent Interaction: A Systematic Mapping Study. Sensors, 22.","DOI":"10.3390\/s22010020"},{"key":"ref_7","unstructured":"\u0160kapin, R., and Marjeta, R.J. (2018, January 26\u201329). Using Quizzes on a Regular Basis to Motivate and Encourage Student Learning. Proceedings of the 19th SEFI Mathematics Working Group, Seminar on Mathematics in Engineering Education, Coimbra, Portugal. Available online: https:\/\/www.isec.pt\/eventos\/SEFIMWG2017\/documents\/Proceedings_SEFIMWG2018.pdf."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1080\/10401334.2011.561687","article-title":"Insights Gained from the Analysis of Performance and Participation in Online Formative Assessment","volume":"23","author":"Kibble","year":"2011","journal-title":"Teach. Learn. Med."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1186\/s41239-018-0113-2","article-title":"Adaptive quizzes to increase motivation, engagement and learning outcomes in a first year accounting unit","volume":"15","author":"Ross","year":"2018","journal-title":"Int. J. Educ. Technol. High. Educ."},{"key":"ref_10","first-page":"189","article-title":"Interactive UI for Smartphone\/Web Applications and Impact of Social Networks","volume":"22","author":"Malik","year":"2022","journal-title":"Int. J. Comput. Netw. Inf. Secur."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1017\/S0269888908001379","article-title":"User-centered evaluation of adaptive and adaptable systems: A literature review","volume":"23","author":"Klaassen","year":"2008","journal-title":"Knowl. Eng. Rev."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"100363","DOI":"10.1016\/j.cosrev.2021.100363","article-title":"Adaptive user interfaces and universal usability through plasticity of user interface design","volume":"40","author":"Miraz","year":"2021","journal-title":"Comput. Sci. Rev."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"AlRawi, L.N. (2021, January 16\u201317). Understanding the Relation between System Usability and End User Performance. Proceedings of the 2021 2nd International Informatics and Software Engineering Conference (IISEC), Ankara, Turkey.","DOI":"10.1109\/IISEC54230.2021.9672429"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kaur, R., and Sharma, B. (2018, January 30\u201331). Comparative Study for Evaluating the Usability of Web Based Applications. Proceedings of the 2018 4th International Conference on Computing Sciences (ICCS), Phagwara, India.","DOI":"10.1109\/ICCS.2018.00023"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, S.F. (2020, January 11\u201313). Research on Web Interface barrier-free Design for Elderly People. Proceedings of the 2020 International Conference on Intelligent Design (ICID), Xi\u2019an, China.","DOI":"10.1109\/ICID52250.2020.00040"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/S0169-7552(98)00042-7","article-title":"WSDM: A user centered design method for Web sites","volume":"30","author":"Leune","year":"1998","journal-title":"Comput. Netw. ISDN Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1007\/978-3-540-73597-7_18","article-title":"A method for model based design of rich internet application interactive user interfaces","volume":"4607","author":"Linaje","year":"2007","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Bj\u00f8rner, N., Virbitskaite, I., and Voronkov, A. (2019). Case-Based Genetic Optimization of Web User Interfaces. Perspectives of System Informatics. PSI 2019. Lecture Notes in Computer Science, Springer.","DOI":"10.1007\/978-3-030-37487-7"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1108\/IJWIS-12-2018-0089","article-title":"An approach to support the construction of adaptive Web applications","volume":"16","author":"Vasconcelos","year":"2020","journal-title":"Int. J. Web Inf. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"51501","DOI":"10.1109\/ACCESS.2022.3173289","article-title":"User Experience Design Using Machine Learning: A Systematic Review","volume":"10","author":"Abbas","year":"2022","journal-title":"IEEE Access"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yang, Q., Banovic, N., and Zimmerman, J. (2018, January 21\u201326). Mapping Machine Learning Advances from HCI Research to Reveal Starting Places for Design Innovation. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada.","DOI":"10.1145\/3173574.3173704"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Jansson, A.D., and Bremdal, B.A. (2018, January 10\u201312). Genetic Algorithm for Adaptable Design using Crowdsourced Learning as Fitness Measure. Proceedings of the 2018 International Conference on Smart Systems and Technologies (SST), Osijek, Croatia.","DOI":"10.1109\/SST.2018.8564686"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Todi, K., Weir, D., and Oulasvirta, A. (2016, January 4\u20138). Sketchplore: Sketch and explore with a layout optimizer. Proceedings of the 2016 ACM Conference on Designing Interactive Systems, Brisbane, QLD, Australia.","DOI":"10.1145\/2901790.2901817"},{"key":"ref_24","unstructured":"Swearngin, A., Dontcheva, M., Li, W., Brandt, J., Dixon, M., and Ko, A.J. (2018, January 21\u201326). Rewire: Interface design assistance from examples. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Oulasvirta, A., De Pascale, S., Koch, J., Langerak, T., Jokinen, J., Todi, K., Laine, M., Kristhombuge, M., Zhu, Y., and Miniukovich, A. (2018, January 14\u201317). Aalto interface metrics (AIM): A service and codebase for computational GUI evaluation. Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings, Berlin, Germany.","DOI":"10.1145\/3266037.3266087"},{"key":"ref_26","unstructured":"Car, Z., Rasan, I., Zilak, M., and Keselj, A. (2022, October 25). Central State Office for Development of the Digital Society\u2014Methodology for the Development of an Accessible Website. Available online: http:\/\/www.ict-aac.hr\/images\/HAKOM_skup\/Metodologija\/HAKOM_A5_Metodologija_FINAL_WEB.pdf."},{"key":"ref_27","unstructured":"Stocks, E.J. (2022, October 20). Pairing Typefaces within a Family & Superfamily. Available online: https:\/\/fonts.google.com\/knowledge\/choosing_type\/pairing_typefaces_within_a_family_superfamily."},{"key":"ref_28","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A.A. (2017, January 4\u20139). Inception-v4, inception-resnet and the impact of residual connections on learning. Proceedings of the Thirty-first AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_32","unstructured":"Chollet, F. (2021). Deep Learning with Python, Simon and Schuster."},{"key":"ref_33","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). Ten-sorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"e1249","DOI":"10.1002\/widm.1249","article-title":"Ensemble learning: A survey","volume":"8","author":"Sagi","year":"2018","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Ganaie, M.A., and Hu, M. (2021). Ensemble deep learning: A review. arXiv.","DOI":"10.1016\/j.engappai.2022.105151"},{"key":"ref_36","unstructured":"(2022, October 27). What is Universal Design?. Available online: https:\/\/universaldesign.ie\/what-is-universal-design\/."},{"key":"ref_37","first-page":"1","article-title":"Intensive and extensive reading in improving teaching reading comprehension, Lingua Pedagogia","volume":"1","author":"Muchtar","year":"2017","journal-title":"J. Engl. Teach. Stud."},{"key":"ref_38","unstructured":"Bruce, H., Jocelyn, A., and Tanya, M. (2016, January 5\u20137). Optimising Visual Layout for Training and Learning Technologies. Proceedings of the Australasian Conference on Information Systems, Wollongong, Australia. Available online: https:\/\/ro.uow.edu.au\/cgi\/viewcontent.cgi?article=1011&context=acis2016."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Jezic, G., Chen-Burger, J., Kusek, M., Sperka, R., Howlett, R., and Jain, L. (2020). Process Model for Accessible Website User Evaluation. Agents and Multi-Agent Systems: Technologies and Applications 2020. Smart Innovation, Systems and Technologies, Springer.","DOI":"10.1007\/978-981-15-5764-4"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/23\/9336\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:30:35Z","timestamp":1760146235000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/23\/9336"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,30]]},"references-count":39,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["s22239336"],"URL":"https:\/\/doi.org\/10.3390\/s22239336","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,30]]}}}