{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:52:18Z","timestamp":1760147538795,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,2,8]],"date-time":"2023-02-08T00:00:00Z","timestamp":1675814400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Deutsche Forschungsgemeinschaft","award":["416228727\u2014SFB 1410"],"award-info":[{"award-number":["416228727\u2014SFB 1410"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>Training data for user behavior models that predict subjective dimensions of visual perception are often too scarce for deep learning methods to be applicable. With the typical datasets in HCI limited to thousands or even hundreds of records, feature-based approaches are still widely used in visual analysis of graphical user interfaces (UIs). In our paper, we benchmarked the predictive accuracy of the two types of neural network (NN) models, and explored the effects of the number of features, and the dataset volume. To this end, we used two datasets that comprised over 4000 webpage screenshots, assessed by 233 subjects per the subjective dimensions of Complexity, Aesthetics and Orderliness. With the experimental data, we constructed and trained 1908 models. The feature-based NNs demonstrated 16.2%-better mean squared error (MSE) than the convolutional NNs (a modified GoogLeNet architecture); however, the CNNs\u2019 accuracy improved with the larger dataset volume, whereas the ANNs\u2019 did not: therefore, provided that the effect of more data on the models\u2019 error improvement is linear, the CNNs should become superior at dataset sizes over 3000 UIs. Unexpectedly, adding more features to the NN models caused the MSE to somehow increase by 1.23%: although the difference was not significant, this confirmed the importance of careful feature engineering.<\/jats:p>","DOI":"10.3390\/bdcc7010030","type":"journal-article","created":{"date-parts":[[2023,2,9]],"date-time":"2023-02-09T01:59:43Z","timestamp":1675907983000},"page":"30","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A Reasonable Effectiveness of Features in Modeling Visual Perception of User Interfaces"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1889-0692","authenticated-orcid":false,"given":"Maxim","family":"Bakaev","sequence":"first","affiliation":[{"name":"Independent UX Consultant, Novosibirsk 630132, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2761-9009","authenticated-orcid":false,"given":"Sebastian","family":"Heil","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Technische Universitat Chemnitz, 09111 Chemnitz, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6729-2912","authenticated-orcid":false,"given":"Martin","family":"Gaedke","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Technische Universitat Chemnitz, 09111 Chemnitz, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,8]]},"reference":[{"key":"ref_1","unstructured":"Speicher, M., Both, A., and Gaedke, M. (November, January 27). TellMyRelevance! predicting the relevance of web search results from cursor interactions. Proceedings of the 22nd ACM International Conference on Information & Knowledge Management, San Francisco, CA, USA."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Huang, Y., Yang, J., Liu, S., and Pan, J. (2019). Combining facial expressions and electroencephalography to enhance emotion recognition. Future Internet, 11.","DOI":"10.3390\/fi11050105"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"106625","DOI":"10.1016\/j.infsof.2021.106625","article-title":"Why many challenges with GUI test automation (will) remain","volume":"138","author":"Nass","year":"2021","journal-title":"Inf. Softw. Technol."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Bakaev, M., Speicher, M., Jagow, J., Heil, S., and Gaedke, M. (2022, January 5\u20138). We Don\u2019t Need No Real Users?! Surveying the Adoption of User-less Automation Tools by UI Design Practitioners. Proceedings of the International Conference on Web Engineering, Bari, Italy.","DOI":"10.1007\/978-3-031-09917-5_28"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1016\/j.ins.2021.06.071","article-title":"A novel webpage layout aesthetic evaluation model for quantifying webpage layout design","volume":"576","author":"Wan","year":"2021","journal-title":"Inf. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1007\/978-3-030-50578-3_11","article-title":"I Don\u2019t Have That Much Data! Reusing User Behavior Models for Websites from Different Domains","volume":"Volume 12128","author":"Bielikova","year":"2020","journal-title":"Web Engineering"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.ijhcs.2018.11.006","article-title":"Webthetics: Quantifying webpage aesthetics with deep learning","volume":"124","author":"Dou","year":"2019","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.neucom.2020.10.046","article-title":"MSCAN: Multimodal Self-and-Collaborative Attention Network for image aesthetic prediction tasks","volume":"430","author":"Zhang","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_9","unstructured":"Reinecke, K., Yeh, T., Miratrix, L., Mardiko, R., Zhao, Y., Liu, J., and Gajos, K.Z. (May, January 27). Predicting users\u2019 first impressions of website aesthetics with a quantification of perceived visual complexity and colorfulness. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Paris, France."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Miniukovich, A., and De Angeli, A. (2014, January 27\u201330). Quantification of interface visual complexity. Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces, Como, Italy.","DOI":"10.1145\/2598153.2598173"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Oulasvirta, A., De Pascale, S., Koch, J., Langerak, T., Jokinen, J., Todi, K., Laine, M., Kristhombuge, M., Zhu, Y., and Miniukovich, A. (2018, January 14\u201317). Aalto Interface Metrics (AIM) A Service and Codebase for Computational GUI Evaluation. Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings, Berlin, Germany.","DOI":"10.1145\/3266037.3266087"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"561","DOI":"10.13052\/jwe1540-9589.17676","article-title":"Auto-Extraction and Integration of Metrics for Web User Interfaces","volume":"17","author":"Bakaev","year":"2019","journal-title":"J. Web Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1080\/10447318.2021.1926118","article-title":"Assessing the visual esthetics of user interfaces: A ten-year systematic mapping","volume":"38","author":"Lima","year":"2022","journal-title":"Int. J. Hum.-Comput. Interact."},{"key":"ref_14","unstructured":"Bakaev, M., Heil, S., Chirkov, L., and Gaedke, M. (July, January 26). Benchmarking Neural Networks-Based Approaches for Predicting Visual Perception of User Interfaces. Proceedings of the International Conference on Human-Computer Interaction, Virtual Event."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"21","DOI":"10.3390\/fi13010021","article-title":"What Makes a UI Simple? Difficulty and Complexity in Tasks Engaging Visual-Spatial Working Memory","volume":"13","author":"Bakaev","year":"2021","journal-title":"Future Internet"},{"key":"ref_16","unstructured":"Souza, O.T., Souza, A.D.d., Vasconcelos, L.G., and Baldochi, L.A. (2021, January 10\u201314). Usability Smells: A Systematic Review. Proceedings of the ITNG 2021 18th International Conference on Information Technology-New Generations, Las Vegas, NV, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Yang, B., Xing, Z., Xia, X., Chen, C., Ye, D., and Li, S. (2021, January 22\u201330). Don\u2019t do that! hunting down visual design smells in complex uis against design guidelines. Proceedings of the 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE), Madrid, Spain.","DOI":"10.1109\/ICSE43902.2021.00075"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Stickel, C., Ebner, M., and Holzinger, A. (2010, January 4\u20135). The XAOS metric\u2013understanding visual complexity as measure of usability. Proceedings of the HCI in Work and Learning, Life and Leisure: 6th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering, USAB 2010, Klagenfurt, Austria.","DOI":"10.1007\/978-3-642-16607-5_18"},{"key":"ref_19","unstructured":"Alemerien, K., and Magel, K. (2014, January 1\u20133). GUIEvaluator: A Metric-tool for Evaluating the Complexity of Graphical User Interfaces. Proceedings of the SEKE, Vancouver, BC, Canada."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bakaev, M., Heil, S., Khvorostov, V., and Gaedke, M. (2018, January 5\u20138). HCI vision for automated analysis and mining of web user interfaces. Proceedings of the International Conference on Web Engineering, C\u00e1ceres, Spain.","DOI":"10.1007\/978-3-319-91662-0_10"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"102523","DOI":"10.1016\/j.ijhcs.2020.102523","article-title":"Automated prediction of visual complexity of web pages: Tools and evaluations","volume":"145","author":"Michailidou","year":"2021","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Chen, J., Xie, M., Xing, Z., Chen, C., Xu, X., Zhu, L., and Li, G. (2020, January 8\u201313). Object detection for graphical user interface: Old fashioned or deep learning or a combination?. Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Virtual Event, USA.","DOI":"10.1145\/3368089.3409691"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Deka, B., Huang, Z., Franzen, C., Hibschman, J., Afergan, D., Li, Y., Nichols, J., and Kumar, R. (2017, January 22\u201325). Rico: A mobile app dataset for building data-driven design applications. Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, Qu\u00e9bec City, QC, Canada.","DOI":"10.1145\/3126594.3126651"},{"key":"ref_24","unstructured":"Kreinovich, V. (2021). Recent Developments and the New Direction in Soft-Computing Foundations and Applications, Springer."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5455","DOI":"10.1007\/s10462-020-09825-6","article-title":"A survey of the recent architectures of deep convolutional neural networks","volume":"53","author":"Khan","year":"2020","journal-title":"Artif. Intell. Rev."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3998","DOI":"10.1109\/TIP.2018.2831899","article-title":"NIMA: Neural image assessment","volume":"27","author":"Talebi","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1049\/ccs2.12055","article-title":"AI-driven user aesthetics preference prediction for UI layouts via deep convolutional neural networks","volume":"4","author":"Xing","year":"2022","journal-title":"Cogn. Comput. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Sun, C., Shrivastava, A., Singh, S., and Gupta, A. (2017, January 22\u201329). Revisiting unreasonable effectiveness of data in deep learning era. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.97"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1007\/s11263-015-0812-2","article-title":"Do we need more training data?","volume":"119","author":"Zhu","year":"2016","journal-title":"Int. J. Comput. Vis."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kamath, C.N., Bukhari, S.S., and Dengel, A. (2018, January 28\u201331). Comparative study between traditional machine learning and deep learning approaches for text classification. Proceedings of the ACM Symposium on Document Engineering 2018, Halifax, NS, Canada.","DOI":"10.1145\/3209280.3209526"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Miniukovich, A., and De Angeli, A. (2015, January 18\u201323). Computation of interface aesthetics. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Republic of Korea.","DOI":"10.1145\/2702123.2702575"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Miniukovich, A., and Marchese, M. (2020, January 25\u201330). Relationship between visual complexity and aesthetics of webpages. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3313831.3376602"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"794","DOI":"10.1016\/j.ijhcs.2012.06.003","article-title":"The role of visual complexity and prototypicality regarding first impression of websites: Working towards understanding aesthetic judgments","volume":"70","author":"Tuch","year":"2012","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_34","unstructured":"(2022, December 05). KerasTuner. Available online: https:\/\/github.com\/keras-team\/keras-tuner."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1957","DOI":"10.1007\/s00521-016-2787-5","article-title":"Distinguishing paintings from photographs by complexity estimates","volume":"30","author":"Carballal","year":"2018","journal-title":"Neural Comput. Appl."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"L\u00f3pez-Rubio, J.M., Molina-Cabello, M.A., Ramos-Jim\u00e9nez, G., and L\u00f3pez-Rubio, E. (2021, January 16\u201318). Classification of Images as Photographs or Paintings by Using Convolutional Neural Networks. Proceedings of the International Work-Conference on Artificial Neural Networks, Virtual Event.","DOI":"10.1007\/978-3-030-85030-2_36"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"5437","DOI":"10.1007\/s00521-020-05321-8","article-title":"Benchmarking performance of machine and deep learning-based methodologies for Urdu text document classification","volume":"33","author":"Asim","year":"2021","journal-title":"Neural Comput. Appl."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Bianco, S., Celona, L., Napoletano, P., and Schettini, R. (2016, January 24\u201327). Predicting image aesthetics with deep learning. Proceedings of the International Conference on Advanced Concepts for Intelligent Vision Systems, Lecce, Italy.","DOI":"10.1007\/978-3-319-48680-2_11"}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/7\/1\/30\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:28:52Z","timestamp":1760120932000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/7\/1\/30"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,8]]},"references-count":38,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["bdcc7010030"],"URL":"https:\/\/doi.org\/10.3390\/bdcc7010030","relation":{},"ISSN":["2504-2289"],"issn-type":[{"type":"electronic","value":"2504-2289"}],"subject":[],"published":{"date-parts":[[2023,2,8]]}}}