{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T15:55:33Z","timestamp":1774367733934,"version":"3.50.1"},"reference-count":83,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2022,6,16]],"date-time":"2022-06-16T00:00:00Z","timestamp":1655337600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Greek RTDI State Aid Action RESEARCH-CREATEINNOVATE","award":["593"],"award-info":[{"award-number":["593"]}]},{"name":"University of Piraeus Research Center","award":["593"],"award-info":[{"award-number":["593"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Navigation assistive technologies have been designed to support the mobility of people who are blind and visually impaired during independent navigation by providing sensory augmentation, spatial information and general awareness of their environment. This paper focuses on the extended Usability and User Experience (UX) evaluation of BlindRouteVision, an outdoor navigation smartphone application that tries to efficiently solve problems related to the pedestrian navigation of visually impaired people without the aid of guides. The proposed system consists of an Android application that interacts with an external high-accuracy GPS sensor tracking pedestrian mobility in real-time, a second external device specifically designed to be mounted on traffic lights for identifying traffic light status and an ultrasonic sensor for detecting near-field obstacles along the route of the blind. Moreover, during outdoor navigation, it can optionally incorporate the use of Public Means of Transport, as well as provide multiple other uses such as dialing a call and notifying the current location in case of an emergency. We present findings from a Usability and UX standpoint of our proposed system conducted in the context of a pilot study, with 30 people having varying degrees of blindness. We also received feedback for improving both the available functionality of our application and the process by which the blind users learn the features of the application. The method of the study involved using standardized questionnaires and semi-structured interviews. The evaluation took place after the participants were exposed to the system\u2019s functionality via specialized user-centered training sessions organized around a training version of the application that involves route simulation. The results indicate an overall positive attitude from the users.<\/jats:p>","DOI":"10.3390\/s22124538","type":"journal-article","created":{"date-parts":[[2022,6,19]],"date-time":"2022-06-19T21:19:26Z","timestamp":1655673566000},"page":"4538","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["An Extended Usability and UX Evaluation of a Mobile Application for the Navigation of Individuals with Blindness and Visual Impairments Outdoors\u2014An Evaluation Framework Based on Training"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0064-7299","authenticated-orcid":false,"given":"Paraskevi","family":"Theodorou","sequence":"first","affiliation":[{"name":"Department of Digital Systems, School of Information and Communication Technologies, University of Piraeus, 18534 Piraeus, Greece"}]},{"given":"Kleomenis","family":"Tsiligkos","sequence":"additional","affiliation":[{"name":"Department of Digital Systems, School of Information and Communication Technologies, University of Piraeus, 18534 Piraeus, Greece"}]},{"given":"Apostolos","family":"Meliones","sequence":"additional","affiliation":[{"name":"Department of Digital Systems, School of Information and Communication Technologies, University of Piraeus, 18534 Piraeus, Greece"}]},{"given":"Costas","family":"Filios","sequence":"additional","affiliation":[{"name":"Department of Digital Systems, School of Information and Communication Technologies, University of Piraeus, 18534 Piraeus, Greece"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"e144","DOI":"10.1016\/S2214-109X(20)30489-7","article-title":"Causes of Blindness and Vision Impairment in 2020 And Trends Over 30 Years, And Prevalence Of Avoidable Blindness in Relation to Vision 2020: The Right To Sight: An Analysis For The Global Burden Of Disease Study","volume":"9","author":"Steinmetz","year":"2021","journal-title":"Lancet Glob. Health"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"e888","DOI":"10.1016\/S2214-109X(17)30293-0","article-title":"Magnitude, temporal trends, and projections of the global prevalence of blindness and distance and near vision impairment: A systematic review and meta-analysis","volume":"5","author":"Bourne","year":"2017","journal-title":"Lancet Glob. Health"},{"key":"ref_3","unstructured":"(2022, March 27). Vision Impairment and Blindness. Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/blindness-and-visual-impairment."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1295","DOI":"10.1001\/jamaophthalmol.2017.3449","article-title":"Association of Socioeconomics with Prevalence of Visual Impairment and Blindness","volume":"135","author":"Wang","year":"2017","journal-title":"JAMA Ophthalmol."},{"key":"ref_5","unstructured":"Neeraj, S., and Reima, S. (2013, January 11\u201314). Assistive Technology for Totally Blind\u2013Barriers to Adoption. Proceedings of the 36th Information Systems Research Seminar in Scandinavia, Oslo, Norway."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.neubiorev.2016.06.043","article-title":"Devices for visually impaired people: High technological devices with low user acceptance and no adaptability for children","volume":"69","author":"Gori","year":"2016","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1080\/02564602.2020.1819893","article-title":"Tools and Technologies for Blind and Visually Impaired Navigation Support: A Review","volume":"39","author":"Kuriakose","year":"2020","journal-title":"IETE Tech. Rev."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"El-Taher, F., Taha, A., Courtney, J., and Mckeever, S. (2021). A Systematic Review of Urban Navigation Systems for Visually Impaired People. Sensors, 21.","DOI":"10.3390\/s21093103"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2814","DOI":"10.1109\/JSEN.2018.2890423","article-title":"Developing Walking Assistants for Visually Impaired People: A Review","volume":"19","author":"Islam","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_10","unstructured":"(2022, January 26). T1RCI-00593. MANTO: Innovative Autonomous Blind Navigation Outdoor and Indoor and in Museums. Available online: https:\/\/manto.ds.unipi.gr."},{"key":"ref_11","unstructured":"Meliones, A., and Filios, C. (July, January 29). BlindHelper: A Pedestrian Navigation System for Blinds and Visually Impaired. Proceedings of the 9th ACM International Conference on Pervasive Technologies Related to Assistive Environments, Corfu, Greece."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Meliones, A., and Sampson, D. (2018). Blind Museum Tourer: A System for Self-Guided Tours in Museums and Blind Indoor Navigation. Technologies, 6.","DOI":"10.3390\/technologies6010004"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Vel\u00e1zquez, R., Pissaloux, E., Rodrigo, P., Carrasco, M., Giannoccaro, N.I., and Lay-Ekuakille, A. (2018). An Outdoor Navigation System for Blind Pedestrians Using GPS and Tactile-Foot Feedback. Appl. Sci., 8.","DOI":"10.3390\/app8040578"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1007\/978-3-319-94274-2_6","article-title":"BluKane: An Obstacle Avoidance Navigation App to Assist the Visually Impaired","volume":"Volume 10897","author":"Miesenberger","year":"2018","journal-title":"Computers Helping People with Special Needs"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Murata, M., Ahmetovic, D., Sato, D., Takagi, H., Kitani, K.M., and Asakawa, C. (2018, January 19\u201323). Smartphone-Based Indoor Localization for Blind Navigation across Building Complexes. Proceedings of the 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom), Athens, Greece.","DOI":"10.1109\/PERCOM.2018.8444593"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Gomes, J.P., Sousa, J.P., Cunha, C.R., and Morais, E.P. (2018, January 13\u201316). An Indoor Navigation Architecture Using Variable Data Sources for Blind and Visually Impaired Persons. Proceedings of the 2018 13th Iberian Conference on Information Systems and Technologies (CISTI), Caceres, Spain.","DOI":"10.23919\/CISTI.2018.8399347"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"21763","DOI":"10.1109\/ACCESS.2017.2761698","article-title":"Indoor Navigation Validation Framework for Visually Impaired Users","volume":"5","author":"Tao","year":"2017","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kasthuri, R., Nivetha, B., Shabana, S., Veluchamy, M., and Sivakumar, S. (2017, January 23\u201324). Smart Device for Visually Impaired People. Proceedings of the 2017 Third International Conference on Science Technology Engineering & Management (ICONSTEM), Chennai, India.","DOI":"10.1109\/ICONSTEM.2017.8261257"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Patel, S., Kumar, A., Yadav, P., Desai, J., and Patil, D. (2017, January 17\u201318). Smartphone-Based Obstacle Detection for Visually Impaired People. Proceedings of the 2017 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS), Coimbatore, India.","DOI":"10.1109\/ICIIECS.2017.8275916"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Asmara, R.A., Al Huda, F., Andoko, B.S., and Handayani, A.N. (2017, January 24\u201325). Optimized Walking Straight Guidance System for Visually Impaired Person That Use Android Smartphone. Proceedings of the 2017 International Conference on Sustainable Information Engineering and Technology (SIET), Batu, Indonesia.","DOI":"10.1109\/SIET.2017.8304159"},{"key":"ref_21","unstructured":"Mukherjee, S., and Pandian, K.S. (2017, January 1\u20132). Android Based Personal Travelling Assistant Using Turning Algorithm. Proceedings of the 2017 International Conference on Energy, Communication, Data Analytics and Soft Computing (ICECDS), Chennai, India."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1007\/s12193-015-0182-7","article-title":"A survey of assistive technologies and applications for blind users on mobile platforms: A review and foundation for research","volume":"9","author":"Nagy","year":"2015","journal-title":"J. Multimodal User Interfaces"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"7210","DOI":"10.1016\/j.eswa.2014.05.031","article-title":"Accessible smartphones for blind users: A case study for a wayfinding system","volume":"41","author":"Martin","year":"2014","journal-title":"Expert Syst. Appl."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1016\/j.survophthal.2012.10.004","article-title":"Mobile assistive technologies for the visually impaired","volume":"58","author":"Hakobyan","year":"2013","journal-title":"Surv. Ophthalmol."},{"key":"ref_25","first-page":"530","article-title":"Obstacles Detection for Visually Impaired People Using Smart Phones","volume":"13","author":"Karthick","year":"2015","journal-title":"Int. J. Emerg. Technol. Comput. Sci. Electron."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Channabasaveshwara Institute of Technology, Karnataka, M.S.N., Balaji, C., and Shantala, C.P. (2014). An Outdoor Navigation With Voice Recognition Security Application For Visually Impaired People. Int. J. Eng. Trends Technol., 10, 500\u2013504.","DOI":"10.14445\/22315381\/IJETT-V10P298"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Lin, B.-S., Lee, C.-C., and Chiang, P.-Y. (2017). Simple Smartphone-Based Guiding System for Visually Impaired People. Sensors, 17.","DOI":"10.3390\/s17061371"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2016). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. arXiv.","DOI":"10.1109\/TPAMI.2016.2577031"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Mataro, T.V., Masulli, F., Rovetta, S., Cabri, A., Traverso, C., Capris, E., and Torretta, S. (2017, January 11\u201313). An Assistive Mobile System Supporting Blind and Visual Impaired People When Are Outdoor. Proceedings of the 2017 IEEE 3rd International Forum on Research and Technologies for Society and Industry (RTSI), Modena, Italy.","DOI":"10.1109\/RTSI.2017.8065886"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/j.procs.2016.09.132","article-title":"ENVISION: Assisted Navigation of Visually Impaired Smartphone Users","volume":"100","author":"Khenkar","year":"2016","journal-title":"Procedia Comput. Sci."},{"key":"ref_32","unstructured":"Lock, J.C., Cielniak, G., and Bellotto, N. (2017, January 27\u201329). A Portable Navigation System with an Adaptive Multimodal Interface for the Blind. Proceedings of the 2017 AAAI Spring Symposium Series, Stanford, CA, USA."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Heuten, W., Henze, N., Boll, S., and Pielot, M. (2008, January 20\u201322). Tactile Wayfinder: A Non-Visual Support System for Wayfinding. Proceedings of the 5th Nordic Conference on Human-Computer Interaction Building Bridges\u2014NordiCHI \u201908, Lund, Sweden.","DOI":"10.1145\/1463160.1463179"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Tepelea, L., Gavrilu, I., and Gacs\u00e1di, A. (2017, January 1\u20132). Smartphone application to assist visually impaired people. Proceedings of the 14th International Conference on Engineering of Modern Electric Systems (EMES), Oradea, Romania.","DOI":"10.1109\/EMES.2017.7980421"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.jnca.2013.10.015","article-title":"Accurate positioning using long range active RFID technology to assist visually impaired people","volume":"41","author":"Alghamdi","year":"2014","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Tanveer, M.S.R., Hashem, M.M.A., and Hossain, M.K. (2015, January 21\u201323). Android Assistant EyeMate for Blind and Blind Tracker. Proceedings of the 2015 18th International Conference on Computer and Information Technology (ICCIT), Dhaka, Bangladesh.","DOI":"10.1109\/ICCITechn.2015.7488080"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1109\/THMS.2018.2799588","article-title":"Design and Construction of Electronic Aid for Visually Impaired People","volume":"48","author":"Patil","year":"2018","journal-title":"IEEE Trans. Human-Machine Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1109\/THMS.2019.2931745","article-title":"An Astute Assistive Device for Mobility and Object Recognition for Visually Impaired People","volume":"49","author":"Meshram","year":"2019","journal-title":"IEEE Trans. Human-Machine Syst."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Rahman, M.A., Sadi, M.S., Islam, M.M., and Saha, P. (2019, January 28\u201330). Design and Development of Navigation Guide for Visually Impaired People. Proceedings of the 2019 IEEE International Conference on Biomedical Engineering, Computer and Information Technology for Health (BECITHCON), Dhaka, Bangladesh.","DOI":"10.1109\/BECITHCON48839.2019.9063201"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"10199","DOI":"10.1109\/JSEN.2020.2990609","article-title":"Design and Implementation of an Intelligent Assistive System for Visually Impaired People for Aerial Obstacle Avoidance and Fall Detection","volume":"20","author":"Chang","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2568","DOI":"10.1109\/JSEN.2018.2795046","article-title":"An Electromagnetic Sensor Prototype to Assist Visually Impaired and Blind People in Autonomous Walking","volume":"18","author":"Cardillo","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1109\/JERM.2021.3117129","article-title":"Millimeter-Wave Radar Cane: A Blind People Aid With Moving Human Recognition Capabilities","volume":"6","author":"Cardillo","year":"2021","journal-title":"IEEE J. Electromagn. RF Microw. Med. Biol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1450322","DOI":"10.1080\/23311916.2018.1450322","article-title":"Assistive device for orientation and mobility of the visually impaired based on millimeter wave radar technology\u2014Clinical investigation results","volume":"5","author":"Kiuru","year":"2018","journal-title":"Cogent Eng."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1109\/TMRB.2020.3011501","article-title":"Automated Walking Guide to Enhance the Mobility of Visually Impaired People","volume":"2","author":"Islam","year":"2020","journal-title":"IEEE Trans. Med. Robot. Bionics"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"33029","DOI":"10.1109\/ACCESS.2018.2817164","article-title":"A Highly Accurate and Reliable Data Fusion Framework for Guiding the Visually Impaired","volume":"6","author":"Elmannai","year":"2018","journal-title":"IEEE Access"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1567","DOI":"10.1109\/TMM.2020.3001500","article-title":"V-Eye: A Vision-Based Navigation System for the Visually Impaired","volume":"23","author":"Duh","year":"2020","journal-title":"IEEE Trans. Multimed."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Lin, Y., Wang, K., Yi, W., and Lian, S. (2019, January 27\u201328). Deep Learning Based Wearable Assistive System for Visually Impaired People. Proceedings of the IEEE\/CVF International Conference on Computer Vision Workshops, Seoul, Korea.","DOI":"10.1109\/ICCVW.2019.00312"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Younis, O., Al-Nuaimy, W., Rowe, F., and Alomari, M.H. (2019). A Smart Context-Aware Hazard Attention System to Help People with Peripheral Vision Loss. Sensors, 19.","DOI":"10.3390\/s19071630"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Yang, K., Wang, K., Bergasa, L.M., Romera, E., Hu, W., Sun, D., Sun, J., Cheng, R., Chen, T., and L\u00f3pez, E. (2018). Unifying terrain awareness for the visually impaired through real-time semantic segmentation. Sensors, 18.","DOI":"10.3390\/s18051506"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Bai, J., Liu, Z., Lin, Y., Li, Y., Lian, S., and Liu, D. (2019). Wearable Travel Aid for Environment Perception and Navigation of Visually Impaired People. Electronics, 8.","DOI":"10.3390\/electronics8060697"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"013028","DOI":"10.1117\/1.JEI.28.1.013028","article-title":"Assisting the visually impaired: Multitarget warning through millimeter wave radar and RGB-depth sensors","volume":"28","author":"Long","year":"2019","journal-title":"J. Electron. Imaging"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1007\/978-3-319-94274-2_12","article-title":"Intersection Navigation for People with Visual Impairment","volume":"Volume 10897","author":"Miesenberger","year":"2018","journal-title":"Computers Helping People with Special Needs"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Yu, S., Lee, H., and Kim, J. (2019, January 27\u201328). Street Crossing Aid Using Light-Weight CNNs for the Visually Impaired. Proceedings of the IEEE\/CVF International Conference on Computer Vision Workshops, Seoul, Korea.","DOI":"10.1109\/ICCVW.2019.00317"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Ihejimba, C., and Wenkstern, R.Z. (October, January 28). DetectSignal: A Cloud-Based Traffic Signal Notification System for the Blind and Visually Impaired. Proceedings of the 2020 IEEE International Smart Cities Conference (ISC2), Piscataway, NJ, USA.","DOI":"10.1109\/ISC251055.2020.9239004"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Theodorou, P., Meliones, A., and Filios, C. (2022). Smart traffic lights for people with visual impairments: A literature overview and a proposed implementation. J. Vis. Impair. Blind.","DOI":"10.1177\/02646196221099154"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"S\u00e1ez, Y., Mu\u00f1oz, J., Canto, F., Garc\u00eda, A., and Montes, H. (2019). Assisting Visually Impaired People in the Public Transport System through RF-Communication and Embedded Systems. Sensors, 19.","DOI":"10.3390\/s19061282"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Yu, C., Li, Y., Huang, T.-Y., Hsieh, W.-A., Lee, S.-Y., Yeh, I.-H., Lin, G.K., Yu, N.-H., Tang, H.-H., and Chang, Y.-J. (2020). BusMyFriend: Designing a Bus Reservation Service for People with Visual Impairments in Taipei. Companion Publication of the 2020 ACM Designing Interactive Systems Conference, ACM.","DOI":"10.1145\/3393914.3395879"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"See, A.R., Sasing, B.G., and Advincula, W.D. (2022). A Smartphone-Based Mobility Assistant Using Depth Imaging for Visually Impaired and Blind. Appl. Sci., 12.","DOI":"10.3390\/app12062802"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Meliones, A., Filios, C., and Llorente, J. (2022). Reliable Ultrasonic Obstacle Recognition for Outdoor Blind Navigation. Technologies, 10.","DOI":"10.3390\/technologies10030054"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1080\/17483100802362085","article-title":"Cognitive design in action: Developing assistive technology for situational awareness for persons who are blind","volume":"3","author":"Yaagoubi","year":"2008","journal-title":"Disabil. Rehabil. Assist. Technol."},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Theodorou, P., and Meliones, A. (2020). Towards a Training Framework for Improved Assistive Mobile App Acceptance and Use Rates by Blind and Visually Impaired People. Educ. Sci., 10.","DOI":"10.3390\/educsci10030058"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1016\/j.compedu.2015.07.005","article-title":"How do young children engage with mobile apps? Cognitive, psychomotor, and affective perspective","volume":"87","author":"Noorhidawati","year":"2015","journal-title":"Comput. Educ."},{"key":"ref_63","unstructured":"Marks, D., Cremin, L., Sneider, A., Laxton, T., McPhee, I., and Marks, L. (2012). Does Use of Touch Screen Computer Technology Improve Classroom Engagement in Children?. Durham University School of Education."},{"key":"ref_64","first-page":"1","article-title":"Measuring User Engagement","volume":"6","author":"Lalmas","year":"2014","journal-title":"Synth. Lect. Inf. Concepts Retr. Serv."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"V\u00f6lkel, T., and Weber, G. (2008, January 13\u201315). RouteCheckr: Personalized Multicriteria Routing for Mobility Impaired Pedestrians. Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility\u2014Assets \u201908, Halifax, NS, Canada.","DOI":"10.1145\/1414471.1414506"},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1145\/1039539.1039541","article-title":"Usability engineering methods for software developers","volume":"48","author":"Holzinger","year":"2005","journal-title":"Commun. ACM"},{"key":"ref_67","unstructured":"(2022, April 02). ISO\/IEC 25010:2011. Available online: https:\/\/www.iso.org\/standard\/35733.html."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Forlizzi, J., and Battarbee, K. (2004, January 1\u20134). Understanding Experience in Interactive Systems. Proceedings of the 2004 Conference on Designing Interactive Systems Processes, Practices, Methods, and Techniques\u2014DIS \u201904, Cambridge, MA, USA.","DOI":"10.1145\/1013115.1013152"},{"key":"ref_69","unstructured":"(2022, March 28). ISO 9241-210:2019. Available online: https:\/\/www.iso.org\/standard\/77520.html."},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Majrashi, K., Hamilton, M., Uitdenbogerd, A.L., and Al-Megren, S. (2020). Cross-Platform Usability Model Evaluation. Multimodal Technol. Interact., 4.","DOI":"10.3390\/mti4040080"},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"D\u00edaz-Oreiro, I., L\u00f3pez, G., Quesada, L., and Guerrero, L. (2019, January 2\u20135). Standardized Questionnaires for User Experience Evaluation: A Systematic Literature Review. Proceedings of the 13th International Conference on Ubiquitous Computing and Ambient \u202aIntelligence UCAmI 2019, Toledo, Spain.","DOI":"10.3390\/proceedings2019031014"},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Lallemand, C., and Koenig, V. (2017, January 19\u201322). How Could an Intranet Be Like a Friend to Me? Why Standardized UX Scales Don\u2019t Always Fit. Proceedings of the European Conference on Cognitive Ergonomics 2017, Ume\u00e5, Sweden.","DOI":"10.1145\/3121283.3121288"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.ijhcs.2018.08.008","article-title":"No need to read: Developing a pictorial single-item scale for measuring perceived usability","volume":"122","author":"Baumgartner","year":"2018","journal-title":"Int. J. Human-Computer Stud."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Forster, Y., Hergeth, S., Naujoks, F., and Krems, J.F. (2018, January 23\u201325). How Usability Can Save the Day\u2014Methodological Considerations for Making Automated Driving a Success Story. Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Toronto, ON, Canada.","DOI":"10.1145\/3239060.3239076"},{"key":"ref_75","unstructured":"Klammer, J., and van den Anker, F.W.G. (2018). Design, User Experience, and Usability: Users, Contexts and Case Studies, Springer International Publishing."},{"key":"ref_76","doi-asserted-by":"crossref","unstructured":"Hassenzahl, M., Burmester, M., and Koller, F. (2003). AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualit\u03b4t. Mensch & Computer, Vieweg+ Teubner Verlag.","DOI":"10.1007\/978-3-322-80058-9_19"},{"key":"ref_77","doi-asserted-by":"crossref","unstructured":"Soares, M., Falc\u00e3o, C., and Ahram, T.Z. (2017). The meCUE Questionnaire: A Modular Tool for Measuring User Experience. Advances in Ergonomics Modeling, Usability & Special Populations, Springer. Advances in Intelligent Systems and Computing.","DOI":"10.1007\/978-3-319-41685-4"},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Fenton, N.E., and Bieman, J. (2014). Software Metrics: A Rigorous and Practical Approach, CRC Press.","DOI":"10.1201\/b17461"},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1007\/978-3-540-89350-9_6","article-title":"Construction and Evaluation of a User Experience Questionnaire","volume":"Volume 5298","author":"Holzinger","year":"2008","journal-title":"HCI and Usability for Education and Work"},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Theodorou, P., and Meliones, A. (2022). Gaining Insight for the Design, Development, Deployment and Distribution of Assistive Navigation Systems for Blind and Visually Impaired People through a Detailed User Requirements Elicitation, Universal Access in the Information Society (UAIS), Springer International Publishing.","DOI":"10.1007\/s10209-022-00885-9"},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2021\/5518722","article-title":"UX Evaluation with Standardized Questionnaires in Ubiquitous Computing and Ambient Intelligence: A Systematic Literature Review","volume":"2021","author":"Quesada","year":"2021","journal-title":"Adv. Human-Comput. Interact."},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Dell, N., Vaidyanathan, V., Medhi, I., Cutrell, E., and Thies, W. (2012, January 5\u201310). \u201cYours Is Better!\u201d: Participant Response Bias in HCI. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Austin, TX, USA.","DOI":"10.1145\/2207676.2208589"},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"1024","DOI":"10.1080\/09687599.2013.818773","article-title":"The social model of disability: Thirty years on","volume":"28","author":"Oliver","year":"2013","journal-title":"Disabil. Soc."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/12\/4538\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:32:53Z","timestamp":1760139173000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/12\/4538"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,16]]},"references-count":83,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,6]]}},"alternative-id":["s22124538"],"URL":"https:\/\/doi.org\/10.3390\/s22124538","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,16]]}}}