{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T18:07:42Z","timestamp":1785434862737,"version":"3.56.0"},"reference-count":37,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2026,6,22]],"date-time":"2026-06-22T00:00:00Z","timestamp":1782086400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"King Saud University, Riyadh, Saudi Arabia","award":["ORF-2026-2169"],"award-info":[{"award-number":["ORF-2026-2169"]}]},{"award":["ORF-2026-2169"],"award-info":[{"award-number":["ORF-2026-2169"]}],"id":[{"id":"https:\/\/ror.org\/02f81g417","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Visual impairment affects approximately 2.2 billion people worldwide, yet existing assistive technologies remain fragmented and prohibitively expensive. This paper presents Munir, an integrated multimodal assistive system designed to enhance human\u2013computer interaction through a combination of a mobile application and Bluetooth-enabled smart glasses. Munir leverages a hybrid machine learning architecture to provide inclusive, real-time support for daily living activities. The system integrates ten core capabilities\u2014including face recognition, optical character recognition, and scene description\u2014all accessible through a unified bilingual (Arabic\/English) voice interface. By employing on-device processing for biometric tasks, Munir ensures user privacy and trust while maintaining high responsiveness. End-to-end system evaluation on the SCface dataset achieves a 96.69% recognition rate with 0% False Accept Rate. At an estimated first-year total cost of $806, Munir demonstrates a 4\u20135\u00d7 cost advantage over commercial alternatives, providing a scalable and affordable multimodal solution for global digital inclusion.<\/jats:p>","DOI":"10.3390\/s26123950","type":"journal-article","created":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T01:03:23Z","timestamp":1782263003000},"page":"3950","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Munir: A Multimodal Smart-Glasses System for Enhancing Human\u2013Computer Interaction for Visually Impaired Individuals"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5134-5995","authenticated-orcid":false,"given":"Nora","family":"Alhammad","sequence":"first","affiliation":[{"name":"College of Computer and Information Sciences, King Saud University, Riyadh 11451, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-5279-642X","authenticated-orcid":false,"given":"Aljawharah","family":"Alsubaie","sequence":"additional","affiliation":[{"name":"College of Computer and Information Sciences, King Saud University, Riyadh 11451, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-0476-6454","authenticated-orcid":false,"given":"Rama","family":"Alomair","sequence":"additional","affiliation":[{"name":"College of Computer and Information Sciences, King Saud University, Riyadh 11451, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-0043-6450","authenticated-orcid":false,"given":"Fajer","family":"Alamro","sequence":"additional","affiliation":[{"name":"College of Computer and Information Sciences, King Saud University, Riyadh 11451, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-7762-9665","authenticated-orcid":false,"given":"Mashael","family":"Alammar","sequence":"additional","affiliation":[{"name":"College of Computer and Information Sciences, King Saud University, Riyadh 11451, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,6,22]]},"reference":[{"key":"ref_1","unstructured":"World Health Organization (2019). World Report on Vision, WHO."},{"key":"ref_2","first-page":"886","article-title":"Depression and quality of life in older adults with visual impairment: A longitudinal study","volume":"140","author":"Vu","year":"2022","journal-title":"JAMA Ophthalmol."},{"key":"ref_3","unstructured":"OrCam Technologies (2026, April 01). OrCam MyEye 2 Product Specifications. Available online: https:\/\/www.orcam.com."},{"key":"ref_4","unstructured":"Envision (2026, April 01). Envision Glasses: AI-Powered Glasses for the Blind and Visually Impaired. Available online: https:\/\/www.letsenvision.com."},{"key":"ref_5","unstructured":"Microsoft (2026, April 01). Seeing AI: Talking Camera for the Blind. Available online: https:\/\/www.microsoft.com\/en-us\/ai\/seeing-ai."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"107903","DOI":"10.1109\/ACCESS.2024.3424933","article-title":"A comprehensive review of face recognition techniques, trends, and challenges","volume":"12","author":"Gururaj","year":"2024","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"102391","DOI":"10.1016\/j.displa.2023.102391","article-title":"Artificial intelligence for visually impaired","volume":"77","author":"Wang","year":"2023","journal-title":"Displays"},{"key":"ref_8","unstructured":"(2026, April 01). Be My Eyes. Connecting Blind and Low-Vision People with Sighted Volunteers. Available online: https:\/\/www.bemyeyes.com."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1109\/THMS.2024.3375655","article-title":"AI-SenseVision: A low-cost artificial-intelligence-based robust and real-time assistance for visually impaired people","volume":"54","author":"Joshi","year":"2024","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kim, D., and Choi, Y. (2021). Applications of smart glasses in applied sciences: A systematic review. Appl. Sci., 11.","DOI":"10.3390\/app11114956"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Mukhiddinov, M., and Cho, J. (2022). Smart glass system using deep learning for the blind and visually impaired. Electronics, 11.","DOI":"10.3390\/electronics10222756"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Xie, Z., Li, Z., Zhang, Y., Zhang, J., Liu, F., and Chen, W. (2022). A multi-sensory guidance system for the visually impaired using YOLO and ORB-SLAM. Information, 13.","DOI":"10.3390\/info13070343"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Okolo, G.I., Althobaiti, T., and Ramzan, N. (2024). Assistive systems for visually impaired persons: Challenges and opportunities for navigation assistance. Sensors, 24.","DOI":"10.3390\/s24113572"},{"key":"ref_14","unstructured":"Vieira, T., Pereira, M., Lopes, S., and Cunha, A. (2024). A comprehensive survey on emerging assistive technologies for visually impaired persons. Sensors, 24."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Deng, J., Guo, J., Xue, N., and Zafeiriou, S. (2019). ArcFace: Additive angular margin loss for deep face recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 15\u201320 June 2019, IEEE.","DOI":"10.1109\/CVPR.2019.00482"},{"key":"ref_16","first-page":"507","article-title":"A deep insight into measuring face image utility with general and face-specific image quality metrics","volume":"4","author":"Fu","year":"2022","journal-title":"IEEE Trans. Biom. Behav. Identity Sci."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7\u201312). FaceNet: A unified embedding for face recognition and clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Firmansyah, A.M., Kusumasari, T.F., and Alam, E.N. (2023). Comparison of face recognition accuracy of ArcFace, FaceNet and FaceNet512 models on DeepFace framework. Proceedings of the International Conference on Computer Science, Information Technology and Engineering (ICCoSITE), Jakarta, Indonesia, 16 February 2023, IEEE.","DOI":"10.1109\/ICCoSITE57641.2023.10127799"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Douklias, A., Zorzos, I., Maltezos, E., Nousis, V., Bolierakis, S.N., Karagiannidis, L., Ouzounoglou, E., and Amditis, A. (2025). A multicomponent face verification and identification system. Appl. Sci., 15.","DOI":"10.3390\/app15158161"},{"key":"ref_20","unstructured":"Luo, J., Fang, Y., Zhao, J., and Wang, Z. (2022, January 15\u201317). Real-time face recognition system based on YOLOv5 and InsightFace. Proceedings of the 7th International Conference on Intelligent Computing and Signal Processing (ICSP), Xi\u2019an, China."},{"key":"ref_21","first-page":"107903","article-title":"A comprehensive benchmarking of facial recognition pipelines","volume":"12","author":"Serengil","year":"2024","journal-title":"IEEE Access"},{"key":"ref_22","unstructured":"Based Hardware Inc. (2026, April 01). Omi Glass Dev Kit Technical Specifications. Available online: https:\/\/www.omi.glass."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"139","DOI":"10.32604\/iasc.2023.033940","article-title":"Driving activity classification using deep residual networks based on smart glasses sensors","volume":"38","author":"Hnoohom","year":"2023","journal-title":"Intell. Autom. Soft Comput."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Cao, Q., Shen, L., Xie, W., Parkhi, O.M., and Zisserman, A. (2018, January 15\u201319). VGGFace2: A dataset for recognising faces across pose and age. Proceedings of the IEEE International Conference on Automatic Face & Gesture Recognition (FG), Xi\u2019an, China.","DOI":"10.1109\/FG.2018.00020"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Guo, Y., Zhang, L., Hu, Y., He, X., and Gao, J. (2016, January 11\u201314). MS-Celeb-1M: A dataset and benchmark for large-scale face recognition. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46487-9_6"},{"key":"ref_26","unstructured":"InsightFace Team (2026, April 01). Buffalo_l Model Pack: Face Recognition Benchmark Results. Available online: https:\/\/github.com\/deepinsight\/insightface."},{"key":"ref_27","unstructured":"W3C (2026, April 23). Web Content Accessibility Guidelines (WCAG) 2.1. W3C Recommendation 2018 (Updated 2023). Available online: https:\/\/www.w3.org\/TR\/WCAG21\/."},{"key":"ref_28","unstructured":"Google Cloud (2026, May 01). Cloud Vision API Documentation. Available online: https:\/\/cloud.google.com\/vision\/docs."},{"key":"ref_29","unstructured":"OpenAI (2026, April 01). Update to GPT-5 System Card: GPT-5.2. OpenAI Technical Report 2025. Available online: https:\/\/openai.com\/index\/gpt-5-system-card-update-gpt-5-2\/."},{"key":"ref_30","unstructured":"Huang, G.B., Ramesh, M., Berg, T., and Learned-Miller, E. (2007). Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments, University of Massachusetts. Technical Report 07-49."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"863","DOI":"10.1007\/s11042-009-0417-2","article-title":"SCface\u2014Surveillance cameras face database","volume":"51","author":"Grgic","year":"2011","journal-title":"Multimed. Tools Appl."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"104290","DOI":"10.1016\/j.imavis.2021.104290","article-title":"Multiscale parallel deep CNN (mpdCNN) architecture for the real low-resolution face recognition for surveillance","volume":"115","author":"Mishra","year":"2021","journal-title":"Image Vis. Comput."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"107046","DOI":"10.1109\/ACCESS.2021.3100717","article-title":"Arabic scene text recognition in the deep learning era: Analysis on a novel dataset","volume":"9","author":"Hassan","year":"2021","journal-title":"IEEE Access"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Feng, J., Beheshti, M., Philipson, M., Ramsaywack, Y., Porfiri, M., and Rizzo, J. (2026). Evaluating OCR performance for assistive technology: Effects of walking speed, camera placement, and camera type. arXiv.","DOI":"10.1080\/17483107.2026.2673178"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zein, S., Salleh, N., and Grundy, J. (2015). Mobile Application Testing in Industrial Contexts: An Exploratory Multiple Case-Study. Communications in Computer and Information Science, Springer.","DOI":"10.1007\/978-3-319-22689-7_3"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/s10664-021-10059-5","article-title":"Software testing and Android applications: A large-scale empirical study","volume":"27","author":"Pecorelli","year":"2022","journal-title":"Empir. Softw. Eng."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018). MobileNetV2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA, 18\u201323 June 2018, IEEE.","DOI":"10.1109\/CVPR.2018.00474"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/12\/3950\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T01:10:09Z","timestamp":1782263409000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/12\/3950"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,22]]},"references-count":37,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2026,6]]}},"alternative-id":["s26123950"],"URL":"https:\/\/doi.org\/10.3390\/s26123950","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,22]]}}}