{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,31]],"date-time":"2026-10-31T21:34:10Z","timestamp":1793482450503,"version":"4.5.0"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,5,11]],"date-time":"2026-05-11T00:00:00Z","timestamp":1778457600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T00:00:00Z","timestamp":1782950400000},"content-version":"vor","delay-in-days":52,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Despite significant recent advances, visual aid systems are still limited by the use of conventional computer vision algorithms, constrained sensor capabilities, high power consumption, and reliance on cloud-based processing, which introduce latency and privacy risks. Current assistive technologies for visually impaired individuals often suffer from a lack of secure and competent communication and an inability to deal with complex computer vision tasks. This paper introduces SENSEYE, a resource-aware visionary framework that employs edge computing with a secure and competent communication mechanism. The proposed architecture integrates IoT Edge and virtual decentralized services in a portable system that is small, cost-effective, and power-efficient. The integration of open AI models with advanced functionality in this system design helps to recognize objects, locate moving obstacles, detect sudden changes, perceive a summary from a live feed, and represent them as audio in real time. SENSEYE integrates real-time object detection, scene comprehension, and global positioning system (GPS)-based navigation into a portable, low-latency device. This system leverages optimized lightweight AI models, e.g., SSD-MobileNetV2 and VILA1.5-3b, to provide accurate environmental awareness and seamless auditory feedback through efficient speech processing. The system also enables secure remote assistance via video streaming and real-time GPS location sharing, ensuring enhanced user safety and connectivity. The evaluations confirm superior accuracy, power efficiency, and responsiveness compared to traditional sensor-based or cloud-reliant systems. Although challenges remain, particularly in constrained sensor capabilities, power efficiency trade-offs, and potential sensory overload, future work will focus on improving wearability, optimizing energy consumption, and advancing multimodal, user-centric AI integration for enhanced accessibility. This paper presents a novel resource-aware edge AI architecture with integrated real-time perception and secure IoT communication, establishing a scalable, privacy-preserving, and interpretable foundation for next-generation assistive systems for visually impaired individuals.<\/jats:p>","DOI":"10.1038\/s41598-026-51257-9","type":"journal-article","created":{"date-parts":[[2026,5,11]],"date-time":"2026-05-11T18:15:02Z","timestamp":1778523302000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["SENSEYE: a resource-aware visionary framework for assisting individuals with visual disabilities"],"prefix":"10.1038","volume":"16","author":[{"given":"Akash Shingha","family":"Bappy","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tapio","family":"Sepp\u00e4nen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Md Ziaul","family":"Hoque","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,5,11]]},"reference":[{"key":"51257_CR1","doi-asserted-by":"publisher","first-page":"3435","DOI":"10.21817\/ijet\/2017\/v9i5\/170905302","volume":"9","author":"DE Gbenga","year":"2017","unstructured":"Gbenga, D. E., Shani, A. I. & Adekunle, A. L. Smart walking stick for visually impaired people using ultrasonic sensors and arduino. Int. J. Eng. Technol. 9, 3435\u20133447 (2017).","journal-title":"Int. J. Eng. Technol."},{"key":"51257_CR2","doi-asserted-by":"publisher","first-page":"565","DOI":"10.3390\/s17030565","volume":"17","author":"W Elmannai","year":"2017","unstructured":"Elmannai, W. & Elleithy, K. Sensor-based assistive devices for visually-impaired people: Current status, challenges, and future directions. Sensors 17, 565 (2017).","journal-title":"Sensors"},{"key":"51257_CR3","unstructured":"Payne, J. Microsoft launches ai app for visually impaired. UWIRE Text 1\u20131 (2017)."},{"key":"51257_CR4","doi-asserted-by":"publisher","first-page":"e986","DOI":"10.1111\/aos.15001","volume":"100","author":"X-T-A Nguyen","year":"2022","unstructured":"Nguyen, X.-T.-A., Koopman, J., van Genderen, M. M., Stam, H. L. & Boon, C. J. Artificial vision: The effectiveness of the orcam in patients with advanced inherited retinal dystrophies. Acta Ophthalmol. 100, e986\u2013e993 (2022).","journal-title":"Acta Ophthalmol."},{"key":"51257_CR5","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpbup.2021.100015","volume":"1","author":"MA Rahman","year":"2021","unstructured":"Rahman, M. A. & Sadi, M. S. Iot enabled automated object recognition for the visually impaired. Comput. Methods Programs Biomed. Update 1, 100015 (2021).","journal-title":"Comput. Methods Programs Biomed. Update"},{"key":"51257_CR6","doi-asserted-by":"publisher","DOI":"10.1016\/j.displa.2023.102391","volume":"77","author":"J Wang","year":"2023","unstructured":"Wang, J., Wang, S. & Zhang, Y. Artificial intelligence for visually impaired. Displays 77, 102391 (2023).","journal-title":"Displays"},{"key":"51257_CR7","doi-asserted-by":"crossref","unstructured":"Ulfa, A., Rosspertiwi, A.\u00a0A., Sahroni, A. & Murnani, S. S-cane: Ultrasonic sensor-based smart cane for the visually impaired. In 2023 IEEE International Biomedical Instrumentation and Technology Conference (IBITeC) 7\u201311 (IEEE, 2023).","DOI":"10.1109\/IBITeC59006.2023.10390939"},{"key":"51257_CR8","unstructured":"Dambhare, S. & Sakhare, A. Smart stick for blind: Obstacle detection, artificial vision and real-time assistance via gps. In 2nd National Conference on Information and Communication Technology (NCICT) vol.\u00a02, 31\u201333 (2011)."},{"key":"51257_CR9","first-page":"53","volume":"6","author":"OO Oladayo","year":"2014","unstructured":"Oladayo, O. O. A multidimensional walking aid for visually impaired using ultrasonic sensors network with voice guidance. Int. J. Intell. Syst. Appl. 6, 53\u201359 (2014).","journal-title":"Int. J. Intell. Syst. Appl."},{"key":"51257_CR10","unstructured":"Wahab, M. H.\u00a0A. et al. Smart cane: Assistive cane for visually-impaired people. arXiv preprint arXiv:1110.5156 (2011)."},{"key":"51257_CR11","doi-asserted-by":"crossref","unstructured":"Saaid, M.\u00a0F., Ismail, I. & Noor, M. Z.\u00a0H. Radio frequency identification walking stick (rfiws): A device for the blind. In 2009 5th International Colloquium on Signal Processing & Its Applications 250\u2013253 (IEEE, 2009).","DOI":"10.1109\/CSPA.2009.5069227"},{"key":"51257_CR12","doi-asserted-by":"publisher","first-page":"2802","DOI":"10.3390\/s23052802","volume":"23","author":"AM Joseph","year":"2023","unstructured":"Joseph, A. M., Kian, A. & Begg, R. State-of-the-art review on wearable obstacle detection systems developed for assistive technologies and footwear. Sensors 23, 2802 (2023).","journal-title":"Sensors"},{"key":"51257_CR13","unstructured":"Singh, D.\u00a0K. Dynamic environment exploration tool: A blind\u2019s eye. In Proceedings of the XYZ Conference (2015)."},{"key":"51257_CR14","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1177\/0145482X211027492","volume":"115","author":"C Granquist","year":"2021","unstructured":"Granquist, C. et al. Evaluation and comparison of artificial intelligence vision aids: Orcam myeye 1 and seeing ai. J. Visual Impairment Blindness 115, 277\u2013285 (2021).","journal-title":"J. Visual Impairment Blindness"},{"key":"51257_CR15","doi-asserted-by":"publisher","first-page":"2473","DOI":"10.3390\/s17112473","volume":"17","author":"R Tapu","year":"2017","unstructured":"Tapu, R., Mocanu, B. & Zaharia, T. Deep-see: Joint object detection, tracking and recognition with application to visually impaired navigational assistance. Sensors 17, 2473 (2017).","journal-title":"Sensors"},{"key":"51257_CR16","doi-asserted-by":"crossref","unstructured":"Murali, V.\u00a0N. & Coughlan, J.\u00a0M. Smartphone-based crosswalk detection and localization for visually impaired pedestrians. In 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW) 1\u20137 (IEEE, 2013).","DOI":"10.1109\/ICMEW.2013.6618432"},{"key":"51257_CR17","doi-asserted-by":"publisher","first-page":"1134","DOI":"10.12694\/scpe.v25i2.2619","volume":"25","author":"B Pydala","year":"2024","unstructured":"Pydala, B., Kumar, T. P. & Baseer, K. K. Visisense: a comprehensive iot-based assistive technology system for enhanced navigation support for the visually impaired. Scalable Comput. Pract. Exp. 25, 1134\u20131151 (2024).","journal-title":"Scalable Comput. Pract. Exp."},{"key":"51257_CR18","doi-asserted-by":"crossref","unstructured":"Saputra, M. R.\u00a0U., Santosa, P.\u00a0I. et al. Obstacle avoidance for visually impaired using auto-adaptive thresholding on kinect\u2019s depth image. In 2014 IEEE 11th Intl Conf on Ubiquitous Intelligence and Computing and 2014 IEEE 11th Intl Conf on Autonomic and Trusted Computing and 2014 IEEE 14th Intl Conf on Scalable Computing and Communications and Its Associated Workshops 337\u2013342 (IEEE, 2014).","DOI":"10.1109\/UIC-ATC-ScalCom.2014.108"},{"key":"51257_CR19","unstructured":"Sethuraman, S.\u00a0C., Tadkapally, G.\u00a0R., Mohanty, S.\u00a0P., Galada, G. & Subramanian, A. Magiceye: An intelligent wearable towards independent living of visually impaired. arXiv preprint arXiv:2303.13863 (2023)."},{"key":"51257_CR20","doi-asserted-by":"publisher","first-page":"31672","DOI":"10.1038\/s41598-025-13390-9","volume":"15","author":"J Ye","year":"2025","unstructured":"Ye, J., Mansour, A. & Huang, F. Enhancing real-time heading estimation for pedestrian navigation via deep learning and smartphone embedded sensors. Sci. Rep. 15, 31672 (2025).","journal-title":"Sci. Rep."},{"key":"51257_CR21","doi-asserted-by":"publisher","first-page":"1036","DOI":"10.1038\/s41433-023-02842-z","volume":"38","author":"E Waisberg","year":"2024","unstructured":"Waisberg, E. et al. Meta smart glasses-large language models and the future for assistive glasses for individuals with vision impairments. Eye 38, 1036\u20131038 (2024).","journal-title":"Eye"},{"key":"51257_CR22","doi-asserted-by":"crossref","unstructured":"Avila, M., Wolf, K., Brock, A. & Henze, N. Remote assistance for blind users in daily life: A survey about be my eyes. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments 1\u20132 (2016).","DOI":"10.1145\/2910674.2935839"},{"key":"51257_CR23","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1109\/JIOT.2016.2579198","volume":"3","author":"W Shi","year":"2016","unstructured":"Shi, W., Cao, J., Zhang, Q., Li, Y. & Xu, L. Edge computing: Vision and challenges. IEEE Internet Things J. 3, 637\u2013646 (2016).","journal-title":"IEEE Internet Things J."},{"key":"51257_CR24","unstructured":"Archet, A., Gac, N., Orieux, F. & Ventroux, N. Embedded ai performances of nvidia\u2019s jetson orin soc series. In 17\u00e8me Colloque National du GDR SOC2 (2023)."},{"key":"51257_CR25","unstructured":"Gamess, E. & Hernandez, S. Performance evaluation of different raspberry pi models for a broad spectrum of interests. Int. J. Adv. Comput. Sci. Appl. 13 (2022)."},{"key":"51257_CR26","unstructured":"Radford, A. et al. Robust speech recognition via large-scale weak supervision. In International Conference on Machine Learning 28492\u201328518 (PMLR, 2023)."},{"key":"51257_CR27","first-page":"9459","volume":"33","author":"P Lewis","year":"2020","unstructured":"Lewis, P. et al. Retrieval-augmented generation for knowledge-intensive nlp tasks. Adv. Neural. Inf. Process. Syst. 33, 9459\u20139474 (2020).","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"51257_CR28","doi-asserted-by":"crossref","unstructured":"Douze, M. et al. The faiss library. IEEE Trans. Big Data (2025).","DOI":"10.1109\/TBDATA.2025.3618474"},{"key":"51257_CR29","unstructured":"Yang, A. et al. Qwen3 technical report. arXiv preprint arXiv:2505.09388 (2025)."},{"key":"51257_CR30","doi-asserted-by":"publisher","first-page":"1207","DOI":"10.5194\/isprs-archives-XLVIII-1-W2-2023-1207-2023","volume":"48","author":"P H\u00fcbner","year":"2023","unstructured":"H\u00fcbner, P., Hou, J. & Iwaszczuk, D. Evaluation of intel realsense d455 camera depth estimation for indoor slam applications. Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci. 48, 1207\u20131214 (2023).","journal-title":"Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"51257_CR31","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A. & Chen, L.-C. Mobilenetv2: Inverted residuals and linear bottlenecks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 4510\u20134520 (2018).","DOI":"10.1109\/CVPR.2018.00474"},{"key":"51257_CR32","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y. et al. Microsoft coco: Common objects in context. In European Conference on Computer Vision 740\u2013755 (Springer, 2014).","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"51257_CR33","doi-asserted-by":"crossref","unstructured":"Liu, W. et al. Ssd: Single shot multibox detector. In European Conference on Computer Vision 21\u201337 (Springer, 2016).","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"51257_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3508391","volume":"21","author":"E Jeong","year":"2022","unstructured":"Jeong, E., Kim, J. & Ha, S. Tensorrt-based framework and optimization methodology for deep learning inference on jetson boards. ACM Trans. Embedded Comput. Syst. (TECS) 21, 1\u201326 (2022).","journal-title":"ACM Trans. Embedded Comput. Syst. (TECS)"},{"key":"51257_CR35","unstructured":"Bordes, F. et al. An introduction to vision-language modeling. arXiv preprint arXiv:2405.17247 (2024)."},{"key":"51257_CR36","doi-asserted-by":"crossref","unstructured":"Liu, Z. et al. Nvila: Efficient frontier visual language models. In Proceedings of the Computer Vision and Pattern Recognition Conference 4122\u20134134 (2025).","DOI":"10.1109\/CVPR52734.2025.00390"},{"key":"51257_CR37","doi-asserted-by":"publisher","first-page":"1439","DOI":"10.1109\/TLA.2019.8931137","volume":"17","author":"S Quincozes","year":"2019","unstructured":"Quincozes, S., Emilio, T. & Kazienko, J. Mqtt protocol: Fundamentals, tools and future directions. IEEE Lat. Am. Trans. 17, 1439\u20131448 (2019).","journal-title":"IEEE Lat. Am. Trans."},{"key":"51257_CR38","unstructured":"Grinberg, M. Flask Web Development (O\u2019Reilly Media, Inc., 2018)."},{"key":"51257_CR39","unstructured":"Crickard III, P. Leaflet js essentials (Packt Publishing Ltd, 2014)."},{"key":"51257_CR40","doi-asserted-by":"crossref","unstructured":"Sredojev, B., Samardzija, D. & Posarac, D. Webrtc technology overview and signaling solution design and implementation. In 2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) 1006\u20131009 (IEEE, 2015).","DOI":"10.1109\/MIPRO.2015.7160422"},{"key":"51257_CR41","first-page":"96","volume":"8","author":"DD Aboyomi","year":"2023","unstructured":"Aboyomi, D. D. & Daniel, C. A comparative analysis of modern object detection algorithms: Yolo vs. ssd vs. faster r-cnn. ITEJ Inf. Technol. Eng. J. 8, 96\u2013106 (2023).","journal-title":"ITEJ Inf. Technol. Eng. J."},{"key":"51257_CR42","unstructured":"Hinck, M., Olson, M.\u00a0L., Cobbley, D., Tseng, S.-Y. & Lal, V. Llava-gemma: Accelerating multimodal foundation models with a compact language model. arXiv preprint arXiv:2404.01331 (2024)."},{"key":"51257_CR43","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2024.104753","volume":"179","author":"A Abdelsalam","year":"2024","unstructured":"Abdelsalam, A., Mansour, M., Porras, J. & Happonen, A. Depth accuracy analysis of the zed 2i stereo camera in an indoor environment. Robot. Auton. Syst. 179, 104753 (2024).","journal-title":"Robot. Auton. Syst."},{"key":"51257_CR44","unstructured":"Zhang, C.\u00a0C., Wang, C., Dai, X. & Liu, S. Camera-based analysis of human pose for fall detection. In 2023 Congress in Computer Science, Computer Engineering, & Applied Computing (CSCE) 1779\u20131782 (IEEE, 2023)."},{"key":"51257_CR45","doi-asserted-by":"crossref","unstructured":"Wu, W.-C., Hsieh, C.-H., Huang, H.-C., Chen, O. T.-C. & Fang, Y.-J. Hearing aid system with 3d sound localization. In TENCON 2007-2007 IEEE Region 10 Conference 1\u20134 (IEEE, 2007).","DOI":"10.1109\/TENCON.2007.4428959"},{"key":"51257_CR46","doi-asserted-by":"crossref","unstructured":"J\u00fanior, M.\u00a0J., Maia, O.\u00a0B., Oliveira, H., Souto, E. & Barreto, R. Assistive technology through internet of things and edge computing. In 2019 IEEE 9th International Conference on Consumer Electronics (ICCE-Berlin) 330\u2013332 (IEEE, 2019).","DOI":"10.1109\/ICCE-Berlin47944.2019.8966148"},{"key":"51257_CR47","first-page":"20","volume":"2024","author":"MC McDonnall","year":"2024","unstructured":"McDonnall, M. C., Steverson, A. & Boydstun, J. Actual and preferred methods for learning to use assistive technology. Assist. Technol. Outcomes Benefits 2024, 20 (2024).","journal-title":"Assist. Technol. Outcomes Benefits"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-51257-9","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-51257-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-51257-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T15:49:45Z","timestamp":1783007385000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-51257-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,11]]},"references-count":47,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["51257"],"URL":"https:\/\/doi.org\/10.1038\/s41598-026-51257-9","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-8117793\/v1","asserted-by":"object"}]},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,11]]},"assertion":[{"value":"14 November 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 April 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 May 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"20335"}}