{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T01:46:09Z","timestamp":1760060769204,"version":"build-2065373602"},"reference-count":23,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2025,9,17]],"date-time":"2025-09-17T00:00:00Z","timestamp":1758067200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"JSPS KAKENHI","award":["23H03440"],"award-info":[{"award-number":["23H03440"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>This study introduces a mobile application designed to assist visually impaired persons (VIPs) in navigating complex environments, such as supermarkets. Recent assistive tools often identify objects in isolation without providing contextual awareness. In contrast, our proposed system uses seamless scene and object recognition to help users efficiently locate target items and understand their surroundings. Employing a \u201chuman-in-the-loop approach\u201d, users control their smartphone camera direction to explore the space. Experiments conducted in a simulated shopping environment show that the system enhances object-finding efficiency and improves user orientation. This approach not only increases independence, but also promotes inclusivity by enabling VIPs to perform everyday tasks with greater confidence and autonomy.<\/jats:p>","DOI":"10.3390\/info16090808","type":"journal-article","created":{"date-parts":[[2025,9,17]],"date-time":"2025-09-17T13:03:02Z","timestamp":1758114182000},"page":"808","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Smartphone-Based Seamless Scene and Object Recognition for Visually Impaired Persons"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-2830-497X","authenticated-orcid":false,"given":"Fisilmi Azizah","family":"Rahman","sequence":"first","affiliation":[{"name":"Graduate School of Science and Engineering, Saga University, Saga 840-8502, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-1825-6707","authenticated-orcid":false,"given":"Ferina Ayu","family":"Pusparani","sequence":"additional","affiliation":[{"name":"Graduate School of Science and Engineering, Saga University, Saga 840-8502, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1272-9010","authenticated-orcid":false,"given":"Wen Liang","family":"Yeoh","sequence":"additional","affiliation":[{"name":"Graduate School of Science and Engineering, Saga University, Saga 840-8502, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8022-7314","authenticated-orcid":false,"given":"Osamu","family":"Fukuda","sequence":"additional","affiliation":[{"name":"Graduate School of Science and Engineering, Saga University, Saga 840-8502, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,9,17]]},"reference":[{"key":"ref_1","unstructured":"Envision Technologies (2025, February 03). Envision AI. Available online: https:\/\/www.letsenvision.com."},{"key":"ref_2","unstructured":"Google (2025, February 03). Lookout\u2014Assisted Vision. Available online: https:\/\/play.google.com\/store\/apps\/details?id=com.google.android.apps.accessibility.reveal."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Rahman, F.A., Handayani, A.N., Takayanagi, M., He, Y., Fukuda, O., Yamaguchi, N., and Okumura, H. (2020, January 19\u201319). Assistive Device for Visual Impaired Person Based on Real Time Object Detection. Proceedings of the 2020 4th International Conference on Vocational Education and Training (ICOVET), Malang, Indonesia.","DOI":"10.1109\/ICOVET50258.2020.9230285"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Rahman, F.A., Yamaguchi, N., Handayani, A.N., Okumura, H., Yeoh, W.L., and Fukuda, O. (2023, January 23\u201325). The development of a smartphone application based on object detection and indoor navigation to assist visually impaired. Proceedings of the 2023 8th International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), Okinawa, Japan.","DOI":"10.1109\/ICIIBMS60103.2023.10347685"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1518\/001872095779049543","article-title":"Toward a Theory of Situation Awareness in Dynamic Systems","volume":"37","author":"Endsley","year":"1995","journal-title":"Hum. Factors"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Plikynas, D., \u017dvironas, A., Budrionis, A., and Gudauskis, M. (2020). Indoor Navigation Systems for Visually Impaired Persons: Mapping the Features of Existing Technologies to User Needs. Sensors, 20.","DOI":"10.3390\/s20030636"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1109\/THMS.2020.3016051","article-title":"Techniques for Constructing Indoor Navigation Systems for the Visually Impaired: A Review","volume":"50","author":"Kandalan","year":"2020","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"26712","DOI":"10.1109\/ACCESS.2021.3052415","article-title":"Analysis of Navigation Assistants for Blind and Visually Impaired People: A Systematic Review","volume":"9","author":"Khan","year":"2021","journal-title":"IEEE Access"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Yu, X., and Saniie, J. (2025). Visual Impairment Spatial Awareness System for Indoor Navigation and Daily Activities. J. Imaging, 11.","DOI":"10.3390\/jimaging11010009"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Brilli, D.D., Georgaras, E., Tsilivaki, S., Melanitis, N., and Nikita, K. (2024, January 1\u20134). AIris: An AI-Powered Wearable Assistive Device for the Visually Impaired. Proceedings of the 2024 10th IEEE RAS\/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob), Heidelberg, Germany.","DOI":"10.1109\/BioRob60516.2024.10719976"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Liu, H., Liu, R., Yang, K., Zhang, J., Peng, K., and Stiefelhagen, R. (2021). HIDA: Towards Holistic Indoor Understanding for the Visually Impaired via Semantic Instance Segmentation with a Wearable Solid-State LiDAR Sensor. arXiv.","DOI":"10.1109\/ICCVW54120.2021.00204"},{"key":"ref_12","unstructured":"BN, R., Guru, R., and A, A.M. (2024). Small Object Detection for Indoor Assistance to the Blind using YOLO NAS Small and Super Gradients. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Luan, X., Zhang, J., Xu, M., Silamu, W., and Li, Y. (2023). Lightweight Scene Text Recognition Based on Transformer. Sensors, 23.","DOI":"10.3390\/s23094490"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2140002","DOI":"10.1142\/S0218213021400029","article-title":"An Intelligent Mobile Application for Assisting Visually Impaired in Daily Consumption Based on Machine Learning with Assistive Technology","volume":"30","author":"Ng","year":"2021","journal-title":"Int. J. Artif. Intell. Tools"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Pratap, A., Kumar, S., and Chakravarty, S. (2025). Adaptive Object Detection for Indoor Navigation Assistance: A Performance Evaluation of Real-Time Algorithms. arXiv.","DOI":"10.2139\/ssrn.5112107"},{"key":"ref_16","unstructured":"Pfitzer, N., Zhou, Y., Poggensee, M., Kurtulus, D., Dominguez-Dager, B., Dusmanu, M., Pollefeys, M., and Bauer, Z. (2025). MR.NAVI: Mixed-Reality Navigation Assistant for the Visually Impaired. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Said, Y., Atri, M., Albahar, M.A., Ben Atitallah, A., and Alsariera, Y.A. (2023). Scene Recognition for Visually-Impaired People\u2019s Navigation Assistance Based on Vision Transformer with Dual Multiscale Attention. Mathematics, 11.","DOI":"10.3390\/math11051127"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Norkhalid, A.M., Faudzi, M.A., Ghapar, A.A., and Rahim, F.A. (2020, January 24\u201326). Mobile Application: Mobile Assistance for Visually Impaired People\u2014Speech Interface System (SIS). Proceedings of the 2020 8th International Conference on Information Technology and Multimedia (ICIMU), Selangor, Malaysia.","DOI":"10.1109\/ICIMU49871.2020.9243450"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1145\/3698151","article-title":"Audio-Vibratory You-Are-Here Mobile Maps for People with Visual Impairments","volume":"8","author":"Sargsyan","year":"2024","journal-title":"Proc. ACM Hum.-Comput. Interact."},{"key":"ref_20","unstructured":"Dwyer, B., Nelson, J., and Hansen, T. (2025, July 26). Roboflow (Version 1.0) [Software]. Available online: https:\/\/roboflow.com."},{"key":"ref_21","unstructured":"Google (2025, January 03). Android Studio. Available online: https:\/\/developer.android.com\/studio."},{"key":"ref_22","unstructured":"Flutter Team (2025, January 03). Flutter (Version 3.16.4). Cross-Platform Mobile Application Framework. Available online: https:\/\/flutter.dev."},{"key":"ref_23","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, D.S., Davis, A., Dean, J., and Devin, M. (2025, July 26). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. Available online: https:\/\/www.tensorflow.org."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/9\/808\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:47:07Z","timestamp":1760035627000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/9\/808"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,17]]},"references-count":23,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2025,9]]}},"alternative-id":["info16090808"],"URL":"https:\/\/doi.org\/10.3390\/info16090808","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2025,9,17]]}}}