{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:42:27Z","timestamp":1760233347973,"version":"build-2065373602"},"reference-count":29,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,12,27]],"date-time":"2022-12-27T00:00:00Z","timestamp":1672099200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Faculty of Management of Comenius University"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Modern technologies such as the Internet of Things (IoT) and physical systems used as navigation systems play an important role in locating a specific location in an unfamiliar environment. Due to recent technological developments, users can now incorporate these systems into mobile devices, which has a positive impact on the acceptance of navigational systems and the number of users who use them. The system that is used to find a specific location within a building is known as an indoor navigation system. In this study, we present a novel approach to adaptable and changeable multistory navigation systems that can be implemented in different environments such as libraries, grocery stores, shopping malls, and official buildings using facial and speech recognition with the help of voice broadcasting. We chose a library building for the experiment to help registered users find a specific book on different building floors. In the proposed system, to help the users, robots are placed on each floor of the building, communicating with each other, and with the person who needs navigational help. The proposed system uses an Android platform that consists of two separate applications: one for administration to add or remove settings and data, which in turn builds an environment map, while the second application is deployed on robots that interact with the users. The developed system was tested using two methods, namely system evaluation, and user evaluation. The evaluation of the system is based on the results of voice and face recognition by the user, and the model\u2019s performance relies on accuracy values obtained by testing out various values for the neural network parameters. The evaluation method adopted by the proposed system achieved an accuracy of 97.92% and 97.88% for both of the tasks. The user evaluation method using the developed Android applications was tested on multi-story libraries, and the results were obtained by gathering responses from users who interacted with the applications for navigation, such as to find a specific book. Almost all the users find it useful to have robots placed on each floor of the building for giving specific directions with automatic recognition and recall of what a person is searching for. The evaluation results show that the proposed system can be implemented in different environments, which shows its effectiveness.<\/jats:p>","DOI":"10.3390\/s23010275","type":"journal-article","created":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T05:31:54Z","timestamp":1672205514000},"page":"275","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["An Intelligent Multi-Floor Navigational System Based on Speech, Facial Recognition and Voice Broadcasting Using Internet of Things"],"prefix":"10.3390","volume":"23","author":[{"given":"Mahib","family":"Ullah","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xingmei","family":"Li","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1694-7317","authenticated-orcid":false,"given":"Muhammad Abul","family":"Hassan","sequence":"additional","affiliation":[{"name":"Department of Information Engineering and Computer Science, University of Trento, 38122 Trento, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6572-5326","authenticated-orcid":false,"given":"Farhat","family":"Ullah","sequence":"additional","affiliation":[{"name":"School of Automation, China University of Geosciences, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6224-392X","authenticated-orcid":false,"given":"Yar","family":"Muhammad","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Beihang University, Beijing 100191, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2439-277X","authenticated-orcid":false,"given":"Fabrizio","family":"Granelli","sequence":"additional","affiliation":[{"name":"Department of Information Engineering and Computer Science, University of Trento, 38122 Trento, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lucia","family":"Vilcekova","sequence":"additional","affiliation":[{"name":"Information Systems Department, Faculty of Management Comenius University in Bratislava, Odboj\u2019arov 10, 82005 Bratislava, Slovakia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0078-7849","authenticated-orcid":false,"given":"Tariq","family":"Sadad","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Engineering and Technology, Mardan 23200, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wu, T., Liu, J., Li, Z., Liu, K., and Xu, B. (2018). Accurate smartphone indoor visual positioning based on a high-precision 3D photorealistic map. Sensors, 18.","DOI":"10.3390\/s18061974"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Liao, X., Chen, R., Li, M., Guo, B., Niu, X., and Zhang, W. (2019). Design of a Smartphone Indoor Positioning Dynamic Ground Truth Reference System Using Robust Visual Encoded Targets. Sensors, 19.","DOI":"10.3390\/s19051261"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.isprsjprs.2019.02.014","article-title":"BIM-Tracker: A model-based visual tracking approach for indoor localisation using a 3D building model","volume":"150","author":"Acharya","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_4","first-page":"64","article-title":"Indoor localization improved by spatial context\u2014A survey","volume":"52","author":"Gu","year":"2019","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_5","first-page":"978","article-title":"Space location of image in urban environments based on C\/S structure","volume":"43","author":"Zhang","year":"2018","journal-title":"Geomat. Inf. Sci. Wuhan Univ."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"04001","DOI":"10.1051\/e3sconf\/202128004001","article-title":"Methods for developing an indoor navigation system","volume":"280","author":"Deliyska","year":"2021","journal-title":"E3S Web Conf."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Paiva, S. (2013). A Mobile and Web Indoor Navigation System: A Case Study in a University Environment. Advances in Information Systems and Technologies, Springer.","DOI":"10.1007\/978-3-642-36981-0_90"},{"key":"ref_8","first-page":"10515","article-title":"Indoor Navigation System","volume":"10","author":"Rajendra","year":"2015","journal-title":"Int. J. Appl. Eng. Res."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1186\/s13673-020-00222-0","article-title":"Indoor positioning and wayfinding systems: A survey","volume":"10","author":"Kunhoth","year":"2020","journal-title":"Hum. Cent. Comput. Inf. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Li, M., Chen, R., Liao, X., Guo, B., Zhang, W., and Guo, G. (2020). A Precise Indoor Visual Positioning Approach Using a Built Image Feature Database and Single User Image from Smartphone Cameras. Remote Sens., 5.","DOI":"10.3390\/rs12050869"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lluvia, I., Lazkano, E., and Ansuategi, A. (2021). Active Mapping and Robot Exploration: A Survey. Sensors, 21.","DOI":"10.3390\/s21072445"},{"key":"ref_12","unstructured":"Standard, I.I. (2019). Indoor navigation for personal and vehicle ITS station. Intelligent Transport Systems, ISO. [1st ed.]."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Heya, T.A., Arefin, S.E., Chakrabarty, A., and Alam, M. (2018, January 22\u201323). Image Processing Based Indoor Localization System for Assisting Visually Impaired People. Proceedings of the Ubiquitous Positioning, Indoor Navigation and Location-Based Services (UPINLBS), Wuhan, China.","DOI":"10.1109\/UPINLBS.2018.8559936"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"6756","DOI":"10.1109\/JSEN.2018.2847356","article-title":"A Smartphone-Based Pedestrian Dead Reckoning System With Multiple Virtual Tracking for Indoor Navigation","volume":"18","author":"Ju","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"702","DOI":"10.1109\/TMC.2018.2842751","article-title":"Vision-Based Mobile Indoor Assistive Navigation Aid for Blind People","volume":"18","author":"Li","year":"2019","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Labb\u00e9, M., and Michaud, F. (2014, January 14\u201318). Online global loop closure detection for large-scale multi-session graph-based SLAM. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA.","DOI":"10.1109\/IROS.2014.6942926"},{"key":"ref_17","unstructured":"Mcdonald, J., Kaess, M., Cadena, C., and Neira, J. (2011, January 7\u20139). 6-DOF Multi-session Visual SLAM using Anchor Node. Proceedings of the European Conference on Mobile Robots, \u00d6rebro, Sweden."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhang, D., Xia, F., Yang, Z., Yao, L., and Zhao, W. (2010, January 21\u201323). Localization Technologies for Indoor Human Tracking. Proceedings of the 5th International Conference on Future Information Technology, Busan, Korea.","DOI":"10.1109\/FUTURETECH.2010.5482731"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1067","DOI":"10.1109\/TSMCC.2007.905750","article-title":"Survey of Wireless Indoor Positioning Techniques and Systems","volume":"37","author":"Liu","year":"2007","journal-title":"IEEE Trans. Syst. Man Cybern. Part C Appl. Rev."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Dayekh, C. (2010, January 18\u201321). Cooperative Localization in Mines Using Fingerprinting and Neural Networks. Proceedings of the IEEE Wireless Communication and Networking Conference, Sydney, Australia.","DOI":"10.1109\/WCNC.2010.5506666"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Morar, A.A. (2020). A Comprehensive Survey of Indoor Localization Methods Based on Computer Vision. Sensors, 20.","DOI":"10.3390\/s20092641"},{"key":"ref_22","first-page":"31","article-title":"Smart Voice Assistant for Library System","volume":"2","author":"Kumar","year":"2020","journal-title":"Int. Res. J. Multidiscip. Technovation"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2341","DOI":"10.1007\/s10664-019-09754-1","article-title":"Third-party libraries in mobile apps: When, how, and why developers update them","volume":"25","author":"Salza","year":"2019","journal-title":"Empir. Softw. Eng."},{"key":"ref_24","unstructured":"Farhoodfar, A. (2019, January 24). Machine Learning for Mobile Developers: Tensorflow Lite Framework. Proceedings of the IEEE Consumer Electronics Society SCV, Santa Clara, CA, USA."},{"key":"ref_25","first-page":"18","article-title":"Text-to-Speech Recognition using Google API","volume":"183","author":"Orochi","year":"2021","journal-title":"Int. J. Comput. Appl."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kendall, A., and Cipolla, R. (2016, January 16\u201321). Modelling uncertainty in deep learning for camera relocalization. Proceedings of the 2016 IEEE international conference on Robotics and Automation (ICRA), Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487679"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1109\/LGRS.2017.2781741","article-title":"Remote sensing image registration using convolutional neural network features","volume":"15","author":"Ye","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1224","DOI":"10.1109\/TPAMI.2017.2709749","article-title":"SIFT meets CNN: A decade survey of instance retrieval","volume":"40","author":"Zheng","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.isprsjprs.2019.02.020","article-title":"BIM-PoseNet: Indoor camera localisation using a 3D indoor model and deep learning from synthetic images","volume":"150","author":"Acharya","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/275\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:52:34Z","timestamp":1760147554000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/275"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,27]]},"references-count":29,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23010275"],"URL":"https:\/\/doi.org\/10.3390\/s23010275","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,12,27]]}}}