{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:12:30Z","timestamp":1760238750460,"version":"build-2065373602"},"reference-count":60,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2020,8,26]],"date-time":"2020-08-26T00:00:00Z","timestamp":1598400000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this paper, we present a navigation strategy exclusively designed for social robots with limited sensors for applications in homes. The overall system integrates a reactive design based on subsumption architecture and a knowledge system with learning capabilities. The component of the system includes several modules, such as doorway detection and room localization via convolutional neural network (CNN), avoiding obstacles via reinforcement learning, passing the doorway via Canny edge\u2019s detection, building an abstract map called a Directional Semantic Topological Map (DST-Map) within the knowledge system, and other predefined layers within the subsumption architecture. The individual modules and the overall system are evaluated in a virtual environment using Webots simulator.<\/jats:p>","DOI":"10.3390\/s20174815","type":"journal-article","created":{"date-parts":[[2020,8,26]],"date-time":"2020-08-26T09:05:37Z","timestamp":1598432737000},"page":"4815","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Sequential Localizing and Mapping: A Navigation Strategy via Enhanced Subsumption Architecture"],"prefix":"10.3390","volume":"20","author":[{"given":"Kamal M.","family":"Othman","sequence":"first","affiliation":[{"name":"Autonomous and Intelligent Systems Laboratory, School of Mechatronic Systems Engineering Simon Fraser University, Surrey, BC V3T 0A3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ahmad B.","family":"Rad","sequence":"additional","affiliation":[{"name":"Autonomous and Intelligent Systems Laboratory, School of Mechatronic Systems Engineering Simon Fraser University, Surrey, BC V3T 0A3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,26]]},"reference":[{"key":"ref_1","unstructured":"Sony (2020, April 15). Aibo Unleash Wonder. Available online: https:\/\/us.aibo.com."},{"key":"ref_2","unstructured":"SoftBank Robotics (2020, April 15). Nao Humanoid Robot. Available online: https:\/\/www.softbankrobotics.com\/emea\/en\/nao."},{"key":"ref_3","unstructured":"SoftBank Robotics (2020, April 15). Pepper the Humanoid and Programmable Robot. Available online: https:\/\/www.softbankrobotics.com\/emea\/en\/pepper."},{"key":"ref_4","unstructured":"University of Hertfordshire (2020, April 15). Kaspar the Social Robot. Available online: https:\/\/www.herts.ac.uk\/kaspar\/the-social-robot."},{"key":"ref_5","first-page":"99","article-title":"Simultaneous localization and mapping (SLAM): Part I the Essential Algorithms","volume":"2","author":"Bailey","year":"2006","journal-title":"Robot. Autom. Mag."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/JRA.1986.1087032","article-title":"A robust layered control system for a mobile robot","volume":"2","author":"Brooks","year":"1986","journal-title":"IEEE J. Robot. Autom."},{"key":"ref_7","unstructured":"Yamauchi, B. (1997, January 10\u201311). Frontier-based approach for autonomous exploration. Proceedings of the IEEE International Symposium on Computational Intelligence in Robotics and Automation, Monterey, CA, USA."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Umari, H., and Mukhopadhyay, S. (2017, January 24\u201328). Autonomous robotic exploration based on multiple rapidly-exploring randomized trees. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8202319"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1109\/34.584097","article-title":"Autonomous exploration: Driven by uncertainty","volume":"19","author":"Whaite","year":"1997","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Stachniss, C., Grisetti, G., and Burgard, W. (2005, January 8\u201311). Information gain-based exploration using rao-blackwellized particle filters. Proceedings of the Robotics: Science and Systems, Cambridge, MA, USA.","DOI":"10.15607\/RSS.2005.I.009"},{"key":"ref_11","unstructured":"Jadidi, M.G., Miro, J.V., and Dissanayake, G. (October, January 28). Mutual information-based exploration on continuous occupancy maps. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Hamburg, Germany."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Bai, S., Chen, F., and Englot, B. (2017, January 24\u201328). Toward autonomous mapping and exploration for mobile robots through deep supervised learning. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8206050"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Shrestha, R., Tian, F.P., Feng, W., Tan, P., and Vaughan, R. (2019, January 20\u201324). Learned map prediction for enhanced mobile robot exploration. Proceedings of the IEEE International Conference on Robotics and Automation, Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793769"},{"key":"ref_14","first-page":"363","article-title":"The SLAM problem: A survey","volume":"184","author":"Aulinas","year":"2008","journal-title":"Front. Artif. Intell. Appl."},{"key":"ref_15","unstructured":"Ho, T.S., Fai, Y.C., and Ming, E.S.L. (June, January 31). Simultaneous localization and mapping survey based on filtering techniques. Proceedings of the 2015 10th Asian Control Conference: Emerging Control Techniques for a Sustainable World, ASCC 2015, Sabah, Malaysia."},{"key":"ref_16","unstructured":"Milford, M.J., Wyeth, G.F., and Prasser, D. (May, January 26). RatSLAM: A hippocampal model for simultaneous localization and mapping. Proceedings of the IEEE International Conference on Robotics and Automation, New Orleans, LA, USA."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1131","DOI":"10.1177\/0278364909340592","article-title":"Persistent navigation and mapping using a biologically inspired slam system","volume":"29","author":"Milford","year":"2010","journal-title":"Int. J. Robot. Res."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Steckel, J., and Peremans, H. (2013). BatSLAM: Simultaneous Localization and Mapping Using Biomimetic Sonar. PLoS ONE.","DOI":"10.1371\/journal.pone.0054076"},{"key":"ref_19","first-page":"169","article-title":"A review of control architectures for autonomous navigation of mobile robots","volume":"6","author":"Nakhaeinia","year":"2011","journal-title":"Int. J. Phys. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1006\/anbe.2000.1606","article-title":"Animal cognition and animal behaviour","volume":"61","author":"Shettleworth","year":"2001","journal-title":"Anim. Behav."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/S0921-8890(05)80031-4","article-title":"Integrating behavioral, perceptual, and world knowledge in reactive navigation","volume":"6","author":"Arkin","year":"1990","journal-title":"Robot. Auton. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1177\/027836498600500106","article-title":"Real-time obstacle avoidance for manipulators and mobile robots","volume":"5","author":"Khatib","year":"1986","journal-title":"Int. J. Robot. Res."},{"key":"ref_23","unstructured":"Arkin, R.C. (1998). Behavior-Based Robotics, MIT Press."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/S0888-613X(00)00056-6","article-title":"Fuzzy behaviors for mobile robot navigation: Design, coordination and fusion","volume":"25","author":"Aguirre","year":"2000","journal-title":"Int. J. Approx. Reason."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1016\/j.knosys.2011.11.009","article-title":"A new hybrid navigation algorithm for mobile robots in environments with incomplete knowledge","volume":"27","author":"Zhu","year":"2012","journal-title":"Knowl. Based Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Karim, S., Sonenberg, L., and Tan, A.H. (2006, January 7\u201311). A hybrid architecture combining reactive plan execution and reactive learning. Proceedings of the 9th Biennial Pacific Rim International Conference on Artificial Intelligence (PRICAI), Guilin, China.","DOI":"10.1007\/978-3-540-36668-3_23"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"8477","DOI":"10.1016\/j.eswa.2011.01.045","article-title":"A hybrid agent architecture integrating desire, intention and reinforcement learning","volume":"38","author":"Tan","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1109\/70.143349","article-title":"Integration of representation into goal-driven behavior-based robots","volume":"8","author":"Mataric","year":"1992","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1007\/s10514-006-7231-8","article-title":"A purely reactive navigation scheme for dynamic environments using Case-Based Reasoning","volume":"21","author":"Urdiales","year":"2006","journal-title":"Auton. Robot."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"012025","DOI":"10.1088\/1742-6596\/285\/1\/012025","article-title":"Navigation towards a goal position: From reactive to generalised learned control","volume":"285","author":"Selvatici","year":"2011","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_31","unstructured":"Hendzel, Z., and Szuster, M. (May, January 29). Neural dynamic programming in reactive navigation of wheeled mobile robot. Proceedings of the International Conference on Artificial Intelligence and Soft Computing, Zakopane, Poland."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3583","DOI":"10.1109\/LRA.2018.2853801","article-title":"Reactive Magnetic-Field-Inspired navigation method for robots in unknown convex 3-D environments","volume":"3","author":"Ataka","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"de Cubber, G., Berrabah, S.A., Doroftei, D., Baudoin, Y., and Sahli, H. (2010). Combining dense structure from motion and visual SLAM in a behavior-based robot control architecture. Int. J. Adv. Robot. Syst.","DOI":"10.5772\/7240"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"G\u00f3mez-Anaya, D., Munguia, R., Guerra, E., and Grau, A. (2014, January 16\u201319). Full autonomous navigation for an aerial robot using behavior-based control motion and SLAM. Proceedings of the 2014 IEEE Emerging Technology and Factory Automation (ETFA), Barcelona, Spain.","DOI":"10.1109\/ETFA.2014.7005240"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.ifacol.2015.12.033","article-title":"SLAM-Based Spatial Memory for Behavior-Based Robots","volume":"48","author":"Jiang","year":"2015","journal-title":"IFAC-PapersOnLine"},{"key":"ref_36","unstructured":"(2019, November 10). Webots. Available online: https:\/\/cyberbotics.com."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Othman, K.M., and Rad, A.B. (2019). An Indoor Room Classification System for Social Robots via Integration of CNN and ECOC. Appl. Sci., 9.","DOI":"10.3390\/app9030470"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Othman, K.M., and Rad, A.B. (2020). SRIN: A New Dataset for Social Robot Indoor Navigation. Glob. J. Eng. Sci., 4.","DOI":"10.33552\/GJES.2020.04.000596"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/S0921-8890(05)80025-9","article-title":"Elephants don\u2019t play chess","volume":"6","author":"Brooks","year":"1990","journal-title":"Robot. Auton. Syst."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1007\/s10462-009-9094-9","article-title":"Integrated cognitive architectures: A survey","volume":"28","author":"Chong","year":"2007","journal-title":"Artif. Intell. Rev."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Zal, F., Chen, T.S., Chi, S.W., and Kuo, C.H. (June, January 31). Fuzzy controller based subsumption behavior architecture for autonomous robotic wheelchair. Proceedings of the 2013 International Conference on Advanced Robotics Intelligent Systems ARIS 2013, Tainan, Taiwan.","DOI":"10.1109\/ARIS.2013.6573552"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/s10710-014-9229-x","article-title":"Evolving robot sub-behaviour modules using Gene Expression Programming","volume":"16","author":"Mwaura","year":"2014","journal-title":"Genet. Program. Evolvable Mach."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Thompson, T., Milne, F., Andrew, A., and Levine, J. (2009, January 7\u201310). Improving control through subsumption in the EvoTanks domain. Proceedings of the CIG2009\u20142009 IEEE Symposium on Computational Intelligence and Games, Milano, Italy.","DOI":"10.1109\/CIG.2009.5286452"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Brooks, R.A., and Mataric, M.J. (1993). Real robots, real learning problems. Robot Learning, Kluwer Academic Publishers.","DOI":"10.1007\/978-1-4615-3184-5_8"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1016\/0004-3702(92)90058-6","article-title":"Automatic programming of behavior-based robots using reinforcement learning","volume":"55","author":"Mahadevan","year":"1992","journal-title":"Artif. Intell."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1023\/A:1008819414322","article-title":"Reinforcement Learning in the Multi-Robot Domain","volume":"4","author":"Mataric","year":"1997","journal-title":"Auton. Robots"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"999","DOI":"10.1109\/TSMCA.2012.2183349","article-title":"Fusion of Multiple Behaviors Using Layered Reinforcement Learning","volume":"42","author":"Hwang","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern. Part A Syst. Hum."},{"key":"ref_48","first-page":"473","article-title":"Behaviors Coordination and Learning on Autonomous Navigation of Physical Robot","volume":"9","author":"Wicaksono","year":"2013","journal-title":"TELKOMNIKA Telecommun. Comput. Electron. Control"},{"key":"ref_49","unstructured":"Sutton, R.S. (1984). Temporal Credit Assignment in Reinforcement Learning. [Ph.D. Thesis, University of Massachusetts]."},{"key":"ref_50","unstructured":"Pearce, J.M. (1997). Animal Learning and Cognition: An Introduction, Psychology Press. [3rd ed.]."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Terry, W.S. (2017). Learning and Memory\u2014Basic Principles, Processes, and Procedures, Routledge.","DOI":"10.4324\/9781315622781"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1054","DOI":"10.1109\/TNN.1998.712192","article-title":"Reinforcement learning: An introduction","volume":"9","author":"Sutton","year":"1998","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_53","first-page":"1","article-title":"Algorithms for reinforcement learning","volume":"4","year":"2010","journal-title":"Synth. Lect. Artif. Intell. Mach. Learn."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Othman, K.M., and Rad, A.B. (2020). A Doorway Detection and Direction (3Ds) System for Social Robots via a Monocular Camera. Sensors, 20.","DOI":"10.3390\/s20092477"},{"key":"ref_55","unstructured":"(2019, December 01). Nao Documentation. Available online: http:\/\/doc.aldebaran.com\/2-1\/home_nao.html."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1017\/S0263574713001070","article-title":"Topological simultaneous localization and mapping: A survey","volume":"32","author":"Boal","year":"2014","journal-title":"Robotica"},{"key":"ref_57","unstructured":"Chollet, F. (2020, August 24). Keras Documentation. Available online: https:\/\/keras.io."},{"key":"ref_58","unstructured":"(2020, August 24). Compute Canada. Available online: https:\/\/www.computecanada.ca."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A Computational Approach to Edge Detection","volume":"8","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/S0734-189X(88)80033-1","article-title":"A survey of the hough transform","volume":"44","author":"Illingworth","year":"1988","journal-title":"Comput. Vis. Graph. Image Process."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/17\/4815\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:06:53Z","timestamp":1760177213000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/17\/4815"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,26]]},"references-count":60,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["s20174815"],"URL":"https:\/\/doi.org\/10.3390\/s20174815","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,8,26]]}}}