{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T15:27:41Z","timestamp":1774884461487,"version":"3.50.1"},"reference-count":56,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2022,3,20]],"date-time":"2022-03-20T00:00:00Z","timestamp":1647734400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the Joint fund of Science and Technology Department of Liaoning Province and State Key Laboratory of Robotics, China","award":["2020-KF-22-16"],"award-info":[{"award-number":["2020-KF-22-16"]}]},{"name":"the The Key Research and Development program of Anhui Province of China","award":["202104a05020043"],"award-info":[{"award-number":["202104a05020043"]}]},{"name":"the Open Projects Program of National Laboratory of Pattern Recognition","award":["202100040"],"award-info":[{"award-number":["202100040"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Visual navigation is of vital importance for autonomous mobile robots. Most existing practical perception-aware based visual navigation methods generally require prior-constructed precise metric maps, and learning-based methods rely on large training to improve their generality. To improve the reliability of visual navigation, in this paper, we propose a novel object-level topological visual navigation method. Firstly, a lightweight object-level topological semantic map is constructed to release the dependence on the precise metric map, where the semantic associations between objects are stored via graph memory and topological organization is performed. Then, we propose an object-based heuristic graph search method to select the global topological path with the optimal and shortest characteristics. Furthermore, to reduce the global cumulative error, a global path segmentation strategy is proposed to divide the global topological path on the basis of active visual perception and object guidance. Finally, to achieve adaptive smooth trajectory generation, a Bernstein polynomial-based smooth trajectory refinement method is proposed by transforming trajectory generation into a nonlinear planning problem, achieving smooth multi-segment continuous navigation. Experimental results demonstrate the feasibility and efficiency of our method on both simulation and real-world scenarios. The proposed method also obtains better navigation success rate (SR) and success weighted by inverse path length (SPL) than the state-of-the-art methods.<\/jats:p>","DOI":"10.3390\/s22062387","type":"journal-article","created":{"date-parts":[[2022,3,20]],"date-time":"2022-03-20T21:37:17Z","timestamp":1647812237000},"page":"2387","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Object-Based Reliable Visual Navigation for Mobile Robot"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2954-1113","authenticated-orcid":false,"given":"Fan","family":"Wang","sequence":"first","affiliation":[{"name":"Anhui Institute of Optics and Fine Mechanics, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"},{"name":"Science Island Branch of Graduate School, University of Science and Technology of China, Hefei 230026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5306-2577","authenticated-orcid":false,"given":"Chaofan","family":"Zhang","sequence":"additional","affiliation":[{"name":"Anhui Institute of Optics and Fine Mechanics, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wen","family":"Zhang","sequence":"additional","affiliation":[{"name":"Anhui Institute of Optics and Fine Mechanics, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cuiyun","family":"Fang","sequence":"additional","affiliation":[{"name":"Anhui Institute of Optics and Fine Mechanics, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"},{"name":"Science Island Branch of Graduate School, University of Science and Technology of China, Hefei 230026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yingwei","family":"Xia","sequence":"additional","affiliation":[{"name":"Anhui Institute of Optics and Fine Mechanics, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yong","family":"Liu","sequence":"additional","affiliation":[{"name":"Anhui Institute of Optics and Fine Mechanics, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hao","family":"Dong","sequence":"additional","affiliation":[{"name":"China National Tobacco Quality Supervision Test Center, Zhengzhou 450001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zhang, C., Liu, Y., Wang, F., Xia, Y., and Zhang, W. (2018). Vins-mkf: A tightly-coupled multi-keyframe visual-inertial odometry for accurate and robust state estimation. Sensors, 18.","DOI":"10.3390\/s18114036"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Milstein, A. (2008). Occupancy grid maps for localization and mapping. Motion Plan, InTech.","DOI":"10.5772\/6003"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Liu, Y., Bao, L., Zhang, C., Zhang, W., and Xia, Y. (2019, January 4\u20136). Accurate and robust RGB-D dense mapping with inertial fusion and deformation-graph optimization. Proceedings of the 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI), Portland, OR, USA.","DOI":"10.1109\/ICTAI.2019.00249"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1309","DOI":"10.1109\/TRO.2016.2624754","article-title":"Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age","volume":"32","author":"Cadena","year":"2016","journal-title":"IEEE Trans. Robot."},{"key":"ref_5","unstructured":"Chaplot, D.S., Salakhutdinov, R., Gupta, A., and Gupta, S. (2020, January 14\u201319). Neural topological slam for visual navigation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA."},{"key":"ref_6","unstructured":"Chen, T., Gupta, S., and Gupta, A. (2019). Learning exploration policies for navigation. arXiv."},{"key":"ref_7","unstructured":"Chaplot, D.S., Gandhi, D., Gupta, S., Gupta, A., and Salakhutdinov, R. (2020). Learning to explore using active neural slam. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Garg, S., S\u00fcnderhauf, N., Dayoub, F., Morrison, D., Cosgun, A., Carneiro, G., Wu, Q., Chin, T.J., Reid, I., and Gould, S. (2021). Semantics for robotic mapping, perception and interaction: A survey. arXiv.","DOI":"10.1561\/9781680837698"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sun, N., Yang, E., Corney, J., and Chen, Y. (2019). Semantic path planning for indoor navigation and household tasks. Annual Conference towards Autonomous Robotic Systems, Springer.","DOI":"10.1007\/978-3-030-25332-5_17"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Vasilopoulos, V., Pavlakos, G., Bowman, S.L., Caporale, J., Daniilidis, K., Pappas, G.J., and Koditschek, D.E. (2020). Technical report: Reactive semantic planning in unexplored semantic environments using deep perceptual feedback. arXiv.","DOI":"10.1109\/LRA.2020.3001496"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Klaas, T., Lambrecht, J., and Funk, E. (2020, January 8\u201311). Semantic Local Planning for Mobile Robots through Path Optimization Services on the Edge: A Scenario-based Evaluation. Proceedings of the 2020 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Vienna, Austria.","DOI":"10.1109\/ETFA46521.2020.9212092"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/s10514-018-9724-7","article-title":"Topological local-metric framework for mobile robots navigation: A long term perspective","volume":"43","author":"Tang","year":"2019","journal-title":"Auton. Robot."},{"key":"ref_13","unstructured":"Wang, F., Zhang, C., Tang, F., Jiang, H., Wu, Y., and Liu, Y. (2022). Lightweight Object-level Topological Semantic Mapping and Long-term Global Localization based on Graph Matching. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Gao, F., Wu, W., Lin, Y., and Shen, S. (2018, January 21\u201325). Online safe trajectory generation for quadrotors using fast marching method and bernstein basis polynomial. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8462878"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Kielas-Jensen, C., and Cichella, V. (2019, January 3\u20138). BeBOT: Bernstein polynomial toolkit for trajectory generation. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), The Venetian Macao, Macau.","DOI":"10.1109\/IROS40897.2019.8967564"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1874","DOI":"10.1109\/TRO.2021.3075644","article-title":"ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual\u2013Inertial, and Multimap SLAM","volume":"37","author":"Campos","year":"2021","journal-title":"IEEE Trans. Robot."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"8681","DOI":"10.1109\/LRA.2021.3113987","article-title":"A Point-Line VIO System With Novel Feature Hybrids and with Novel Line Predicting-Matching","volume":"6","author":"Wei","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wang, F., Zhang, C., Zhang, G., Liu, Y., Xia, Y., and Yang, X. (2021, January 27\u201331). PLMCVIO: Point-Line based Multi-Camera Visual Inertial Odometry. Proceedings of the 2021 IEEE 11th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER), Jiaxian, China.","DOI":"10.1109\/CYBER53097.2021.9588162"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"106981","DOI":"10.1109\/ACCESS.2021.3100426","article-title":"RDMO-SLAM: Real-time visual SLAM for dynamic environments using semantic label prediction with optical flow","volume":"9","author":"Liu","year":"2021","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"108225","DOI":"10.1016\/j.patcog.2021.108225","article-title":"Blitz-SLAM: A semantic SLAM in dynamic environments","volume":"121","author":"Fan","year":"2022","journal-title":"Pattern Recognit."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yang, S., and Scherer, S. (2018). CubeSLAM: Monocular 3D object detection and SLAM without prior models. arXiv.","DOI":"10.1109\/TRO.2019.2909168"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Salas-Moreno, R.F., Newcombe, R.A., Strasdat, H., Kelly, P.H., and Davison, A.J. (2013, January 23\u201328). Slam++: Simultaneous localisation and mapping at the level of objects. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.178"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1051","DOI":"10.1109\/TRO.2010.2081410","article-title":"Pure topological mapping in mobile robotics","volume":"26","author":"Marinakis","year":"2010","journal-title":"IEEE Trans. Robot."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Lui, W.L.D., and Jarvis, R. (2010, January 18\u201322). A pure vision-based approach to topological SLAM. Proceedings of the 2010 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan.","DOI":"10.1109\/IROS.2010.5651115"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1133","DOI":"10.1007\/s10514-017-9682-5","article-title":"Long-term online multi-session graph-based SPLAM with memory management","volume":"42","author":"Michaud","year":"2018","journal-title":"Auton. Robot."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1109\/70.928558","article-title":"Topological simultaneous localization and mapping (SLAM): Toward exact localization without explicit localization","volume":"17","author":"Choset","year":"2001","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Liu, Y., Petillot, Y., Lane, D., and Wang, S. (2019, January 20\u201324). Global localization with object-level semantics and topology. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794475"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"S\u00e1nchez-Ib\u00e1\u00f1ez, J.R., P\u00e9rez-del-Pulgar, C.J., and Garc\u00eda-Cerezo, A. (2021). Path Planning for Autonomous Mobile Robots: A Review. Sensors, 21.","DOI":"10.3390\/s21237898"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1109\/ACCESS.2014.2302442","article-title":"Sampling-based robot motion planning: A review","volume":"2","author":"Elbanhawi","year":"2014","journal-title":"IEEE Access"},{"key":"ref_30","unstructured":"Lavalle, S.M. (1998). Rapidly-exploring random trees: A new tool for path planning. Comput. Sci. Dept. Oct., 98."},{"key":"ref_31","unstructured":"Kuffner, J.J., and LaValle, S.M. (2000, January 24\u201328). RRT-connect: An efficient approach to single-query path planning. Proceedings of the IEEE International Conference on Robotics and Automation, Symposia Proceedings (Cat. No. 00CH37065), San Francisco, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"846","DOI":"10.1177\/0278364911406761","article-title":"Sampling-based algorithms for optimal motion planning","volume":"30","author":"Karaman","year":"2011","journal-title":"Int. J. Robot. Res."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1109\/70.508439","article-title":"Probabilistic roadmaps for path planning in high-dimensional configuration spaces","volume":"12","author":"Kavraki","year":"1996","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1109\/MRA.2013.2248309","article-title":"Fast Marching Method for safer, more efficient mobile robot trajectories","volume":"20","author":"Valero","year":"2013","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_35","first-page":"97","article-title":"Optimal path planning using RRT* based approaches: A survey and future directions","volume":"7","author":"Noreen","year":"2016","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1007\/BF01386390","article-title":"A note on two problems in connexion with graphs","volume":"1","author":"Dijkstra","year":"1959","journal-title":"Numer. Math."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1109\/TSSC.1968.300136","article-title":"A formal basis for the heuristic determination of minimum cost paths","volume":"4","author":"Hart","year":"1968","journal-title":"IEEE Trans. Syst. Sci. Cybern."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Stentz, A. (1997). Optimal and efficient path planning for partially known environments. Intelligent Unmanned Ground Vehicles, Springer.","DOI":"10.1007\/978-1-4615-6325-9_11"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.artint.2003.12.001","article-title":"Lifelong planning A*","volume":"155","author":"Koenig","year":"2004","journal-title":"Artif. Intell."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1177\/0278364909359210","article-title":"Path planning for autonomous vehicles in unknown semi-structured environments","volume":"29","author":"Dolgov","year":"2010","journal-title":"Int. J. Robot. Res."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Ratliff, N., Zucker, M., Bagnell, J.A., and Srinivasa, S. (2009, January 12\u201317). CHOMP: Gradient optimization techniques for efficient motion planning. Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan.","DOI":"10.1109\/ROBOT.2009.5152817"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Berg, J., Patil, S., and Alterovitz, R. (2017). Motion planning under uncertainty using differential dynamic programming in belief space. Robotics Research, Springer.","DOI":"10.1007\/978-3-319-29363-9_27"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1062","DOI":"10.1177\/0278364917741532","article-title":"Hold or take optimal plan (hoop): A quadratic programming approach to multi-robot trajectory generation","volume":"37","author":"Tang","year":"2018","journal-title":"Int. J. Robot. Res."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Mellinger, D., and Kumar, V. (2011, January 9\u201313). Minimum snap trajectory generation and control for quadrotors. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980409"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1017\/S0263574712000331","article-title":"Reactive and the shortest path navigation of a wheeled mobile robot in cluttered environments","volume":"31","author":"Savkin","year":"2013","journal-title":"Robotica"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1992","DOI":"10.1109\/TRO.2021.3071527","article-title":"Raptor: Robust and perception-aware trajectory replanning for quadrotor fast flight","volume":"37","author":"Zhou","year":"2021","journal-title":"IEEE Trans. Robot."},{"key":"ref_47","unstructured":"Kielas-Jensen, C., and Cichella, V. (2020). Bernstein polynomial-based transcription method for solving optimal trajectory generation problems. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Ding, Z., Han, X., and Niethammer, M. (2019, January 13\u201317). VoteNet: A deep learning label fusion method for multi-atlas segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Shenzhen, China.","DOI":"10.1007\/978-3-030-32248-9_23"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"4338","DOI":"10.1109\/TPAMI.2020.3005434","article-title":"Deep learning for 3d point clouds: A survey","volume":"43","author":"Guo","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Dai, A., Chang, A.X., Savva, M., Halber, M., Funkhouser, T., and Nie\u00dfner, M. (2017, January 21\u201326). Scannet: Richly-annotated 3d reconstructions of indoor scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.261"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Song, S., Lichtenberg, S.P., and Xiao, J. (2015, January 7\u201312). Sun rgb-d: A rgb-d scene understanding benchmark suite. Proceedings of the IEEE conference on computer vision and pattern recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298655"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1349","DOI":"10.1109\/34.895972","article-title":"Content-based image retrieval at the end of the early years","volume":"22","author":"Smeulders","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1109\/34.67632","article-title":"The perspective view of three points","volume":"13","author":"Wolfe","year":"1991","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Xia, F., Zamir, A.R., He, Z., Sax, A., Malik, J., and Savarese, S. (2018, January 18\u201323). Gibson env: Real-world perception for embodied agents. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00945"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1109\/100.580977","article-title":"The dynamic window approach to collision avoidance","volume":"4","author":"Fox","year":"1997","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_56","unstructured":"Batra, D., Gokaslan, A., Kembhavi, A., Maksymets, O., Mottaghi, R., Savva, M., Toshev, A., and Wijmans, E. (2020). Objectnav revisited: On evaluation of embodied agents navigating to objects. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/6\/2387\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:39:48Z","timestamp":1760135988000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/6\/2387"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,20]]},"references-count":56,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["s22062387"],"URL":"https:\/\/doi.org\/10.3390\/s22062387","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,20]]}}}