{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:13:19Z","timestamp":1760231599184,"version":"build-2065373602"},"reference-count":42,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2022,9,30]],"date-time":"2022-09-30T00:00:00Z","timestamp":1664496000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&amp;D Program of China","doi-asserted-by":"publisher","award":["2021YFC2201902","202234"],"award-info":[{"award-number":["2021YFC2201902","202234"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Tianjin Transportation Science and Technology Development Plan","award":["2021YFC2201902","202234"],"award-info":[{"award-number":["2021YFC2201902","202234"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Loop closure detection is an important component of Simultaneous Localization and Mapping (SLAM). In this paper, a novel two-branch loop closure detection algorithm unifying deep Convolutional Neural Network (ConvNet) features and semantic edge features is proposed. In detail, we use one feature extraction module to extract both ConvNet and semantic edge features simultaneously. The deep ConvNet features are subjected to a Context Feature Enhancement (CFE) module in the global feature ranking branch to generate a representative global feature descriptor. Concurrently, to reduce the interference of dynamic features, the extracted semantic edge information of landmarks is encoded through the Vector of Locally Aggregated Descriptors (VLAD) framework in the semantic edge feature ranking branch to form semantic edge descriptors. Finally, semantic, visual, and geometric information is integrated by the similarity score fusion calculation. Extensive experiments on six public datasets show that the proposed approach can achieve competitive recall rates at 100% precision compared to other state-of-the-art methods.<\/jats:p>","DOI":"10.3390\/rs14194885","type":"journal-article","created":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T03:07:28Z","timestamp":1665371248000},"page":"4885","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Unifying Deep ConvNet and Semantic Edge Features for Loop Closure Detection"],"prefix":"10.3390","volume":"14","author":[{"given":"Jie","family":"Jin","sequence":"first","affiliation":[{"name":"School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3962-4748","authenticated-orcid":false,"given":"Jiale","family":"Bai","sequence":"additional","affiliation":[{"name":"School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0271-044X","authenticated-orcid":false,"given":"Yan","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China"}]},{"given":"Jiani","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Palomeras, N., Carreras, M., and Andrade-Cetto, J. (2019). Active SLAM for Autonomous Underwater Exploration. Remote Sens., 11.","DOI":"10.3390\/rs11232827"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1309","DOI":"10.1109\/TRO.2016.2624754","article-title":"Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age","volume":"32","author":"Cadena","year":"2016","journal-title":"IEEE Trans. Robot."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1007\/s11263-006-0020-1","article-title":"Detecting Loop Closure with Scene Sequences","volume":"74","author":"Ho","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1699","DOI":"10.1109\/TPAMI.2011.41","article-title":"Automatic Relocalization and Loop Closing for Real-Time Monocular SLAM","volume":"33","author":"Williams","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Sivic, J., and Zisserman, A. (2003, January 13\u201316). Video Google: A text retrieval approach to object matching in videos. Proceedings of the IEEE International Conference on Computer Vision, Nice, France.","DOI":"10.1109\/ICCV.2003.1238663"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1704","DOI":"10.1109\/TPAMI.2011.235","article-title":"Aggregating Local Image Descriptors into Compact Codes","volume":"34","author":"Jegou","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Perronnin, F., and Dance, C. (2007, January 17\u201322). Fisher Kernels on Visual Vocabularies for Image Categorization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383266"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Tsintotas, K.A., Bampis, L., and Gasteratos, A. (2022). The Revisiting Problem in Simultaneous Localization and Mapping: A Survey on Visual Loop Closure Detection. IEEE Trans. Intell. Transp.","DOI":"10.1109\/TITS.2022.3175656"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Radenovic, F., Tolias, G., and Chum, O. (2016, January 8\u201316). CNN Image Retrieval Learns from BoW: Unsupervised Fine-Tuning with Hard Examples. Proceedings of the 14th European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_1"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhang, X., Su, Y., and Zhu, X. (2017, January 7\u20138). Loop closure detection for visual SLAM systems using convolutional neural network. Proceedings of the International Conference on Automation and Computing, Huddersfield, UK.","DOI":"10.23919\/IConAC.2017.8082072"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1687","DOI":"10.1109\/LRA.2018.2801879","article-title":"X-View: Graph-Based Semantic Multi-View Localization","volume":"3","author":"Gawel","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_12","unstructured":"Benbihi, A., Aravecchia, S., Geist, M., and Pradalier, C. (August, January 31). Image-Based Place Recognition on Bucolic Environment Across Seasons From Semantic Edge Description. Proceedings of the IEEE International Conference on Robotics and Automation, Paris, France."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Toft, C., Olsson, C., and Kahl, F. (2017, January 22\u201329). Long-term 3D Localization and Pose from Semantic Labellings. Proceedings of the International Conference on Computer Vision Workshops, Venice, Italy.","DOI":"10.1109\/ICCVW.2017.83"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yu, X., Chaturvedi, S., Feng, C., Taguchi, Y., Lee, T., Fernandes, C., and Ramalingam, S. (2018, January 1\u20135). VLASE: Vehicle Localization by Aggregating Semantic Edges. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Madrid, Spain.","DOI":"10.1109\/IROS.2018.8594358"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"7041","DOI":"10.1109\/LRA.2021.3097242","article-title":"Topology Aware Object-Level Semantic Mapping Towards More Robust Loop Closure","volume":"6","author":"Lin","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/S0079-6123(06)55002-2","article-title":"Building the gist of a scene: The role of global image features in recognition","volume":"155","author":"Oliva","year":"2006","journal-title":"Prog. Brain Res."},{"key":"ref_17","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1177\/0278364908090961","article-title":"FAB-MAP: Probabilistic localization and mapping in the space of appearance","volume":"27","author":"Cummins","year":"2008","journal-title":"Int. J. Robot. Res."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1188","DOI":"10.1109\/TRO.2012.2197158","article-title":"Bags of Binary Words for Fast Place Recognition in Image Sequences","volume":"28","author":"Tardos","year":"2012","journal-title":"IEEE Trans. Robot."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1061","DOI":"10.1109\/TRO.2017.2704598","article-title":"Hierarchical Place Recognition for Topological Mapping","volume":"33","author":"Ortiz","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Tsintotas, K.A., Bampis, L., and Gasteratos, A. (2018, January 21\u201325). Assigning Visual Words to Places for Loop Closure Detection. Proceedings of the IEEE International Conference on Robotics and Automation, Brisbane, QLD, Australia.","DOI":"10.1109\/ICRA.2018.8461146"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"103782","DOI":"10.1016\/j.robot.2021.103782","article-title":"Modest-vocabulary loop-closure detection with incremental bag of tracked words","volume":"141","author":"Tsintotas","year":"2021","journal-title":"Robot. Auton. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lategahn, H., Beck, J., Kitt, B., and Stiller, C. (2013, January 23\u201326). How to Learn an Illumination Robust Image Feature for Place Recognition. Proceedings of the IEEE Intelligent Vehicles Symposium, Gold Coast, Australia.","DOI":"10.1109\/IVS.2013.6629483"},{"key":"ref_24","unstructured":"Chen, Z., Lam, O., Jacobson, A., and Milford, M. (2014). Convolutional Neural Network-based Place Recognition. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"An, S., Che, G., Zhou, F., Liu, X., Ma, X., and Chen, Y. (2019, January 3\u20138). Fast and Incremental Loop Closure Detection Using Proximity Graphs. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Macau, China.","DOI":"10.1109\/IROS40897.2019.8968043"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L. (2018, January 18\u201323). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.1109\/TPAMI.2017.2711011","article-title":"NetVLAD: CNN Architecture for Weakly Supervised Place Recognition","volume":"40","author":"Arandjelovic","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1109\/TNNLS.2019.2908982","article-title":"Spatial Pyramid-Enhanced NetVLAD With Weighted Triplet Loss for Place Recognition","volume":"31","author":"Yu","year":"2020","journal-title":"IEEE Trans. Neural Netw. Learn."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, Z., Li, J., Khademi, S., and van Gemert, J. (2019, January 27\u201328). Attention-Aware Age-Agnostic Visual Place Recognition. Proceedings of the IEEE\/CVF International Conference on Computer Vision Workshop, Seoul, Korea.","DOI":"10.1109\/ICCVW.2019.00181"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4015","DOI":"10.1109\/LRA.2018.2859916","article-title":"Learning Context Flexible Attention Model for Long-Term Visual Place Recognition","volume":"3","author":"Chen","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Kim, H.J., Dunn, E., and Frahm, J. (2017, January 21\u201326). Learned Contextual Feature Reweighting for Image Geo-Localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.346"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Acuna, D., Kar, A., and Fidler, S. (2019, January 15\u201320). Devil is in the Edges: Learning Semantic Boundaries from Noisy Annotations. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01133"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Wang, Y., Qiu, Y., Cheng, P., and Duan, X. (2020). Robust Loop Closure Detection Integrating Visual-Spatial-Semantic Information via Topological Graphs and CNN Features. Remote Sens., 12.","DOI":"10.3390\/rs12233890"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (2016, January 27\u201330). The Cityscapes Dataset for Semantic Urban Scene Understanding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR.2016.350"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1655","DOI":"10.1109\/TPAMI.2018.2846566","article-title":"Fine-Tuning CNN Image Retrieval with No Human Annotation","volume":"41","author":"Radenovic","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/JPROC.2020.3004555","article-title":"A Comprehensive Survey on Transfer Learning","volume":"109","author":"Zhuang","year":"2021","journal-title":"Proc. IEEE."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Xia, Y., Xu, Y., Li, S., Wang, R., Du, J., Cremers, D., and Stilla, U. (2021, January 20\u201325). SOE-Net: A Self-Attention and Orientation Encoding Network for Point Cloud based Place Recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01119"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for autonomous driving? The KITTI vision benchmark suite. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1177\/0278364913507326","article-title":"The Malaga urban dataset: High-rate stereo and LiDAR in a realistic urban scenario","volume":"33","year":"2014","journal-title":"Int. J. Robot. Res."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1352","DOI":"10.1109\/TRO.2019.2926475","article-title":"Detecting the Expectancy of a Place Using Nearby Context for Appearance-Based Mapping","volume":"35","author":"Kazmi","year":"2019","journal-title":"IEEE Trans. Robot."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Yuan, Z., Xu, K., Zhou, X., Deng, B., and Ma, Y. (2021). SVG-Loop: Semantic-Visual-Geometric Information-Based Loop Closure Detection. Remote Sens., 13.","DOI":"10.3390\/rs13173520"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/19\/4885\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:44:26Z","timestamp":1760143466000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/19\/4885"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,30]]},"references-count":42,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["rs14194885"],"URL":"https:\/\/doi.org\/10.3390\/rs14194885","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,9,30]]}}}