{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T15:38:19Z","timestamp":1775230699501,"version":"3.50.1"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2023,12,1]],"date-time":"2023-12-01T00:00:00Z","timestamp":1701388800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,12,1]],"date-time":"2023-12-01T00:00:00Z","timestamp":1701388800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Horizon 2020 Research and Innovation Programme","award":["101017008"],"award-info":[{"award-number":["101017008"]}]},{"DOI":"10.13039\/501100003329","name":"Ministerio de Economia y Competitividad","doi-asserted-by":"crossref","award":["RTI2018-095599-B-C21"],"award-info":[{"award-number":["RTI2018-095599-B-C21"]}],"id":[{"id":"10.13039\/501100003329","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Madrid Robotics Digital Innovation Hub","award":["S2018\/NMT-4331"],"award-info":[{"award-number":["S2018\/NMT-4331"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Intell Robot Syst"],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Mobile robot localization is an important task in navigation and can be challenging, especially in non-static environments as the scene naturally involves movable objects and appearance changes. In this paper, we address the problem of estimating the robot\u2019s pose in non-static environments containing movable objects. We understand as non-static environments, dynamic environments in which objects might be moved or changed their appearance. We propose a probabilistic localization approach that combines metric and semantic information and takes into account both, static and movable objects. We perform a pixel-wise association of depth and semantic data from an RGB-D sensor with a semantically-augmented truncated signed distance field (TSDF) in order to estimate the robot\u2019s pose. The combination of metric and semantic information increases the robustness w.r.t. movable objects and object appearance changes. The experiments conducted in a real indoor environment and a publicly-available dataset suggest that our approach successfully estimates robot pose in non-static environments and they show an improvement compared to robot localization based only on metric or semantic information and compared to a feature-based method.<\/jats:p>","DOI":"10.1007\/s10846-023-02021-y","type":"journal-article","created":{"date-parts":[[2023,12,1]],"date-time":"2023-12-01T06:02:51Z","timestamp":1701410571000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Localization Exploiting Semantic and Metric Information in Non-static Indoor Environments"],"prefix":"10.1007","volume":"109","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4859-5053","authenticated-orcid":false,"given":"Clara","family":"Gomez","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alejandra C.","family":"Hernandez","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ram\u00f3n","family":"Barber","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cyrill","family":"Stachniss","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,12,1]]},"reference":[{"key":"2021_CR1","doi-asserted-by":"publisher","first-page":"43563","DOI":"10.1109\/ACCESS.2020.2977684","volume":"8","author":"S Han","year":"2020","unstructured":"Han, S., Xi, Z.: Dynamic Scene Semantics SLAM Based on Semantic Segmentation. IEEE Access 8, 43563\u201343570 (2020)","journal-title":"IEEE Access"},{"key":"2021_CR2","doi-asserted-by":"crossref","unstructured":"Palazzolo, E., Behley, J., Lottes, P., Gigu\u00e8re, P., Stachniss, C.: ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residuals. arXiv preprint (2019)","DOI":"10.1109\/IROS40897.2019.8967590"},{"issue":"4","key":"2021_CR3","doi-asserted-by":"publisher","first-page":"2263","DOI":"10.1109\/LRA.2017.2724759","volume":"2","author":"S Li","year":"2017","unstructured":"Li, S., Lee, D.: RGB-D SLAM in dynamic environments using static point weighting. IEEE Robot. Autom. Lett. (RA-L) 2(4), 2263\u20132270 (2017)","journal-title":"IEEE Robot. Autom. Lett. (RA-L)"},{"key":"2021_CR4","doi-asserted-by":"crossref","unstructured":"Bavle, H., Manthe, S., de\u00a0la Puente, P., Rodriguez-Ramos, A., Sampedro, C., Campoy, P.: Stereo visual odometry and semantics based localization of aerial robots in indoor environments. In: Proceedings\u00a0of the IEEE\/RSJ International\u00a0Conference\u00a0on Intelligent Robots and Systems (IROS), IEEE, pp. 1018\u20131023 (2018)","DOI":"10.1109\/IROS.2018.8593426"},{"key":"2021_CR5","doi-asserted-by":"publisher","first-page":"21963","DOI":"10.1109\/ACCESS.2019.2899049","volume":"7","author":"W Zhang","year":"2019","unstructured":"Zhang, W., Liu, G., Tian, G.: A coarse to fine indoor visual localization method using environmental semantic information. IEEE Access 7, 21963\u201321970 (2019)","journal-title":"IEEE Access"},{"key":"2021_CR6","doi-asserted-by":"crossref","unstructured":"Cramariuc, A., Tschopp, F., Alatur, N., Benz, S., Falck, T., Br\u00fchlmeier, M., Hahn, B., Nieto, J., Siegwart, R.: SemSegMap\u20133D segment-based semantic localization. In: Proceedings\u00a0of the IEEE\/RSJ International\u00a0Conference\u00a0on Intelligent Robots and Systems (IROS), IEEE, pp. 1183\u20131190 (2021)","DOI":"10.1109\/IROS51168.2021.9636156"},{"key":"2021_CR7","doi-asserted-by":"crossref","unstructured":"Hughes, N., Chang, Y., Carlone, L.: Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimization. Robotics: Science and Systems (RSS) (2022)","DOI":"10.15607\/RSS.2022.XVIII.050"},{"issue":"2","key":"2021_CR8","doi-asserted-by":"publisher","first-page":"568","DOI":"10.1109\/LRA.2022.3229228","volume":"8","author":"J Yu","year":"2022","unstructured":"Yu, J., Shen, S.: SemanticLoop: loop closure with 3D semantic graph matching. IEEE Robot. Autom. Lett. (RA-L) 8(2), 568\u2013575 (2022)","journal-title":"IEEE Robot. Autom. Lett. (RA-L)"},{"key":"2021_CR9","doi-asserted-by":"crossref","unstructured":"Kim, J.J., Urschler, M., Riddle, P.J., Wicker, J.S.: Closing the Loop: Graph Networks to Unify Semantic Objects and Visual Features for Multi-object Scenes. In: Proceedings\u00a0of the IEEE\/RSJ International\u00a0Conference\u00a0on Intelligent Robots and Systems (IROS), IEEE, pp. 4352\u20134358 (2022)","DOI":"10.1109\/IROS47612.2022.9981542"},{"key":"2021_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.robot.2019.03.012","volume":"117","author":"L Xiao","year":"2019","unstructured":"Xiao, L., Wang, J., Qiu, X., Rong, Z., Zou, X.: Dynamic-SLAM: Semantic monocular visual localization and mapping based on deep learning in dynamic environment. J Robot. Autonomous Syst. (RAS) 117, 1\u201316 (2019)","journal-title":"J Robot. Autonomous Syst. (RAS)"},{"key":"2021_CR11","doi-asserted-by":"crossref","unstructured":"Xu, B., Li, W., Tzoumanikas, D., Bloesch, M., Davison, A., Leutenegger, S.: MID-Fusion: Octree-based object-level multi-instance dynamic SLAM. In: Proceedings\u00a0of the IEEE International\u00a0Conference\u00a0on Robotics & Automation (ICRA), IEEE, pp. 5231\u20135237 (2019)","DOI":"10.1109\/ICRA.2019.8794371"},{"issue":"4","key":"2021_CR12","doi-asserted-by":"publisher","first-page":"925","DOI":"10.1109\/TRO.2019.2909168","volume":"35","author":"S Yang","year":"2019","unstructured":"Yang, S., Scherer, S.: CubeSLAM: Monocular 3D object SLAM. IEEE Trans. Robot. 35(4), 925\u2013938 (2019)","journal-title":"IEEE Trans. Robot."},{"key":"2021_CR13","doi-asserted-by":"crossref","unstructured":"Singh, G., Wu, M., Lam, S.-K., et al.: Hierarchical Loop Closure Detection for Long-term Visual SLAM with Semantic-Geometric Descriptors. In: IEEE International Intelligent Transportation Systems Conference (ITSC), IEEE, pp. 2909\u20132916 (2021)","DOI":"10.1109\/ITSC48978.2021.9564866"},{"issue":"6","key":"2021_CR14","doi-asserted-by":"publisher","first-page":"647","DOI":"10.1177\/0278364908090961","volume":"27","author":"M Cummins","year":"2008","unstructured":"Cummins, M., Newman, P.: FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance. Intl. J Robot. Res. (IJRR) 27(6), 647\u2013665 (2008)","journal-title":"Intl. J Robot. Res. (IJRR)"},{"key":"2021_CR15","doi-asserted-by":"crossref","unstructured":"Dayoub, F., Duckett, T.: An adaptive appearance-based map for long-term topological localization of mobile robots. In: Proceedings\u00a0of the IEEE\/RSJ International\u00a0Conference\u00a0on Intelligent Robots and Systems (IROS), IEEE, pp. 3364\u20133369 (2008)","DOI":"10.1109\/IROS.2008.4650701"},{"key":"2021_CR16","doi-asserted-by":"crossref","unstructured":"Derner, E., Gomez, C., Hernandez, A.C., Barber, R., Babu\u0161ka, R.: Towards life-long autonomy of mobile robots through feature-based change detection. In: Proceedings\u00a0of the European\u00a0Conference\u00a0on Mobile Robotics (ECMR), IEEE, pp. 1\u20136 (2019)","DOI":"10.1109\/ECMR.2019.8870940"},{"key":"2021_CR17","doi-asserted-by":"crossref","unstructured":"Patel, N., Khorrami, F., Krishnamurthy, P., Tzes, A.: Tightly Coupled Semantic RGB-D Inertial Odometry for Accurate Long-Term Localization and Mapping. In: Proceedings\u00a0of the International\u00a0Conference\u00a0on Advanced Robotics (ICAR), IEEE, pp. 523\u2013528 (2019)","DOI":"10.1109\/ICAR46387.2019.8981658"},{"key":"2021_CR18","unstructured":"Stachniss, C., Burgard, W.: Mobile Robot Mapping and Localization in Non-Static Environments. In: Proceedings\u00a0of the National Conference on Artificial Intelligence (AAAI), Pittsburgh, PA, USA, pp. 1324\u20131329 (2005)"},{"key":"2021_CR19","doi-asserted-by":"crossref","unstructured":"Vysotska, O., Stachniss, C.: Lazy Data Association For Image Sequences Matching Under Substantial Appearance Changes. IEEE Robot. Autom. Lett. (RA-L) 1(1), 213\u2013220 (2016)","DOI":"10.1109\/LRA.2015.2512936"},{"key":"2021_CR20","doi-asserted-by":"crossref","unstructured":"Vysotska, O., Stachniss, C.: Effective Visual Place Recognition Using Multi-Sequence Maps. IEEE Robot. Autom. Lett. (RA-L) 4, 1730\u20131736 (2019)","DOI":"10.1109\/LRA.2019.2897160"},{"key":"2021_CR21","doi-asserted-by":"crossref","unstructured":"Milford, M., Wyeth, G.F.: SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights. In: Proceedings\u00a0of the IEEE International\u00a0Conference\u00a0on Robotics & Automation (ICRA) (2012)","DOI":"10.1109\/ICRA.2012.6224623"},{"key":"2021_CR22","doi-asserted-by":"crossref","unstructured":"Chen, X., Milioto, A., Palazzolo, E., Gigu\u00e8re, P., Behley, J., Stachniss, C.: SuMa++: Efficient LiDAR-based Semantic SLAM. In: Proceedings\u00a0of the IEEE\/RSJ International\u00a0Conference\u00a0on Intelligent Robots and Systems (IROS) (2019)","DOI":"10.1109\/IROS40897.2019.8967704"},{"key":"2021_CR23","doi-asserted-by":"crossref","unstructured":"Stenborg, E., Toft, C., Hammarstrand, L.: Long-term visual localization using semantically segmented images. In: Proceedings\u00a0of the IEEE International\u00a0Conference\u00a0on Robotics & Automation (ICRA), IEEE, pp. 6484\u20136490 (2018)","DOI":"10.1109\/ICRA.2018.8463150"},{"key":"2021_CR24","doi-asserted-by":"crossref","unstructured":"Arshad, S., Kim, G.-W.: Leveraging Semantics in Appearance based Loop Closure Detection for Long-Term Visual SLAM. In: IEEE International Conference on Big Data and Smart Computing (BigComp), IEEE, pp. 371\u2013372 (2023)","DOI":"10.1109\/BigComp57234.2023.00087"},{"key":"2021_CR25","doi-asserted-by":"crossref","unstructured":"Chebrolu, N., Lottes, P., L\u00e4be, T., Stachniss, C.: Robot Localization Based on Aerial Images for Precision Agriculture Tasks in Crop Fields. In: Proceedings\u00a0of the IEEE International\u00a0Conference\u00a0on Robotics & Automation (ICRA), IEEE, pp. 1787\u20131793 (2019)","DOI":"10.1109\/ICRA.2019.8794030"},{"issue":"4","key":"2021_CR26","doi-asserted-by":"publisher","first-page":"4407","DOI":"10.1109\/LRA.2018.2869640","volume":"3","author":"N Radwan","year":"2018","unstructured":"Radwan, N., Valada, A., Burgard, W.: Vlocnet++: Deep multitask learning for semantic visual localization and odometry. IEEE Robot. Autom. Lett. (RA-L) 3(4), 4407\u20134414 (2018)","journal-title":"IEEE Robot. Autom. Lett. (RA-L)"},{"key":"2021_CR27","doi-asserted-by":"crossref","unstructured":"Toft, C., Stenborg, E., Hammarstrand, L., Brynte, L., Pollefeys, M., Sattler, T., Kahl, F.: Semantic match consistency for long-term visual localization. In: Proceedings\u00a0of the European\u00a0Conference\u00a0on Computer Vision (ECCV), pp. 383\u2013399 (2018)","DOI":"10.1007\/978-3-030-01216-8_24"},{"key":"2021_CR28","doi-asserted-by":"crossref","unstructured":"Zeng, A., Song, S., Nie\u00dfner, M., Fisher, M., Xiao, J., Funkhouser, T.: 3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions. In: Proceedings\u00a0of the IEEE Conference\u00a0on Computer Vision and Pattern Recognition (CVPR), pp. 1802\u20131811 (2017)","DOI":"10.1109\/CVPR.2017.29"},{"key":"2021_CR29","unstructured":"Dellaert, F., Fox, D., Burgard, W., Thrun, S.: Monte Carlo Localization for Mobile Robots, booktitle = IEEE International Conference on Robotics and Automation (ICRA). (1999)"},{"key":"2021_CR30","volume-title":"Probabilistic Robotics (Intelligent Robotics and Autonomous Agents)","author":"S Thrun","year":"2005","unstructured":"Thrun, S., Burgard, W., Fox, D.: Probabilistic Robotics (Intelligent Robotics and Autonomous Agents). The MIT Press, Cambridge, Massachusetts (2005)"},{"key":"2021_CR31","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1613\/jair.616","volume":"11","author":"D Fox","year":"1999","unstructured":"Fox, D., Burgard, W., Thrun, S.: Markov localization for mobile robots in dynamic environments. J Artif. Intell. Res. 11, 391\u2013427 (1999)","journal-title":"J Artif. Intell. Res."},{"key":"2021_CR32","doi-asserted-by":"crossref","unstructured":"Krajn\u00edk, T., Fentanes, J.P., Mozos, O., Duckett, T., Ekekrantz, J., Hanheide, M.: Long-term topological localisation for service robots in dynamic environments using spectral maps. In: Proceedings\u00a0of the IEEE\/RSJ International\u00a0Conference\u00a0on Intelligent Robots and Systems (IROS), IEEE, pp. 4537\u20134542 (2014)","DOI":"10.1109\/IROS.2014.6943205"},{"key":"2021_CR33","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., Girshick, R.: Mask R-CNN. In: Proceedings\u00a0of the IEEE International\u00a0Conference\u00a0on Computer Vision (ICCV) (2017)","DOI":"10.1109\/ICCV.2017.322"},{"issue":"4","key":"2021_CR34","doi-asserted-by":"publisher","first-page":"5401","DOI":"10.1109\/LRA.2020.3007402","volume":"5","author":"C Gomez","year":"2020","unstructured":"Gomez, C., Hernandez, A.C., Derner, E., Barber, R., Babu\u0161ka, R.: Object-Based Pose Graph for Dynamic Indoor Environments. IEEE Robot. Autom. Lett. (RA-L) 5(4), 5401\u20135408 (2020)","journal-title":"IEEE Robot. Autom. Lett. (RA-L)"}],"container-title":["Journal of Intelligent &amp; Robotic Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-023-02021-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10846-023-02021-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-023-02021-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,31]],"date-time":"2023-12-31T11:04:58Z","timestamp":1704020698000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10846-023-02021-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12]]},"references-count":34,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["2021"],"URL":"https:\/\/doi.org\/10.1007\/s10846-023-02021-y","relation":{},"ISSN":["0921-0296","1573-0409"],"issn-type":[{"value":"0921-0296","type":"print"},{"value":"1573-0409","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12]]},"assertion":[{"value":"17 January 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 November 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 December 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors have no relevant financial or non-financial interests to disclose.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"86"}}