{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T14:26:42Z","timestamp":1766068002351,"version":"build-2065373602"},"reference-count":41,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2024,7,18]],"date-time":"2024-07-18T00:00:00Z","timestamp":1721260800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Materials\/Parts Technology Development Program","award":["20023305","RS-2024-00346415"],"award-info":[{"award-number":["20023305","RS-2024-00346415"]}]},{"name":"National Research Foundation of Korea (NRF)","award":["20023305","RS-2024-00346415"],"award-info":[{"award-number":["20023305","RS-2024-00346415"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Recent advancements in simultaneous localization and mapping (SLAM) have significantly improved the handling of dynamic objects. Traditionally, SLAM systems mitigate the impact of dynamic objects by extracting, matching, and tracking features. However, in real-world scenarios, dynamic object information critically influences decision-making processes in autonomous navigation. To address this, we present a novel approach for incorporating dynamic object information into map representations, providing valuable insights for understanding movement context and estimating collision risks. Our method leverages on-site mobile robots and multiple object tracking (MOT) to gather activation levels. We propose a multimodal map framework that integrates occupancy maps obtained through SLAM with Gaussian process (GP) modeling to quantify the activation levels of dynamic objects. The Gaussian process method utilizes a map-based grid cell algorithm that distinguishes regions with varying activation levels while providing confidence measures. To validate the practical effectiveness of our approach, we also propose a method to calculate additional costs from the generated maps for global path planning. This results in path generation through less congested areas, enabling more informative navigation compared to traditional methods. Our approach is validated using a diverse dataset collected from crowded environments such as a library and public square and is demonstrated to be intuitive and to accurately provide activation levels.<\/jats:p>","DOI":"10.3390\/rs16142622","type":"journal-article","created":{"date-parts":[[2024,7,18]],"date-time":"2024-07-18T08:39:12Z","timestamp":1721291952000},"page":"2622","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A New Multimodal Map Building Method Using Multiple Object Tracking and Gaussian Process Regression"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-2774-3848","authenticated-orcid":false,"given":"Eunseong","family":"Jang","sequence":"first","affiliation":[{"name":"Division of Electronic Engineering, Jeonbuk National University, Jeonju 54896, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9312-6299","authenticated-orcid":false,"given":"Sang Jun","family":"Lee","sequence":"additional","affiliation":[{"name":"Division of Electronic Engineering, Jeonbuk National University, Jeonju 54896, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2689-1940","authenticated-orcid":false,"given":"HyungGi","family":"Jo","sequence":"additional","affiliation":[{"name":"Division of Electronic Engineering, Jeonbuk National University, Jeonju 54896, Republic of Korea"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"714","DOI":"10.1109\/TMECH.2018.2795252","article-title":"Efficient grid-based Rao\u2013Blackwellized particle filter SLAM with interparticle map sharing","volume":"23","author":"Jo","year":"2018","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A versatile and accurate monocular SLAM system","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4861","DOI":"10.1109\/LRA.2022.3152830","article-title":"Faster-LIO: Lightweight tightly coupled LiDAR-inertial odometry using parallel sparse incremental voxels","volume":"7","author":"Bai","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Hess, W., Kohler, D., Rapp, H., and Andor, D. (2016, January 16\u201321). Real-time loop closure in 2D LIDAR SLAM. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487258"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ambru\u015f, R., Bore, N., Folkesson, J., and Jensfelt, P. (2014, January 14\u201318). Meta-rooms: Building and maintaining long term spatial models in a dynamic world. Proceedings of the 2014 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA.","DOI":"10.1109\/IROS.2014.6942806"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2272","DOI":"10.1109\/LRA.2021.3061363","article-title":"ERASOR: Egocentric ratio of pseudo occupancy-based dynamic object removal for static 3D point cloud map building","volume":"6","author":"Lim","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ruchti, P., and Burgard, W. (2018, January 21\u201325). Mapping with dynamic-object probabilities calculated from single 3d range scans. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8463149"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kim, G., and Kim, A. (2020, January 25\u201329). Remove, then revert: Static point cloud map construction using multiresolution range images. Proceedings of the 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.","DOI":"10.1109\/IROS45743.2020.9340856"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Choi, B., Jo, H., and Kim, E. (2019, January 3\u20138). Normal Distribution Mixture Matching based Model Free Object Tracking Using 2D LIDAR. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Venetian Macao, Macau.","DOI":"10.1109\/IROS40897.2019.8967876"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Merugu, S., Jain, K., Mittal, A., and Raman, B. (2020). Sub-scene target detection and recognition using deep learning convolution neural networks. ICDSMLA 2019: Proceedings of the 1st International Conference on Data Science, Machine Learning and Applications, Springer.","DOI":"10.1007\/978-981-15-1420-3_119"},{"key":"ref_11","first-page":"1729","article-title":"DNNBoT: Deep neural network-based botnet detection and classification","volume":"71","author":"Haq","year":"2022","journal-title":"Comput. Mater. Contin."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhang, R., Cao, Z., Yang, S., Si, L., Sun, H., Xu, L., and Sun, F. (2024). Cognition-Driven Structural Prior for Instance-Dependent Label Transition Matrix Estimation. IEEE Trans. Neural Netw. Learn. Syst.","DOI":"10.1109\/TNNLS.2023.3347633"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Pomerleau, F., Kr\u00fcsi, P., Colas, F., Furgale, P., and Siegwart, R. (June, January 31). Long-term 3D map maintenance in dynamic environments. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907397"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Linder, T., Breuers, S., Leibe, B., and Arras, K.O. (2016, January 16\u201321). On multi-modal people tracking from mobile platforms in very crowded and dynamic environments. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487766"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Cheng, S., Yao, M., and Xiao, X. (June, January 29). DC-MOT: Motion deblurring and compensation for multi-object tracking in UAV videos. Proceedings of the 2023 IEEE International Conference on Robotics and Automation (ICRA), London, UK.","DOI":"10.1109\/ICRA48891.2023.10160931"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Jafari, O.H., Mitzel, D., and Leibe, B. (June, January 31). Real-time RGB-D based people detection and tracking for mobile robots and head-worn cameras. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907688"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1109\/TIV.2021.3087664","article-title":"Task-driven rgb-lidar fusion for object tracking in resource-efficient autonomous system","volume":"7","author":"Samal","year":"2021","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Shen, L., Guo, H., Bai, Y., Qin, L., Ang, M., and Rus, D. (October, January 27). Group Multi-Object Tracking for Dynamic Risk Map and Safe Path Planning. Proceedings of the 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.","DOI":"10.1109\/IROS51168.2021.9636702"},{"key":"ref_19","unstructured":"Gong, H., Sim, J., Likhachev, M., and Shi, J. (2011, January 6\u201313). Multi-hypothesis motion planning for visual object tracking. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3248","DOI":"10.1109\/LRA.2021.3062010","article-title":"Learning occupancy priors of human motion from semantic maps of urban environments","volume":"6","author":"Rudenko","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1550147718763550","DOI":"10.1177\/1550147718763550","article-title":"A flexible human detection service suitable for Intelligent Spaces based on a multi-camera network","volume":"14","author":"Almonfrey","year":"2018","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1093","DOI":"10.1109\/LRA.2017.2660060","article-title":"Enabling flow awareness for mobile robots in partially observable environments","volume":"2","author":"Kucner","year":"2017","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, Z., Jensfelt, P., and Folkesson, J. (2016, January 26\u201331). Building a human behavior map from local observations. Proceedings of the 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), New York, NY, USA.","DOI":"10.1109\/ROMAN.2016.7745092"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhang, R., Tan, J., Cao, Z., Xu, L., Liu, Y., Si, L., and Sun, F. (2024). Part-Aware Correlation Networks for Few-shot Learning. IEEE Trans. Multimed.","DOI":"10.1109\/TMM.2024.3394681"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Vintr, T., Yan, Z., Duckett, T., and Krajn\u00edk, T. (2019, January 20\u201324). Spatio-temporal representation for long-term anticipation of human presence in service robotics. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793534"},{"key":"ref_26","first-page":"133","article-title":"Introduction to Gaussian processes","volume":"168","author":"MacKay","year":"1998","journal-title":"NATO ASI Ser. F Comput. Syst. Sci."},{"key":"ref_27","unstructured":"Ebden, M. (2015). Gaussian processes: A quick introduction. arXiv."},{"key":"ref_28","unstructured":"Wang, J. (2020). An intuitive tutorial to Gaussian processes regression. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Guo, H., Meng, Z., Huang, Z., Kang, L.W., Chen, Z., Meghjani, M., Ang, M., and Rus, D. (2019, January 3\u20138). Safe path planning with gaussian process regulated risk map. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Venetian Macao, Macau.","DOI":"10.1109\/IROS40897.2019.8967744"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"13975","DOI":"10.1038\/s41598-021-93474-4","article-title":"Use of Gaussian process regression for radiation mapping of a nuclear reactor with a mobile robot","volume":"11","author":"West","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"O\u2019Callaghan, S.T., Singh, S.P., Alempijevic, A., and Ramos, F.T. (2011, January 9\u201313). Learning navigational maps by observing human motion patterns. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980478"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Stuede, M., and Schappler, M. (2022, January 23\u201327). Non-parametric Modeling of Spatio-Temporal Human Activity Based on Mobile Robot Observations. Proceedings of the 2022 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Kyoto, Japan.","DOI":"10.1109\/IROS47612.2022.9982067"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1304","DOI":"10.1109\/TRO.2021.3101358","article-title":"Robotic exploration for learning human motion patterns","volume":"38","author":"Molina","year":"2021","journal-title":"IEEE Trans. Robot."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"522","DOI":"10.1109\/THMS.2013.2283945","article-title":"Person tracking in large public spaces using 3-D range sensors","volume":"43","author":"Kanda","year":"2013","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_35","unstructured":"Cheeseman, P., Smith, R., and Self, M. (1897, January 9\u201314). A stochastic map for uncertain spatial relationships. Proceedings of the 4th International Symposium on Robotic Research, Santa Clara, CA, USA."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1109\/34.88573","article-title":"Least-squares estimation of transformation parameters between two point patterns","volume":"13","author":"Umeyama","year":"1991","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_37","unstructured":"GPy (2024, July 17). GPy: A Gaussian Process Framework in Python. Available online: http:\/\/github.com\/SheffieldML\/GPy."},{"key":"ref_38","unstructured":"Jeonbuk National University (2024, June 03). Floor Guide of Central Library. Available online: https:\/\/dl.jbnu.ac.kr\/webcontent\/info\/79."},{"key":"ref_39","unstructured":"(2024, June 03). Jeonbuk University Promotional Video (Campus). Available online: https:\/\/www.youtube.com\/watch?v=QEoti0R8uT4."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1109\/TSSC.1968.300136","article-title":"A formal basis for the heuristic determination of minimum cost paths","volume":"4","author":"Hart","year":"1968","journal-title":"IEEE Trans. Syst. Sci. Cybern."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/TRO.2006.889486","article-title":"Improved techniques for grid mapping with rao-blackwellized particle filters","volume":"23","author":"Grisetti","year":"2007","journal-title":"IEEE Trans. Robot."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/14\/2622\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:18:42Z","timestamp":1760109522000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/14\/2622"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,18]]},"references-count":41,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["rs16142622"],"URL":"https:\/\/doi.org\/10.3390\/rs16142622","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2024,7,18]]}}}