{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:10:35Z","timestamp":1760137835447,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2022,2,26]],"date-time":"2022-02-26T00:00:00Z","timestamp":1645833600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"EACEA under the Erasmus Mundus Action 2, Strand 1 project LEADER","award":["2014-0862-001-001"],"award-info":[{"award-number":["2014-0862-001-001"]}]},{"name":"Scientific and Technological Project in Henan Province","award":["212102210080","222102210019"],"award-info":[{"award-number":["212102210080","222102210019"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Electronics"],"abstract":"<jats:p>This paper focuses on the mapping problem for mobile robots in dynamic environments where the state of every point in space may change, over time, between free or occupied. The dynamical behaviour of a single point is modelled by a Markov chain, which has to be learned from the data collected by the robot. Spatial correlation is based on Gaussian random fields (GRFs), which correlate the Markov chain parameters according to their physical distance. Using this strategy, one point can be learned from its surroundings, and unobserved space can also be learned from nearby observed space. The map is a field of Markov matrices that describe not only the occupancy probabilities (the stationary distribution) as well as the dynamics in every point. The estimation of transition probabilities of the whole space is factorised into two steps: The parameter estimation for training points and the parameter prediction for test points. The parameter estimation in the first step is solved by the expectation maximisation (EM) algorithm. Based on the estimated parameters of training points, the parameters of test points are obtained by the predictive equation in Gaussian processes with noise-free observations. Finally, this method is validated in experimental environments.<\/jats:p>","DOI":"10.3390\/electronics11050722","type":"journal-article","created":{"date-parts":[[2022,2,27]],"date-time":"2022-02-27T20:46:17Z","timestamp":1645994777000},"page":"722","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["HMM-Based Dynamic Mapping with Gaussian Random Fields"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5794-1336","authenticated-orcid":false,"given":"Hongjun","family":"Li","sequence":"first","affiliation":[{"name":"Zhongyuan-Petersburg Aviation College, Zhongyuan University of Technology, Zhengzhou 450007, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0660-0384","authenticated-orcid":false,"given":"Miguel","family":"Bar\u00e3o","sequence":"additional","affiliation":[{"name":"Departamento de Inform\u00e1tica, Escola de Ci\u00eancias e Tecnologia, Universidade de \u00c9vora, 7004-516 \u00c9vora, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4492-7548","authenticated-orcid":false,"given":"Lu\u00eds","family":"Rato","sequence":"additional","affiliation":[{"name":"Departamento de Inform\u00e1tica, Escola de Ci\u00eancias e Tecnologia, Universidade de \u00c9vora, 7004-516 \u00c9vora, Portugal"}]},{"given":"Shengjun","family":"Wen","sequence":"additional","affiliation":[{"name":"Zhongyuan-Petersburg Aviation College, Zhongyuan University of Technology, Zhengzhou 450007, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,26]]},"reference":[{"key":"ref_1","unstructured":"Moravec, H., and Elfes, A. (1985, January 25\u201328). High resolution maps from wide angle sonar. Proceedings of the IEEE International Conference on Robotics and Automation, St. Louis, MO, USA."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Plebe, A., Kooij, J.F., Papini, G.P.R., and Da Lio, M. (2021, January 11\u201317). Occupancy grid mapping with cognitive plausibility for autonomous driving applications. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCVW54120.2021.00328"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"807","DOI":"10.5194\/isprs-archives-XLII-2-W15-807-2019","article-title":"Developing affordable bathymetric analysis techniques using non-conventional payload for cultural heritage inspections","volume":"42","author":"Mugnai","year":"2019","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_4","unstructured":"Wang, C.-C., and Thorpe, C. (2002, January 11\u201315). Simultaneous localization and mapping with detection and tracking of moving objects. Proceedings of the IEEE International Conference on Robotics and Automation, Washington, DC, USA."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2874","DOI":"10.1109\/TITS.2019.2921248","article-title":"Grid-based object tracking with nonlinear dynamic state and shape estimation","volume":"21","author":"Steyer","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_6","unstructured":"Schreiber, M., Belagiannis, V., Gl\u00e4ser, C., and Dietmayer, K. (June, January 30). Dynamic occupancy grid mapping with recurrent neural networks. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China."},{"key":"ref_7","unstructured":"Bengio, Y., and Frasconi, P. (1995, January 27\u201330). An input output hmm architecture. Proceedings of the Advances in Neural Information Processing Systems, Denver, CO, USA."},{"key":"ref_8","unstructured":"Meyer-Delius, D., Beinhofer, M., and Burgard, W. (2012, January 22). Occupancy grid models for robot mapping in changing environments. Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, Toronto, ON, Canada."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1007\/s10514-009-9112-4","article-title":"Classifying dynamic objects","volume":"26","author":"Luber","year":"2009","journal-title":"Auton. Robot."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1662","DOI":"10.1177\/0278364913502830","article-title":"Lifelong localization in changing environments","volume":"32","author":"Tipaldi","year":"2013","journal-title":"Int. J. Robot. Res."},{"key":"ref_11","unstructured":"Wang, Z., Ambrus, R., Jensfelt, P., and Folkesson, J. (2014, January 14\u201318). Modeling motion patterns of dynamic objects by iohmm. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Dadhich, A., Koganti, N., and Shibata, T. (2015, January 2). Modeling occupancy grids using edhmm for dynamic environments. Proceedings of the 2015 Conference on Advances in Robotics, New York, NY, USA.","DOI":"10.1145\/2783449.2783510"},{"key":"ref_13","unstructured":"Rapp, M., Dietmayer, K., Hahn, M., Duraisamy, B., and Dickmann, J. (2016, January 5\u20138). Hidden markov model-based occupancy grid maps of dynamic environments. Proceedings of the 19th International Conference on Information Fusion (FUSION), Heidelberg, Germany."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1109\/5.18626","article-title":"A tutorial on hidden markov models and selected applications in speech recognition","volume":"7","author":"Rabiner","year":"1989","journal-title":"Proc. IEEE"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Tingdahl, D., and Gool, L.V. (2011, January 10\u201311). A public system for image based 3d model generation. Proceedings of the International Conference on Computer Vision\/Computer Graphics Collaboration Techniques and Applications, Rocquencourt, France.","DOI":"10.1007\/978-3-642-24136-9_23"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, H., Bar\u00e3o, M., and Rato, L. (2018, January 6\u20137). Mapping dynamic environments using markov random field models. Proceedings of the 24th International Conference on Automation and Computing (ICAC), Newcastle Upon Tyne, UK.","DOI":"10.23919\/IConAC.2018.8749092"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1177\/0278364911421039","article-title":"Gaussian process occupancy maps","volume":"31","author":"Ramos","year":"2012","journal-title":"Int. J. Robot. Res."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kim, S., and Kim, J. (2012, January 14\u201318). Building occupancy maps with a mixture of gaussian processes. Proceedings of the IEEE International Conference on Robotics and Automation, Saint Paul, MA, USA.","DOI":"10.1109\/ICRA.2012.6225355"},{"key":"ref_19","unstructured":"Kim, S., and Kim, J. (2013, January 3\u20137). Continuous occupancy maps using overlapping local gaussian processes. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan."},{"key":"ref_20","unstructured":"Kim, S., and Kim, J. (2014, January 2\u20134). Recursive bayesian updates for occupancy mapping and surface reconstruction. Proceedings of the Australasian Conference on Robotics and Automation, Melbourne, Australia."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Vido, C.E., and Ramos, F. (2016, January 16\u201321). From grids to continuous occupancy maps through area kernels. Proceedings of the IEEE International Conference on Robotics and Automation, Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487235"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wang, J., and Englot, B. (2016, January 16\u201321). Fast, accurate gaussian process occupancy maps via test-data octrees and nested bayesian fusion. Proceedings of the IEEE International Conference on Robotics and Automation, Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487232"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lee, B., Zhang, C., Huang, Z., and Lee, D.D. (2019, January 20\u201324). Online continuous mapping using gaussian process implicit surfaces. Proceedings of the International Conference on Robotics and Automation, Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794324"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"100175","DOI":"10.1016\/j.ifacsc.2021.100175","article-title":"Approximating stochastic loads using the em-algorithm","volume":"18","author":"Ossevorth","year":"2021","journal-title":"IFAC J. Syst. Control"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.21037\/shc.2018.01.01","article-title":"Simultaneous localization and mapping (slam) robotics techniques: A possible application in surgery","volume":"2","author":"Scaradozzi","year":"2018","journal-title":"Shanghai Chest"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Bibby, C., and Reid, I. (2007, January 27\u201330). Simultaneous localisation and mapping in dynamic environments (slamide) with reversible data association. Proceedings of the Robotics: Science and Systems, Atlanta, GA, USA.","DOI":"10.15607\/RSS.2007.III.014"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1874","DOI":"10.1109\/TRO.2021.3075644","article-title":"Orb-slam3: An accurate open-source library for visual, visual\u2013Inertial, and multimap slam","volume":"37","author":"Campos","year":"2021","journal-title":"IEEE Trans. Robot."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Rocher, G., Lavirotte, S., Tigli, J.-Y., Cotte, G., and Dechavanne, F. (2021). An iohmm-based framework to investigate drift in effectiveness of iot-based systems. Sensors, 21.","DOI":"10.3390\/s21020527"},{"key":"ref_29","unstructured":"Rato, L. (2002). Controlo Comutado Baseado em Modelos M\u00faltiplos. [Ph.D. Thesis, Technical University of Lisbon]."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1109\/2.30720","article-title":"Using occupancy grids for mobile robot perception and navigation","volume":"22","author":"Elfes","year":"1989","journal-title":"Computer"},{"key":"ref_31","unstructured":"Thrun, S., Burgard, W., and Fox, D. (2005). Probabilistic Robotics, MIT Press."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1561\/2000000034","article-title":"Theory and use of the em algorithm","volume":"4","author":"Gupta","year":"2011","journal-title":"Found. Trends Signal Process."},{"key":"ref_33","unstructured":"Nocedal, J., and Wright, S. (2006). Numerical Optimization, Springer Science & Business Media."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Rasmussen, C.E., and Williams, C.K. (2006). Gaussian Processes for Machine Learning, MIT Press.","DOI":"10.7551\/mitpress\/3206.001.0001"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Julier, S.J. (2002, January 8\u201310). The scaled unscented transformation. Proceedings of the American Control Conference, Anchorage, MI, USA.","DOI":"10.1109\/ACC.2002.1025369"},{"key":"ref_36","unstructured":"Van Der Merwe, R. (2004). Sigma-point Kalman Filters for Probabilistic Inference in Dynamic State-Space Models. [Ph.D. Thesis, Oregon Health & Science University]."}],"container-title":["Electronics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-9292\/11\/5\/722\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:28:00Z","timestamp":1760135280000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-9292\/11\/5\/722"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,26]]},"references-count":36,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["electronics11050722"],"URL":"https:\/\/doi.org\/10.3390\/electronics11050722","relation":{},"ISSN":["2079-9292"],"issn-type":[{"type":"electronic","value":"2079-9292"}],"subject":[],"published":{"date-parts":[[2022,2,26]]}}}