{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T02:29:07Z","timestamp":1772504947503,"version":"3.50.1"},"reference-count":29,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2019,5,6]],"date-time":"2019-05-06T00:00:00Z","timestamp":1557100800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["Kr752\/33-1"],"award-info":[{"award-number":["Kr752\/33-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["Kr752\/36-1"],"award-info":[{"award-number":["Kr752\/36-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Autonomous exploration of environmental fields is one of the most promising tasks to be performed by fleets of mobile underwater robots. The goal is to maximize the information gain during the exploration process by integrating an information-metric into the path-planning and control step. Therefore, the system maintains an internal belief representation of the environmental field which incorporates previously collected measurements from the real field. In contrast to surface robots, mobile underwater systems are forced to run all computations on-board due to the limited communication bandwidth in underwater domains. Thus, reducing the computational cost of field exploration algorithms constitutes a key challenge for in-field implementations on micro underwater robot teams. In this work, we present a computationally efficient exploration algorithm which utilizes field belief models based on Gaussian Processes, such as Gaussian Markov random fields or Kalman regression, to enable field estimation with constant computational cost over time. We extend the belief models by the use of weighted shape functions to directly incorporate spatially continuous field observations. The developed belief models function as information-theoretic value functions to enable path planning through stochastic optimal control with path integrals. We demonstrate the efficiency of our exploration algorithm in a series of simulations including the case of a stationary spatio-temporal field.<\/jats:p>","DOI":"10.3390\/s19092094","type":"journal-article","created":{"date-parts":[[2019,5,9]],"date-time":"2019-05-09T11:22:35Z","timestamp":1557400955000},"page":"2094","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Learning Environmental Field Exploration with Computationally Constrained Underwater Robots: Gaussian Processes Meet Stochastic Optimal Control"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7256-6984","authenticated-orcid":false,"given":"Daniel Andre","family":"Duecker","sequence":"first","affiliation":[{"name":"Institute of Mechanics and Ocean Engineering, Hamburg University of Technology, 21073 Hamburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andreas Rene","family":"Geist","sequence":"additional","affiliation":[{"name":"Institute of Mechanics and Ocean Engineering, Hamburg University of Technology, 21073 Hamburg, Germany"},{"name":"Max Planck Institute for Intelligent Systems, 70569 Stuttgart, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Edwin","family":"Kreuzer","sequence":"additional","affiliation":[{"name":"Institute of Mechanics and Ocean Engineering, Hamburg University of Technology, 21073 Hamburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eugen","family":"Solowjow","sequence":"additional","affiliation":[{"name":"Siemens Corporate Technology, Berkeley, CA 94704, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,5,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1016\/j.robot.2009.09.014","article-title":"A novel low-cost, limited-resource approach to autonomous multi-robot exploration and mapping","volume":"58","author":"Gifford","year":"2010","journal-title":"Robot. Autonomous Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1109\/LRA.2016.2519947","article-title":"AVEXIS\u2014Aqua vehicle explorer for in-situ sensing","volume":"1","author":"Griffiths","year":"2016","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Duecker, D.A., Hackbarth, A., Johannink, T., Kreuzer, E., and Solowjow, E. (2018, January 21\u201325). Micro Underwater Vehicle Hydrobatics: A Submerged Furuta Pendulum. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.","DOI":"10.1109\/ICRA.2018.8461091"},{"key":"ref_4","unstructured":"Wang, H., Liu, P.X., Xie, X., Liu, X., Hayat, T., and Alsaadi, F.E. (2018). Adaptive fuzzy asymptotical tracking control of nonlinear systems with unmodeled dynamics and quantized actuator. Inf. Sci., in press."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1476","DOI":"10.1109\/TCYB.2015.2447153","article-title":"Fuzzy Adaptive Control Design and Discretization for a Class of Nonlinear Uncertain Systems","volume":"46","author":"Zhao","year":"2016","journal-title":"IEEE Trans. Cybern."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1002\/pamm.201210355","article-title":"Multi-Agent Motion Control of Autonomous Vehicles in 3D Flow Fields","volume":"12","author":"Hackbarth","year":"2012","journal-title":"PAMM"},{"key":"ref_7","first-page":"119","article-title":"A Statistical Approach to some Basic Mine Valuation Problems on the Witwatersrand","volume":"52","author":"Krige","year":"1951","journal-title":"J. S. Afr. Inst. Mining Metall."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhang, B., and Sukhatme, G.S. (2007, January 10\u201314). Adaptive Sampling for Estimating a Scalar Field using a Robotic Boat and a Sensor Network. Proceedings of the 2007 IEEE International Conference on Robotics and Automation, Roma, Italy.","DOI":"10.1109\/ROBOT.2007.364041"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1118","DOI":"10.1109\/TRO.2011.2162766","article-title":"Mobile Sensor Network Navigation using Gaussian Processes with Truncated Observations","volume":"27","author":"Xu","year":"2011","journal-title":"IEEE Trans. Robot."},{"key":"ref_10","unstructured":"Xu, Y., Choi, J., Dass, S., and Maiti, T. (2015). Bayesian Prediction and Adaptive Sampling Algorithms for Mobile Sensor Networks: Online Environmental Field Reconstruction in Space and Time, Springer."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1007\/s10182-012-0196-3","article-title":"Spatio-temporal Modeling of Particulate Matter Concentration through the SPDE Approach","volume":"97","author":"Cameletti","year":"2013","journal-title":"AStA Adv. Stat. Anal."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1111\/j.1467-9868.2011.00777.x","article-title":"An Explicit Link between Gaussian Fields and Gaussian Markov Random Fields: the Stochastic Partial Differential Equation Approach","volume":"73","author":"Lindgren","year":"2011","journal-title":"J. R. Stat. Soc. Ser. B (Stat. Methodol.)"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3520","DOI":"10.1016\/j.automatica.2013.09.008","article-title":"Efficient Bayesian Spatial Prediction with Mobile Sensor Networks using Gaussian Markov Random Fields","volume":"49","author":"Xu","year":"2013","journal-title":"Automatica"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Jadaliha, M., Jeong, J., Xu, Y., Choi, J., and Kim, J. (2018). Fully Bayesian Prediction Algorithms for Mobile Robotic Sensors under Uncertain Localization Using Gaussian Markov Random Fields. Sensors, 18.","DOI":"10.3390\/s18092866"},{"key":"ref_15","unstructured":"Todescato, M., Carron, A., Carli, R., Pillonetto, G., and Schenato, L. (2017). Efficient Spatio-Temporal Gaussian Regression via Kalman Filtering. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1271","DOI":"10.1177\/0278364914533443","article-title":"Sampling-based robotic information gathering algorithms","volume":"33","author":"Hollinger","year":"2014","journal-title":"Int. J. Robot. Res."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Marchant, R., and Ramos, F. (June, January 31). Bayesian Optimisation for informative continuous path planning. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907763"},{"key":"ref_18","unstructured":"Marchant, R., Ramos, F., and Sanner, S. (2014, January 23\u201327). Sequential Bayesian Optimisation for Spatial-Temporal Monitoring. Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI), Quebec, QC, Canada."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1109\/TSMC.2015.2500027","article-title":"Mutual Information-Based Multi-AUV Path Planning for Scalar Field Sampling Using Multidimensional RRT-Star","volume":"46","author":"Cui","year":"2016","journal-title":"IEEE Trans. Syst. Man. Cybern. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1016\/j.automatica.2012.05.029","article-title":"Spatial prediction with mobile sensor networks using Gaussian processes with built-in Gaussian Markov random fields","volume":"49","author":"Xu","year":"2012","journal-title":"Automatica"},{"key":"ref_21","first-page":"3137","article-title":"A Generalized Path Integral Control Approach to Reinforcement Learning","volume":"11","author":"Theodorou","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1063\/1.2709596","article-title":"An Introduction to Stochastic Control Theory, Path Integrals and Reinforcement Learning","volume":"887","author":"Kappen","year":"2007","journal-title":"AIP Conf. Proc."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1007\/s10514-017-9685-2","article-title":"Learning Environmental Fields with Micro Underwater Vehicles: A Path Integral\u2014Gaussian Markov Random Field Approach","volume":"42","author":"Kreuzer","year":"2018","journal-title":"Auton. Robots"},{"key":"ref_24","first-page":"235","article-title":"Near-Optimal Sensor Placements in Gaussian Processes: Theory, Efficient Algorithms and Empirical Studies","volume":"9","author":"Krause","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Rue, H., and Held, L. (2005). Gaussian Markov Random Fields: Theory and Applications, CRC Press.","DOI":"10.1201\/9780203492024"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A New Approach to Linear Filtering and Prediction Problems","volume":"82","author":"Kalman","year":"1960","journal-title":"J. Basic Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1109\/MSP.2013.2246292","article-title":"Spatiotemporal Learning via Infinite-dimensional Bayesian Filtering and Smoothing: A look at Gaussian Process Regression through Kalman Filtering","volume":"30","author":"Sarkka","year":"2013","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_28","unstructured":"Turchetta, M., Berkenkamp, F., and Krause, A. (2016). Safe exploration in finite markov decision processes. Advances in Neural Information Processing Systems, Curran Associates Inc."},{"key":"ref_29","unstructured":"Zimmer, C., Meister, M., and Nguyen-Tuong, D. (2018). Safe Active Learning for Time-Series Modeling with Gaussian Processes. Advances in Neural Information Processing Systems, Curran Associates Inc."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/9\/2094\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:49:25Z","timestamp":1760186965000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/9\/2094"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,5,6]]},"references-count":29,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2019,5]]}},"alternative-id":["s19092094"],"URL":"https:\/\/doi.org\/10.3390\/s19092094","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,5,6]]}}}