{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T04:44:19Z","timestamp":1792730659904,"version":"4.5.0"},"reference-count":75,"publisher":"SAGE Publications","issue":"3","license":[{"start":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T00:00:00Z","timestamp":1725926400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T00:00:00Z","timestamp":1725926400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2025,3]]},"abstract":"<jats:p>Learning-based adaptive control methods hold the potential to empower autonomous agents in mitigating the impact of process variations with minimal human intervention. However, their application to autonomous underwater vehicles (AUVs) has been constrained by two main challenges: (1) the presence of unknown dynamics in the form of sea current disturbances, which cannot be modelled or measured due to limited sensor capability, particularly on smaller low-cost AUVs, and (2) the nonlinearity of AUV tasks, where the controller response at certain operating points must be excessively conservative to meet specifications at other points. Deep Reinforcement Learning (DRL) offers a solution to these challenges by training versatile neural network policies. Nevertheless, the application of DRL algorithms to AUVs has been predominantly limited to simulated environments due to their inherent high sample complexity and the distribution shift problem. This paper introduces a novel approach by combining the Maximum Entropy Deep Reinforcement Learning framework with a classic model-based control architecture to formulate an adaptive controller. In this framework, we propose a Sim-to-Real transfer strategy, incorporating a bio-inspired experience replay mechanism, an enhanced domain randomisation technique, and an evaluation protocol executed on a physical platform. Our experimental assessments demonstrate the effectiveness of this method in learning proficient policies from suboptimal simulated models of the AUV. When transferred to a real-world vehicle, the approach exhibits a control performance three times higher compared to its model-based nonadaptive but optimal counterpart.<\/jats:p>","DOI":"10.1177\/02783649241272115","type":"journal-article","created":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T10:00:30Z","timestamp":1725962430000},"page":"407-430","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":21,"title":["Sim-to-real transfer of adaptive control parameters for AUV stabilisation under current disturbance"],"prefix":"10.1177","volume":"44","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1882-0731","authenticated-orcid":false,"given":"Thomas","family":"Chaffre","sequence":"first","affiliation":[{"name":"Flinders University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan","family":"Wheare","sequence":"additional","affiliation":[{"name":"Flinders University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Lammas","sequence":"additional","affiliation":[{"name":"Flinders University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paulo","family":"Santos","sequence":"additional","affiliation":[{"name":"Flinders University"},{"name":"CROSSING IRL CNRS"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gilles","family":"Le Chenadec","sequence":"additional","affiliation":[{"name":"ENSTA Bretagne"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7654-9978","authenticated-orcid":false,"given":"Karl","family":"Sammut","sequence":"additional","affiliation":[{"name":"Flinders University"},{"name":"CROSSING IRL CNRS"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3281-379X","authenticated-orcid":false,"given":"Benoit","family":"Clement","sequence":"additional","affiliation":[{"name":"Flinders University"},{"name":"CROSSING IRL CNRS"},{"name":"ENSTA Bretagne"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2024,9,10]]},"reference":[{"key":"e_1_3_5_2_1","first-page":"151","volume-title":"Proceedings of the 36th International Conference on Machine Learning, Proceedings of Machine Learning Research","author":"Ahmed Z","year":"2019","unstructured":"Ahmed Z, Le Roux N, Norouzi M, et al. (2019) Understanding the impact of entropy on policy optimization. In: Chaudhuri K, Salakhutdinov R (eds) Proceedings of the 36th International Conference on Machine Learning, Proceedings of Machine Learning Research. Piscataway, NJ: IEEE, Vol. 97, 151\u2013160."},{"key":"e_1_3_5_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/OCEANS.2005.1639923"},{"key":"e_1_3_5_4_1","volume-title":"Layer Normalization","author":"Ba LJ","year":"2016","unstructured":"Ba LJ, Kiros JR, Hinton GE (2016) Layer Normalization. CoRR abs\/1607. https:\/\/arxiv.org\/abs\/1607.06450."},{"key":"e_1_3_5_5_1","doi-asserted-by":"publisher","DOI":"10.3390\/rs12162588"},{"key":"e_1_3_5_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/C2014-0-03287-X"},{"key":"e_1_3_5_7_1","volume-title":"Bluerov-ros-pkg","author":"Blue Robotics Inc","year":"2015","unstructured":"Blue Robotics Inc (2015) Bluerov-ros-pkg. https:\/\/github.com\/bluerobotics\/bluerov-ros-pkg."},{"key":"e_1_3_5_8_1","volume-title":"BlueROV2","author":"Blue Robotics Inc","year":"2017","unstructured":"Blue Robotics Inc (2017a) BlueROV2. https:\/\/docs.bluerobotics.com\/brov2\/."},{"key":"e_1_3_5_9_1","volume-title":"T200 Thruster","author":"Blue Robotics Inc","year":"2017","unstructured":"Blue Robotics Inc (2017b) T200 Thruster. https:\/\/bluerobotics.com\/store\/thrusters\/t100-t200-thrusters\/t200-thruster-r2-rp\/."},{"key":"e_1_3_5_10_1","volume-title":"Reinforcement Learning and Sim-To-Real Transfer for Adaptive Control of AUV","author":"Chaffre T","year":"2023","unstructured":"Chaffre T (2023) Reinforcement Learning and Sim-To-Real Transfer for Adaptive Control of AUV. Bedford Park, SA: Flinders University. Phd thesis."},{"key":"e_1_3_5_11_1","doi-asserted-by":"crossref","unstructured":"Chaffre T Moras J Chan-Hon-Tong A et al. (2020) Sim-to-Real transfer with incremental environment complexity for reinforcement learning of depth-based robot navigation. In: Proceedings of the 17th International Conference on Informatics Automation and Robotics ICINCO 2020 Virtual 2020.","DOI":"10.5220\/0009821603140323"},{"key":"e_1_3_5_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2021.10.113"},{"key":"e_1_3_5_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-92442-3_19"},{"key":"e_1_3_5_14_1","volume-title":"Learning Stochastic Adaptive Control Using a Bio-Inspired Experience Replay","author":"Chaffre T","year":"2022","unstructured":"Chaffre T, Santos P, Le Chenadec G, et al. (2022b) Learning Stochastic Adaptive Control Using a Bio-Inspired Experience Replay. Bedford Park, SA: Flinders University."},{"key":"e_1_3_5_15_1","volume-title":"The Tenth International Conference on Learning Representations, ICLR 2022","author":"Chen X","year":"2022","unstructured":"Chen X, Hu J, Jin C, et al. (2022) Understanding domain randomization for sim-to-real transfer. The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, 25\u201329 April 2022. https:\/\/openreview.net\/forum?id=T8vZHIRTrY."},{"key":"e_1_3_5_16_1","doi-asserted-by":"publisher","DOI":"10.1049\/iet-its.2019.0273"},{"key":"e_1_3_5_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.conengprac.2003.12.013"},{"key":"e_1_3_5_18_1","volume-title":"Automatique Appliqu\u00e9e (2\u00b0 \u00c9d. Revue et Augment\u00e9e)","author":"De-Larminat P","year":"2009","unstructured":"De-Larminat P (2009) Automatique Appliqu\u00e9e (2\u00b0 \u00c9d. Revue et Augment\u00e9e). London: Hermes Science."},{"key":"e_1_3_5_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/CDC.1996.572756"},{"key":"e_1_3_5_20_1","unstructured":"Dulac-Arnold G Levine N Mankowitz DJ et al. (2020) An empirical investigation of the challenges of real-world reinforcement learning. https:\/\/arxiv.org\/abs\/2003.11881."},{"key":"e_1_3_5_21_1","unstructured":"Ermakov V (2019) Mavros. https:\/\/wiki.ros.org\/mavros."},{"key":"e_1_3_5_22_1","unstructured":"Eysenbach B Levine S (2022) Maximum entropy RL (provably) solves some robust RL problems. In: The tenth international conference on learning representations ICLR 2022 Virtual Event 25\u201329 April 2022. https:\/\/openreview.net\/forum?id=PtSAD3caaA2."},{"key":"e_1_3_5_23_1","volume-title":"International Conference on Machine Learning, ICML 2023, 23-29 July 2023","author":"Eysenbach B","year":"2023","unstructured":"Eysenbach B, Geist M, Levine S, et al. (2023a) A connection between one-step RL and critic regularization in reinforcement learning. In: Krause A, Brunskill E, Cho K, et al. (eds) International Conference on Machine Learning, ICML 2023, 23-29 July 2023. Honolulu, Hawaii, USA: PMLR. https:\/\/proceedings.mlr.press\/v202\/eysenbach23a.html."},{"key":"e_1_3_5_24_1","volume-title":"International Conference on Machine Learning, ICML 2023, 23-29 July 2023","author":"Eysenbach B","year":"2023","unstructured":"Eysenbach B, Geist M, Levine S, et al. (2023b) A connection between one-step RL and critic regularization in reinforcement learning. In: Krause A, Brunskill E, Cho K, et al. (eds) International Conference on Machine Learning, ICML 2023, 23-29 July 2023. Honolulu, Hawaii, USA. PMLR. https:\/\/proceedings.mlr.press\/v202\/eysenbach23a.html."},{"key":"e_1_3_5_25_1","volume-title":"Proceedings of the 37th International Conference on Machine Learning, ICML 2020","author":"Fedus W","year":"2020","unstructured":"Fedus W, Ramachandran P, Agarwal R, et al. (2020) Revisiting fundamentals of experience replay. Proceedings of the 37th International Conference on Machine Learning, ICML 2020, Virtual Event, 13\u201318 July 2020. https:\/\/proceedings.mlr.press\/v119\/fedus20a.html."},{"key":"e_1_3_5_26_1","unstructured":"Fortunato M Azar MG Piot B et al. (2018) Noisy networks for exploration. In: 6th International Conference on Learning Representations ICLR 2018 Vancouver BC Canada 3 May 2018. https:\/\/openreview.net\/forum?id=rywHCPkAW."},{"key":"e_1_3_5_27_1","volume-title":"Nonlinear Modelling and Control of Underwater Vehicles","author":"Fossen TI","year":"1991","unstructured":"Fossen TI (1991) Nonlinear Modelling and Control of Underwater Vehicles. PhD Thesis, Islamabad: NUST."},{"key":"e_1_3_5_28_1","doi-asserted-by":"publisher","DOI":"10.1002\/9781119994138"},{"key":"e_1_3_5_29_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan","author":"Fujimoto S","year":"2018","unstructured":"Fujimoto S, van Hoof H, Meger D (2018) Addressing function approximation error in actor-critic methods. In: Dy JG, Krause A (eds) Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan. Stockholm, Sweden: PMLR. https:\/\/proceedings.mlr.press\/v80\/fujimoto18a.html."},{"key":"e_1_3_5_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/2789272.2886795"},{"key":"e_1_3_5_31_1","volume-title":"Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021","author":"Ghosh D","year":"2021","unstructured":"Ghosh D, Rahme J, Kumar A, et al. (2021) Why generalization in RL is difficult: epistemic pomdps and implicit partial observability. In: Ranzato M, Beygelzimer A, Dauphin YN, et al. (eds) Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021. Piscataway: IEEE. https:\/\/proceedings.neurips.cc\/paper\/2021\/hash\/d5ff135377d39f1de7372c95c74dd962-Abstract.html."},{"key":"e_1_3_5_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/AUV.2012.6380718"},{"key":"e_1_3_5_33_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning, ICML 2017","author":"Haarnoja T","year":"2017","unstructured":"Haarnoja T, Tang H, Abbeel P, et al. (2017) Reinforcement learning with deep energy-based policies. In: Precup D, Teh YW (eds) Proceedings of the 34th International Conference on Machine Learning, ICML 2017. Sydney, NSW, Australia: PMLR. https:\/\/proceedings.mlr.press\/v70\/haarnoja17a.html."},{"key":"e_1_3_5_34_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning, ICML 2018","author":"Haarnoja T","year":"2018","unstructured":"Haarnoja T, Zhou A, Abbeel P, et al. (2018) Soft actor-critic: off-policy maximum entropy deep reinforcement learning with a stochastic actor. In: Dy JG, Krause A (eds) Proceedings of the 35th International Conference on Machine Learning, ICML 2018. Stockholm, Sweden: PMLR. https:\/\/proceedings.mlr.press\/v80\/haarnoja18b.html."},{"key":"e_1_3_5_35_1","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2019.XV.011"},{"key":"e_1_3_5_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/J.VEHCOM.2022.100551"},{"key":"e_1_3_5_37_1","doi-asserted-by":"crossref","unstructured":"Hanover D Loquercio A Bauersfeld L et al. (2023) Autonomous drone racing: a survey. arXiv:2301.01755.","DOI":"10.1109\/TRO.2024.3400838"},{"key":"e_1_3_5_38_1","volume-title":"Proceedings of the 39th International Conference on Machine Learning","author":"Kang K","year":"2022","unstructured":"Kang K, Gradu P, Choi JJ, et al. (2022) Lyapunov density models: constraining distribution shift in learning-based control. In: Chaudhuri K, Jegelka S, Song L, et al. (eds) Proceedings of the 39th International Conference on Machine Learning. Baltimore, MA: PMLR."},{"key":"e_1_3_5_39_1","doi-asserted-by":"publisher","DOI":"10.23919\/OCEANS40490.2019.8962598"},{"key":"e_1_3_5_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2022.10.401"},{"key":"e_1_3_5_41_1","volume-title":"Advances in Neural Information Processing Systems 12, [NIPS Conference, Denver, Colorado, USA, November 29 - December 4, 1999]","author":"Konda VR","year":"1999","unstructured":"Konda VR, Tsitsiklis JN (1999) Actor-critic algorithms. In: Solla SA, Leen TK, M\u00fcller K (eds) Advances in Neural Information Processing Systems 12, [NIPS Conference, Denver, Colorado, USA, November 29 - December 4, 1999]. Cambridge, Massachusetts: The MIT Press. https:\/\/papers.nips.cc\/paper\/1786-actor-critic-algorithms."},{"key":"e_1_3_5_42_1","unstructured":"Kostrikov I Nair A Levine S (2022) Offline reinforcement learning with implicit q-learning. In: The tenth international conference on learning representations ICLR 2022 Virtual Event 25\u201329 April 2022. https:\/\/openreview.net\/forum?id=68n2s9ZJWF8."},{"key":"e_1_3_5_43_1","volume-title":"Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019","author":"Kumar A","year":"2019","unstructured":"Kumar A, Fu J, Soh M, et al. (2019) Stabilizing off-policy q-learning via bootstrapping error reduction. In: Wallach HM, Larochelle H, Beygelzimer A, et al. (eds.) Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019. Vancouver, BC, Canada: NeurIPS. https:\/\/proceedings.neurips.cc\/paper\/2019\/hash\/c2073ffa77b5357a498057413bb09d3a-Abstract.html."},{"key":"e_1_3_5_44_1","doi-asserted-by":"publisher","unstructured":"Lagattu K Chenadec GL Artusi E et al. (2024) Drl-based thruster fault recovery for unmanned underwater vehicles. In: Australian & New Zealand Control Conference ANZCC 2024 Gold Coast Australia 1-2 February 2024. DOI: 10.1109\/ANZCC59813.2024.10432828.","DOI":"10.1109\/ANZCC59813.2024.10432828"},{"key":"e_1_3_5_45_1","unstructured":"Li Q Kumar A Kostrikov I et al. (2023) Efficient deep reinforcement learning requires regulating overfitting. In: The eleventh international conference on learning representations ICLR 2023 Kigali Rwanda 1\u20135 May 2023. https:\/\/openreview.net\/pdf?id=14-kr46GvP-."},{"key":"e_1_3_5_46_1","isbn-type":"print","volume-title":"Liapunov Functions and Stability in Control Theory","author":"Liberzon D","year":"2005","unstructured":"Liberzon D (2005a) Liapunov Functions and Stability in Control Theory, 2nd edition. berlin: Springer. ISBN: 3-540-21332-5.","ISBN":"https:\/\/id.crossref.org\/isbn\/3540213325","edition":"2"},{"key":"e_1_3_5_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2005.08.002"},{"key":"e_1_3_5_48_1","unstructured":"Lillicrap TP Hunt JJ Pritzel A et al. (2016) Continuous control with deep reinforcement learning. In: Bengio Y LeCun Y (eds) 4th International Conference on Learning Representations ICLR 2016 San Juan Puerto Rico: ICLR. https:\/\/arxiv.org\/abs\/1509.02971."},{"key":"e_1_3_5_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992699"},{"key":"e_1_3_5_50_1","doi-asserted-by":"crossref","unstructured":"Liu Y Gupta A Abbeel P et al. (2018) Imitation from observation: learning to imitate behaviors from raw video via context translation. 2018 IEEE international conference on robotics and automation ICRA 2018 Brisbane Australia 21\u201325 May 2018.","DOI":"10.1109\/ICRA.2018.8462901"},{"key":"e_1_3_5_51_1","volume-title":"UUV Simulator: A Gazebo-Based Package for Underwater Intervention and Multi-Robot Simulation","author":"Manh\u00e3es M","year":"2016","unstructured":"Manh\u00e3es M, Scherer S, Voss M, et al. (2016) UUV Simulator: A Gazebo-Based Package for Underwater Intervention and Multi-Robot Simulation. Piscataway: MTS\/IEEE OCEANS."},{"key":"e_1_3_5_52_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.oceaneng.2008.08.007"},{"key":"e_1_3_5_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-08338-4_25"},{"key":"e_1_3_5_54_1","volume-title":"Ar_track_alvar","author":"Niekum S","year":"2019","unstructured":"Niekum S, Saito I (2019) Ar_track_alvar. https:\/\/wiki.ros.org\/ar_track_alvar."},{"issue":"4","key":"e_1_3_5_55_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3197517.3201311","article-title":"Deepmimic: example-guided deep reinforcement learning of physics-based character skills","volume":"37","author":"Peng XB","year":"2018","unstructured":"Peng XB, Abbeel P, Levine S, et al. (2018) Deepmimic: example-guided deep reinforcement learning of physics-based character skills. ACM Transactions on Graphics 37(4): 1\u201314.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_5_56_1","unstructured":"Plappert M Houthooft R Dhariwal P et al. (2018) Parameter space noise for exploration. 6th international conference on learning representations ICLR 2018 Vancouver BC Canada 3 May 2018. https:\/\/openreview.net\/forum?id=ByBAl2eAZ."},{"key":"e_1_3_5_57_1","volume-title":"Pixhawk 1 Flight controller","author":"PX4 Dev Team","year":"2019","unstructured":"PX4 Dev Team (2019) Pixhawk 1 Flight controller. https:\/\/docs.px4.io\/v1.9.0\/en\/flight_controller\/pixhawk.html."},{"key":"e_1_3_5_58_1","volume-title":"Qgroundcontrol","author":"QGroundControl","year":"2019","unstructured":"QGroundControl (2019) Qgroundcontrol. https:\/\/qgroundcontrol.com\/."},{"key":"e_1_3_5_59_1","volume-title":"Ros: An Open-Source Robot Operating System","author":"Quigley M","year":"2009","unstructured":"Quigley M, Conley K, Gerkey BP, et al. (2009) Ros: An Open-Source Robot Operating System. ICRA Wksh on Open Source Software."},{"key":"e_1_3_5_60_1","volume-title":"System Identification and State Estimation for ROV uDrone","author":"Sand\u00f8y SS","year":"2016","unstructured":"Sand\u00f8y SS (2016) System Identification and State Estimation for ROV uDrone. Trondheim, Norway: NTNU. Master\u2019s Thesis."},{"key":"e_1_3_5_61_1","volume-title":"Target Following for an Autonomous Underwater Vehicle Using Regularized Elm-Based Reinforcement Learning","author":"Sun T","year":"2015","unstructured":"Sun T, He B, Nian R, et al. (2015) Target Following for an Autonomous Underwater Vehicle Using Regularized Elm-Based Reinforcement Learning. Washington: MTS\/IEEE."},{"key":"e_1_3_5_62_1","volume-title":"Reinforcement Learning an Introduction","author":"Sutton RS","year":"2018","unstructured":"Sutton RS, Barto AG (2018) Reinforcement Learning an Introduction. 2nd edition. Cambridge, Massachusetts: MIT Press.","edition":"2"},{"key":"e_1_3_5_63_1","first-page":"1057","volume-title":"Advances in Neural Information Processing Systems 12, [NIPS Conference, Denver, Colorado, USA, November 29 - December 4, 1999]","author":"Sutton RS","year":"1999","unstructured":"Sutton RS, McAllester DA, Singh S, et al. (1999) Policy gradient methods for reinforcement learning with function approximation. In: Solla SA, Leen TK, M\u00fcller K (eds) Advances in Neural Information Processing Systems 12, [NIPS Conference, Denver, Colorado, USA, November 29 - December 4, 1999]. Cambridge, Massachusetts: The MIT Press, 1057\u20131063."},{"key":"e_1_3_5_64_1","doi-asserted-by":"crossref","unstructured":"Tavakkoli F Sarhadi P Clement B (2024) Model free deep deterministic policy gradient controller for setpoint tracking of non-minimum phase systems. 14th united kingdom automatic control council (UKACC) international conference on control (CONTROL 2024) Winchester UK 10\u201312 April 2024.","DOI":"10.1109\/CONTROL60310.2024.10531953"},{"key":"e_1_3_5_65_1","doi-asserted-by":"publisher","unstructured":"Tobin J Fong R Ray A et al. (2017) Domain randomization for transferring deep neural networks from simulation to the real world. 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems IROS 2017 Vancouver BC Canada 24\u201328 September 2017. DOI: 10.1109\/IROS.2017.8202133.","DOI":"10.1109\/IROS.2017.8202133"},{"key":"e_1_3_5_66_1","volume-title":"ALVAR","author":"VTT Technical Research Centre of Finland Ltd","year":"2019","unstructured":"VTT Technical Research Centre of Finland Ltd (2019). ALVAR. https:\/\/virtual.vtt.fi\/virtual\/proj2\/multimedia\/alvar\/index.html."},{"key":"e_1_3_5_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/OCEANS.2018.8604754"},{"key":"e_1_3_5_68_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992698"},{"key":"e_1_3_5_69_1","volume-title":"Policy Gradient Algorithms","author":"Weng L","year":"2018","unstructured":"Weng L (2018) Policy Gradient Algorithms. https:\/\/lilianweng.github.io\/posts\/2018-04-08-policy-gradient\/."},{"key":"e_1_3_5_70_1","doi-asserted-by":"publisher","DOI":"10.3390\/S23177321"},{"key":"e_1_3_5_71_1","volume-title":"6-DoF Modelling and Control of a Remotely Operated Vehicle","author":"Wu CJ","year":"2018","unstructured":"Wu CJ (2018) 6-DoF Modelling and Control of a Remotely Operated Vehicle. Bedford Park, SA: Flinders University. Msc thesis."},{"key":"e_1_3_5_72_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-015-0186-2"},{"key":"e_1_3_5_73_1","doi-asserted-by":"publisher","unstructured":"Ye F Zhang S Wang P et al. (2021) A survey of deep reinforcement learning algorithms for motion planning and control of autonomous vehicles. IEEE Intelligent Vehicles Symposium IV 2021 Nagoya Japan 11\u201317 July 2021. DOI: 10.1109\/IV48863.2021.9575880.","DOI":"10.1109\/IV48863.2021.9575880"},{"key":"e_1_3_5_74_1","doi-asserted-by":"crossref","unstructured":"Yu R Shi Z Huang C et al. (2017) Deep reinforcement learning based optimal trajectory tracking control of autonomous underwater vehicle. In: 2017 36th chinese control conference (CCC) Dalian 26\u201328 July 2017.","DOI":"10.23919\/ChiCC.2017.8028138"},{"key":"e_1_3_5_75_1","doi-asserted-by":"publisher","DOI":"10.1109\/SSCI47803.2020.9308468"},{"key":"e_1_3_5_76_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.4019264"}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649241272115","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/02783649241272115","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649241272115","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T10:17:32Z","timestamp":1777457852000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/02783649241272115"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,10]]},"references-count":75,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,3]]}},"alternative-id":["10.1177\/02783649241272115"],"URL":"https:\/\/doi.org\/10.1177\/02783649241272115","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"value":"0278-3649","type":"print"},{"value":"1741-3176","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,10]]}}}