{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T16:10:09Z","timestamp":1777911009479,"version":"3.51.4"},"reference-count":31,"publisher":"SAGE Publications","issue":"3","license":[{"start":{"date-parts":[[2024,11,26]],"date-time":"2024-11-26T00:00:00Z","timestamp":1732579200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Transactions of the Institute of Measurement and Control"],"published-print":{"date-parts":[[2026,2]]},"abstract":"<jats:p>This paper proposes a two-stage controller based on deep reinforcement learning for an unmanned underwater vehicle under conditions of parameter uncertainty and external measurement noise. The feedback linearization technique is first applied to linearize the dynamic model, and then this is used to design the control law, the integral term is added to expand the control law into a Proportional Integral Derivative (PID) control method, which is used as the first stage controller. The second stage controller is to realize parameter regulation, the Deep Deterministic Policy Gradient (DDPG) algorithm is used to train the agent in response to the controller\u2019s need to adjust gain parameters in real time to cope with external interference. Moreover, in order to minimize unnecessary exploration at the beginning of the training process, the previous excellent manual experience is combined with the training process. Compared to the original DDPG algorithm, this algorithm exhibits a faster convergence rate. To verify the performance of Feedback Linearized DDPG PID Control (FLDDPGPIDC), three advanced methods were compared with the method. Results indicate that tracking performance is significantly improved in the presence of external measurement noise and dynamic parameter perturbations.<\/jats:p>","DOI":"10.1177\/01423312241292851","type":"journal-article","created":{"date-parts":[[2024,11,27]],"date-time":"2024-11-27T02:07:59Z","timestamp":1732673279000},"page":"449-459","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Single degree of freedom control based on deep reinforcement learning for underwater unmanned vehicle"],"prefix":"10.1177","volume":"48","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-4405-6192","authenticated-orcid":false,"given":"Nan","family":"Li","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, Nanjing University of Science and Technology, PR China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Changming","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Nanjing University of Science and Technology, PR China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yan","family":"Shi","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Nanjing University of Science and Technology, PR China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2024,11,26]]},"reference":[{"key":"e_1_3_3_2_1","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1218\/1\/012058"},{"key":"e_1_3_3_3_1","doi-asserted-by":"publisher","DOI":"10.3390\/su152014691"},{"key":"e_1_3_3_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.isatra.2020.02.017"},{"key":"e_1_3_3_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.oceaneng.2023.114109"},{"key":"e_1_3_3_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.oceaneng.2020.107131"},{"key":"e_1_3_3_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11071-015-2551-x"},{"key":"e_1_3_3_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASE.2020.3001183"},{"key":"e_1_3_3_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3001631"},{"key":"e_1_3_3_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.oceaneng.2020.108053"},{"key":"e_1_3_3_11_1","doi-asserted-by":"publisher","DOI":"10.5954\/ICAROB.2024.GS4-6"},{"key":"e_1_3_3_12_1","doi-asserted-by":"publisher","DOI":"10.3390\/jmse10060795"},{"key":"e_1_3_3_13_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2022\/4126595","article-title":"(2022) An embedded linear model three-dimensional fuzzy PID control system for a bionic AUV under wave disturbance","author":"Lyu D","year":"2022","unstructured":"Lyu D, Su H, Li Y, et al. (2022) An embedded linear model three-dimensional fuzzy PID control system for a bionic AUV under wave disturbance. Mathematical Problems in Engineering. 2022 (1): 1\u201319.","journal-title":"Mathematical Problems in Engineering"},{"key":"e_1_3_3_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2964116"},{"key":"e_1_3_3_15_1","doi-asserted-by":"publisher","DOI":"10.1177\/09544062231207456"},{"key":"e_1_3_3_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICUAS54217.2022.9836068"},{"key":"e_1_3_3_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2020.108863"},{"key":"e_1_3_3_18_1","doi-asserted-by":"publisher","DOI":"10.1061\/JAEEEZ.ASENG-5286"},{"key":"e_1_3_3_19_1","first-page":"10895","article-title":"A new approach for three-dimensional trajectory tracking control of under-actuated AUVs with model uncertainties","volume":"228","author":"Thanh PNN","year":"2021","unstructured":"Thanh PNN, Tam PM, Anh HPH (2021) A new approach for three-dimensional trajectory tracking control of under-actuated AUVs with model uncertainties. Ocean Engineering 228: 10895.","journal-title":"Ocean Engineering"},{"issue":"1","key":"e_1_3_3_20_1","first-page":"41","article-title":"Control of an unmmaned underwater vehicles using an optimized LQR method","volume":"1","author":"Tijani IB","year":"2016","unstructured":"Tijani IB, Budiyono A (2016) Control of an unmmaned underwater vehicles using an optimized LQR method. Marine and Underwater Science and Technology 1(1): 41\u201348.","journal-title":"Marine and Underwater Science and Technology"},{"key":"e_1_3_3_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apor.2021.102960"},{"key":"e_1_3_3_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.oceaneng.2023.116184"},{"key":"e_1_3_3_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.oceaneng.2024.118171"},{"key":"e_1_3_3_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.oceaneng.2022.113407"},{"key":"e_1_3_3_25_1","doi-asserted-by":"publisher","DOI":"10.3934\/mbe.2023404"},{"key":"e_1_3_3_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.euromechflu.2015.05.007"},{"key":"e_1_3_3_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.oceaneng.2020.107884"},{"key":"e_1_3_3_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.oceaneng.2018.12.018"},{"key":"e_1_3_3_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40815-020-00939-1"},{"key":"e_1_3_3_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.oceaneng.2022.112566"},{"key":"e_1_3_3_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.oceaneng.2023.113667"},{"key":"e_1_3_3_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40815-017-0398-7"}],"container-title":["Transactions of the Institute of Measurement and Control"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01423312241292851","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/01423312241292851","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01423312241292851","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T15:12:29Z","timestamp":1777648349000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/01423312241292851"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,26]]},"references-count":31,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,2]]}},"alternative-id":["10.1177\/01423312241292851"],"URL":"https:\/\/doi.org\/10.1177\/01423312241292851","relation":{},"ISSN":["0142-3312","1477-0369"],"issn-type":[{"value":"0142-3312","type":"print"},{"value":"1477-0369","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,26]]}}}