{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T02:45:56Z","timestamp":1782355556399,"version":"3.54.5"},"reference-count":31,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T00:00:00Z","timestamp":1752451200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Tendon-Driven Continuum Robots are widely recognized for their flexibility and adaptability in constrained environments, making them invaluable for most applications, such as medical surgery, industrial tasks, and so on. However, the inherent uncertainties and highly nonlinear dynamics of these manipulators pose significant challenges for classical model-based controllers. Addressing these challenges necessitates the development of advanced control strategies capable of adapting to diverse operational scenarios. This paper presents a centralized position control strategy using Deep Reinforcement Learning, with a particular focus on the Sim-to-Real transfer of control policies. The proposed method employs a customized Modified Transpose Jacobian control strategy for continuum arms, where its parameters are optimally tuned using the Deep Deterministic Policy Gradient algorithm. By integrating an optimal adaptive gain-tuning regulation, the research aims to develop a model-free controller that achieves superior performance compared to ideal model-based strategies. Both simulations and real-world experiments demonstrate that the proposed controller significantly enhances the trajectory-tracking performance of continuum manipulators. The proposed controller achieves robustness across various initial conditions and trajectories, making it a promising candidate for general-purpose applications.<\/jats:p>","DOI":"10.3389\/frobt.2025.1488869","type":"journal-article","created":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T07:34:37Z","timestamp":1752478477000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Learning-based control for tendon-driven continuum robotic arms"],"prefix":"10.3389","volume":"12","author":[{"given":"Nima","family":"Maghooli","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Omid","family":"Mahdizadeh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammad","family":"Bajelani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"S. Ali A.","family":"Moosavian","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,7,14]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1261","DOI":"10.1109\/TRO.2015.2489500","article-title":"Continuum robots for medical applications: a survey","volume":"31","author":"Burgner-Kahrs","year":"2015","journal-title":"IEEE Trans. Rob."},{"key":"B2","doi-asserted-by":"publisher","first-page":"4741","DOI":"10.1109\/LRA.2022.3146903","article-title":"Closed-loop dynamic control of a soft manipulator using deep reinforcement learning","volume":"7","author":"Centurelli","year":"2022","journal-title":"IEEE Rob. Autom. Lett."},{"key":"B3","first-page":"245","volume-title":"Kinematically redundant manipulators","author":"Chiaverini","year":"2008"},{"key":"B4","first-page":"1","article-title":"Control of continuum robots for medical applications: state of the art","author":"Chikhaoui","year":"2018"},{"key":"B5","first-page":"438","volume-title":"Introduction to robotics: Mechanics and control","author":"Craig","year":"2018"},{"key":"B6","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1080\/01691864.2013.854452","article-title":"Compact modeling of spatial continuum robotic arms towards real-time control","volume":"28","author":"Dehghani","year":"2013","journal-title":"Adv. Rob."},{"key":"B7","doi-asserted-by":"publisher","first-page":"100077","DOI":"10.1016\/J.FRAOPE.2024.100077","article-title":"DDPG-based reinforcement learning for controlling a spatial three-section continuum robot","volume":"6","author":"Djeffal","year":"2024","journal-title":"Franklin Open"},{"key":"B8","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1561\/2200000071","article-title":"An introduction to deep reinforcement learning","volume":"11","author":"Fran\u00e7ois-Lavet","year":"2018","journal-title":"Found. Trends Mach. Learn."},{"key":"B9","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1089\/soro.2017.0007","article-title":"Control strategies for soft robotic manipulators: a survey","volume":"5","author":"George Thuruthel","year":"2018","journal-title":"Soft Rob."},{"key":"B10","first-page":"1208","article-title":"Path planning for multisection continuum arms","author":"Godage","year":"2012"},{"key":"B11","doi-asserted-by":"publisher","first-page":"809","DOI":"10.1007\/s10846-020-01237-6","article-title":"A fuzzy reinforcement learning approach for continuum robot control","volume":"100","author":"Goharimanesh","year":"2020","journal-title":"J. Intell. Rob. Syst. Theory Appl."},{"key":"B12","doi-asserted-by":"publisher","first-page":"873446","DOI":"10.3389\/frobt.2022.873446","article-title":"FAS\u2014a fully actuated segment for tendon-driven continuum robots","volume":"9","author":"Grassmann","year":"2022","journal-title":"Front. Rob. AI"},{"key":"B13","doi-asserted-by":"publisher","first-page":"04022065","DOI":"10.1061\/(ASCE)AS.1943-5525.0001426","article-title":"An integrated tracking control approach based on reinforcement learning for a continuum robot in space capture missions","volume":"35","author":"Jiang","year":"2022","journal-title":"J. Aerosp. Eng."},{"key":"B14","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1109\/TRO.2005.861458","article-title":"Kinematics for multisection continuum robots","volume":"22","author":"Jones","year":"2006","journal-title":"IEEE Trans. Rob."},{"key":"B15","doi-asserted-by":"publisher","first-page":"1238","DOI":"10.1177\/0278364913495721","article-title":"Reinforcement learning in robotics: a survey","volume":"32","author":"Kober","year":"2013","journal-title":"Int. J. Rob. Res."},{"key":"B16","doi-asserted-by":"publisher","first-page":"9153","DOI":"10.3390\/APP13169153","article-title":"Comparison of various reinforcement learning environments in the context of continuum robot control","volume":"13","author":"Ko\u0142ota","year":"2023","journal-title":"Appl. Sci."},{"key":"B17","article-title":"Continuous control with deep reinforcement learning","author":"Lillicrap","year":"2015"},{"key":"B18","first-page":"631","article-title":"Control of continuum manipulators with shape constraints via deep reinforcement learning","author":"Maghooli","year":"2024"},{"key":"B19","first-page":"606","article-title":"Intelligent model-free control for tendon-driven continuum robotic arms","author":"Maghooli","year":"2023"},{"key":"B20","doi-asserted-by":"publisher","first-page":"1500","DOI":"10.1109\/IROS.1997.656557","article-title":"Control of space free-flyers using the modified transpose Jacobian algorithm","volume":"3","author":"Moosavian","year":"1997","journal-title":"IEEE Int. Conf. Intell. Rob. Syst."},{"key":"B21","doi-asserted-by":"publisher","first-page":"1226","DOI":"10.1016\/J.AUTOMATICA.2006.12.029","article-title":"Modified transpose Jacobian control of robotic systems","volume":"43","author":"Moosavian","year":"2007","journal-title":"Automatica"},{"key":"B22","doi-asserted-by":"publisher","first-page":"895388","DOI":"10.3389\/frobt.2022.895388","article-title":"Characterization of continuum robot arms under reinforcement learning and derived improvements","volume":"9","author":"Morimoto","year":"2022","journal-title":"Front. Rob. AI"},{"key":"B23","first-page":"141","article-title":"Model-free reinforcement learning with ensemble for a soft continuum robot arm","author":"Morimoto","year":"2021"},{"key":"B24","doi-asserted-by":"publisher","first-page":"809427","DOI":"10.3389\/frobt.2021.809427","article-title":"Design, modeling, and visual learning-based control of soft robotic fish driven by super-coiled polymers","volume":"8","author":"Rajendran","year":"2022","journal-title":"Front. Rob. AI"},{"key":"B25","doi-asserted-by":"publisher","first-page":"630245","DOI":"10.3389\/frobt.2020.630245","article-title":"How to model tendon-driven continuum robots and benchmark modelling performance","volume":"7","author":"Rao","year":"2021","journal-title":"Front. Rob. AI"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1033","DOI":"10.1109\/TRO.2011.2160469","article-title":"Statics and dynamics of continuum robots with general tendon routing and external loading","volume":"27","author":"Rucker","year":"2011","journal-title":"IEEE Trans. Rob."},{"key":"B27","first-page":"497","article-title":"Continuous control of a soft continuum arm using deep reinforcement learning","author":"Satheeshbabu","year":"2020"},{"key":"B28","first-page":"558","article-title":"Review on reinforcement learning controller in soft manipulator","author":"Wang","year":""},{"key":"B29","doi-asserted-by":"publisher","first-page":"730330","DOI":"10.3389\/frobt.2021.730330","article-title":"A survey for machine learning-based control of continuum robots","volume":"8","author":"Wang","year":"","journal-title":"Front. Rob. AI"},{"key":"B30","doi-asserted-by":"publisher","first-page":"310","DOI":"10.3390\/INFO11060310","article-title":"Position control of cable-driven robotic soft arm based on deep reinforcement learning","volume":"11","author":"Wu","year":"2020","journal-title":"Information 2020"},{"key":"B31","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1016\/J.MECHMACHTHEORY.2019.02.005","article-title":"A comprehensive static model of cable-driven multi-section continuum robots considering friction effect","volume":"135","author":"Yuan","year":"2019","journal-title":"Mech. Mach. Theory"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2025.1488869\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T07:34:37Z","timestamp":1752478477000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2025.1488869\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,14]]},"references-count":31,"alternative-id":["10.3389\/frobt.2025.1488869"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2025.1488869","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,14]]},"article-number":"1488869"}}