{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T08:04:58Z","timestamp":1768291498656,"version":"3.49.0"},"reference-count":43,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,1,22]],"date-time":"2022-01-22T00:00:00Z","timestamp":1642809600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61903141"],"award-info":[{"award-number":["61903141"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004479","name":"Natural Science Foundation of Jiangxi Province","doi-asserted-by":"publisher","award":["20192BAB217008"],"award-info":[{"award-number":["20192BAB217008"]}],"id":[{"id":"10.13039\/501100004479","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Using reinforcement learning (RL) for torque distribution of skid steering vehicles has attracted increasing attention recently. Various RL-based torque distribution methods have been proposed to deal with this classical vehicle control problem, achieving a better performance than traditional control methods. However, most RL-based methods focus only on improving the performance of skid steering vehicles, while actuator faults that may lead to unsafe conditions or catastrophic events are frequently omitted in existing control schemes. This study proposes a meta-RL-based fault-tolerant control (FTC) method to improve the tracking performance of vehicles in the case of actuator faults. Based on meta deep deterministic policy gradient (meta-DDPG), the proposed FTC method has a representative gradient-based metalearning algorithm workflow, which includes an offline stage and an online stage. In the offline stage, an experience replay buffer with various actuator faults is constructed to provide data for training the metatraining model; then, the metatrained model is used to develop an online meta-RL update method to quickly adapt its control policy to actuator fault conditions. Simulations of four scenarios demonstrate that the proposed FTC method can achieve a high performance and adapt to actuator fault conditions stably.<\/jats:p>","DOI":"10.3390\/s22030845","type":"journal-article","created":{"date-parts":[[2022,1,23]],"date-time":"2022-01-23T20:36:27Z","timestamp":1642970187000},"page":"845","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Metalearning-Based Fault-Tolerant Control for Skid Steering Vehicles under Actuator Fault Conditions"],"prefix":"10.3390","volume":"22","author":[{"given":"Huatong","family":"Dai","sequence":"first","affiliation":[{"name":"School of Electrical Engineering and Automation, East China Jiaotong University, Nanchang 330013, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pengzhan","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering and Automation, East China Jiaotong University, Nanchang 330013, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hui","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering and Automation, East China Jiaotong University, Nanchang 330013, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"157909","DOI":"10.1109\/ACCESS.2019.2949746","article-title":"Fault-Tolerant Dynamic Control of a Four-Wheel Redundantly-Actuated Mobile Robot","volume":"7","author":"Zhang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1108\/IR-04-2020-0082","article-title":"Comprehensive study of skid-steer wheeled mobile robots: Development and challenges","volume":"48","author":"Khan","year":"2021","journal-title":"Ind. Robot"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"91368","DOI":"10.1109\/ACCESS.2020.2994530","article-title":"Fault-Tolerant Stability Control for Independent Four-Wheel Drive Electric Vehicle Under Actuator Fault Conditions","volume":"8","author":"Lee","year":"2020","journal-title":"IEEE Access"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"9090","DOI":"10.1109\/TIE.2018.2798571","article-title":"Adaptive sliding mode fault-tolerant coordination control for four-wheel independently driven electric vehicles","volume":"65","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1049\/iet-cta.2018.5967","article-title":"Non-fragile control design and state estimation for vehicle dynamics subject to input delay and actuator faults","volume":"14","author":"Sakthivel","year":"2020","journal-title":"IET Control Theory Appl."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"45642","DOI":"10.1109\/ACCESS.2021.3066003","article-title":"MAS-Based Slip Ratio Fault-Tolerant Control in Finite Time for EV","volume":"9","author":"Zhang","year":"2021","journal-title":"IEEE Access"},{"key":"ref_7","first-page":"1","article-title":"Reinforcement learning-aided Performance-driven Fault-tolerant Control of Feedback Control Systems","volume":"99","author":"Hua","year":"2021","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_8","unstructured":"Finn, C., Rajeswaran, A., Kakade, S., and Levine, S. (2019, January 9\u201315). Online Meta-Learning. Proceedings of the 36th International Conference on Machine Learning, Long Beach, CA, USA."},{"key":"ref_9","first-page":"1094","article-title":"Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning","volume":"100","author":"Yu","year":"2020","journal-title":"Proc. Conf. Robot Learn."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1124","DOI":"10.1177\/0278364919859634","article-title":"High-speed path following control of skid-steered vehicles","volume":"38","author":"Huskic","year":"2019","journal-title":"Int. J. Robot. Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.ymssp.2019.01.005","article-title":"Kinematics-aware model predictive control for autonomous high-speed tracked vehicles under the off-road conditions","volume":"123","author":"Zhao","year":"2019","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1177\/0954407020950588","article-title":"Speed-adaptive motion control algorithm for differential steering vehicle","volume":"235","author":"Du","year":"2020","journal-title":"Proc. Inst. Mech. Eng. Part D J. Automob. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Rabiee, S., and Biswas, J. (2019, January 20\u201324). A Friction-Based Kinematic Model for Skid-Steer Wheeled Mobile Robots. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794216"},{"key":"ref_14","first-page":"2268","article-title":"Model predictive control allocation for stability improvement of four-wheel drive electric vehicles in critical driving condition","volume":"9","author":"Zhao","year":"2015","journal-title":"Control Theory Appl."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"9677","DOI":"10.1109\/TIE.2018.2821625","article-title":"Application of Lexicographic Optimization Method to Integrated Vehicle Control Systems","volume":"65","author":"Khosravani","year":"2018","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1007\/s12239-018-0006-3","article-title":"Allocation control algorithms design and comparison based on distributed drive electric vehicles","volume":"19","author":"Leng","year":"2018","journal-title":"Int. J. Automot. Technol."},{"key":"ref_17","unstructured":"Liao, J.F., Chen, Z., and Yao, B. (2017, January 3\u20137). Adaptive robust control of skid steer mobile robot with independent driving torque allocation. Proceedings of the 2017 IEEE International Conference on Advanced Intelligent Mechatronics (AIM), Munich, Germany."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhang, H., Liang, H.W., Tao, X., Ding, Y., Yu, B., and Bai, R.G. (2021). Driving force distribution and control for maneuverability and stability of a 6WD skid-steering EUGV with independent drive motors. Appl. Sci.-BASEL, 11.","DOI":"10.3390\/app11030961"},{"key":"ref_19","unstructured":"Finn, C., Abbeel, P., and Levine, S. (2017, January 6\u201311). Model-Agnostic Meta-Learning for Fast Adaptation of Deep Network. Proceedings of the 34th International Conference on Machine Learning, Sydney, NSW, Australia."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ahmed, I., Quiones-Grueiro, M., and Biswas, G. (2020). Complementary Meta-Reinforcement Learning for Fault-Adaptive Control. arXiv.","DOI":"10.36001\/phmconf.2020.v12i1.1289"},{"key":"ref_21","unstructured":"Ahmed, I., Khorasgani, H., and Biswas, G. (2020). Comparison of Model Predictive and Reinforcement Learning Methods for Fault Tolerant Control. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Ahmed, I., Quiones-Grueiro, M., and Biswas, G. (2020). Fault-Tolerant Control of Degrading Systems with On-Policy Reinforcement Learning. arXiv.","DOI":"10.1016\/j.ifacol.2020.12.878"},{"key":"ref_23","unstructured":"Ahmed, I., Quiones-Grueiro, M., and Biswas, G. (2020). Performance-Weighed Policy Sampling for Meta-Reinforcement Learning. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yel, E., and Bezzo, N. (2021). A Meta-Learning-Based Trajectory Tracking Framework for UAVs under Degraded Conditions. arXiv.","DOI":"10.1109\/IROS51168.2021.9635918"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"47353","DOI":"10.1109\/ACCESS.2019.2909579","article-title":"Learning to Guide: Guide Law Based on Deep Meta-learning and Model Predictive Path Integral Control","volume":"7","author":"Liang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhao, F., You, K., Fan, Y., and Yan, G. (2020, January 27\u201329). Velocity Regulation for Automatic Train Operation via Meta-Reinforcement Learning. Proceedings of the 2020 39th Chinese Control Conference (CCC), Shenyang, China.","DOI":"10.23919\/CCC50068.2020.9188581"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Li, B., Gan, Z.G., Chen, D.Q., and Aleksandrovich, D.S. (2020). UAV Maneuvering Target Tracking in Uncertain Environments Based on Deep Reinforcement Learning and Meta-Learning. Remote Sens., 12.","DOI":"10.3390\/rs12223789"},{"key":"ref_28","unstructured":"Sliver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., and Riedmiller, M. (2014, January 21\u201326). Deterministic policy gradient algorithms. Proceedings of the 31st International Conference on Machine Learning, Beijing, China."},{"key":"ref_29","unstructured":"Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., and Wierstra, D. (2015). Continuous control with deep reinforcement learning. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Li, Z., Zhou, J., Li, X., Du, X., Wang, L., and Wang, Y. (2020, January 27\u201328). Continuous Control for Moving Object Tracking of Unmanned Skid-Steered Vehicle Based on Reinforcement Learning. Proceedings of the 2020 3rd International Conference on Unmanned Systems (ICUS), Harbin, China.","DOI":"10.1109\/ICUS50048.2020.9274962"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2905","DOI":"10.3390\/s18092905","article-title":"Intelligent Land-Vehicle Model Transfer Trajectory Planning Method Based on Deep Reinforcement Learning","volume":"18","author":"Yu","year":"2018","journal-title":"Sensors"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Jin, L.Q., Tian, D.T., Zhang, Q.X., and Wang, J.J. (2020). Optimal Torque Distribution Control of Multi-Axle Electric Vehicles with In-wheel Motors Based on DDPG Algorithm. Energies, 13.","DOI":"10.3390\/en13061331"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Hu, H.Y., Lu, Z.Y., Wang, Q., and Zheng, C.Y. (2020). End-to-End Automated Lane-Change Maneuvering Considering Driving Style Using a Deep Deterministic Policy Gradient Algorithm. Sensors, 20.","DOI":"10.3390\/s20185443"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"8874619","DOI":"10.1155\/2020\/8874619","article-title":"Model-free attitude control of spacecraft based on PID-guide TD3 algorithm","volume":"2020","author":"Zhang","year":"2020","journal-title":"Int. J. Aerosp. Eng."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wan, K.F., Gao, X.G., Hu, Z.J., and Wu, G.F. (2020). Robust motion control for UAV in dynamic uncertain environments using deep reinforcement learning. Remote Sens., 12.","DOI":"10.3390\/rs12040640"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Taherian, S., Kuutti, S., Visca, M., and Fallah, S. (2021). Self-adaptive torque vectoring controller using reinforcement learning. arXiv.","DOI":"10.1109\/ITSC48978.2021.9564494"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Taherian, S., Montanaro, U., Dixit, S., and Fallah, S. (2019, January 27\u201330). Integrated Trajectory Planning and Torque Vectoring for Autonomous Emergency Collision Avoidance. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, New Zealand.","DOI":"10.1109\/ITSC.2019.8917495"},{"key":"ref_38","unstructured":"Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglo, I., Wierstra, D., and Riedmiller, M. (2013). Playing Atari with Deep Reinforcement Learning. arXiv."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Kaushik, R., Anne, T., and Mount, J.B. (January, January 24). Fast Online Adaptation in Robotics through Meta-Learning Embeddings of Simulated Priors. Proceedings of the 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.","DOI":"10.1109\/IROS45743.2020.9341462"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"19048","DOI":"10.1109\/ACCESS.2017.2754647","article-title":"Performance-Oriented Coordinated Adaptive Robust Control for Four-Wheel Independently Driven Skid Steer Mobile Robot","volume":"5","author":"Liao","year":"2017","journal-title":"IEEE Access"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1109\/TVT.2015.2391184","article-title":"Vehicle lateral dynamics control through AFS\/DYC and robust gain-scheduling approach","volume":"65","author":"Zhang","year":"2016","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"104510","DOI":"10.1016\/j.conengprac.2020.104510","article-title":"Fault-tolerant control for four-wheel independent actuated electric vehicle using feedback linearization and cooperative game theory","volume":"101","author":"Zhang","year":"2020","journal-title":"Control Eng. Pract."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"4527","DOI":"10.1109\/TVT.2019.2904698","article-title":"Fault-Tolerant Control for Electric Vehicles with Independently Driven in-Wheel Motors Considering Individual Driver Steering Characteristics","volume":"68","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Veh. Technol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/845\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:06:02Z","timestamp":1760133962000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/845"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,22]]},"references-count":43,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["s22030845"],"URL":"https:\/\/doi.org\/10.3390\/s22030845","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,22]]}}}