{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T16:37:15Z","timestamp":1775666235032,"version":"3.50.1"},"reference-count":44,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,1,15]],"date-time":"2025-01-15T00:00:00Z","timestamp":1736899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:p>A reward shaping deep deterministic policy gradient (RS-DDPG) and simultaneous localization and mapping (SLAM) path tracking algorithm is proposed to address the issues of low accuracy and poor robustness of target path tracking for robotic control during maneuver. RS-DDPG algorithm is based on deep reinforcement learning (DRL) and designs a reward function to optimize the parameters of DDPG to achieve the required tracking accuracy and stability. A visual SLAM algorithm based on semantic segmentation and geometric information is proposed to address the issues of poor robustness and susceptibility to interference from dynamic objects in dynamic scenes for SLAM based on visual sensors. Using the Apollo autonomous driving simulation platform, simulation experiments were conducted on the actual DDPG algorithm and the improved RS-DDPG path-tracking control algorithm. The research results indicate that the proposed RS-DDPG algorithm outperforms the DDPG algorithm in terms of path tracking accuracy and robustness. The results showed that it effectively improved the performance of visual SLAM systems in dynamic scenarios.<\/jats:p>","DOI":"10.3389\/fnbot.2024.1428358","type":"journal-article","created":{"date-parts":[[2025,1,15]],"date-time":"2025-01-15T13:29:03Z","timestamp":1736947743000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Deep reinforcement learning and robust SLAM based robotic control algorithm for self-driving path optimization"],"prefix":"10.3389","volume":"18","author":[{"given":"Samiullah","family":"Khan","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ashfaq","family":"Niaz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dou","family":"Yinke","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Muhammad Usman","family":"Shoukat","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Saqib Ali","family":"Nawaz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2025,1,15]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"3390","DOI":"10.3390\/math11153390","article-title":"Model-based optimization approach for PID control of pitch\u2013roll UAV orientation","volume":"11","author":"Arrieta","year":"2023","journal-title":"Mathematics"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"100566","DOI":"10.1016\/j.simpa.2023.100566","article-title":"SS-MPC: a user-friendly software based on single shooting optimization to solve model predictive control problems","volume":"17","author":"Bayat","year":"2023","journal-title":"Softw. Impacts"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"121695","DOI":"10.1016\/j.eswa.2023.121695","article-title":"Enhancement of the power quality of DFIG-based dual-rotor wind turbine systems using fractional order fuzzy controller","volume":"238","author":"Benbouhenni","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"ref4","doi-asserted-by":"publisher","first-page":"202203","DOI":"10.1007\/s11432-022-3713-8","article-title":"Trajectory tracking control of autonomous heavy-duty mining dump trucks with uncertain dynamic characteristics","volume":"66","author":"Chen","year":"2023","journal-title":"SCIENCE CHINA Inf. Sci."},{"key":"ref5","doi-asserted-by":"publisher","first-page":"1600","DOI":"10.1109\/TAC.2022.3154347","article-title":"Enhanced P-type control: indirect adaptive learning from set-point updates","volume":"68","author":"Chi","year":"2022","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"166528","DOI":"10.1109\/ACCESS.2019.2952161","article-title":"SOF-SLAM: a semantic visual SLAM for dynamic environments","volume":"7","author":"Cui","year":"2019","journal-title":"IEEE Access"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1109\/TPAMI.2020.3010942","article-title":"Rgb-d slam in dynamic environments using point correlations","volume":"44","author":"Dai","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref8","doi-asserted-by":"publisher","first-page":"105676","DOI":"10.1016\/j.conengprac.2023.105676","article-title":"Do-mpc: towards FAIR nonlinear and robust model predictive control","volume":"140","author":"Fiedler","year":"2023","journal-title":"Control. Eng. Pract."},{"key":"ref22","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1080\/21642583.2014.956372","article-title":"Design of internal model control-proportional integral derivative controller with improved filter for disturbance rejection","volume":"2","author":"Gopi Krishna Rao","year":"2014","journal-title":"Syst. Sci. Cont. Eng."},{"key":"ref9","doi-asserted-by":"publisher","first-page":"21160","DOI":"10.1109\/ACCESS.2022.3154086","article-title":"Semantic SLAM based on improved DeepLabv3+ in dynamic scenarios","volume":"10","author":"Hu","year":"2022","journal-title":"IEEE Access"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"4406","DOI":"10.1109\/TASE.2023.3296201","article-title":"Series PID control with higher-order derivatives for processes approximated by IPDT models","volume":"21","author":"Huba","year":"2023","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref11","doi-asserted-by":"publisher","first-page":"106","DOI":"10.59277\/ROMJIST.2024.1.08","article-title":"Neural network-based pattern recognition in the framework of edge computing","volume":"27","author":"Jing","year":"2024","journal-title":"Sci. Technol."},{"key":"ref12","author":"Ju","year":"2020"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3567591","article-title":"Constructing neural network based models for simulating dynamical systems","volume":"55","author":"Legaard","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref14","doi-asserted-by":"publisher","first-page":"1114","DOI":"10.1177\/02783649241227968","article-title":"MARS-LVIG dataset: a multi-sensor aerial robots SLAM dataset for LiDAR-visual-inertial-GNSS fusion","volume":"43","author":"Li","year":"2024","journal-title":"Int. J. Robot. Res."},{"key":"ref15","doi-asserted-by":"publisher","first-page":"658","DOI":"10.1007\/s12555-021-0299-2","article-title":"Fuzzy adaptive control law for trajectory tracking based on a fuzzy adaptive neural PID controller of a multi-rotor unmanned aerial vehicle","volume":"21","author":"Mendoza","year":"2023","journal-title":"Int. J. Control. Autom. Syst."},{"key":"ref16","author":"Messikommer","year":"2022"},{"key":"ref17","author":"Montemerlo","year":"2003"},{"key":"ref18","doi-asserted-by":"publisher","first-page":"12101","DOI":"10.3390\/su151612101","article-title":"Optimal energy consumption path planning for unmanned aerial vehicles based on improved particle swarm optimization","volume":"15","author":"Na","year":"2023","journal-title":"Sustain. For."},{"key":"ref19","doi-asserted-by":"publisher","first-page":"1174","DOI":"10.1007\/s12083-022-01424-2","article-title":"Hierarchical traffic light-aware routing via fuzzy reinforcement learning in software-defined vehicular networks","volume":"16","author":"Naderi","year":"2023","journal-title":"Peer Peer Netw. Appl."},{"key":"ref20","doi-asserted-by":"publisher","first-page":"12713","DOI":"10.1109\/TVT.2023.3269787","article-title":"Linear time-varying MPC-based autonomous emergency steering control for collision avoidance","volume":"72","author":"Nguyen","year":"2023","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref21","doi-asserted-by":"publisher","first-page":"121240","DOI":"10.1016\/j.eswa.2023.121240","article-title":"Q-learning based system for path planning with unmanned aerial vehicles swarms in obstacle environments","volume":"235","author":"Puente-Castro","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref23","first-page":"3","article-title":"Hybrid data-driven active disturbance rejection sliding mode control (SMC) with tower crane systems validation","volume":"27","author":"Roman","year":"2024","journal-title":"Sci. Technol."},{"key":"ref24","author":"Shao","year":"2022"},{"key":"ref25","doi-asserted-by":"publisher","first-page":"1486","DOI":"10.36922\/aih.1486","article-title":"Use of digital transformation and artificial intelligence strategies for pharmaceutical industry in Pakistan: applications and challenges","volume":"1","author":"Shoukat","year":"2023","journal-title":"Artif. Intell. Health"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"102370","DOI":"10.1016\/j.aei.2024.102370","article-title":"Cognitive robotics: deep learning approaches for trajectory and motion control in complex environment","volume":"60","author":"Shoukat","year":"2024","journal-title":"Adv. Eng. Inform."},{"key":"ref27","doi-asserted-by":"publisher","first-page":"31297","DOI":"10.1007\/s11042-023-16875-9","article-title":"Smart home for enhanced healthcare: exploring human machine interface oriented digital twin model","volume":"83","author":"Shoukat","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref28","doi-asserted-by":"publisher","first-page":"1097725","DOI":"10.3389\/fpls.2023.1097725","article-title":"Dynamic detection of three-dimensional crop phenotypes based on a consumer-grade RGB-D camera","volume":"14","author":"Song","year":"2023","journal-title":"Front. Plant Sci."},{"key":"ref29","doi-asserted-by":"publisher","first-page":"240","DOI":"10.1016\/j.ins.2022.12.118","article-title":"Neural-network based adaptive sliding mode control for Takagi-Sugeno fuzzy systems","volume":"628","author":"Sun","year":"2023","journal-title":"Inf. Sci."},{"key":"ref30","doi-asserted-by":"publisher","first-page":"e0172395","DOI":"10.1371\/journal.pone.0172395","article-title":"Multiagent cooperation and competition with deep reinforcement learning","volume":"12","author":"Tampuu","year":"2017","journal-title":"PLoS One"},{"key":"ref31","first-page":"1915","article-title":"Evaluation of model predictive control (MPC) of solar thermal heating system with thermal energy storage for buildings with highly variable occupancy levels","volume-title":"Building simulation","author":"Wei","year":"2023"},{"key":"ref32","doi-asserted-by":"publisher","first-page":"1739","DOI":"10.1002\/rob.22208","article-title":"Research on unmanned electric shovel autonomous driving path tracking control based on improved pure tracking and fuzzy control","volume":"40","author":"Wu","year":"2023","journal-title":"J. Field Robot."},{"key":"ref33","doi-asserted-by":"publisher","first-page":"1670","DOI":"10.1177\/09544070221145468","article-title":"Nonlinear H\u221e path following control for autonomous ground vehicles via neural network and policy iteration algorithm","volume":"238","author":"Xue","year":"2024","journal-title":"Proc. Inst. Mech. Eng. Part D J. Automobile Eng."},{"key":"ref34","doi-asserted-by":"publisher","first-page":"220","DOI":"10.3390\/a16050220","article-title":"Improved DQN for dynamic obstacle avoidance and ship path planning","volume":"16","author":"Yang","year":"2023","journal-title":"Algorithms"},{"key":"ref35","author":"Yang","year":"2022"},{"key":"ref36","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1007\/s10462-021-10045-9","article-title":"Sparse online kernelized actor-critic learning in reproducing kernel Hilbert space","volume":"55","author":"Yang","year":"2022","journal-title":"Artif. Intell. Rev."},{"key":"ref37","doi-asserted-by":"publisher","first-page":"5560","DOI":"10.3390\/rs15235560","article-title":"Automatic Targetless monocular camera and LiDAR external parameter calibration method for Mobile robots","volume":"15","author":"Yu","year":"2023","journal-title":"Remote Sens."},{"key":"ref38","doi-asserted-by":"publisher","first-page":"012127","DOI":"10.1088\/1742-6596\/1754\/1\/012127","article-title":"Research on key technologies of autonomous driving platform","volume":"1754","author":"Yuan","year":"2021","journal-title":"J. Phys. Conf. Ser."},{"key":"ref39","doi-asserted-by":"publisher","first-page":"1893","DOI":"10.3390\/rs15071893","article-title":"PLDS-SLAM: point and line features SLAM in dynamic environment","volume":"15","author":"Yuan","year":"2023","journal-title":"Remote Sens."},{"key":"ref40","doi-asserted-by":"publisher","first-page":"2667","DOI":"10.1364\/AO.517411","article-title":"High-precision binocular camera calibration method based on a 3D calibration object","volume":"63","author":"Zhang","year":"2024","journal-title":"Appl. Opt."},{"key":"ref41","doi-asserted-by":"publisher","first-page":"107549","DOI":"10.1016\/j.jobe.2023.107549","article-title":"Seismic control of adaptive variable stiffness intelligent structures using fuzzy control strategy combined with LSTM","volume":"78","author":"Zhang","year":"2023","journal-title":"J. Build. Eng."},{"key":"ref42","doi-asserted-by":"publisher","first-page":"75545","DOI":"10.1109\/ACCESS.2018.2873617","article-title":"Semantic SLAM based on object detection and improved octomap","volume":"6","author":"Zhang","year":"2018","journal-title":"IEEE Access"},{"key":"ref43","doi-asserted-by":"publisher","first-page":"1156","DOI":"10.3390\/rs15041156","article-title":"Simultaneous localization and mapping (SLAM) for autonomous driving: concept and analysis","volume":"15","author":"Zheng","year":"2023","journal-title":"Remote Sens."},{"key":"ref44","first-page":"1717","article-title":"In-wheel motor electric vehicle based on fuzzy neural network yaw stability optimization control","volume":"31","author":"Zhou","year":"2023","journal-title":"Eng. Lett."}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1428358\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,15]],"date-time":"2025-01-15T13:29:06Z","timestamp":1736947746000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1428358\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,15]]},"references-count":44,"alternative-id":["10.3389\/fnbot.2024.1428358"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2024.1428358","relation":{},"ISSN":["1662-5218"],"issn-type":[{"value":"1662-5218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,15]]},"article-number":"1428358"}}