{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T16:36:13Z","timestamp":1781282173421,"version":"3.54.1"},"reference-count":38,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,1,8]],"date-time":"2025-01-08T00:00:00Z","timestamp":1736294400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Path planning in complex and dynamic environments poses a significant challenge in the field of mobile robotics. Traditional path planning methods such as genetic algorithms, Dijkstra's algorithm, and Floyd's algorithm typically rely on deterministic search strategies, which can lead to local optima and lack global search capabilities in dynamic settings. These methods have high computational costs and are not efficient for real-time applications.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>To address these issues, this paper presents a Quantum-behaved Particle Swarm Optimization model enhanced by deep reinforcement learning (RL-QPSO Net) aimed at improving global optimality and adaptability in path planning. The RL-QPSO Net combines quantum-inspired particle swarm optimization (QPSO) and deep reinforcement learning (DRL) modules through a dual control mechanism to achieve path optimization and environmental adaptation. The QPSO module is responsible for global path optimization, using quantum mechanics to avoid local optima, while the DRL module adjusts strategies in real-time based on environmental feedback, thus enhancing decision-making capabilities in complex high-dimensional scenarios.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results and discussion<\/jats:title><jats:p>Experiments were conducted on multiple datasets, including Cityscapes, NYU Depth V2, Mapillary Vistas, and ApolloScape, and the results showed that RL-QPSO Net outperforms traditional methods in terms of accuracy, computational efficiency, and model complexity. This method demonstrated significant improvements in accuracy and computational efficiency, providing an effective path planning solution for real-time applications in complex environments for mobile robots. In the future, this method could be further extended to resource-limited environments to achieve broader practical applications.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fnbot.2024.1464572","type":"journal-article","created":{"date-parts":[[2025,1,8]],"date-time":"2025-01-08T06:19:01Z","timestamp":1736317141000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["RL-QPSO net: deep reinforcement learning-enhanced QPSO for efficient mobile robot path planning"],"prefix":"10.3389","volume":"18","author":[{"given":"Yang","family":"Jing","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Li","family":"Weiya","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,1,8]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1016\/j.arcontrol.2020.10.001","article-title":"A comparative review on mobile robot path planning: classical or meta-heuristic methods?","volume":"50","author":"Ab Wahab","year":"2020","journal-title":"Annu. Rev. Control"},{"key":"B2","doi-asserted-by":"publisher","first-page":"3275","DOI":"10.1016\/j.ins.2008.04.005","article-title":"Path planning on a cuboid using genetic algorithms","volume":"178","author":"Aybars","year":"2008","journal-title":"Inf. Sci"},{"key":"B3","first-page":"147","author":"Aziz","year":"2017"},{"key":"B4","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1007\/s10514-020-09947-4","article-title":"Reinforcement based mobile robot path planning with improved dynamic window approach in unknown environment","volume":"45","author":"Chang","year":"2021","journal-title":"Auton. Robots"},{"key":"B5","unstructured":"\u201cThe cityscapes dataset,\u201d\n          \n          \n            \n              Cordts\n              M.\n            \n            \n              Omran\n              M.\n            \n            \n              Ramos\n              S.\n            \n            \n              Scharw\u00e4chter\n              T.\n            \n            \n              Enzweiler\n              M.\n            \n            \n              Benenson\n              R.\n            \n          \n          CVPR Workshop on the Future of Datasets in Vision\n          \n          2015"},{"key":"B6","doi-asserted-by":"publisher","first-page":"5493","DOI":"10.3390\/s20195493","article-title":"Deep reinforcement learning for indoor mobile robot path planning","volume":"20","author":"Gao","year":"2020","journal-title":"Sensors"},{"key":"B7","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1109\/ICUAS60882.2024.10556862","article-title":"\u201cBenchmarking off-policy deep reinforcement learning algorithms for uav path planning,\u201d","volume-title":"2024 International Conference on Unmanned Aircraft Systems (ICUAS)","author":"Garg","year":"2024"},{"key":"B8","doi-asserted-by":"publisher","first-page":"2259009","DOI":"10.1142\/S0218001422590091","article-title":"An improved a-star algorithm for complete coverage path planning of unmanned ships","volume":"36","author":"Guo","year":"2022","journal-title":"Int. J. Pattern Recogn. Artif. Intellig"},{"key":"B9","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1016\/j.protcy.2016.03.010","article-title":"Time-efficient a* algorithm for robot path planning","volume":"23","author":"Guruji","year":"2016","journal-title":"Procedia Technol"},{"key":"B10","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1109\/ITAIC58329.2023.10408799","article-title":"\u201cMobile robot path planning based on improved a* algorithm,\u201d","volume-title":"2023 IEEE 11th Joint International Information Technology and Artificial Intelligence Conference (ITAIC)","author":"Han","year":"2023"},{"key":"B11","doi-asserted-by":"publisher","first-page":"10980","DOI":"10.1109\/TNNLS.2022.3172168","article-title":"Multiagent soft actor-critic based hybrid motion planner for mobile robots","volume":"34","author":"He","year":"2022","journal-title":"IEEE Trans. Neural netw. Learn. Syst"},{"key":"B12","unstructured":"\u201cThe apolloscape dataset for autonomous driving,\u201d\n          \n          \n            \n              Huang\n              X.\n            \n            \n              Cheng\n              X.\n            \n            \n              Geng\n              Q.\n            \n            \n              Cao\n              B.\n            \n            \n              Zhou\n              D.\n            \n            \n              Wang\n              P.\n            \n          \n          Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops\n          \n          2018"},{"key":"B13","doi-asserted-by":"crossref","first-page":"995","DOI":"10.1109\/ROBOT.2000.844730","article-title":"\u201cRRT-connect: An efficient approach to single-query path planning,\u201d","volume-title":"Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No. 00CH37065)","author":"Kuffner","year":"2000"},{"key":"B14","unstructured":"\u201cProbabilistic roadmaps for robot path planning,\u201d\n          \n          \n            \n              Latombe\n              L.-C.\n            \n          \n          Pratical Motion Planning in Robotics: Current Aproaches and Future Challenges\n          \n          1998"},{"key":"B15","doi-asserted-by":"publisher","first-page":"76523","DOI":"10.1109\/ACCESS.2022.3176608","article-title":"M-A3C: a mean-asynchronous advantage actor-critic reinforcement learning method for real-time gait planning of biped robot","volume":"10","author":"Leng","year":"2022","journal-title":"IEEE Access"},{"key":"B16","doi-asserted-by":"publisher","first-page":"168951","DOI":"10.1109\/ACCESS.2020.3023999","article-title":"A firefly algorithm with self-adaptive population size for global path planning of mobile robot","volume":"8","author":"Li","year":"2020","journal-title":"IEEE Access"},{"key":"B17","doi-asserted-by":"publisher","first-page":"616","DOI":"10.1007\/s11227-021-03878-2","article-title":"An improved dqn path planning algorithm","volume":"78","author":"Li","year":"2022","journal-title":"J. Supercomput"},{"key":"B18","first-page":"3372","article-title":"\u201cA two-streamed network for estimating fine-scaled depth maps from single rgb images,\u201d","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Li","year":"2017"},{"key":"B19","doi-asserted-by":"publisher","first-page":"120254","DOI":"10.1016\/j.eswa.2023.120254","article-title":"Path planning techniques for mobile robots: review and prospect","volume":"227","author":"Liu","year":"2023","journal-title":"Expert Syst. Appl"},{"key":"B20","doi-asserted-by":"publisher","first-page":"147827","DOI":"10.1109\/ACCESS.2020.3015976","article-title":"Surface optimal path planning using an extended dijkstra algorithm","volume":"8","author":"Luo","year":"2020","journal-title":"IEEE Access"},{"key":"B21","unstructured":"Muis\n              M.\n            \n          \n          Malang, Indonesia\n          Universitas Brawijaya\n          Implementasi Rapidly-exploring Random Tree (RRT) Algorithm sebagai Metode Path Planning untuk Melewati Penghalang pada Omni-directional Wheeled Robot\n          \n          2019"},{"key":"B22","doi-asserted-by":"crossref","DOI":"10.1109\/ICCCNT49239.2020.9225479","article-title":"\u201cRobotic path planning using recurrent neural networks,\u201d","volume-title":"2020 11th International Conference on Computing, Communication and Networking Technologies (ICCCNT)","author":"Nair","year":"2020"},{"key":"B23","first-page":"4990","article-title":"\u201cThe mapillary vistas dataset for semantic understanding of street scenes,\u201d","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Neuhold","year":"2017"},{"key":"B24","doi-asserted-by":"publisher","first-page":"6716","DOI":"10.1109\/TVT.2022.3160746","article-title":"Path planning for the dynamic uav-aided wireless systems using monte carlo tree search","volume":"71","author":"Qian","year":"2022","journal-title":"IEEE Trans. Vehic. Technol"},{"key":"B25","doi-asserted-by":"publisher","first-page":"4249","DOI":"10.1109\/LRA.2020.2994035","article-title":"Glas: Global-to-local safe autonomy synthesis for multi-robot motion planning with end-to-end learning","volume":"5","author":"Riviere","year":"2020","journal-title":"IEEE Robot. Automat. Letters"},{"key":"B26","doi-asserted-by":"publisher","first-page":"7898","DOI":"10.3390\/s21237898","article-title":"Path planning for autonomous mobile robots: a review","volume":"21","author":"Sanchez-Ibanez","year":"2021","journal-title":"Sensors"},{"key":"B27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/ICOA.2018.8370584","article-title":"\u201cRoute planning for electric vehicle efficiency using the bellman-ford algorithm on an embedded gpu,\u201d","volume-title":"2018 4th International Conference on Optimization and Applications (ICOA)","author":"Schambers","year":"2018"},{"key":"B28","doi-asserted-by":"publisher","first-page":"4378","DOI":"10.1016\/j.jfranklin.2023.01.033","article-title":"Dynamic path planning of mobile robot based on improved simulated annealing algorithm","volume":"360","author":"Shi","year":"2023","journal-title":"J. Franklin Inst"},{"key":"B29","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1109\/JAS.2023.123975","article-title":"Path planning and tracking control for parking via soft actor-critic under non-ideal scenarios","volume":"11","author":"Tang","year":"2023","journal-title":"IEEE\/CAA J. Autom. Sinica"},{"key":"B30","doi-asserted-by":"publisher","first-page":"3692","DOI":"10.1109\/TIV.2023.3274536","article-title":"Motion planning for autonomous driving: the state of the art and future perspectives","volume":"8","author":"Teng","year":"2023","journal-title":"IEEE Trans. Intellig. Vehicl"},{"key":"B31","doi-asserted-by":"publisher","first-page":"1748","DOI":"10.1109\/TASE.2020.2976560","article-title":"Neural RRT*: Learning-based optimal path planning","volume":"17","author":"Wang","year":"2020","journal-title":"IEEE Trans. Automat. Sci. Eng"},{"key":"B32","doi-asserted-by":"publisher","first-page":"119410","DOI":"10.1016\/j.eswa.2022.119410","article-title":"Modified adaptive ant colony optimization algorithm and its application for solving path planning of mobile robot","volume":"215","author":"Wu","year":"2023","journal-title":"Expert Syst. Appl"},{"key":"B33","doi-asserted-by":"publisher","first-page":"112809","DOI":"10.1016\/j.oceaneng.2022.112809","article-title":"Global path planning algorithm based on double dqn for multi-tasks amphibious unmanned surface vehicle","volume":"266","author":"Xiaofei","year":"2022","journal-title":"Ocean Eng"},{"key":"B34","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1049\/trit.2020.0024","article-title":"Multi-robot path planning based on a deep reinforcement learning dqn algorithm","volume":"5","author":"Yang","year":"2020","journal-title":"CAAI Trans. Intellig. Technol"},{"key":"B35","doi-asserted-by":"publisher","first-page":"106209","DOI":"10.1016\/j.knosys.2020.106209","article-title":"A constrained differential evolution algorithm to solve uav path planning in disaster scenarios","volume":"204","author":"Yu","year":"2020","journal-title":"Knowl.-Based Syst"},{"key":"B36","doi-asserted-by":"publisher","first-page":"22547","DOI":"10.1109\/JIOT.2022.3182798","article-title":"A novel hybrid particle swarm optimization algorithm for path planning of uavs","volume":"9","author":"Yu","year":"2022","journal-title":"IEEE Intern. Things J"},{"key":"B37","unstructured":"Variational policy gradient method for reinforcement learning with general utilities\n          \n          4572\n          4583\n          \n            \n              Zhang\n              J.\n            \n            \n              Koppel\n              A.\n            \n            \n              Bedi\n              A. S.\n            \n            \n              Szepesvari\n              C.\n            \n            \n              Wang\n              M.\n            \n          \n          Adv. Neural Inf. Process. Syst\n          33\n          2020"},{"key":"B38","doi-asserted-by":"publisher","first-page":"111462","DOI":"10.1016\/j.knosys.2024.111462","article-title":"Novel task decomposed multi-agent twin delayed deep deterministic policy gradient algorithm for multi-uav autonomous path planning","volume":"287","author":"Zhou","year":"2024","journal-title":"Knowl.-Based Syst"}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1464572\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,8]],"date-time":"2025-01-08T06:19:10Z","timestamp":1736317150000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1464572\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,8]]},"references-count":38,"alternative-id":["10.3389\/fnbot.2024.1464572"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2024.1464572","relation":{},"ISSN":["1662-5218"],"issn-type":[{"value":"1662-5218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,8]]},"article-number":"1464572"}}