{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,20]],"date-time":"2025-07-20T04:22:41Z","timestamp":1752985361114,"version":"3.37.3"},"reference-count":22,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,7,12]],"date-time":"2022-07-12T00:00:00Z","timestamp":1657584000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,12]],"date-time":"2022-07-12T00:00:00Z","timestamp":1657584000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002888","name":"Beijing Municipal Commission of Education","doi-asserted-by":"publisher","award":["KM202110858001"],"award-info":[{"award-number":["KM202110858001"]}],"id":[{"id":"10.13039\/501100002888","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["EURASIP J. Adv. Signal Process."],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In the field of autonomous driving, obstacle avoidance is of great significance for safe driving. At present, in addition to traditional obstacle avoidance algorithms including VFH algorithm, artificial potential field method, a large number of related researches are focused on algorithms based on vision and neural networks. Researches on these algorithms have achieved some results, and some of which have completed real road tests. However, most of algorithms consider only local environmental information which may cause local optimum in complex driving environments. Therefore, it is necessary to consider the environmental information beyond the sensor's perceptual ability for autonomous driving in complex environment. In the network-assisted automated driving system, networked vehicles can obtain road obstacles\u2019 and condition information through roadside sensors and mobile network, so as to gain extra sensing ability. Therefore, network-assisted automated driving is of great significance in obstacle avoidance. Under this background, this paper presents an automatic driving obstacle avoidance strategy combining path planning and reinforcement learning. At first, a global optimal path is planned through global information, then merge the global optimal path and vehicle information into a vector. Use this vector as input of reinforcement learning neural network and output vehicle control signals to follow optimal path while avoiding obstacles.<\/jats:p>","DOI":"10.1186\/s13634-022-00872-5","type":"journal-article","created":{"date-parts":[[2022,7,12]],"date-time":"2022-07-12T09:20:16Z","timestamp":1657617616000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Target-driven obstacle avoidance algorithm based on DDPG for connected autonomous vehicles"],"prefix":"10.1186","volume":"2022","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1553-0330","authenticated-orcid":false,"given":"Yu","family":"Chen","sequence":"first","affiliation":[]},{"given":"Wei","family":"Han","sequence":"additional","affiliation":[]},{"given":"Qinghua","family":"Zhu","sequence":"additional","affiliation":[]},{"given":"Yong","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Jingya","family":"Zhao","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,7,12]]},"reference":[{"issue":"9","key":"872_CR1","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1109\/MCOM.2018.1701320","volume":"56","author":"Y Zhang","year":"2018","unstructured":"Y. Zhang, H. Zhang, K. Long, Q. Zheng, X. Xie, Software-defined and fog-computing-based next generation vehicular networks. IEEE Commun. Mag. 56(9), 34\u201341 (2018). https:\/\/doi.org\/10.1109\/MCOM.2018.1701320","journal-title":"IEEE Commun. Mag."},{"issue":"1","key":"872_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/S1353-4858(21)00001-5","volume":"2021","author":"ES Ali","year":"2021","unstructured":"E.S. Ali et al., Machine learning technologies for secure vehicular communication in internet of vehicles: recent advances and applications. Secur. Commun. Netw. 2021(1), 1\u201323 (2021)","journal-title":"Secur. Commun. Netw."},{"key":"872_CR3","doi-asserted-by":"crossref","unstructured":"J.R. Millan, Reinforcement learning of goal-directed obstacle-avoiding reaction strategies in an autonomous mobile robot. Robot. Auton. Syst. 15(4), 275\u2013299 (1995)","DOI":"10.1016\/0921-8890(95)00021-7"},{"key":"872_CR4","unstructured":"J.M. Snider, Automatic Steering Methods for Autonomous Automobile Path Tracking. [Dissertation]. Pittsburgh. Carnegie Mellon University (2009)"},{"key":"872_CR5","doi-asserted-by":"publisher","unstructured":"X. Zhang, J. Wang, H. Zhang, L. Li, M. Pan, Z. Han, Data-driven transportation network company vehicle scheduling with users\u2019 location differential privacy preservation,\" in IEEE Transactions on Mobile Computing. https:\/\/doi.org\/10.1109\/TMC.2021.3091148","DOI":"10.1109\/TMC.2021.3091148"},{"issue":"3","key":"872_CR6","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1177\/027836402320556421","volume":"21","author":"D Hsu","year":"2002","unstructured":"D. Hsu et al., Randomized kinodynamic motion planning with moving obstacles. Int. J. Robot. Res. 21(3), 233\u2013255 (2002)","journal-title":"Int. J. Robot. Res."},{"issue":"5","key":"872_CR7","doi-asserted-by":"publisher","first-page":"3391","DOI":"10.1109\/TII.2020.2987421","volume":"17","author":"X Liu","year":"2021","unstructured":"X. Liu, C. Sun, M. Zhou, C. Wu, B. Peng, P. Li, Reinforcement learning-based multislot double-threshold spectrum sensing with bayesian fusion for industrial big spectrum data. IEEE Trans. Ind. Inf. 17(5), 3391\u20133400 (2021). https:\/\/doi.org\/10.1109\/TII.2020.2987421","journal-title":"IEEE Trans. Ind. Inf."},{"issue":"1","key":"872_CR8","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1109\/100.580977","volume":"4","author":"D Fox","year":"2002","unstructured":"D. Fox, W. Burgard, S. Thrun, The dynamic window approach to collision avoidance. IEEE Robot. Autom. Mag. 4(1), 23\u201333 (2002)","journal-title":"IEEE Robot. Autom. Mag."},{"key":"872_CR9","doi-asserted-by":"publisher","first-page":"1758","DOI":"10.1109\/ICRA.2019.8793810","volume":"2019","author":"HW Jun","year":"2019","unstructured":"H.W. Jun, H.J. Kim, B.H. Lee, Goal-driven navigation for non-holonomic multi-robot system by learning collision. Int. Conf. Robot. Autom. (ICRA) 2019, 1758\u20131764 (2019). https:\/\/doi.org\/10.1109\/ICRA.2019.8793810","journal-title":"Int. Conf. Robot. Autom. (ICRA)"},{"key":"872_CR10","doi-asserted-by":"publisher","first-page":"3105","DOI":"10.1109\/IROS40897.2019.8968151","volume":"2019","author":"T Dang","year":"2019","unstructured":"T. Dang, F. Mascarich, S. Khattak, C. Papachristos, K. Alexis, Graph-based path planning for autonomous robotic exploration in subterranean environments. IEEE\/RSJ Int. Conf. Intell. Robots Syst. (IROS) 2019, 3105\u20133112 (2019). https:\/\/doi.org\/10.1109\/IROS40897.2019.8968151","journal-title":"IEEE\/RSJ Int. Conf. Intell. Robots Syst. (IROS)"},{"key":"872_CR11","doi-asserted-by":"publisher","unstructured":"N. Zhang, X. Bao, Y. He, X.-H. Lu, Research on path planning and tracking method of auto-driving vehicles under complex constraints, in 2019 2nd China Symposium on Cognitive Computing and Hybrid Intelligence (CCHI), 2019, pp. 1\u20135. https:\/\/doi.org\/10.1109\/CCHI.2019.8901923","DOI":"10.1109\/CCHI.2019.8901923"},{"key":"872_CR12","doi-asserted-by":"crossref","unstructured":"I. Ulrich, J. Borenstein, VFH\/sup *\/: local obstacle avoidance with look-ahead verification, in IEEE Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065). San Francisco. 2000, pp. 2505\u20132511","DOI":"10.1109\/ROBOT.2000.846405"},{"key":"872_CR13","doi-asserted-by":"crossref","unstructured":"I. Ulrich, J. Borenstein, VFH+: reliable obstacle avoidance for fast mobile robots, in IEEE Proceedings of 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146). Leuven. 1998, pp. 1572\u20131577","DOI":"10.1109\/ROBOT.1998.677362"},{"issue":"3","key":"872_CR14","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1109\/70.88137","volume":"7","author":"J Borenstein","year":"1991","unstructured":"J. Borenstein, Y. Koren, The vector field histogram-fast obstacle avoidance for mobile robots. IEEE Trans. Robot. Autom. 7(3), 278\u2013288 (1991). https:\/\/doi.org\/10.1109\/70.88137","journal-title":"IEEE Trans. Robot. Autom."},{"issue":"4","key":"872_CR15","doi-asserted-by":"publisher","first-page":"5971","DOI":"10.1109\/JIOT.2018.2863267","volume":"6","author":"X Liu","year":"2019","unstructured":"X. Liu, X. Zhang, Rate and energy efficiency improvements for 5G-based IoT with simultaneous transfer. IEEE Internet Things J. 6(4), 5971\u20135980 (2019). https:\/\/doi.org\/10.1109\/JIOT.2018.2863267","journal-title":"IEEE Internet Things J."},{"key":"872_CR16","doi-asserted-by":"crossref","unstructured":"O. Khatib, Real-time obstacle avoidance for manipulators and mobile robots, in IEEE Proceedings of the 1985 IEEE International Conference on Robotics and Automation. Saint Louis. 1985, pp. 500\u2013505","DOI":"10.1109\/ROBOT.1985.1087247"},{"key":"872_CR17","doi-asserted-by":"publisher","unstructured":"P.X. Hien, G.-W. Kim, Goal-oriented navigation with avoiding obstacle based on deep reinforcement learning in continuous action space, in 2021 21st International Conference on Control, Automation and Systems (ICCAS), 2021, pp. 8\u201311. https:\/\/doi.org\/10.23919\/ICCAS52745.2021.9649898","DOI":"10.23919\/ICCAS52745.2021.9649898"},{"key":"872_CR18","unstructured":"P. Caianiello, D. Presutti, A Case Study on Goal Oriented Obstacle Avoidance\u201d, in Napoli Claudia di. Proceedings of the 16th Workshop \u201cFrom Objects to Agents\u201d. Naples. 2015:142\u2013145"},{"issue":"4","key":"872_CR19","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1109\/MWC.2019.1800515","volume":"26","author":"Y Liu","year":"2019","unstructured":"Y. Liu, H. Zhang, K. Long, A. Nallanathan, V.C.M. Leung, Energy-efficient subchannel matching and power allocation in NOMA autonomous driving vehicular networks. IEEE Wirel. Commun. 26(4), 88\u201393 (2019)","journal-title":"IEEE Wirel. Commun."},{"issue":"8","key":"872_CR20","doi-asserted-by":"publisher","first-page":"5379","DOI":"10.1109\/TII.2019.2947435","volume":"16","author":"X Liu","year":"2020","unstructured":"X. Liu, X. Zhang, NOMA-based resource allocation for cluster-based cognitive industrial internet of things. IEEE Trans. Ind. Inf. 16(8), 5379\u20135388 (2020). https:\/\/doi.org\/10.1109\/TII.2019.2947435","journal-title":"IEEE Trans. Ind. Inf."},{"issue":"3","key":"872_CR21","doi-asserted-by":"publisher","first-page":"2052","DOI":"10.1109\/TII.2019.2951728","volume":"17","author":"X Liu","year":"2021","unstructured":"X. Liu, X.B. Zhai, W. Lu, C. Wu, QoS-guarantee resource allocation for multibeam satellite industrial internet of things with NOMA. IEEE Trans. Ind. Inf. 17(3), 2052\u20132061 (2021). https:\/\/doi.org\/10.1109\/TII.2019.2951728","journal-title":"IEEE Trans. Ind. Inf."},{"key":"872_CR22","first-page":"171","volume-title":"Robot Motion Planning and Control","author":"JP Laumond","year":"2005","unstructured":"J.P. Laumond, Robot Motion Planning and Control (Springer, Berlin, 2005), pp. 171\u2013253"}],"container-title":["EURASIP Journal on Advances in Signal Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13634-022-00872-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13634-022-00872-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13634-022-00872-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,28]],"date-time":"2024-09-28T23:14:24Z","timestamp":1727565264000},"score":1,"resource":{"primary":{"URL":"https:\/\/asp-eurasipjournals.springeropen.com\/articles\/10.1186\/s13634-022-00872-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,12]]},"references-count":22,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["872"],"URL":"https:\/\/doi.org\/10.1186\/s13634-022-00872-5","relation":{},"ISSN":["1687-6180"],"issn-type":[{"type":"electronic","value":"1687-6180"}],"subject":[],"published":{"date-parts":[[2022,7,12]]},"assertion":[{"value":"18 January 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 April 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 July 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This Manuscripts do not involve human participants, human data or human tissue. Include a statement on ethics approval and consent. This Manuscripts not involving ethical approval and consent. Include the name of the ethics committee that approved the study and the committee\u2019s reference number if appropriate. The studies not involving animals must include a statement on ethics approval.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"61"}}