{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T17:25:31Z","timestamp":1790011531284,"version":"4.0.1"},"reference-count":44,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,9,22]],"date-time":"2023-09-22T00:00:00Z","timestamp":1695340800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:p>With the development of machine perception and multimodal information decision-making techniques, autonomous driving technology has become a crucial area of advancement in the transportation industry. The optimization of vehicle navigation, path planning, and obstacle avoidance tasks is of paramount importance. In this study, we explore the use of attention mechanisms in a end-to-end architecture for optimizing obstacle avoidance and path planning in autonomous driving vehicles. We position our research within the broader context of robotics, emphasizing the fusion of information and decision-making capabilities. The introduction of attention mechanisms enables vehicles to perceive the environment more accurately by focusing on important information and making informed decisions in complex scenarios. By inputting multimodal information, such as images and LiDAR data, into the attention mechanism module, the system can automatically learn and weigh crucial environmental features, thereby placing greater emphasis on key information during obstacle avoidance decisions. Additionally, we leverage the end-to-end architecture and draw from classical theories and algorithms in the field of robotics to enhance the perception and decision-making abilities of autonomous driving vehicles. Furthermore, we address the optimization of path planning using attention mechanisms. We transform the vehicle's navigation task into a sequential decision-making problem and employ LSTM (Long Short-Term Memory) models to handle dynamic navigation in varying environments. By applying attention mechanisms to weigh key points along the navigation path, the vehicle can flexibly select the optimal route and dynamically adjust it based on real-time conditions. Finally, we conducted extensive experimental evaluations and software experiments on the proposed end-to-end architecture on real road datasets. The method effectively avoids obstacles, adheres to traffic rules, and achieves stable, safe, and efficient autonomous driving in diverse road scenarios. This research provides an effective solution for optimizing obstacle avoidance and path planning in the field of autonomous driving. Moreover, it contributes to the advancement and practical applications of multimodal information fusion in navigation, localization, and human-robot interaction.<\/jats:p>","DOI":"10.3389\/fnbot.2023.1269447","type":"journal-article","created":{"date-parts":[[2023,9,22]],"date-time":"2023-09-22T05:46:16Z","timestamp":1695361576000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Research on obstacle avoidance optimization and path planning of autonomous vehicles based on attention mechanism combined with multimodal information decision-making thoughts of robots"],"prefix":"10.3389","volume":"17","author":[{"given":"Xuejin","family":"Wu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guangming","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nachuan","family":"Shen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,9,22]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"8638","DOI":"10.1109\/TITS.2023.3250320","article-title":"VeSoNet: traffic-aware content caching for vehicular social networks using deep reinforcement learning","volume":"24","author":"Aung","year":"2023","journal-title":"IEEE Trans. Intell. Transp. Syst"},{"key":"B2","doi-asserted-by":"publisher","first-page":"3614","DOI":"10.1109\/TITS.2023.3236274","article-title":"Autonomous vehicles security: challenges and solutions using blockchain and artificial intelligence","volume":"24","author":"Bendiab","year":"2023","journal-title":"IEEE Trans. Intell. Transp. Syst"},{"key":"B3","doi-asserted-by":"crossref","first-page":"3324","DOI":"10.23919\/ACC55779.2023.10156163","article-title":"\u201cFuture-focused control barrier functions for autonomous vehicle control,\u201d","volume-title":"2023 American Control Conference (ACC)","author":"Black","year":"2023"},{"key":"B4","doi-asserted-by":"publisher","first-page":"505","DOI":"10.1016\/j.dcan.2020.12.001","article-title":"Robot and its living space: a roadmap for robot development based on the view of living space","volume":"7","author":"Cai","year":"2021","journal-title":"Digit. Commun. Netw"},{"key":"B5","doi-asserted-by":"publisher","first-page":"217","DOI":"10.18196\/jrc.v4i2.17757","article-title":"Adaptive p control and adaptive fuzzy logic controller with expert system implementation for robotic manipulator application","volume":"4","author":"Chotikunnan","year":"2023","journal-title":"J. Robot. Control"},{"key":"B6","article-title":"\u201cThe cityscapes dataset,\u201d","author":"Cordts","year":"2015","journal-title":"CVPR Workshop on the Future of Datasets in Vision, Vol. 2"},{"key":"B7","doi-asserted-by":"publisher","first-page":"101937","DOI":"10.1016\/j.jocs.2022.101937","article-title":"An improved RRT* algorithm for robot path planning based on path expansion heuristic sampling","volume":"67","author":"Ding","year":"2023","journal-title":"J. Comput. Sci"},{"key":"B8","doi-asserted-by":"publisher","first-page":"190","DOI":"10.1016\/j.jcat.2023.01.013","article-title":"Adsorption, surface reactions and hydrodeoxygenation of acetic acid on platinum and nickel catalysts","volume":"418","author":"Ezeonu","year":"2023","journal-title":"J. Catal"},{"key":"B9","doi-asserted-by":"publisher","first-page":"6674","DOI":"10.1109\/TITS.2023.3238889","article-title":"Can connected autonomous vehicles improve mixed traffic safety without compromising efficiency in realistic scenarios?","volume":"24","author":"Garg","year":"2023","journal-title":"IEEE Trans. Intell. Transp. Syst"},{"key":"B10","doi-asserted-by":"crossref","first-page":"3354","DOI":"10.1109\/CVPR.2012.6248074","article-title":"\u201cAre we ready for autonomous driving? The kitti vision benchmark suite,\u201d","volume-title":"2012 IEEE Conference on Computer Vision and Pattern Recognition","author":"Geiger","year":"2012"},{"key":"B11","doi-asserted-by":"publisher","first-page":"108891","DOI":"10.1016\/j.ress.2022.108891","article-title":"Risk coupling analysis of road transportation accidents of hazardous materials in complicated maritime environment","volume":"229","author":"Guo","year":"2023","journal-title":"Reliabil. Eng. Syst. Saf"},{"key":"B12","doi-asserted-by":"publisher","first-page":"113632","DOI":"10.1016\/j.oceaneng.2023.113632","article-title":"A path planning approach for unmanned surface vehicles based on dynamic and fast q-learning","volume":"270","author":"Hao","year":"2023","journal-title":"Ocean Eng"},{"key":"B13","doi-asserted-by":"publisher","first-page":"778","DOI":"10.3390\/coatings13040778","article-title":"Bacterial detection and differentiation of Staphylococcus aureus and Escherichia coli utilizing long-period fiber gratings functionalized with nanoporous coated structures","volume":"13","author":"He","year":"2023","journal-title":"Coatings"},{"key":"B14","doi-asserted-by":"publisher","first-page":"155701","DOI":"10.1088\/1361-6528\/ac47d2","article-title":"Au-on-ag nanostructure for in-situ sers monitoring of catalytic reactions","volume":"33","author":"He","year":"2022","journal-title":"Nanotechnology"},{"key":"B15","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1109\/TASE.2021.3064065","article-title":"Sim2real in robotics and automation: applications and challenges","volume":"18","author":"H\u00f6fer","year":"2021","journal-title":"IEEE Trans. Autom. Sci. Eng"},{"key":"B16","first-page":"17853","article-title":"\u201cPlanning-oriented autonomous driving,\u201d","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Hu","year":"2023"},{"key":"B17","first-page":"954","article-title":"\u201cThe apolloscape dataset for autonomous driving,\u201d","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops","author":"Huang","year":"2018"},{"key":"B18","doi-asserted-by":"publisher","first-page":"2702","DOI":"10.1109\/TPAMI.2019.2926463","article-title":"The apolloscape open dataset for autonomous driving and its application","volume":"42","author":"Huang","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell"},{"key":"B19","doi-asserted-by":"publisher","first-page":"4549","DOI":"10.1007\/s00521-022-07929-4","article-title":"Road safety assessment and risks prioritization using an integrated swara and marcos approach under spherical fuzzy environment","volume":"35","author":"Jafarzadeh Ghoushchi","year":"2023","journal-title":"Neural Comput. Appl"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2306.06987","article-title":"Potential field-based path planning with interactive speed optimization for autonomous vehicles","author":"Lin","year":"2023","journal-title":"arXiv preprint arXiv:2306.06987"},{"key":"B21","doi-asserted-by":"publisher","first-page":"9709","DOI":"10.1038\/s41598-021-89235-y","article-title":"Spectroscopically clean au nanoparticles for catalytic decomposition of hydrogen peroxide","volume":"11","author":"Liu","year":"2021","journal-title":"Sci. Rep"},{"key":"B22","first-page":"367","article-title":"\u201cPath planning for mobile robots based on improving dijkstra algorithm,\u201d","volume-title":"International Conference on Cloud Computing, Performance Computing, and Deep Learning (CCPCDL 2023), Vol. 12712","author":"Ma","year":"2023"},{"key":"B23","doi-asserted-by":"publisher","first-page":"120002","DOI":"10.1016\/j.eswa.2023.120002","article-title":"A fault diagnosis framework for autonomous vehicles with sensor self-diagnosis","volume":"224","author":"Min","year":"2023","journal-title":"Expert Syst. Appl"},{"key":"B24","doi-asserted-by":"publisher","first-page":"119049","DOI":"10.1016\/j.eswa.2022.119049","article-title":"Autonomous path planning with obstacle avoidance for smart assistive systems","volume":"213","author":"Ntakolia","year":"2023","journal-title":"Expert Syst. Appl"},{"key":"B25","doi-asserted-by":"publisher","first-page":"512","DOI":"10.1007\/s11431-022-2218-9","article-title":"A novel LSTM-autoencoder and enhanced transformer-based detection method for shield machine cutterhead clogging","volume":"66","author":"Qin","year":"2023","journal-title":"Sci. China Technol. Sci"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3587937","article-title":"Adatime: a benchmarking suite for domain adaptation on time series data","volume":"17","author":"Ragab","year":"2023","journal-title":"ACM Trans. Knowl. Discov. Data"},{"key":"B27","first-page":"726","article-title":"\u201cSafety-enhanced autonomous driving using interpretable sensor fusion transformer,\u201d","volume-title":"Conference on Robot Learning","author":"Shao","year":""},{"key":"B28","first-page":"13723","article-title":"\u201cReasonNet: end-to-end driving with temporal and global reasoning,\u201d","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Shao","year":""},{"key":"B29","first-page":"2446","article-title":"\u201cScalability in perception for autonomous driving: Waymo open dataset,\u201d","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Sun","year":"2020"},{"key":"B30","doi-asserted-by":"publisher","first-page":"09544070221149278","DOI":"10.1177\/09544070221149278","article-title":"Optimal reinforcement learning and probabilistic-risk-based path planning and following of autonomous vehicles with obstacle avoidance","volume":"2023","author":"Taghavifar","year":"2023","journal-title":"Proc. Instit. Mech. Eng. Part D"},{"key":"B31","doi-asserted-by":"publisher","first-page":"113432","DOI":"10.1016\/j.oceaneng.2022.113432","article-title":"Adaptive adjustable fast marching square method based path planning for the swarm of heterogeneous unmanned surface vehicles (USVS)","volume":"268","author":"Tan","year":"2023","journal-title":"Ocean Eng"},{"key":"B32","doi-asserted-by":"publisher","first-page":"11603","DOI":"10.1021\/acs.langmuir.1c01941","article-title":"Atomic, molecular and hybrid oxygen structures on silver","volume":"37","author":"Tang","year":"2021","journal-title":"Langmuir"},{"key":"B33","doi-asserted-by":"publisher","first-page":"898","DOI":"10.1016\/j.procs.2023.03.122","article-title":"Comparison of path planning methods for robot navigation in simulated agricultural environments","volume":"220","author":"V\u00e1sconez","year":"2023","journal-title":"Proc. Comput. Sci"},{"key":"B34","doi-asserted-by":"publisher","first-page":"831","DOI":"10.1109\/JAS.2023.123552","article-title":"Chat with chatGPT on industry 5.0: learning and decision-making for intelligent industries","volume":"10","author":"Wang","year":"2023","journal-title":"IEEE\/CAA J. Autom. Sin"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1117\/12.2674526","article-title":"\u201cMobile robot path planning based on an improved a* algorithm,\u201d","author":"Wang","year":"2023","journal-title":"International Conference on Computer Graphics, Artificial Intelligence, and Data Processing (ICCAID 2022), Vol. 12604"},{"key":"B36","doi-asserted-by":"publisher","first-page":"119410","DOI":"10.1016\/j.eswa.2022.119410","article-title":"Modified adaptive ant colony optimization algorithm and its application for solving path planning of mobile robot","volume":"215","author":"Wu","year":"2023","journal-title":"Expert Syst. Appl"},{"key":"B37","doi-asserted-by":"publisher","first-page":"106457","DOI":"10.1016\/j.compbiomed.2022.106457","article-title":"AGGN: attention-based glioma grading network with multi-scale feature extraction and multi-modal information fusion","volume":"152","author":"Wu","year":"2023","journal-title":"Comput. Biol. Med"},{"key":"B38","doi-asserted-by":"publisher","first-page":"110164","DOI":"10.1016\/j.knosys.2022.110164","article-title":"Cooperative path planning optimization for multiple UAVs with communication constraints","volume":"260","author":"Xu","year":"2023","journal-title":"Knowl. Based Syst"},{"key":"B39","doi-asserted-by":"publisher","first-page":"234","DOI":"10.1016\/j.tifs.2023.03.018","article-title":"Robotization and intelligent digital systems in the meat cutting industry: from the perspectives of robotic cutting, perception, and digital development","volume":"135","author":"Xu","year":"2023","journal-title":"Trends Food Sci. Technol"},{"key":"B40","doi-asserted-by":"publisher","first-page":"114005","DOI":"10.1016\/j.oceaneng.2023.114005","article-title":"Proximal policy optimization with reciprocal velocity obstacle based collision avoidance path planning for multi-unmanned surface vehicles","volume":"273","author":"Xue","year":"2023","journal-title":"Ocean Eng"},{"key":"B41","doi-asserted-by":"publisher","first-page":"75742","DOI":"10.1109\/ACCESS.2022.3192026","article-title":"Fine segmentation on faces with masks based on a multistep iterative segmentation algorithm","volume":"10","author":"Zhang","year":"2022","journal-title":"IEEE Access"},{"key":"B42","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1016\/j.isprsjprs.2022.12.021","article-title":"Perception and sensing for autonomous vehicles under adverse weather conditions: a survey","volume":"196","author":"Zhang","year":"2023","journal-title":"ISPRS J. Photogramm. Remote Sens"},{"key":"B43","doi-asserted-by":"publisher","first-page":"28821","DOI":"10.1109\/ACCESS.2022.3157823","article-title":"Fast 3D visualization of massive geological data based on clustering index fusion","volume":"10","author":"Zhang","year":"2022","journal-title":"IEEE Access"},{"key":"B44","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1016\/j.ins.2023.01.093","article-title":"Rethinking attention mechanism in time series classification","volume":"627","author":"Zhao","year":"2023","journal-title":"Inform. Sci"}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2023.1269447\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,22]],"date-time":"2023-09-22T05:46:30Z","timestamp":1695361590000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2023.1269447\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,22]]},"references-count":44,"alternative-id":["10.3389\/fnbot.2023.1269447"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2023.1269447","relation":{},"ISSN":["1662-5218"],"issn-type":[{"value":"1662-5218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,22]]},"article-number":"1269447"}}