{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,14]],"date-time":"2025-10-14T00:50:00Z","timestamp":1760403000570,"version":"build-2065373602"},"reference-count":42,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,1,14]],"date-time":"2022-01-14T00:00:00Z","timestamp":1642118400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61976224","61976088"],"award-info":[{"award-number":["61976224","61976088"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Fundamental Research Funds for the Central Universities of Central South University","award":["2021zzts0701"],"award-info":[{"award-number":["2021zzts0701"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>An intelligent land vehicle utilizes onboard sensors to acquire observed states at a disorderly intersection. However, partial observation of the environment occurs due to sensor noise. This causes decision failure easily. A collision relationship-based driving behavior decision-making method via deep recurrent Q network (CR-DRQN) is proposed for intelligent land vehicles. First, the collision relationship between the intelligent land vehicle and surrounding vehicles is designed as the input. The collision relationship is extracted from the observed states with the sensor noise. This avoids a CR-DRQN dimension explosion and speeds up the network training. Then, DRQN is utilized to attenuate the impact of the input noise and achieve driving behavior decision-making. Finally, some comparative experiments are conducted to verify the effectiveness of the proposed method. CR-DRQN maintains a high decision success rate at a disorderly intersection with partially observable states. In addition, the proposed method is outstanding in the aspects of safety, the ability of collision risk prediction, and comfort.<\/jats:p>","DOI":"10.3390\/s22020636","type":"journal-article","created":{"date-parts":[[2022,1,16]],"date-time":"2022-01-16T20:45:21Z","timestamp":1642365921000},"page":"636","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["A Collision Relationship-Based Driving Behavior Decision-Making Method for an Intelligent Land Vehicle at a Disorderly Intersection via DRQN"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3690-8569","authenticated-orcid":false,"given":"Lingli","family":"Yu","sequence":"first","affiliation":[{"name":"School of Automation, Central South University, Changsha 410083, China"},{"name":"Hunan Xiangjiang Artificial Intelligence Academy, Changsha 410000, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4765-6483","authenticated-orcid":false,"given":"Shuxin","family":"Huo","sequence":"additional","affiliation":[{"name":"School of Automation, Central South University, Changsha 410083, China"},{"name":"Hunan Xiangjiang Artificial Intelligence Academy, Changsha 410000, China"}]},{"given":"Keyi","family":"Li","sequence":"additional","affiliation":[{"name":"School of Automation, Central South University, Changsha 410083, China"},{"name":"Hunan Xiangjiang Artificial Intelligence Academy, Changsha 410000, China"}]},{"given":"Yadong","family":"Wei","sequence":"additional","affiliation":[{"name":"School of Automation, Central South University, Changsha 410083, China"},{"name":"Hunan Xiangjiang Artificial Intelligence Academy, Changsha 410000, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Bijelic, M., Muench, C., Ritter, W., Kalnishkan, Y., and Dietmayer, K. (2018, January 4\u20137). Robustness Against Unknown Noise for Raw Data Fusing Neural Networks. Proceedings of the 2018 21st International Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA.","DOI":"10.1109\/ITSC.2018.8569911"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Fayyad, J., Jaradat, M.A., Gruyer, D., and Najjaran, H. (2020). Deep Learning Sensor Fusion for Autonomous Vehicle Perception and Localization: A review. Sensors, 20.","DOI":"10.3390\/s20154220"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Pan, X., and Lin, X. (2021, January 24\u201326). Research on the Behavior Decision of Connected and Autonomous Vehicle at the Unsignalized Intersection. Proceedings of the 2021 IEEE International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology (CEI), Fuzhou, China.","DOI":"10.1109\/CEI52496.2021.9574485"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"113816","DOI":"10.1016\/j.eswa.2020.113816","article-title":"Self-driving cars: A survey","volume":"165","author":"Badue","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2076","DOI":"10.1109\/TITS.2020.3036984","article-title":"Human-Like Decision Making for Autonomous Driving: A Noncooperative Game Theoretic Approach","volume":"22","author":"Hang","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1186\/s10033-021-00639-3","article-title":"Planning and Decision-making for Connected Autonomous Vehicles at Road Intersections: A Review","volume":"34","author":"Li","year":"2021","journal-title":"Chin. J. Mech. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Smirnov, N., Liu, Y.Z., Validi, A., Morales-Alvarez, W., and Olaverri-Monreal, C. (2021). A Game Theory-Based Approach for Modeling Autonomous Vehicle Behavior in Congested, Urban Lane-Changing Scenarios. Sensors, 21.","DOI":"10.3390\/s21041523"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"189546","DOI":"10.1109\/ACCESS.2020.3031674","article-title":"A Conflict Decision Model Based on Game Theory for Intelligent Vehicles at Urban Unsignalized Intersections","volume":"8","author":"Chen","year":"2020","journal-title":"IEEE Access"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"9829","DOI":"10.1109\/JSEN.2018.2871869","article-title":"Parking Detection Method Based on Finite-State Machine and Collaborative Decision-Making","volume":"18","author":"Zhu","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"708","DOI":"10.1016\/j.asoc.2015.01.066","article-title":"Fuzzy decision method to improve the information exchange in a vehicle sensor tracking system","volume":"35","author":"Cueva","year":"2015","journal-title":"Appl. Soft Comput."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.trc.2016.02.009","article-title":"A binary decision model for discretionary lane changing move based on fuzzy inference system","volume":"67","author":"Balal","year":"2016","journal-title":"Transp. Res. Part C-Emerg. Technol."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Silva, I., and Naranjo, J.E. (2020). A Systematic Methodology to Evaluate Prediction Models for Driving Style Classification. Sensors, 20.","DOI":"10.3390\/s20061692"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wang, C., Delport, J., and Wang, Y. (2019). Lateral Motion Prediction of On-Road Preceding Vehicles: A Data-Driven Approach. Sensors, 19.","DOI":"10.3390\/s19092111"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1007\/s42154-020-00113-1","article-title":"Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections","volume":"3","author":"Li","year":"2020","journal-title":"Automot. Innov."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Alizadeh, A., Moghadam, M., Bicer, Y., Ure, N.K., Yavas, U., and Kurtulus, C. (2019, January 27\u201330). Automated Lane Change Decision Making using Deep Reinforcement Learning in Dynamic and Uncertain Highway Environment. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, New Zealand.","DOI":"10.1109\/ITSC.2019.8917192"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Sallab, A.E.L., Abdou, M., and Perot, E. (2017). Deep Reinforcement Learning Framework for Autonomous Driving. Electron. Imaging, 70\u201376.","DOI":"10.2352\/ISSN.2470-1173.2017.19.AVM-023"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1109\/OJITS.2020.2965969","article-title":"Surround Vehicle Motion Prediction Using LSTM-RNN for Motion Planning of Autonomous Vehicles at Multi-Lane Turn Intersections","volume":"1","author":"Jeong","year":"2020","journal-title":"IEEE Open J. Intell. Transp. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zeng, J.H., Hu, J.M., and Zhang, Y. (2018, January 26\u201330). Adaptive Traffic Signal Control with Deep Recurrent Q-learning. Proceedings of the IEEE Intelligent Vehicles Symposium, Changshu, China.","DOI":"10.1109\/IVS.2018.8500414"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Choe, C.J., Baek, S., Woon, B., and Kong, S.H. (2018, January 12\u201314). Deep Q Learning with LSTM for Traffic Light Control. Proceedings of the 2018 24th Asia-Pacific Conference on Communications, Ningbo, China.","DOI":"10.1109\/APCC.2018.8633520"},{"key":"ref_20","unstructured":"Jozefowicz, R., Zaremba, W., and Sutskever, I. (2015, January 6\u201311). An Empirical Exploration of Recurrent Network Architectures. Proceedings of the 32nd International Conference on International Conference on Machine Learning, Lille, France."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Iberraken, D., Adouane, L., and Denis, D. (2018, January 1\u20135). Multi-Level Bayesian Decision-Making for Safe and Flexible Autonomous Navigation in Highway Environment. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Madrid, Spain.","DOI":"10.1109\/IROS.2018.8593565"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Noh, S. (2018, January 1\u20135). Probabilistic Collision Threat Assessment for Autonomous Driving at Road Intersections Inclusive of Vehicles in Violation of Traffic Rules. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Madrid, Spain.","DOI":"10.1109\/IROS.2018.8593645"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"105805","DOI":"10.1016\/j.aap.2020.105805","article-title":"Risk perception and the warning strategy based on safety potential field theory","volume":"148","author":"Li","year":"2020","journal-title":"Accid. Anal. Prev."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1367","DOI":"10.1007\/s10514-017-9619-z","article-title":"Multipolicy decision-making for autonomous driving via changepoint-based behavior prediction: Theory and experiment","volume":"41","author":"Galceran","year":"2017","journal-title":"Auton. Robot."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Hsu, T.M., Chen, Y.R., and Wang, C.H. (2020, January 4\u20137). Decision Making Process of Autonomous Vehicle with Intention-Aware Prediction at Unsignalized Intersections. Proceedings of the 2020 International Automatic Control Conference (CACS), Hsinchu, Taiwan.","DOI":"10.1109\/CACS50047.2020.9289815"},{"key":"ref_26","unstructured":"Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., and Wierstra, D. (2015). Continuous control with deep reinforcement learning. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Huang, Z.Q., Zhang, J., Tian, R., and Zhang, Y.X. (2019, January 19\u201322). End-to-end autonomous driving decision based on deep reinforcement learning. Proceedings of the 5th International Conference on Control, Automation and Robotics, Beijing, China.","DOI":"10.1109\/ICCAR.2019.8813431"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Chen, J., Xue, Z., and Fan, D. (2020). Deep Reinforcement Learning Based Left-Turn Connected and Automated Vehicle Control at Signalized Intersection in Vehicle-to-Infrastructure Environment. Information, 11.","DOI":"10.3390\/info11020077"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"5876","DOI":"10.1109\/TVT.2020.2986005","article-title":"A decision-making strategy for vehicle autonomous braking in emergency via deep reinforcement learning","volume":"69","author":"Fu","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Qian, L.L., Xu, X., and Zeng, Y.J. (2019). Deep consistent behavioral decision making with planning features for autonomous vehicles. Electronics, 8.","DOI":"10.3390\/electronics8121492"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kai, S., Wang, B., Chen, D., Hao, J., Zhang, H., and Liu, W. (November, January 19). A Multi-Task Reinforcement Learning Approach for Navigating Unsignalized Intersections. Proceedings of the 2020 IEEE Intelligent Vehicles Symposium (IV), Las Vegas, NV, USA.","DOI":"10.1109\/IV47402.2020.9304542"},{"key":"ref_33","unstructured":"Chen, L., Hu, X., Tang, B., and Cheng, Y. (2020). Conditional DQN-Based Motion Planning with Fuzzy Logic for Autonomous Driving. IEEE Trans. Intell. Transp. Syst., 1\u201312."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kamran, D., Lopez, C.F., Lauer, M., and Stiller, C. (November, January 19). Risk-Aware High-level Decisions for Automated Driving at Occluded Intersections with Reinforcement Learning. Proceedings of the 2020 IEEE Intelligent Vehicles Symposium (IV), Las Vegas, NV, USA.","DOI":"10.1109\/IV47402.2020.9304606"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"151983","DOI":"10.1109\/ACCESS.2021.3127105","article-title":"Tactical Decision-Making for Autonomous Driving Using Dueling Double Deep Q Network With Double Attention","volume":"9","author":"Zhang","year":"2021","journal-title":"IEEE Access"},{"key":"ref_36","unstructured":"Mokhtari, K., and Wagner, A.R. (2021). Safe Deep Q-Network for Autonomous Vehicles at Unsignalized Intersection. arXiv."},{"key":"ref_37","unstructured":"Graesser, L., and Keng, W.L. (2019). Foundations of Deep Reinforcement Learning: Theory and Practice in Python, Addison-Wesley Professional. [1st ed.]."},{"key":"ref_38","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press. [2nd ed.]."},{"key":"ref_39","unstructured":"Chollet, F. (2017). Deep Learning with Python, Manning Publications Co.. [6th ed.]."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2905","DOI":"10.3390\/s18092905","article-title":"Intelligent Land-Vehicle Model Transfer Trajectory Planning Method Based on Deep Reinforcement Learning","volume":"18","author":"Yu","year":"2018","journal-title":"Sensors"},{"key":"ref_41","unstructured":"Farebrother, J., Machado, M.C., and Bowling, M.H. (2018). Generalization and Regularization in DQN. arXiv."},{"key":"ref_42","unstructured":"Hausknecht, M.J., and Stone, P. (2015). Deep Reinforcement Learning in Parameterized Action Space. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/2\/636\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:15:03Z","timestamp":1760364903000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/2\/636"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,14]]},"references-count":42,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["s22020636"],"URL":"https:\/\/doi.org\/10.3390\/s22020636","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,1,14]]}}}