{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:35:06Z","timestamp":1760150106579,"version":"build-2065373602"},"reference-count":23,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2023,10,13]],"date-time":"2023-10-13T00:00:00Z","timestamp":1697155200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Higher standards for reliability and efficiency apply to the connection between vehicle terminals and infrastructure by the fifth-generation mobile communication technology (5G). A vehicle-to-infrastructure system uses a communication system called NR-V2I (New Radio-Vehicle to Infrastructure), which uses Link Adaptation (LA) technology to communicate in constantly changing V2I to increase the efficacy and reliability of V2I information transmission. This paper proposes a Double Deep Q-learning (DDQL) LA scheduling algorithm for optimizing the modulation and coding scheme (MCS) of autonomous driving vehicles in V2I communication. The problem with the Doppler shift and complex fast time-varying channels reducing the reliability of information transmission in V2I scenarios is that they make it less likely that the information will be transmitted accurately. Schedules for autonomous vehicles using Space Division Multiplexing (SDM) and MCS are used in V2I communications. To address the issue of Deep Q-learning (DQL) overestimation in the Q-Network learning process, the approach integrates Deep Neural Network (DNN) and Double Q-Network (DDQN). The findings of this study demonstrate that the suggested algorithm can adapt to complex channel environments with varying vehicle speeds in V2I scenarios and by choosing the best scheduling scheme for V2I road information transmission using a combination of MCS. SDM not only increases the accuracy of the transmission of road safety information but also helps to foster cooperation and communication between vehicle terminals to realize cooperative driving.<\/jats:p>","DOI":"10.3390\/s23208454","type":"journal-article","created":{"date-parts":[[2023,10,14]],"date-time":"2023-10-14T14:59:59Z","timestamp":1697295599000},"page":"8454","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Ultra-Reliable Deep-Reinforcement-Learning-Based Intelligent Downlink Scheduling for 5G New Radio-Vehicle to Infrastructure Scenarios"],"prefix":"10.3390","volume":"23","author":[{"given":"Jizhe","family":"Wang","sequence":"first","affiliation":[{"name":"State Grid Chongqing Information and Telecommunication Company, Chongqing 400012, China"}]},{"given":"Yuanbing","family":"Zheng","sequence":"additional","affiliation":[{"name":"State Grid Chongqing Information and Telecommunication Company, Chongqing 400012, China"}]},{"given":"Jian","family":"Wang","sequence":"additional","affiliation":[{"name":"State Grid Chongqing Information and Telecommunication Company, Chongqing 400012, China"}]},{"given":"Zhenghua","family":"Shen","sequence":"additional","affiliation":[{"name":"State Grid Chongqing Information and Telecommunication Company, Chongqing 400012, China"}]},{"given":"Lei","family":"Tong","sequence":"additional","affiliation":[{"name":"State Grid Chongqing Information and Telecommunication Company, Chongqing 400012, China"}]},{"given":"Yahao","family":"Jing","sequence":"additional","affiliation":[{"name":"School of Microelectronics and Communication Engineering, Chongqing University, Chongqing 400044, China"}]},{"given":"Yu","family":"Luo","sequence":"additional","affiliation":[{"name":"School of Microelectronics and Communication Engineering, Chongqing University, Chongqing 400044, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0171-4323","authenticated-orcid":false,"given":"Yong","family":"Liao","sequence":"additional","affiliation":[{"name":"School of Microelectronics and Communication Engineering, Chongqing University, Chongqing 400044, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"5186","DOI":"10.1109\/TITS.2023.3241251","article-title":"A Cooperative Vehicle-Infrastructure System for Road Hazards Detection with Edge Intelligence","volume":"24","author":"Chen","year":"2023","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.23919\/cje.2022.00.337","article-title":"A V2V Emergent Message Dissemination Scheme for 6G-Oriented Vehicular Networks","volume":"32","author":"Chen","year":"2023","journal-title":"Chin. J. Electron."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2836","DOI":"10.1109\/TVT.2020.2965137","article-title":"Robust Modulation Classification Over \u03b1-Stable Noise Using Graph-Based Fractional Lower-Order Cyclic Spectrum Analysis","volume":"69","author":"Yan","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Mota, M.P., Araujo, D.C., Costa Neto, F.H., de Almeida, A.L.F., and Cavalcanti, F.R. (2019, January 9\u201313). Adaptive Modulation and Coding Based on Reinforcement Learning for 5G Networks. Proceedings of the 2019 IEEE Globecom Workshops (GC Wkshps), Waikoloa, HI, USA.","DOI":"10.1109\/GCWkshps45667.2019.9024384"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Tsurumi, S., and Fujii, T. (2018, January 10\u201312). Reliable Vehicle-to-Vehicle Communication Using Spectrum Environment Map. Proceedings of the 2018 International Conference on Information Networking (ICOIN), Chiang Mai, Thailand.","DOI":"10.1109\/ICOIN.2018.8343131"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"5976","DOI":"10.1109\/TWC.2023.3238850","article-title":"Roadside IRS-Aided Vehicular Communication: Efficient Channel Estimation and Low-Complexity Beamforming Design","volume":"22","author":"Huang","year":"2023","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3152","DOI":"10.1109\/TITS.2019.2929020","article-title":"Deep Learning for Intelligent Transportation Systems: A Survey of Emerging Trends","volume":"21","author":"Veres","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_8","unstructured":"Ramjee, S., Ju, S., Yang, D., Liu, X., Gamal, A.E., and Eldar, Y.C. (2023, July 03). Fast Deep Learning for Automatic Modulation Classification. Available online: https:\/\/arxiv.org\/abs\/1901.05850v1."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Liu, X., Yang, D., and Gamal, A.E. (November, January 29). Deep Neural Network Architectures for Modulation Classification. Proceedings of the 2017 51st Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA, USA.","DOI":"10.1109\/ACSSC.2017.8335483"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2392","DOI":"10.1109\/COMST.2017.2727878","article-title":"A Survey of Machine Learning Techniques Applied to Self-Organizing Cellular Networks","volume":"19","author":"Klaine","year":"2017","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_11","first-page":"47","article-title":"A Continuous-State Reinforcement Learning Strategy for Link Adaptation in OFDM Wireless Systems","volume":"30","author":"Vieira","year":"2015","journal-title":"J. Commun. Inf. Syst."},{"key":"ref_12","unstructured":"(2023, July 03). Robust Adaptive Modulation and Coding (AMC) Selection in LTE Systems Using Reinforcement Learning. Available online: https:\/\/ieeexplore.ieee.org\/abstract\/document\/6966162\/."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/MSP.2017.2743240","article-title":"Deep Reinforcement Learning: A Brief Survey","volume":"34","author":"Arulkumaran","year":"2017","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3281","DOI":"10.1109\/TWC.2019.2912754","article-title":"Deep Reinforcement Learning-Based Modulation and Coding Scheme Selection in Cognitive Heterogeneous Networks","volume":"18","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1109\/LCOMM.2022.3210928","article-title":"DQN-Based Adaptive MCS and SDM for 5G Massive MIMO-OFDM Downlink","volume":"27","author":"Liao","year":"2023","journal-title":"IEEE Commun. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2417","DOI":"10.1109\/TSTE.2019.2958361","article-title":"A Novel Multi-Agent DDQN-AD Method-Based Distributed Strategy for Automatic Generation Control of Integrated Energy Systems","volume":"11","author":"Xi","year":"2020","journal-title":"IEEE Trans. Sustain. Energy"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1109\/TSG.2019.2924025","article-title":"Double Deep Q -Learning-Based Distributed Operation of Battery Energy Storage System Considering Uncertainties","volume":"11","author":"Bui","year":"2020","journal-title":"IEEE Trans. Smart Grid."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"73164","DOI":"10.1109\/ACCESS.2020.2983715","article-title":"Maximum-Throughput Sidelink Resource Allocation for NR-V2X Networks with the Energy-Efficient CSI Transmission","volume":"3","author":"Xiaoqin","year":"2020","journal-title":"IEEE Access"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2009","DOI":"10.1109\/TVT.2022.3210689","article-title":"On the Feasibility of Remote Driving Applications Over mmWave 5G Vehicular Communications: Implementation and Demonstration","volume":"9","author":"Kim","year":"2023","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"18","DOI":"10.23919\/JCC.2023.03.002","article-title":"DQL-based intelligent scheduling algorithm for automatic driving in massive MIMO V2I scenarios","volume":"3","author":"Liao","year":"2023","journal-title":"China Commun."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sasaoka, N., Sasaki, T., and Itoh, Y. (2019, January 19\u201321). PMI\/RI Selection Based on Channel Capacity Increment Ratio. Proceedings of the 2019 International Symposium on Multimedia and Communication Technology (ISMAC), Quezon City, Philippines.","DOI":"10.1109\/ISMAC.2019.8836179"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"(2023, July 19). Passive Method for Estimating Available Throughput for Autonomous Off-Peak Data Transfer. Available online: https:\/\/www.hindawi.com\/journals\/wcmc\/2020\/3502394\/.","DOI":"10.1155\/2020\/3502394"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1109\/TCCN.2020.2983170","article-title":"A Reinforcement Learning Method for Joint Mode Selection and Power Adaptation in the V2V Communication Network in 5G","volume":"3","author":"Zhao","year":"2020","journal-title":"IEEE Trans. Cogn. Commun."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8454\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:06:38Z","timestamp":1760130398000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8454"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,13]]},"references-count":23,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["s23208454"],"URL":"https:\/\/doi.org\/10.3390\/s23208454","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,10,13]]}}}