{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T12:26:19Z","timestamp":1764937579581,"version":"build-2065373602"},"reference-count":40,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2023,6,25]],"date-time":"2023-06-25T00:00:00Z","timestamp":1687651200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Beijing Natural Science Foundation","award":["L211002","4222002","L202016","KM 202010005017"],"award-info":[{"award-number":["L211002","4222002","L202016","KM 202010005017"]}]},{"name":"Foundation of the Beijing Municipal Commission of Education","award":["L211002","4222002","L202016","KM 202010005017"],"award-info":[{"award-number":["L211002","4222002","L202016","KM 202010005017"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In the communication-based train control (CBTC) system, traditional modes such as LTE or WLAN in train-to-train (T2T) communication face the problem of a complex and costly deployment of base stations and ground core networks. Therefore, the multi-hop ad hoc network, which has the characteristics of being relatively flexible and cheap, is considered for CBTC. However, because of the high mobility of the train, it is likely to move out of the communication range of wayside nodes. Moreover, some wayside nodes are heavily congested, resulting in long packet queuing delays that cannot meet the transmission requirements. To solve these problems, in this paper, we investigate the next-hop relay selection problem in multi-hop ad hoc networks to minimize transmission time, enhance the network throughput, and ensure the channel quality. In addition, we propose a multiagent dueling deep Q learning (DQN) algorithm to optimize the delay and throughput of the entire link by selecting the next-hop relay node. The simulation results show that, compared with the existing routing algorithms, it has obvious improvement in the aspects of delay, throughput, and packet loss rate.<\/jats:p>","DOI":"10.3390\/s23135883","type":"journal-article","created":{"date-parts":[[2023,6,26]],"date-time":"2023-06-26T05:28:02Z","timestamp":1687757282000},"page":"5883","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Next-Hop Relay Selection for Ad Hoc Network-Assisted Train-to-Train Communications in the CBTC System"],"prefix":"10.3390","volume":"23","author":[{"given":"Sixing","family":"Ma","sequence":"first","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5576-9883","authenticated-orcid":false,"given":"Meng","family":"Li","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China"}]},{"given":"Ruizhe","family":"Yang","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8470-3982","authenticated-orcid":false,"given":"Yang","family":"Sun","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2880-3329","authenticated-orcid":false,"given":"Zhuwei","family":"Wang","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China"}]},{"given":"Pengbo","family":"Si","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,6,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1544","DOI":"10.1109\/TITS.2018.2856635","article-title":"Enhancing Communication-Based Train Control Systems Through Train-to-Train Communications","volume":"20","author":"Wang","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2162","DOI":"10.1109\/TVT.2013.2291533","article-title":"Communication-Based Train Control (CBTC) Systems with Cooperative Relaying: Design and Performance Analysis","volume":"63","author":"Zhu","year":"2014","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1767","DOI":"10.1109\/TIT.2006.894682","article-title":"Resource Allocation and Quality of Service Evaluation for Wireless Communication Systems Using Fluid Models","volume":"53","author":"Liu","year":"2007","journal-title":"IEEE Trans. Inf. Theory."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4072","DOI":"10.1109\/TITS.2019.2936219","article-title":"Train-Centric CBTC Meets Age of Information in Train-to-Train Communications","volume":"21","author":"Wang","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1109\/TITS.2015.2481394","article-title":"Energy-Efficient Communication-Based Train Control Systems with Packet Delay and Loss","volume":"17","author":"Sun","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wang, X., Liu, L., Tang, T., and Zhu, L. (2018, January 12\u201314). Next Generation Train-Centric Communication-Based Train Control System with Train-to-Train (T2T) Communications. Proceedings of the 2018 International Conference on Intelligent Rail Transportation (ICIRT), Singapore.","DOI":"10.1109\/ICIRT.2018.8641649"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Li, Y., and Zhu, L. (2022, January 4\u20138). Collaborative Cloud and Edge Computing in 5G based Train Control Systems. Proceedings of the 2022 IEEE Global Communications Conference, Rio de Janeiro, Brazil.","DOI":"10.1109\/GLOBECOM48099.2022.10001291"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2283","DOI":"10.1109\/COMST.2020.3004197","article-title":"Toward Smart Wireless Communications via Intelligent Reflecting Surfaces: A Contemporary Survey","volume":"22","author":"Gong","year":"2020","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ahmed, M., Wahid, A., Laique, S.S., Khan, W.U., Ihsan, A., Xu, F., Chatzinotas, S., and Han, Z. (2023). A Survey on STAR-RIS: Use Cases, Recent Advances, and Future Research Challenges. IEEE Internet Things J.","DOI":"10.36227\/techrxiv.21820617"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ahmed, M., Mirza, M.A., Raza, S., Ahmad, H., Xu, F., Khan, W.U., Lin, Q., and Han, Z. (2023). Vehicular Communication Network Enabled CAV Data Offloading: A Review. IEEE Trans. Intell. Transp. Syst.","DOI":"10.1109\/TITS.2023.3263643"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1109\/COMST.2015.2495297","article-title":"Survey of Important Issues in UAV Communication Networks","volume":"18","author":"Gupta","year":"2016","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_12","unstructured":"Jacquet, P., Muhlethaler, P., Clausen, T., Laouiti, A., Qayyum, A., and Viennot, L. (2001, January 30). Optimized Link State Routing Protocol for Ad Hoc Networks. Proceedings of the 2001 IEEE International Multi Topic Conference, Lahore, Pakistan."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Bai, F., Sadagopan, N., and Helmy, A. (April, January 30). IMPORTANT: A framework to systematically analyze the Impact of Mobility on Performance of Routing Protocols for Adhoc Networks. Proceedings of the 2003 Twenty-Second Annual Joint Conference of the IEEE Computer and Communications Societies, San Francisco, CA, USA.","DOI":"10.1109\/INFCOM.2003.1208920"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"5785","DOI":"10.1109\/JIOT.2021.3062091","article-title":"Trajectory Design and Access Control for Air\u2013Ground Coordinated Communications System with Multiagent Deep Reinforcement Learning","volume":"9","author":"Ding","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"10059","DOI":"10.1109\/TVT.2022.3182335","article-title":"Packet Routing in Dynamic Multi-Hop UAV Relay Network: A Multi-Agent Learning Approach","volume":"71","author":"Ding","year":"2022","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1379","DOI":"10.1109\/LWC.2020.2991037","article-title":"Relay Selection for UAV-Assisted Urban Vehicular Ad Hoc Networks","volume":"9","author":"He","year":"2020","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wu, Q., and Zheng, J. (2015, January 8\u201312). Performance Modeling and Analysis of the ADHOC MAC Protocol for VANETs. Proceedings of the IEEE International Conference on Communication (ICC\u201915), London, UK.","DOI":"10.1109\/ICC.2015.7248891"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1007\/s11276-015-1000-6","article-title":"Performance Modeling and Analysis of the ADHOC MAC Protocol for Vehicular Networks","volume":"22","author":"Wu","year":"2016","journal-title":"Wirel. Netw."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1109\/JSTSP.2022.3221271","article-title":"Mobility-Aware Cooperative Caching in Vehicular Edge Computing Based on Asynchronous Federated and Deep Reinforcement Learning","volume":"17","author":"Wu","year":"2023","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhu, L., Yu, F.R., and Ning, B. (2010, January 6\u20139). Availability Improvement for WLAN-Based Train-Ground Communication Systems in Communication-Based Train Control (CBTC). Proceedings of the 2010 IEEE 72nd Vehicular Technology Conference, Ottawa, ON, Canada.","DOI":"10.1109\/VETECF.2010.5594409"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Wang, Y., Zhu, L., and Zhao, H. (2017, January 20\u201322). Handover Performance Test and Analysis in TD-LTE based CBTC Train Ground Communication Systems. Proceedings of the 2017 Chinese Automation Congress, Jinan, China.","DOI":"10.1109\/CAC.2017.8243415"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Karp, B., and Kung, H.-T. (2000, January 6\u201311). Gpsr: Greedy Perimeter Stateless Routing for Wireless Networks. Proceedings of the 6th Annual International Conference on Mobile Computing and Networking, Boston, MA, USA.","DOI":"10.1145\/345910.345953"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liu, K., and Niu, K. (2017, January 22\u201324). A Hybrid Relay Node Selection Strategy for VANET Routing. Proceedings of the 2017 IEEE\/CIC International Conference on Communications in China (ICCC), Qingdao, China.","DOI":"10.1109\/ICCChina.2017.8330400"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/MVT.2007.912927","article-title":"Routing in Vehicular Ad Hoc Networks: A Survey","volume":"2","author":"Li","year":"2007","journal-title":"IEEE Veh. Technol. Mag."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/COMST.2008.4625806","article-title":"Vehicle Ad Hoc Networks: Applications and Related Technical Issues","volume":"10","author":"Toor","year":"2008","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wang, Z., Han, R., Li, H., Knoblock, E.J., Apaza, R.D., and Gasper, M.R. (2022, January 18\u201322). Deep Reinforcement Learning Based Routing in an Air-to-Air Ad-hoc Network. Proceedings of the 2022 IEEE\/AIAA 41st Digital Avionics Systems Conference (DASC), Portsmouth, VA, USA.","DOI":"10.1109\/DASC55683.2022.9925799"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1109\/LWC.2019.2958814","article-title":"A Deep Reinforcement Learning Based D2D Relay Selection and Power Level Allocation in mmWave Vehicular Networks","volume":"9","author":"Zhang","year":"2020","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wu, Q., and Zheng, J. (2014, January 10\u201314). Performance Modeling of IEEE 802.11 DCF Based Fair Channel Access for Vehicular-to-Roadside Communication in a Non-Saturated State. Proceedings of the IEEE International Conference on Communication (ICC\u201914), Sydney, NSW, Australia.","DOI":"10.1109\/ICC.2014.6883711"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Chen, Y., Feng, Z., Xu, D., and Liu, Y. (2012, January 10\u201315). Optimal Power Allocation and Relay Selection in Dual-Hop and Multi-Hop Cognitive Networks. Proceedings of the 2012 IEEE International Conference on Communications (ICC), Ottawa, ON, Canada.","DOI":"10.1109\/ICC.2012.6363757"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Wang, Y., Feng, Z., Chen, X., Li, R., and Zhang, P. (2012, January 3\u20136). Outage Constrained Power Allocation and Relay Selection for Multi-Hop Cognitive Network. Proceedings of the 2012 IEEE Vehicular Technology Conference (VTC Fall), Quebec City, QC, Canada.","DOI":"10.1109\/VTCFall.2012.6398939"},{"key":"ref_31","unstructured":"Kleinrock, L. (1975). Queueing Systems, Volume I: Theory, Wiley-Interscience."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1142","DOI":"10.1109\/TWC.2005.847005","article-title":"Queuing with Adaptive Modulation and Coding over Wireless Links: Cross-Layer Analysis and Design","volume":"4","author":"Liu","year":"2005","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"8303","DOI":"10.1109\/TVT.2017.2682123","article-title":"On Relay Selection Schemes for Relay-Assisted D2D Communications in LTE-A Systems","volume":"66","author":"Ma","year":"2017","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1109\/TWC.2020.3026710","article-title":"MmWave M2M Networks: Improving Delay Performance of Relaying","volume":"20","author":"Chen","year":"2021","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"4492","DOI":"10.1109\/T-WC.2008.070867","article-title":"Buffering in a Three-Node Relay Network","volume":"7","author":"Xia","year":"2008","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"14318","DOI":"10.1109\/ACCESS.2018.2796247","article-title":"Multi-Hop Relay-Aided Underlay D2D Communications for Improving Cellular Coverage Quality","volume":"6","author":"Gui","year":"2018","journal-title":"IEEE Access"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3559","DOI":"10.1109\/TII.2019.2897805","article-title":"Performance Optimization for Blockchain-Enabled Industrial Internet of Things (IIoT) Systems: A Deep Reinforcement Learning Approach","volume":"15","author":"Liu","year":"2019","journal-title":"IEEE Trans. Ind. Inf."},{"key":"ref_38","first-page":"1995","article-title":"Dueling Network Architectures for Deep Reinforcement Learning","volume":"48","author":"Wang","year":"2016","journal-title":"PMLR"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1109\/TNSE.2021.3068340","article-title":"Resource Pricing and Allocation in MEC Enabled Blockchain Systems: An A3C Deep Reinforcement Learning Approach","volume":"9","author":"Du","year":"2022","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"9517","DOI":"10.1109\/JIOT.2020.3003449","article-title":"MEC-Assisted Immersive VR Video Streaming over Terahertz Wireless Networks: A Deep Reinforcement Learning Approach","volume":"7","author":"Du","year":"2020","journal-title":"IEEE Internet Things J."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/13\/5883\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:00:23Z","timestamp":1760126423000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/13\/5883"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,25]]},"references-count":40,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2023,7]]}},"alternative-id":["s23135883"],"URL":"https:\/\/doi.org\/10.3390\/s23135883","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,6,25]]}}}