{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T22:24:04Z","timestamp":1778883844194,"version":"3.51.4"},"reference-count":26,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2024,5,11]],"date-time":"2024-05-11T00:00:00Z","timestamp":1715385600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["62173137"],"award-info":[{"award-number":["62173137"]}]},{"name":"National Natural Science Foundation of China","award":["52172403"],"award-info":[{"award-number":["52172403"]}]},{"name":"National Natural Science Foundation of China","award":["62303178"],"award-info":[{"award-number":["62303178"]}]},{"name":"National Natural Science Foundation of China","award":["23A0426"],"award-info":[{"award-number":["23A0426"]}]},{"name":"National Natural Science Foundation of China","award":["22B0577"],"award-info":[{"award-number":["22B0577"]}]},{"name":"Project of Hunan Provincial Department of Education, China","award":["62173137"],"award-info":[{"award-number":["62173137"]}]},{"name":"Project of Hunan Provincial Department of Education, China","award":["52172403"],"award-info":[{"award-number":["52172403"]}]},{"name":"Project of Hunan Provincial Department of Education, China","award":["62303178"],"award-info":[{"award-number":["62303178"]}]},{"name":"Project of Hunan Provincial Department of Education, China","award":["23A0426"],"award-info":[{"award-number":["23A0426"]}]},{"name":"Project of Hunan Provincial Department of Education, China","award":["22B0577"],"award-info":[{"award-number":["22B0577"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Cyclic air braking is a key factor affecting the safe operation of trains on long downhill sections. However, a train\u2019s cycle braking strategy is constrained by multiple factors such as driving environment, speed, and air-refilling time. A Q-learning algorithm-based cyclic braking strategy for a heavy haul train on long downhill sections is proposed to address this challenge. First, the operating environment of a heavy haul train on long downhill sections is designed, considering various constraint parameters, such as the characteristics of special operating routes, allowable operating speeds, and train tube air-refilling time. Second, the operating status and braking operation of a heavy haul train on long downhill sections are discretized in order to establish a Q-table based on state\u2013action pairs. The training of algorithm performance is achieved by continuously updating Q-tables. Finally, taking the heavy haul train formation as the study object, actual line data from the Shuozhou\u2013Huanghua Railway are used for experimental simulation, and different hyperparameters and entry speed conditions are considered. The results show that the safe and stable cyclic braking of a heavy haul train on long downhill sections is achieved. The effectiveness of the Q-learning control strategy is verified.<\/jats:p>","DOI":"10.3390\/info15050271","type":"journal-article","created":{"date-parts":[[2024,5,13]],"date-time":"2024-05-13T09:28:25Z","timestamp":1715592505000},"page":"271","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Cyclic Air Braking Strategy for Heavy Haul Trains on Long Downhill Sections Based on Q-Learning Algorithm"],"prefix":"10.3390","volume":"15","author":[{"given":"Changfan","family":"Zhang","sequence":"first","affiliation":[{"name":"College of Electrical and Information Engineering, Hunan University of Technology, Zhuzhou 412000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-5848-5840","authenticated-orcid":false,"given":"Shuo","family":"Zhou","sequence":"additional","affiliation":[{"name":"College of Electrical and Information Engineering, Hunan University of Technology, Zhuzhou 412000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jing","family":"He","sequence":"additional","affiliation":[{"name":"College of Electrical and Information Engineering, Hunan University of Technology, Zhuzhou 412000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lin","family":"Jia","sequence":"additional","affiliation":[{"name":"College of Electrical and Information Engineering, Hunan University of Technology, Zhuzhou 412000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,5,11]]},"reference":[{"key":"ref_1","first-page":"131","article-title":"China\u2019s railway train speed, density and weight in developing","volume":"1","author":"Jiang","year":"2022","journal-title":"Railw. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4079","DOI":"10.1080\/00423114.2021.1998559","article-title":"Study on longitudinal dynamics of heavy haul trains running on long and steep downhills","volume":"60","author":"Liu","year":"2022","journal-title":"Veh. Syst. Dyn."},{"key":"ref_3","first-page":"277","article-title":"Method for analyzing the operational performance of high-speed railway long ramp EMUs","volume":"57","author":"Hu","year":"2022","journal-title":"J. Southwest Jiaotong Univ."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zhou, X., Cheng, S., Yu, T., Zhou, W., Lin, L., and Wang, J. (2023). Research on the air brake system of heavy haul trains based on neural network. Veh. Syst. Dyn., 1\u201319.","DOI":"10.1080\/00423114.2023.2273866"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Xu, K., and Liu, Q. (2023, January 5\u20138). Long and Short-Term Memory Mechanism Hybrid Model for Speed Trajectory Prediction of Heavy Haul Trains. Proceedings of the 2023 IEEE Symposium Series on Computational Intelligence (SSCI), Mexico City, Mexico.","DOI":"10.1109\/SSCI52147.2023.10371907"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/j.ins.2022.04.004","article-title":"Data-driven models for train control dynamics in high-speed railways: LAG-LSTM for train trajectory prediction","volume":"600","author":"Yin","year":"2022","journal-title":"Inf. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1093\/tse\/tdaa013","article-title":"An intelligent method for controlling the ECP braking system of a heavy-haul train","volume":"2","author":"Tian","year":"2020","journal-title":"Transp. Saf. Environ."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.knosys.2018.08.015","article-title":"Intelligent operation of heavy haul train with data imbalance: A machine learning method","volume":"163","author":"Wang","year":"2019","journal-title":"Knowl.-Based Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"876","DOI":"10.1080\/0305215X.2022.2047669","article-title":"Optimization of the speed curve for heavy-haul trains considering cyclic air braking: An MILP approach","volume":"55","author":"Su","year":"2023","journal-title":"Eng. Optim."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wei, S., Zhu, L., Chen, L., and Lin, Q. (2021). An adaboost-based intelligent driving algorithm for heavy-haul trains. Actuators, 10.","DOI":"10.3390\/act10080188"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Huang, Y., Su, S., and Liu, W. (2020, January 20\u201323). Optimization on the driving curve of heavy haul trains based on artificial bee colony algorithm. Proceedings of the 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), Rhodes, Greece.","DOI":"10.1109\/ITSC45102.2020.9294214"},{"key":"ref_12","first-page":"139","article-title":"Research on operation optimization of heavy-haul combined trains in long and steep downhill sections based on reinforcement learning","volume":"6","author":"Wang","year":"2023","journal-title":"Electr. Drive Locomot."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"708","DOI":"10.1016\/j.ins.2021.04.088","article-title":"Deep reinforcement learning with reference system to handle constraints for energy-efficient train control","volume":"570","author":"Shang","year":"2021","journal-title":"Inf. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"105173","DOI":"10.1016\/j.knosys.2019.105173","article-title":"Reinforcement learning approach for optimal control of multiple electric locomotives in a heavy-haul freight train: A Double-Switch-Q-network architecture","volume":"190","author":"Tang","year":"2020","journal-title":"Knowl.-Based Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"8003","DOI":"10.1109\/TITS.2023.3264238","article-title":"Robust cruise control for the heavy haul train subject to disturbance and actuator saturation","volume":"24","author":"Wang","year":"2023","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1177\/09544097211008293","article-title":"Hill-starting a heavy haul train with a 24-axle locomotive","volume":"236","author":"Wu","year":"2022","journal-title":"Proc. Inst. Mech. Eng. Part F J. Rail Rapid Transit"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhu, Q., Su, S., Tang, T., and Xiao, X. (2021, January 19\u201322). Energy-efficient train control method based on soft actor-critic algorithm. Proceedings of the 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), Indianapolis, IN, USA.","DOI":"10.1109\/ITSC48978.2021.9564449"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3269","DOI":"10.1080\/00423114.2021.1942509","article-title":"Countermeasures for preventing coupler jack-knifing of slave control locomotives in 20,000-tonne heavy-haul trains during cycle braking","volume":"60","author":"Ge","year":"2022","journal-title":"Veh. Syst. Dyn."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1093\/tse\/tdaa015","article-title":"Study on a Segmented Electro-Pneumatic Braking System for Heavy-Haul Trains","volume":"2","author":"Wei","year":"2020","journal-title":"Transp. Saf. Environ."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3742","DOI":"10.1109\/TTE.2022.3169901","article-title":"Modeling of regenerative braking energy for electric multiple units passing long downhill section","volume":"8","author":"Zhang","year":"2022","journal-title":"IEEE Trans. Transp. Electrif."},{"key":"ref_21","first-page":"663","article-title":"Research On Energy-saving Operation Of High-speed Trains Based On Improved Genetic Algorithm","volume":"26","author":"Niu","year":"2022","journal-title":"J. Appl. Sci. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1177\/09544097231196286","article-title":"The design of electronically controlled pneumatic brake signal propagation mode for electronic control braking of a 30,000-ton heavy-haul train","volume":"238","author":"Ma","year":"2024","journal-title":"Proc. Inst. Mech. Eng. Part F J. Rail Rapid Transit"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1177\/09544097231203271","article-title":"On-time and energy-saving train operation strategy based on improved AGA multi-objective optimization","volume":"238","author":"He","year":"2024","journal-title":"Proc. Inst. Mech. Eng. Part F J. Rail Rapid Transit."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Palm, H., and Arndt, L. (2023). Reinforcement Learning-Based Hybrid Multi-Objective Optimization Algorithm Design. Information, 14.","DOI":"10.3390\/info14050299"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wang, X., Wu, C., Xue, J., and Chen, Z. (2020). A method of personalized driving decision for smart car based on deep reinforcement learning. Information, 11.","DOI":"10.3390\/info11060295"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.isatra.2023.07.043","article-title":"Q-learning based fault estimation and fault tolerant iterative learning control for MIMO systems","volume":"142","author":"Wang","year":"2023","journal-title":"ISA Trans."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/5\/271\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:40:49Z","timestamp":1760107249000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/5\/271"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,11]]},"references-count":26,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,5]]}},"alternative-id":["info15050271"],"URL":"https:\/\/doi.org\/10.3390\/info15050271","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,11]]}}}