{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T04:04:19Z","timestamp":1790309059648,"version":"4.1.0"},"reference-count":33,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2023,12,18]],"date-time":"2023-12-18T00:00:00Z","timestamp":1702857600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2019YFF0301801"],"award-info":[{"award-number":["2019YFF0301801"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["61806199"],"award-info":[{"award-number":["61806199"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2019YFF0301801"],"award-info":[{"award-number":["2019YFF0301801"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61806199"],"award-info":[{"award-number":["61806199"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper studies the tactical decision-making model of short track speed skating based on deep reinforcement learning, so as to improve the competitive performance of corresponding short track speed skaters. Short track speed skating, a traditional discipline in the Winter Olympics since its establishment in 1988, has consistently garnered attention. As artificial intelligence continues to advance, the utilization of deep learning methods to enhance athletes\u2019 tactical decision-making capabilities has become increasingly prevalent. Traditional tactical decision techniques often rely on the experience and knowledge of coaches and video analysis methods that require a lot of time and effort. Consequently, this study proposes a scientific simulation environment for short track speed skating, that accurately simulates the physical attributes of the venue, the physiological fitness of the athletes, and the rules of the competition. The Double Deep Q-Network (DDQN) model is enhanced and utilized, with improvements to the reward function and the distinct description of four tactics. This enables agents to learn optimal tactical decisions in various competitive states with a simulation environment. Experimental results demonstrate that this approach effectively enhances the competition performance and physiological fitness allocation of short track speed skaters.<\/jats:p>","DOI":"10.3390\/s23249904","type":"journal-article","created":{"date-parts":[[2023,12,18]],"date-time":"2023-12-18T12:57:56Z","timestamp":1702904276000},"page":"9904","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Enhancing Short Track Speed Skating Performance through Improved DDQN Tactical Decision Model"],"prefix":"10.3390","volume":"23","author":[{"given":"Yuanbo","family":"Yang","sequence":"first","affiliation":[{"name":"School of Information Science and Technology, Beijing Forestry University Beijing, Beijing 100107, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1179-8989","authenticated-orcid":false,"given":"Feimo","family":"Li","sequence":"additional","affiliation":[{"name":"Institute of Automation Chinese Academy of Sciences Beijing, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongxing","family":"Chang","sequence":"additional","affiliation":[{"name":"Institute of Automation Chinese Academy of Sciences Beijing, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,12,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1111\/sms.12429","article-title":"Relationship between strength qualities and short track speed skating performance in young athletes","volume":"26","author":"Felser","year":"2016","journal-title":"Scand. J. Med. Sci. Sport."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"711","DOI":"10.1123\/ijspp.2023-0036","article-title":"Time decay in the performance benefits from repeated-sprint training in hypoxia in world-class short-track speed skaters","volume":"1","author":"Deguire","year":"2023","journal-title":"Int. J. Sport. Physiol. Perform."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"742","DOI":"10.1123\/ijspp.2015-0384","article-title":"Pacing behavior and tactical positioning in 500-and 1000-m short-track speed skating","volume":"11","author":"Noorbergen","year":"2016","journal-title":"Int. J. Sport. Physiol. Perform."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1080\/02640414.2023.2238162","article-title":"Tactical positioning behaviours in short-track speed skating: A static and dynamic sequence analysis","volume":"41","author":"Hext","year":"2023","journal-title":"J. Sport. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1872","DOI":"10.1007\/s10618-017-0512-3","article-title":"Sports analytics for professional speed skating","volume":"31","author":"Knobbe","year":"2017","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1080\/24748668.2008.11868418","article-title":"Performance analysis of world class short track speed skating: What does it take to win?","volume":"8","author":"Zhang","year":"2008","journal-title":"Int. J. Perform. Anal. Sport"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1080\/17461391.2010.499968","article-title":"Relationship between starting and finishing position in short track speed skating races","volume":"11","author":"Muehlbauer","year":"2011","journal-title":"Eur. J. Sport Sci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"902","DOI":"10.1123\/ijspp.2014-0504","article-title":"The relationship between start performance and race outcome in elite 500-m short-track speed skating","volume":"10","author":"Haug","year":"2015","journal-title":"Int. J. Sport. Physiol. Perform."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1239","DOI":"10.1080\/02640410500497733","article-title":"Influence of starting position on finishing position in world cup 500 m short track speed skating","volume":"24","author":"Maw","year":"2006","journal-title":"J. Sport. Sci."},{"key":"ref_10","unstructured":"Liu, C. (2011). Decision-making of agent based on bp neural networks in short track speed skating simulation system. Intell. Comput. Appl., Available online: https:\/\/api.semanticscholar.org\/CorpusID:63141558."},{"key":"ref_11","unstructured":"Yang, W., Chen, Y., Li, F., and Chang, H. (2022, January 27\u201329). A tactical decision-making method for short track speed skating based on deep reinforcement learning. Proceedings of the ISCTT 2022, 7th International Conference on Information Science, Computer Technology and Transportation, Xishuangbanna, China."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Van Hasselt, H., Guez, A., and Silver, D. (2016, January 12\u201317). Deep reinforcement learning with double q-learning. Proceedings of the AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kaloev, M., and Krastev, G. (2021, January 21\u201323). Experiments focused on exploration in deep reinforcement learning. Proceedings of the 2021 5th International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT), Ankara, Turkey.","DOI":"10.1109\/ISMSIT52890.2021.9604690"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1726","DOI":"10.1631\/FITEE.1900533","article-title":"Deep reinforcement learning: A survey","volume":"21","author":"Wang","year":"2020","journal-title":"Front. Inf. Technol. Electron. Eng."},{"key":"ref_15","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press."},{"key":"ref_16","unstructured":"Li, Y. (2017). Deep reinforcement learning: An overview. arXiv."},{"key":"ref_17","unstructured":"Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., and Riedmiller, M. (2013). Playing atari with deep reinforcement learning. arXiv."},{"key":"ref_18","unstructured":"Haarnoja, T., Zhou, A., Abbeel, P., and Levine, S. (2018, January 10\u201315). Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. Proceedings of the International Conference on Machine Learning, Stockholm, Sweden."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhao, D., Wang, H., Shao, K., and Zhu, Y. (2016, January 6\u20139). Deep reinforcement learning with experience replay based on sarsa. Proceedings of the 2016 IEEE Symposium Series on Computational Intelligence (SSCI), Athens, Greece.","DOI":"10.1109\/SSCI.2016.7849837"},{"key":"ref_20","unstructured":"Chua, K., Calandra, R., McAllister, R., and Levine, S. (2018). Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_21","unstructured":"Mnih, V., Badia, A.P., Mirza, M., Graves, A., Lillicrap, T., Harley, T., Silver, D., and Kavukcuoglu, K. (2016, January 20\u201322). Asynchronous methods for deep reinforcement learning. Proceedings of the International Conference on Machine Learning, New York, NY, USA."},{"key":"ref_22","unstructured":"Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal policy optimization algorithms. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1109\/TIV.2019.2955905","article-title":"Combining planning and deep reinforcement learning in tactical decision making for autonomous driving","volume":"5","author":"Hoel","year":"2020","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"103452","DOI":"10.1016\/j.trc.2021.103452","article-title":"Decision making of autonomous vehicles in lane change scenarios: Deep reinforcement learning approaches with risk awareness","volume":"134","author":"Li","year":"2022","journal-title":"Transp. Res. Part Emerg. Technol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"21848","DOI":"10.1109\/TITS.2022.3185255","article-title":"An integrated model for autonomous speed and lane change decision-making based on deep reinforcement learning","volume":"23","author":"Peng","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Alizadeh, A., Moghadam, M., Bicer, Y., Ure, N.K., Yavas, U., and Kurtulus, C. (2019, January 27\u201330). Automated lane change decision making using deep reinforcement learning in dynamic and uncertain highway environment. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, New Zealand.","DOI":"10.1109\/ITSC.2019.8917192"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"4909","DOI":"10.1109\/TITS.2021.3054625","article-title":"Deep reinforcement learning for autonomous driving: A survey","volume":"23","author":"Kiran","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_28","unstructured":"Aytar, Y., Pfaff, T., Budden, D., Paine, T., Wang, Z., and De Freitas, N. (2018). Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"012007","DOI":"10.1088\/1742-6596\/1633\/1\/012007","article-title":"Research on robot arm control based on Unity3D machine learning","volume":"1633","author":"Lin","year":"2020","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_30","unstructured":"Sapio, F., and Ratini, R. (2022). International Conference on Human-Computer Interaction, Springer."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Shahbaz, M., and Khan, A. (2020, January 20\u201322). Autonomous navigation of swarms in 3d environments using deep reinforcement learning. Proceedings of the 2020 International Symposium on Recent Advances in Electrical Engineering & Computer Sciences (RAEE & CS), Islamabad, Pakistan.","DOI":"10.1109\/RAEECS50817.2020.9265845"},{"key":"ref_32","unstructured":"Konings, M. (2018). Pacing and Opponents: The Regulation of Exercise Intensity during Competition. [Ph.D. Thesis, University of Essex]."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/BF00992698","article-title":"Q-learning","volume":"8","author":"Watkins","year":"1992","journal-title":"Mach. Learn."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/24\/9904\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:40:53Z","timestamp":1760132453000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/24\/9904"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,18]]},"references-count":33,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["s23249904"],"URL":"https:\/\/doi.org\/10.3390\/s23249904","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,18]]}}}