{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,30]],"date-time":"2026-01-30T21:00:53Z","timestamp":1769806853749,"version":"3.49.0"},"reference-count":23,"publisher":"World Scientific Pub Co Pte Ltd","issue":"05","funder":[{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["NJ2024030"],"award-info":[{"award-number":["NJ2024030"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["NJ2024030"],"award-info":[{"award-number":["NJ2024030"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Soft. Eng. Knowl. Eng."],"published-print":{"date-parts":[[2026,4]]},"abstract":"<jats:p>This paper proposes a Hybrid Turing Machine (HTM) framework for modeling and controlling cyber-physical systems (CPS), which integrates discrete symbolic computation with continuous physical evolution. In HTM, each symbolic configuration is associated with real-valued dynamics governed by neural flow functions, and transitions are triggered by guard predicates based on system evolution. A pointer-based memory mechanism induces partial observability, which is addressed by a recurrent neural network (RNN) that encodes controller and device behavior into latent continuous states. We prove that computing the maximum total reward or synthesizing an optimal policy in HTM is incomputable, motivating an approximate control approach. To this end, we abstract HTM execution traces into a Partially Observable Markov Decision Process (POMDP) using latent discrete state clustering and RNN-based dynamic modeling. Reinforcement learning is then applied to train a policy over the latent POMDP, which is lifted back to the HTM configuration space for execution. Experimental results on a multi-UAV scheduling task show that our framework enables interpretable hybrid control and consistent decision-making under limited observability.<\/jats:p>","DOI":"10.1142\/s0218194025500871","type":"journal-article","created":{"date-parts":[[2025,10,23]],"date-time":"2025-10-23T09:44:36Z","timestamp":1761212676000},"page":"667-695","source":"Crossref","is-referenced-by-count":0,"title":["Modeling and Controlling Cyber-Physical Systems Based on Hybrid Turing Machine and Reinforcement Learning"],"prefix":"10.1142","volume":"36","author":[{"given":"Chao","family":"Xing","sequence":"first","affiliation":[{"name":"College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, P.\u00a0R.\u00a0China"},{"name":"Ministry Key Laboratory for Safety-Critical Software Development and Verification, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, P.\u00a0R.\u00a0China"},{"name":"Collaborative Innovation Center of Novel Software Technology and Industrialization, Nanjing University, Nanjing 210023, P.\u00a0R.\u00a0China"},{"name":"Key Laboratory of Data Intelligence and Advanced Computing in Provincial Universities, Soochow University, Suzhou 215006, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zining","family":"Cao","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, P.\u00a0R.\u00a0China"},{"name":"Ministry Key Laboratory for Safety-Critical Software Development and Verification, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, P.\u00a0R.\u00a0China"},{"name":"Collaborative Innovation Center of Novel Software Technology and Industrialization, Nanjing University, Nanjing 210023, P.\u00a0R.\u00a0China"},{"name":"Key Laboratory of Data Intelligence and Advanced Computing in Provincial Universities, Soochow University, Suzhou 215006, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhen","family":"Li","sequence":"additional","affiliation":[{"name":"College of Mathematics and Computer Science, Lishui University, Lishui 323000, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2025,11,24]]},"reference":[{"key":"S0218194025500871BIB001","volume-title":"Principles of Cyber-Physical Systems","author":"Alur R.","year":"2015"},{"key":"S0218194025500871BIB002","doi-asserted-by":"publisher","DOI":"10.1109\/ISORC.2008.25"},{"key":"S0218194025500871BIB003","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4419-0224-5"},{"key":"S0218194025500871BIB004","doi-asserted-by":"publisher","DOI":"10.1109\/LICS.1996.561342"},{"key":"S0218194025500871BIB005","doi-asserted-by":"publisher","DOI":"10.1109\/9.664150"},{"key":"S0218194025500871BIB006","volume-title":"Artificial Intelligence: A Modern Approach","author":"Russell S. J.","year":"2016"},{"key":"S0218194025500871BIB007","doi-asserted-by":"publisher","DOI":"10.1145\/568438.568455"},{"key":"S0218194025500871BIB008","doi-asserted-by":"publisher","DOI":"10.1145\/130385.130432"},{"key":"S0218194025500871BIB009","unstructured":"A. Graves, G. Wayne and I. Danihelka, Neural Turing machines, preprint (2014), arXiv:1410.5401."},{"key":"S0218194025500871BIB010","doi-asserted-by":"publisher","DOI":"10.1038\/nature20101"},{"key":"S0218194025500871BIB011","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(98)00023-X"},{"key":"S0218194025500871BIB012","volume-title":"Reinforcement Learning: An Introduction","author":"Barto A. G.","year":"2018"},{"key":"S0218194025500871BIB013","unstructured":"V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra and M. Riedmiller, Playing Atari with deep reinforcement learning, preprint (2013), arXiv:1312.5602."},{"key":"S0218194025500871BIB014","doi-asserted-by":"publisher","DOI":"10.1038\/nature16961"},{"key":"S0218194025500871BIB015","doi-asserted-by":"publisher","DOI":"10.1007\/BFb0058022"},{"key":"S0218194025500871BIB016","doi-asserted-by":"publisher","DOI":"10.1016\/S0925-2312(99)00174-5"},{"key":"S0218194025500871BIB017","doi-asserted-by":"publisher","DOI":"10.1090\/S0002-9947-1953-0053041-6"},{"key":"S0218194025500871BIB018","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-27645-3_12"},{"key":"S0218194025500871BIB019","first-page":"1172","volume-title":"Proc. 31st Int. Conf. Neural Information Processing Systems","author":"Venkatraman A.","year":"2017"},{"key":"S0218194025500871BIB020","doi-asserted-by":"publisher","DOI":"10.1016\/j.ensm.2022.05.007"},{"key":"S0218194025500871BIB021","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2019.01.011"},{"key":"S0218194025500871BIB022","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992698"},{"key":"S0218194025500871BIB023","first-page":"3836","volume-title":"Proc. 35th Int. Conf. Machine Learning","author":"O\u2019Donoghue B.","year":"2018"}],"container-title":["International Journal of Software Engineering and Knowledge Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218194025500871","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,30]],"date-time":"2026-01-30T09:18:51Z","timestamp":1769764731000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218194025500871"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,24]]},"references-count":23,"journal-issue":{"issue":"05","published-print":{"date-parts":[[2026,4]]}},"alternative-id":["10.1142\/S0218194025500871"],"URL":"https:\/\/doi.org\/10.1142\/s0218194025500871","relation":{},"ISSN":["0218-1940","1793-6403"],"issn-type":[{"value":"0218-1940","type":"print"},{"value":"1793-6403","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,24]]}}}