{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T01:26:22Z","timestamp":1760059582196,"version":"build-2065373602"},"reference-count":28,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T00:00:00Z","timestamp":1750636800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Plateau hypoxia represents a type of hypobaric hypoxia caused by reduced atmospheric pressure at high altitudes. Pressurization therapy is one of the most effective methods for alleviating acute high-altitude sickness. This study focuses on the development of an advanced control system for a vehicle-mounted mild hyperbaric chamber (MHBC) designed for the prevention and treatment of plateau hypoxia. Conventional control methods struggle to cope with the high complexity and inherent uncertainties associated with MHBC control tasks, thereby motivating the exploration of sequential decision-making approaches such as reinforcement learning. Nevertheless, the application of sequential decision-making in MHBC control encounters several challenges, including data inefficiency and non-stationary dynamics. The system\u2019s low tolerance for trial-and-error may lead to component damage or unsafe operating conditions, and anomalies such as valve failure can emerge during long-term operation, compromising system stability. To address these challenges, this study proposes a decision-time learning and planning integrated framework for MHBC control. Specifically, an innovative latent model embedding decision-time learning is designed for system identification, separately managing system uncertainties to fine-tune the model output. Furthermore, a decision-time planning algorithm is developed and the planning process is further guided by incorporating a value network and an enhanced online policy. Experimental results demonstrate that the proposed decision-time learning and planning integrated approaches achieve notable performance in MHBC control.<\/jats:p>","DOI":"10.3390\/a18070380","type":"journal-article","created":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T07:42:34Z","timestamp":1750664554000},"page":"380","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Decision-Time Learning and Planning Integrated Control for the Mild Hyperbaric Chamber"],"prefix":"10.3390","volume":"18","author":[{"given":"Nan","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qijing","family":"Lin","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhuangde","family":"Jiang","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ortega, M.A., Fraile-Martinez, O., Garc\u00eda-Montero, C., Callej\u00f3n-Pel\u00e1ez, E., S\u00e1ez, M.A., \u00c1lvarez-Mon, M.A., Garc\u00eda-Honduvilla, N., Monserrat, J., \u00c1lvarez-Mon, M., and Bujan, J. (2021). A general overview on the hyperbaric oxygen therapy: Applications, mechanisms and translational opportunities. Medicina, 57.","DOI":"10.3390\/medicina57090864"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1400","DOI":"10.1007\/s00134-012-2590-4","article-title":"Bench testing of a new hyperbaric chamber ventilator at different atmospheric pressures","volume":"38","author":"Lefebvre","year":"2012","journal-title":"Intensive Care Med."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"de Paco, J.M., P\u00e9rez-Vidal, C., Salinas, A., Guti\u00e9rrez, M.D., Sabater, J.M., and Fern\u00e1ndez, E. (2012, January 24\u201327). Advanced hyperbaric oxygen therapies in automated multiplace chambers. Proceedings of the 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), Rome, Italy.","DOI":"10.1109\/BioRob.2012.6290298"},{"key":"ref_4","first-page":"943","article-title":"Design of atmospheric hypoxic chamber based on fuzzy adaptive control","volume":"Volume 2","author":"Wang","year":"2013","journal-title":"Proceedings of the 2013 IEEE 11th International Conference on Electronic Measurement & Instruments"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Gracia, L., Perez-Vidal, C., de Paco, J.M., and de Paco, L.M. (2018). Identification and control of a multiplace hyperbaric chamber. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0200407"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Motorga, R.M., Muresan, V., Abrudean, M., Valean, H., Clitan, I., Chifor, L., and Unguresan, M. (2023, January 19\u201321). Advanced Control of Pressure Inside a Surgical Chamber Using AI Methods. Proceedings of the 2023 3rd International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME), Tenerife, Canary Islands, Spain.","DOI":"10.1109\/ICECCME57830.2023.10253283"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.inffus.2022.03.003","article-title":"Exploration in deep reinforcement learning: A survey","volume":"85","author":"Ladosz","year":"2022","journal-title":"Inf. Fusion"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1038\/nature24270","article-title":"Mastering the game of go without human knowledge","volume":"550","author":"Silver","year":"2017","journal-title":"Nature"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1109\/JAS.2023.123618","article-title":"A brief overview of ChatGPT: The history, status quo and potential future development","volume":"10","author":"Wu","year":"2023","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"9069","DOI":"10.1109\/TITS.2024.3367769","article-title":"Minimum distance and minimum time optimal path planning with bioinspired machine learning algorithms for faulty unmanned air vehicles","volume":"25","author":"Tutsoy","year":"2024","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Afifa, R., Ali, S., Pervaiz, M., and Iqbal, J. (2023). Adaptive backstepping integral sliding mode control of a mimo separately excited DC motor. Robotics, 12.","DOI":"10.3390\/robotics12040105"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Baillieul, J., and Samad, T. (2021). Encyclopedia of Systems and Control, Springer.","DOI":"10.1007\/978-3-030-44184-5"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"818","DOI":"10.1007\/s40435-020-00665-4","article-title":"A review of PID control, tuning methods and applications","volume":"9","author":"Borase","year":"2021","journal-title":"Int. J. Dyn. Control"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"121101","DOI":"10.1007\/s11432-022-3696-5","article-title":"A survey on model-based reinforcement learning","volume":"67","author":"Luo","year":"2024","journal-title":"Sci. China Inf. Sci."},{"key":"ref_15","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction. A Bradford Book, The MIT Press."},{"key":"ref_16","unstructured":"Janner, M., Fu, J., Zhang, M., and Levine, S. (2019). When to trust your model: Model-based policy optimization. Advances in Neural Information Processing Systems, Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, BC, Canada, 8\u201314 December 2019, Curran Associates Inc."},{"key":"ref_17","unstructured":"Levine, S., and Abbeel, P. (2014). Learning neural network policies with guided policy search under unknown dynamics. Advances in Neural Information Processing Systems, Proceedings of the 28th International Conference on Neural Information Processing Systems, Montr\u00e9al, QC, Canada, 8\u201313 December 2014, MIT Press."},{"key":"ref_18","unstructured":"Deisenroth, M., and Rasmussen, C.E. (July, January 28). PILCO: A model-based and data-efficient approach to policy search. Proceedings of the 28th International Conference on Machine Learning (ICML-11), Bellevue, WA, USA."},{"key":"ref_19","unstructured":"Kahneman, D. (2013). A perspective on judgment and choice: Mapping bounded rationality. Progress in Psychological Science Around the World. Volume 1 Neural, Cognitive and Developmental Issues, Psychology Press."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Altman, E. (2021). Constrained Markov Decision Processes, Routledge.","DOI":"10.1201\/9781315140223"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1146\/annurev-control-042920-092451","article-title":"Partially observable markov decision processes and robotics","volume":"5","author":"Kurniawati","year":"2022","journal-title":"Annu. Rev. Control Robot. Auton. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"105049","DOI":"10.1016\/j.sysconle.2021.105049","article-title":"On the stability properties of gated recurrent units neural networks","volume":"157","author":"Bonassi","year":"2021","journal-title":"Syst. Control Lett."},{"key":"ref_23","unstructured":"Chua, K., Calandra, R., McAllister, R., and Levine, S. (2018). Deep reinforcement learning in a handful of trials using probabilistic dynamics models. Advances in Neural Information Processing Systems, Proceedings of the 32nd International Conference on Neural Information Processing Systems, Montr\u00e9al, QC, Canada, 3\u20138 December 2018, Curran Associates Inc."},{"key":"ref_24","unstructured":"Izmailov, P., Vikram, S., Hoffman, M.D., and Wilson, A.G.G. (2021, January 18\u201324). What are Bayesian neural network posteriors really like?. Proceedings of the International Conference on Machine Learning, PMLR, Virtual."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1146\/annurev-control-090419-075625","article-title":"Learning-based model predictive control: Toward safe learning in control","volume":"3","author":"Hewing","year":"2020","journal-title":"Annu. Rev. Control. Robot. Auton. Syst."},{"key":"ref_26","first-page":"36495","article-title":"A simple decentralized cross-entropy method","volume":"Volume 35","author":"Zhang","year":"2022","journal-title":"Advances in Neural Information Processing Systems, Proceedings of the 36th International Conference on Neural Information Processing Systems, New Orleans, LA, USA, 28 November\u20139 December 2022"},{"key":"ref_27","unstructured":"Hansen, N., Wang, X., and Su, H. (2022). Temporal difference learning for model predictive control. arXiv."},{"key":"ref_28","first-page":"29304","article-title":"Deep reinforcement learning at the edge of the statistical precipice","volume":"Volume 34","author":"Agarwal","year":"2021","journal-title":"Advances in Neural Information Processing Systems, Proceedings of the 35th International Conference on Neural Information Processing Systems, Online, 6\u201314 December 2021"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/7\/380\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:56:57Z","timestamp":1760032617000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/7\/380"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,23]]},"references-count":28,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2025,7]]}},"alternative-id":["a18070380"],"URL":"https:\/\/doi.org\/10.3390\/a18070380","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2025,6,23]]}}}