{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:35:55Z","timestamp":1760146555429,"version":"build-2065373602"},"reference-count":42,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2024,11,18]],"date-time":"2024-11-18T00:00:00Z","timestamp":1731888000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["62203358","62233014"],"award-info":[{"award-number":["62203358","62233014"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Asa result of the time lag in transmission, the data obtained by the sensor is delayed and does not reflect the state at the current moment. The effects of input delay are often overlooked in active inference (AIF), which may lead to significant deviations in state estimation and increased prediction errors, particularly when the system is subjected to a sudden external stimulus. In this paper, a theoretical framework of delayed feedback active inference (DAIF) is proposed to enhance the applicability of AIF to real systems. The probability model of DAIF is defined by incorporating a control distribution into that of AIF. The free energy of DAIF is defined as the sum of the quadratic state, sense, and control prediction error. A predicted state derived from previous states is defined and introduced as the expectation of the prior distribution of the real-time state. A proportional-integral (PI)-like control based on the predicted state is taken to be the expectation of DAIF preference control, whose gain coefficient is inversely proportional to the measurement accuracy variance. To adaptively compensate for external disturbances, a second-order inverse variance accuracy replaces the fixed sensory accuracy of preference control. The simulation results of the trajectory tracking control of a quadrotor unmanned aerial vehicle (UAV) show that DAIF performs better than AIF in state estimation and disturbance resistance.<\/jats:p>","DOI":"10.3390\/e26110990","type":"journal-article","created":{"date-parts":[[2024,11,20]],"date-time":"2024-11-20T09:14:38Z","timestamp":1732094078000},"page":"990","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Integration of Sense and Control for Uncertain Systems Based on Delayed Feedback Active Inference"],"prefix":"10.3390","volume":"26","author":[{"given":"Mingyue","family":"Ji","sequence":"first","affiliation":[{"name":"School of Automation, Northwestern Polytechnical University, Xi\u2019an 710129, China"}]},{"given":"Kunpeng","family":"Pan","sequence":"additional","affiliation":[{"name":"School of Automation, Northwestern Polytechnical University, Xi\u2019an 710129, China"}]},{"given":"Xiaoxuan","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Automation, Northwestern Polytechnical University, Xi\u2019an 710129, China"}]},{"given":"Quan","family":"Pan","sequence":"additional","affiliation":[{"name":"School of Automation, Northwestern Polytechnical University, Xi\u2019an 710129, China"}]},{"given":"Xiangcheng","family":"Dai","sequence":"additional","affiliation":[{"name":"School of Automation, Nanjing University of Information Science and Technology, Nanjing 210044, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0702-908X","authenticated-orcid":false,"given":"Yang","family":"Lyu","sequence":"additional","affiliation":[{"name":"School of Automation, Northwestern Polytechnical University, Xi\u2019an 710129, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,11,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1016\/j.neunet.2021.09.011","article-title":"World model learning and inference","volume":"144","author":"Friston","year":"2021","journal-title":"Neural Netw."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1038\/nrn2787","article-title":"The free-energy principle: A unified brain theory?","volume":"11","author":"Friston","year":"2010","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1162\/NECO_a_00912","article-title":"Active inference: A process theory","volume":"29","author":"Friston","year":"2017","journal-title":"Neural Comput."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Safron, A. (2020). Integrated world modeling theory (iwmt) implemented: Towards reverse engineering consciousness with the free energy principle and active inference. Active Inference: First International Workshop, IWAI 2020, Co-Located with ECML\/PKDD 2020, Ghent, Belgium, 14 September 2020, Proceedings 1, Springer.","DOI":"10.31234\/osf.io\/paz5j"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1023\/A:1007665907178","article-title":"An introduction to variational methods for graphical models","volume":"37","author":"Jordan","year":"1999","journal-title":"Mach. Learn."},{"key":"ref_7","first-page":"70","article-title":"2-d distributed pose estimation of multi-agent systems using bearing measurements","volume":"2","author":"Fang","year":"2023","journal-title":"J. Autom. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1016\/j.neuroimage.2008.03.017","article-title":"Variational filtering","volume":"41","author":"Friston","year":"2008","journal-title":"NeuroImage"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Parr, T., Pezzulo, G., and Friston, K.J. (2022). Active Inference: The Free Energy Principle in Mind, Brain, and Behavior, MIT Press.","DOI":"10.7551\/mitpress\/12441.001.0001"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2655","DOI":"10.1162\/089976600300014881","article-title":"Gaussian processes for classification: Mean-field algorithms","volume":"12","author":"Opper","year":"2000","journal-title":"Neural Comput."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Mathys, C., Daunizeau, J., Friston, K.J., and Stephan, K.E. (2011). A bayesian foundation for individual learning under uncertainty. Front. Hum. Neurosci., 5.","DOI":"10.3389\/fnhum.2011.00039"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1061\/(ASCE)0733-9399(1998)124:4(455)","article-title":"Updating models and their uncertainties. i: Bayesian statistical framework","volume":"124","author":"Beck","year":"1998","journal-title":"J. Eng. Mech."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.jmp.2017.09.004","article-title":"The free energy principle for action and perception: A mathematical review","volume":"81","author":"Buckley","year":"2017","journal-title":"J. Math. Psychol."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Pezzato, C., Baioumy, M., Corbato, C.H., Hawes, N., Wisse, M., and Ferrari, R. (2020). Active inference for fault tolerant control of robot manipulators with sensory faults. Active Inference: First International Workshop, IWAI 2020, Co-Located with ECML\/PKDD 2020, Ghent, Belgium, 14 September 2020, Proceedings 1, Springer.","DOI":"10.1007\/978-3-030-64919-7_3"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Baltieri, M., and Buckley, C.L. (2019, January 14\u201319). Nonmodular architectures of cognitive systems based on active inference. Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.","DOI":"10.1109\/IJCNN.2019.8852048"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Baltieri, M., and Buckley, C.L. (2019). Pid control as a process of active inference with linear generative models. Entropy, 21.","DOI":"10.20944\/preprints201902.0246.v1"},{"key":"ref_17","unstructured":"\u00c5str\u00f6m, K.J., H\u00e4gglund, T., and Astrom, K.J. (2006). Advanced PID Control, ISA\u2014The Instrumentation, Systems, and Automation Society Research Triangle Park."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1016\/S0005-1098(98)00011-9","article-title":"Design of pi controllers based on non-convex optimization","volume":"34","author":"Panagopoulos","year":"1998","journal-title":"Automatica"},{"key":"ref_19","unstructured":"Lanillos, P., and Cheng, G. (2018, January 5). Active inference with function learning for robot body perception. Proceedings of the International Workshop on Continual Unsupervised Sensorimotor Learning, IEEE Developmental Learning and Epigenetic Robotics (ICDL-Epirob), Tokyo, Japan."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1007\/s12555-010-0105-z","article-title":"Autopilots for small unmanned aerial vehicles: A survey","volume":"8","author":"Chao","year":"2010","journal-title":"Int. J. Control. Autom. Syst."},{"key":"ref_21","first-page":"517","article-title":"Enabling operational autonomy for unmanned aerial vehicles with scalability","volume":"10","author":"Jung","year":"2013","journal-title":"J. Aerosp. Inf. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1080\/20464177.2017.1383337","article-title":"Analysis of propulsion systems of unmanned aerial vehicles","volume":"16","author":"Adamski","year":"2017","journal-title":"J. Mar. Eng. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Meera, A.A., and Wisse, M. (2020, January 1\u20133). Free energy principle based state and input observer design for linear systems with colored noise. Proceedings of the 2020 American Control Conference (ACC), Denver, CO, USA.","DOI":"10.23919\/ACC45564.2020.9147581"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1016\/j.neuroimage.2008.02.054","article-title":"Dem: A variational treatment of dynamic systems","volume":"41","author":"Friston","year":"2008","journal-title":"Neuroimage"},{"key":"ref_25","unstructured":"Bas, F., Meera, A.A., Benders, D., and Wisse, M. (2022, January 23\u201327). Free energy principle for state and input estimation of a quadcopter flying in wind. Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Meo, C., and Lanillos, P. (October, January 27). Multimodal vae active inference controller. Proceedings of the 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.","DOI":"10.1109\/IROS51168.2021.9636394"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2973","DOI":"10.1109\/LRA.2020.2974451","article-title":"A novel adaptive controller for robot manipulators based on active inference","volume":"5","author":"Pezzato","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_28","unstructured":"Pitti, A., Quoy, M., Lavandier, C., and Boucenna, S. (2020, January 31). Complementary working memories using free-energy optimization for learning features and structure in sequences. Proceedings of the Workshop Brain PIL New Advances in Brain-Inspired Perception, Interaction and Learning, ICRA2020, Paris, France."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.neunet.2021.05.010","article-title":"Robot navigation as hierarchical active inference","volume":"142","author":"Verbelen","year":"2021","journal-title":"Neural Netw."},{"key":"ref_30","first-page":"13870","article-title":"Contrastive active inference","volume":"34","author":"Mazzaglia","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Baioumy, M., Pezzato, C., Ferrari, R., Corbato, C.H., and Hawes, N. (July, January 29). Fault-tolerant control of robot manipulators with sensory faults using unbiased active inference. Proceedings of the 2021 European Control Conference (ECC), Rotterdam, The Netherlands.","DOI":"10.23919\/ECC54610.2021.9654913"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/TCDS.2022.3156664","article-title":"Adaptation through prediction: Multisensory active inference torque control","volume":"15","author":"Meo","year":"2022","journal-title":"IEEE Trans. Cogn. Dev. Syst."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Baioumy, M., Duckworth, P., Lacerda, B., and Hawes, N. (June, January 30). Active inference for integrated state-estimation, control, and learning. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9562009"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1038\/nprot.2014.025","article-title":"A framework for parameter estimation and model selection from experimental data in systems biology using approximate bayesian computation","volume":"9","author":"Liepe","year":"2014","journal-title":"Nat. Protoc."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2065","DOI":"10.1007\/s11071-016-2811-4","article-title":"Robust motion control of a two-wheeled inverted pendulum with an input delay based on optimal integral sliding mode manifold","volume":"85","author":"Zhou","year":"2016","journal-title":"Nonlinear Dyn."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"634","DOI":"10.1007\/s10957-019-01472-4","article-title":"Turning motion control design of a two-wheeled inverted pendulum using curvature tracking and optimal control theory","volume":"181","author":"Zhou","year":"2019","journal-title":"J. Optim. Theory Appl."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"722","DOI":"10.1016\/j.jtbi.2006.04.002","article-title":"Modeling the glucose\u2013insulin regulatory system and ultradian insulin secretory oscillations with two explicit time delays","volume":"242","author":"Li","year":"2006","journal-title":"J. Theor. Biol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1007\/s00422-012-0512-8","article-title":"Active inference and agency: Optimal control without cost functions","volume":"106","author":"Friston","year":"2012","journal-title":"Biol. Cybern."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1007\/s00422-010-0364-z","article-title":"Action and behavior: A free-energy formulation","volume":"102","author":"Friston","year":"2010","journal-title":"Biol. Cybern."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1109\/TCDS.2021.3049907","article-title":"An empirical study of active inference on a humanoid robot","volume":"14","author":"Oliver","year":"2021","journal-title":"IEEE Trans. Cogn. Dev. Syst."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1539","DOI":"10.1016\/S0045-7949(03)00146-9","article-title":"An optimal control method for linear systems with time delay","volume":"81","author":"Cai","year":"2003","journal-title":"Comput. Struct."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1016\/j.isatra.2014.01.004","article-title":"Position and attitude tracking control for a quadrotor uav","volume":"53","author":"Xiong","year":"2014","journal-title":"ISA Trans."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/26\/11\/990\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:34:16Z","timestamp":1760114056000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/26\/11\/990"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,18]]},"references-count":42,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2024,11]]}},"alternative-id":["e26110990"],"URL":"https:\/\/doi.org\/10.3390\/e26110990","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2024,11,18]]}}}