{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T02:49:45Z","timestamp":1767840585332,"version":"3.49.0"},"reference-count":22,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2014,2,19]],"date-time":"2014-02-19T00:00:00Z","timestamp":1392768000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>In 1960, Rudolf E. Kalman created what is known as the Kalman filter, which is a way to estimate unknown variables from noisy measurements. The algorithm follows the logic that if the previous state of the system is known, it could be used as the best guess for the current state. This information is first applied a priori to any measurement by using it in the underlying dynamics of the system. Second, measurements of the unknown variables are taken. These two pieces of information are taken into account to determine the current state of the system. Bayesian inference is specifically designed to accommodate the problem of updating what we think of the world based on partial or uncertain information. In this paper, we present a derivation of the general Bayesian filter, then adapt it for Markov systems. A simple example is shown for pedagogical purposes. We also show that by using the Kalman assumptions or \u201cconstraints\u201d, we can arrive at the Kalman filter using the method of maximum (relative) entropy (MrE), which goes beyond Bayesian methods. Finally, we derive a generalized, nonlinear filter using MrE, where the original Kalman Filter is a special case. We further show that the variable relationship can be any function, and thus, approximations, such as the extended Kalman filter, the unscented Kalman filter and other Kalman variants are special cases as well.<\/jats:p>","DOI":"10.3390\/e16021047","type":"journal-article","created":{"date-parts":[[2014,2,19]],"date-time":"2014-02-19T11:10:21Z","timestamp":1392808221000},"page":"1047-1069","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["The Kalman Filter Revisited Using Maximum Relative Entropy"],"prefix":"10.3390","volume":"16","author":[{"given":"Adom","family":"Giffin","sequence":"first","affiliation":[{"name":"Department of Mathematics, Clarkson University, Potsdam, New York, USA"}]},{"given":"Renaldas","family":"Urniezius","sequence":"additional","affiliation":[{"name":"Department of Control Technologies, Kaunas University of Technology, Lt-51367 Kaunas, Lithuania"}]}],"member":"1968","published-online":{"date-parts":[[2014,2,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A new approach to linear filtering and prediction problems","volume":"82","author":"Kalman","year":"1960","journal-title":"J. Basic. Eng"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1080\/00031305.1983.10482723","article-title":"Understanding the Kalman Filter","volume":"37","author":"Meinhold","year":"1983","journal-title":"Am. Statis"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Gibbs, B.P. (2011). Advanced Kalman Filtering, Least-Squares and Modeling: A Practical Handbook, Wiley.","DOI":"10.1002\/9780470890042"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Rosenkrantz, R.D. (1983). E. T. Jaynes: Papers on Probability, Statistics and Statistical Physics, Dordrecht.","DOI":"10.1007\/978-94-009-6581-2"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Jaynes, E.T. (2003). Probability Theory: The Logic of Science, Cambridge University Press.","DOI":"10.1017\/CBO9780511790423"},{"key":"ref_6","unstructured":"Knuth, K., Caticha, A., Center, J. L., Giffin, A., and Rodr\u00edguez, C.C. Updating Probabilities with Data and Moments."},{"key":"ref_7","unstructured":"Mohammad-Djafari, A. Updating Probabilities."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1119\/1.1990764","article-title":"Probability, frequency, and reasonable expectation","volume":"14","author":"Cox","year":"1946","journal-title":"Am. J. Phys"},{"key":"ref_9","unstructured":"Thrun, S., Burgard, W., and Fox, D. (2006). Probabilistic Robotics, MIT Press."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/02331880309257","article-title":"Bayesian filtering: From Kalman filters to particle filters, and beyond","volume":"182","author":"Chen","year":"2003","journal-title":"Statistics"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1610","DOI":"10.1016\/j.physa.2008.12.066","article-title":"From physics to economics: An econometric example using maximum relative entropy","volume":"388","author":"Giffin","year":"2009","journal-title":"Physica A"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1813","DOI":"10.1137\/S0363012901393894","article-title":"A Variational Approach to Nonlinear Estimation","volume":"42","author":"Mitter","year":"2004","journal-title":"SIAM J. Contr"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1007\/s10955-004-8781-9","article-title":"Information and Entropy Flow in the Kalman-Bucy Filter","volume":"118","author":"Mitter","year":"2005","journal-title":"J. Stat. Phys"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1071","DOI":"10.1007\/s10955-006-9124-9","article-title":"A maximum entropy method for particle filtering","volume":"123","author":"Eyink","year":"2006","journal-title":"J. Stat. Phys"},{"key":"ref_15","unstructured":"Joseph, P.D. Kalman Filter Lessons. Available online: http:\/\/home.earthlink.net\/~pdjoseph\/id11.html."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Crassidis, J.L., and Junkins, J.L. (2004). Optimal Estimation of Dynamical Systems, Chapman & Hall\/CRC.","DOI":"10.1201\/9780203509128"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Poularikas, A. D. (1998). The Handbook of Formulas and Tables for Signal Processing, CRC Press.","DOI":"10.1201\/9781420049701"},{"key":"ref_18","unstructured":"Jazwinski, A. H. (1970). Stochastic Processes and Filtering Theory, Academic Press."},{"key":"ref_19","unstructured":"Crisan, D., and Rozovskii, B. L. (2011). The Oxford Handbook of Nonlinear Filtering, Oxford University Press."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Katok, A., and Hasselblatt, B. (1996). Introduction to the Modern Theory of Dynamical Systems, Cambridge University Press.","DOI":"10.1017\/CBO9780511809187"},{"key":"ref_21","unstructured":"Beck, C., and Sch\u00f6gl, F. (1995). Thermodynamics of Chaotic Systems: An Introduction, Cambridge University Press."},{"key":"ref_22","unstructured":"Mohammad-Djafari, A. Online robot dead reckoning localization using maximum relative entropy optimization with model constraints."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/16\/2\/1047\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:08:19Z","timestamp":1760216899000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/16\/2\/1047"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,2,19]]},"references-count":22,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2014,2]]}},"alternative-id":["e16021047"],"URL":"https:\/\/doi.org\/10.3390\/e16021047","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,2,19]]}}}