{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:28:54Z","timestamp":1760243334079,"version":"build-2065373602"},"reference-count":14,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2014,9,17]],"date-time":"2014-09-17T00:00:00Z","timestamp":1410912000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>In this paper, we continue our efforts to show how maximum relative entropy (MrE) can be used as a universal updating algorithm. Here, our purpose is to tackle a joint state and parameter estimation problem where our system is nonlinear and in a non-equilibrium state, i.e., perturbed by varying external forces. Traditional parameter estimation can be performed by using filters, such as the extended Kalman filter (EKF). However, as shown with a toy example of a system with first order non-homogeneous ordinary differential equations, assumptions made by the EKF algorithm (such as the Markov assumption) may not be valid. The problem can be solved with exponential smoothing, e.g., exponentially weighted moving average (EWMA). Although this has been shown to produce acceptable filtering results in real exponential systems, it still cannot simultaneously estimate both the state and its parameters and has its own assumptions that are not always valid, for example when jump discontinuities exist. We show that by applying MrE as a filter, we can not only develop the closed form solutions, but we can also infer the parameters of the differential equation simultaneously with the means. This is useful in real, physical systems, where we want to not only filter the noise from our measurements, but we also want to simultaneously infer the parameters of the dynamics of a nonlinear and non-equilibrium system. Although there were many assumptions made throughout the paper to illustrate that EKF and exponential smoothing are special cases ofMrE, we are not \u201cconstrained\u201d, by these assumptions. In other words, MrE is completely general and can be used in broader ways.<\/jats:p>","DOI":"10.3390\/e16094974","type":"journal-article","created":{"date-parts":[[2014,9,17]],"date-time":"2014-09-17T10:53:17Z","timestamp":1410951197000},"page":"4974-4991","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Simultaneous State and Parameter Estimation Using Maximum Relative Entropy with Nonhomogenous Differential Equation Constraints"],"prefix":"10.3390","volume":"16","author":[{"given":"Adom","family":"Giffin","sequence":"first","affiliation":[{"name":"Department of Mathematics, Clarkson University, Potsdam, NY 13699, USA"}]},{"given":"Renaldas","family":"Urniezius","sequence":"additional","affiliation":[{"name":"Department of Automation, Kaunas University of Technology, Kaunas Lt-51367, Lithuania"}]}],"member":"1968","published-online":{"date-parts":[[2014,9,17]]},"reference":[{"key":"ref_1","unstructured":"Knuth, K.H., Caticha, A., Center, J.L., Giffin, A., and Rodr\u00edguez, C.C. (2007, January 8\u201313). Updating Probabilities with Data and Moments. Saratoga Springs, NY, USA."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1047","DOI":"10.3390\/e16021047","article-title":"The Kalman Filter Revisited Using Maximum Relative Entropy","volume":"16","author":"Giffin","year":"2014","journal-title":"Entropy"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A new approach to linear filtering and prediction problems","volume":"82","author":"Kalman","year":"1960","journal-title":"J. Basic. Eng"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1977.tb01600.x","article-title":"Maximum likelihood from incomplete data via the EM algorithm","volume":"39","author":"Dempster","year":"1977","journal-title":"J R. Stat. Soc. Ser. B (Methodol.)"},{"key":"ref_5","unstructured":"Christopher, B.M. (2006). Pattern Recognition and Machine Learning, Springer."},{"key":"ref_6","unstructured":"Jazwinski, A.H. (1970). Stochastic Processes and Filtering Theory, Academic Press."},{"key":"ref_7","unstructured":"Crisan, D., and Rozovskii, B.L. (2011). The Oxford Handbook of Nonlinear Filtering, Oxford University Press."},{"key":"ref_8","unstructured":"Brown, R.G. (1956, January 16). Exponential smoothing for predicting demand. San Fransisco, FA, USA."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Reddy, T.A. (2011). Applied Data Analysis and Modeling for Energy Engineers and Scientists, Springer.","DOI":"10.1007\/978-1-4419-9613-8"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"531","DOI":"10.3402\/tellusa.v42i5.11896","article-title":"Variational assimilation of meterological observations with the direct and adjoint shallow-water equations","volume":"42A","author":"Courtier","year":"1990","journal-title":"Tellus"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"97","DOI":"10.3402\/tellusa.v38i2.11706","article-title":"Variational algorithms for analysis and assimilation of meteorological observations. Theoretical aspects","volume":"38A","author":"LeDimet","year":"1986","journal-title":"Tellus"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1610","DOI":"10.1016\/j.physa.2008.12.066","article-title":"From physics to economics: An econometric example using maximum relative entropy","volume":"388","author":"Giffin","year":"2009","journal-title":"Physica A"},{"key":"ref_13","unstructured":"Goggans, P.M., and Chan, C.Y. (2009). Bayesian Inference and Maximum Entropy Methods in Science and Engineering, AIP Publishing."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Crassidis, J.L., and Junkins, J.L. (2004). Optimal Estimation of Dynamical Systems, Chapman & Hall\/CRC.","DOI":"10.1201\/9780203509128"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/16\/9\/4974\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:16:02Z","timestamp":1760217362000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/16\/9\/4974"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,9,17]]},"references-count":14,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2014,9]]}},"alternative-id":["e16094974"],"URL":"https:\/\/doi.org\/10.3390\/e16094974","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2014,9,17]]}}}