{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:15:51Z","timestamp":1760242551969,"version":"build-2065373602"},"reference-count":29,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2017,11,18]],"date-time":"2017-11-18T00:00:00Z","timestamp":1510963200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Information Theory is a branch of mathematics, more specifically probability theory, that studies information quantification. Recently, several researches have been successful with the use of Information Theoretic Learning (ITL) as a new technique of unsupervised learning. In these works, information measures are used as criterion of optimality in learning. In this article, we will analyze a still unexplored aspect of these information measures, their dynamic behavior. Autoregressive models (linear and non-linear) will be used to represent the dynamics in information measures. As a source of dynamic information, videos with different characteristics like fading, monotonous sequences, etc., will be used.<\/jats:p>","DOI":"10.3390\/e19110612","type":"journal-article","created":{"date-parts":[[2017,11,20]],"date-time":"2017-11-20T11:35:45Z","timestamp":1511177745000},"page":"612","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["An Analysis of Information Dynamic Behavior Using Autoregressive Models"],"prefix":"10.3390","volume":"19","author":[{"given":"Amanda","family":"Oliveira","sequence":"first","affiliation":[{"name":"Center of Exact and Natural Sciences, Federal Rural University of the Semi-Arid Region, Mossoro 59625-900, RN, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adri\u00e3o","family":"D\u00f3ria Neto","sequence":"additional","affiliation":[{"name":"Department of Automation and Computer Engineering, Federal University of Rio Grande do Norte, Natal 59078-970, RN, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Allan","family":"Martins","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Federal University of Rio Grande do Norte, Natal 59078-970, RN, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,11,18]]},"reference":[{"key":"ref_1","unstructured":"Liu, W., Pokharel, P., and Principe, J. (2006, January 16\u201321). Correntropy: A Localized Similarity Measure. Proceedings of the IEEE International Joint Conference on Neural Networks, Vancouver, BC, Canada."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Santamaria, I., Pokharel, P., and Principe, J. (2006). Generalized Correlation Function: Definition, Properties, and Application to Blind Equalization. IEEE Trans. Signal Process., 54.","DOI":"10.1109\/TSP.2006.872524"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1888","DOI":"10.1109\/TPWRS.2009.2030117","article-title":"State Estimation Based On Correntropy: A Proof of Concept","volume":"24","author":"Miranda","year":"2009","journal-title":"IEEE Trans. Power Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1385","DOI":"10.1109\/TPAMI.2006.186","article-title":"Feature Extraction Using Information-Theoretic Learning","volume":"28","author":"Hild","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4190","DOI":"10.1016\/j.eswa.2013.01.027","article-title":"Information-Theoretic Clustering: A Representative and Evolutionary Approach","volume":"40","author":"Martins","year":"2013","journal-title":"Expert Syst. Appl."},{"key":"ref_6","unstructured":"Shimoji, S., and Lee, S. (July, January 28). Data Clustering with Entropical Scheduling. Proceedings of the 1994 IEEE International Conference on IEEE World Congress on Computational Intelligence, Orlando, FL, USA."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1016\/j.patrec.2008.09.011","article-title":"Mean Shift: An Information Theoretic Perspective","volume":"30","author":"Rao","year":"2009","journal-title":"Pattern Recognit. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1109\/34.982897","article-title":"Information Theoretic Clustering","volume":"24","author":"Gokcay","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1023\/A:1008143417156","article-title":"Learning from Examples with Information Theoretic Criteria","volume":"26","author":"Principe","year":"2000","journal-title":"J. VLSI Signal Process."},{"key":"ref_10","unstructured":"Steeg, G.V., Galstyan, A., Sha, F., and Simon, D. (2014, January 21\u201326). Demystifying Information-Theoretic Clustering. Proceedings of the 31st International Conference on International Conference on Machine Learning, Beijing, China."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wu, Z., Peng, S., Chen, B., Zhao, H., and Principe, J. (2015). Proportionate Minimum Error Entropy Algorithm for Sparse System Identification. Entropy, 17.","DOI":"10.3390\/e17095995"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Erdogmus, D., and Principe, J. (2002). An Error-Entropy Minimization Algorithm for supervised training of Nonlinear Adaptive Systems. IEEE Trans. Signal Process., 50.","DOI":"10.1109\/TSP.2002.1011217"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2510","DOI":"10.3390\/e15072510","article-title":"Improved Minimum Entropy Filtering for Continuous Nonlinear Non-Gaussian Systems using a Generalized Density Evolution Equation","volume":"15","author":"Ren","year":"2013","journal-title":"Entropy"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Liu, W., Pokharel, P., and Principe, J. (2007). Correntropy: Properties and Applications in Non-Gaussian Signal Processing. IEEE Trans. Signal Process., 55.","DOI":"10.1109\/TSP.2007.896065"},{"key":"ref_15","unstructured":"Chen, B., Xing, L., Liang, J., Zheng, N., and Principe, J. (2014). Steady-state mean-square error analysis for adaptive filtering under the maximum correntropy criterion. IEEE Signal Process. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Izanloo, R., Fakoorian, S., Yazdi, H., and Simon, D. (2016, January 15\u201318). Kalman Filtering Based on the Maximum Correntropy Criterion in the Presence of Non-Gaussian Noise. Proceedings of the Annual Conference on Information Science and Systems (CISS), Princeton, NJ, USA.","DOI":"10.1109\/CISS.2016.7460553"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Vaidya, U., and Sinha, S. (2016, January 6\u20138). Information Based Measure for Influence Characterization in Dynamical Systems with Applications. Proceedings of the American Control Conference (ACC), Boston, MA, USA.","DOI":"10.1109\/ACC.2016.7526800"},{"key":"ref_18","unstructured":"Chen, B., Xing, L., Xu, B., Zhao, H., and Principe, J. (2016). Insights Into the Robustness of Minimum Error Entropy Estimation. IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"5549","DOI":"10.3390\/e17085549","article-title":"Convergence of a Fixed-Point Minimum Error Entropy Algorithm","volume":"17","author":"Zhang","year":"2015","journal-title":"Entropy"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Principe, J.C. (2010). Information Theoretic Learning: Renyi\u2019s Entropy and Kernel Perspectives, Springer.","DOI":"10.1007\/978-1-4419-1570-2"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Chen, B., Wang, J., Zhao, H., and Principe, J. (2016). Insights into Entropy as a Measure of Multivariate Variability. Entropy, 18.","DOI":"10.3390\/e18050196"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1007\/s40313-014-0155-1","article-title":"A New Clustering Separation Measure Based on Negentropy","volume":"26","author":"Martins","year":"2015","journal-title":"J. Control Autom. Electr. Syst."},{"key":"ref_23","unstructured":"R\u00e9nyi, A. (1960). On Measures of Entropy and Information. Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, University of California Press."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1065","DOI":"10.1214\/aoms\/1177704472","article-title":"On Estimation of a Probability Density Function and Mode","volume":"33","author":"Parzen","year":"1962","journal-title":"Ann. Math. Stat."},{"key":"ref_25","unstructured":"Haykin, S. (2013). Adaptative Filter Theory, Pearson."},{"key":"ref_26","unstructured":"Campos, M., R\u00eago, L., and Mendon\u00e7a, A. (2016). M\u00e9todos Probabil\u00edsticos e Estat\u00edsticos com Aplica\u00e7\u00f5es em Engenharias e Ci\u00eancias, Grupo Gen-LTC."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Fleifel, R., Soliman, S., Hamouda, W., and Badawi, A. (2017, January 19\u201322). LTE Primary User Modeling Using a Hybrid ARIMA\/NARX Neural Network Model in CR. Proceedings of the IEEE Wireless Communications and Networking Conference (WCNC), San Francisco, CA, USA.","DOI":"10.1109\/WCNC.2017.7925756"},{"key":"ref_28","unstructured":"Box, G., Jenkins, G.M., and Reinsel, G.C. (1994). Time Series Analysis: Forecasting and Control, Prentice Hall."},{"key":"ref_29","unstructured":"(2017, April 15). El Espantap\u00e1jaros. Available online: https:\/\/www.youtube.com\/watch?v=sGI7mm9fKrM."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/19\/11\/612\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:50:12Z","timestamp":1760208612000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/19\/11\/612"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,11,18]]},"references-count":29,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2017,11]]}},"alternative-id":["e19110612"],"URL":"https:\/\/doi.org\/10.3390\/e19110612","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2017,11,18]]}}}