{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:25:25Z","timestamp":1760243125389,"version":"build-2065373602"},"reference-count":50,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2015,10,23]],"date-time":"2015-10-23T00:00:00Z","timestamp":1445558400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["1527"],"award-info":[{"award-number":["1527"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Seventh Framework Programme","award":["318723","291734"],"award-info":[{"award-number":["318723","291734"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Quantifying behaviors of robots which were generated autonomously from task-independent objective functions is an important prerequisite for objective comparisons of algorithms and movements of animals. The temporal sequence of such a behavior can be considered as a time series and hence complexity measures developed for time series are natural candidates for its quantification. The predictive information and the excess entropy are such complexity measures. They measure the amount of information the past contains about the future and thus quantify the nonrandom structure in the temporal sequence. However, when using these measures for systems with continuous states one has to deal with the fact that their values will depend on the resolution with which the systems states are observed. For deterministic systems both measures will diverge with increasing resolution. We therefore propose a new decomposition of the excess entropy in resolution dependent and resolution independent parts and discuss how they depend on the dimensionality of the dynamics, correlations and the noise level. For the practical estimation we propose to use estimates based on the correlation integral instead of the direct estimation of the mutual information based on next neighbor statistics because the latter allows less control of the scale dependencies. Using our algorithm we are able to show how autonomous learning generates behavior of increasing complexity with increasing learning duration.<\/jats:p>","DOI":"10.3390\/e17107266","type":"journal-article","created":{"date-parts":[[2015,10,24]],"date-time":"2015-10-24T08:27:06Z","timestamp":1445675226000},"page":"7266-7297","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Quantifying Emergent Behavior of Autonomous Robots"],"prefix":"10.3390","volume":"17","author":[{"given":"Georg","family":"Martius","sequence":"first","affiliation":[{"name":"IST Austria, Am Campus 1, 3400 Klosterneuburg, Austria"},{"name":"Max Planck Institute for Mathematics in the Sciences, Inselstr. 22, 04103 Leipzig, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3987-1271","authenticated-orcid":false,"given":"Eckehard","family":"Olbrich","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Mathematics in the Sciences, Inselstr. 22, 04103 Leipzig, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2015,10,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1140\/epjb\/e2008-00175-0","article-title":"Predictive information and explorative behavior of autonomous robots","volume":"63","author":"Ay","year":"2008","journal-title":"Eur. Phys. J. B"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1177\/1059712310375314","article-title":"Higher coordination with less control\u2014A result of information maximization in the sensorimotor loop","volume":"18","author":"Zahedi","year":"2010","journal-title":"Adapt. Behav."},{"key":"ref_3","unstructured":"Klyubin, A.S., Polani, D., and Nehaniv, C.L. (2005, January 5\u20135). Empowerment: A universal agent-centric measure of control. Proceedings of the IEEE Congress on Evolutionary Computation, Edinburgh, Scotland, UK."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1007\/978-3-642-53734-9_4","article-title":"Empowerment\u2014An Introduction","volume":"Volume 9","author":"Prokopenko","year":"2014","journal-title":"Guided Self-Organization: Inception"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ghosh, A., and Tsuitsui, S. (2002). Advances in Evolutionary Computing, Springer.","DOI":"10.1007\/978-3-642-18965-4"},{"key":"ref_6","unstructured":"Bank, D., and Meeden, L. (2005). The Playground Experiment: Task-Independent Development of a Curious Robot; Proceedings of the AAAI Spring Symposium on Developmental Robotics, Stanford."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Frank, M., Leitner, J., Stollenga, M., F\u00f6rster, A., and Schmidhuber, J. (2014). Curiosity Driven Reinforcement Learning for Motion Planning on Humanoids. Front. Neurorobotics, 7.","DOI":"10.3389\/fnbot.2013.00025"},{"key":"ref_8","unstructured":"Der, R., and Martius, G. (2012). The Playful Machine\u2014Theoretical Foundation and Practical Realization of Self-Organizing Robots, Springer."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Martius, G., Der, R., and Ay, N. (2013). Information Driven Self-Organization of Complex Robotic Behaviors. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0063400"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1007\/978-3-642-53734-9_13","article-title":"Guiding designs of self-organizing swarms: Interactive and automated approaches","volume":"Volume 9","author":"Prokopenko","year":"2014","journal-title":"Guided Self-Organization: Inception, Emergence, Complexity and Computation"},{"key":"ref_11","unstructured":"Der, R., and Martius, G. (2013). Advances in Artificial Life, ECAL 2013, MIT Press."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Der, R., and Martius, G. (2015). A Novel Plasticity Rule Can Explain the Development of Sensorimotor Intelligence. Proc. Natl. Acad. Sci. USA, in press.","DOI":"10.1073\/pnas.1508400112"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2409","DOI":"10.1162\/089976601753195969","article-title":"Predictability, Complexity and Learning","volume":"13","author":"Bialek","year":"2001","journal-title":"Neural Comput."},{"key":"ref_14","unstructured":"Shaw, R. (1984). The Dripping Faucet as a Model Chaotic System, Aerial Press."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1063\/1.1530990","article-title":"Regularities unseen, randomness observed: Levels of entropy convergence","volume":"13","author":"Crutchfield","year":"2003","journal-title":"Chaos"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1007\/BF00668821","article-title":"Toward a quantitative theory of self-generated complexity","volume":"25","author":"Grassberger","year":"1986","journal-title":"Int. J. Theor. Phys."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"953","DOI":"10.1119\/1.1378014","article-title":"Mode interaction in horses, tea, and other nonlinear oscillators: The universal role of symmetry","volume":"69","author":"Banning","year":"2001","journal-title":"Am. J. Phys."},{"key":"ref_18","unstructured":"Martius, G., and Olbrich, E. Supplementary Material. Available online: http:\/\/playfulmachines.com\/QuantBeh2015\/."},{"key":"ref_19","unstructured":"Martius, G. Source Code at the Repository. Available online: https:\/\/github.com\/georgmartius\/behavior-quant."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ramos-G\u00f3mez, F. (1991). Randomness, Information, and Complexity; Proceedings of the 5th Mexican School on Statistical Physics (EMFE 5), World Scientific. corrected version arXiv:1208.3459.","DOI":"10.1142\/9789814539173"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1002\/cplx.20249","article-title":"An information-theoretic primer on complexity, self-organization, and emergence","volume":"15","author":"Prokopenko","year":"2009","journal-title":"Complexity"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"832","DOI":"10.1214\/aoms\/1177728190","article-title":"Remarks on some nonparametric estimates of a density function","volume":"27","author":"Rosenblatt","year":"1956","journal-title":"Ann. Math. Statist."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/TIT.1980.1056144","article-title":"Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy","volume":"IT-26","author":"Shore","year":"1980","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1610","DOI":"10.1016\/j.physa.2008.12.066","article-title":"From physics to economics: An econometric example using maximum relative entropy","volume":"388","author":"Giffin","year":"2009","journal-title":"Physica A"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Takens, F., and Verbitski, E. (1998). Generalized entropies: R\u00e9nyi and correlation integral approach. Nonlinearity, 11.","DOI":"10.1088\/0951-7715\/11\/4\/001"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kraskov, A., St\u00f6gbauer, H., and Grassberger, P. (2004). Estimating mutual information. Phys. Rev. E, 69.","DOI":"10.1103\/PhysRevE.69.066138"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1016\/0370-1573(93)90012-3","article-title":"Noise, chaos and (\u03f5,\u03c4)-entropy per unit time","volume":"235","author":"Gaspard","year":"1993","journal-title":"Phys. Rep."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory, Wiley.","DOI":"10.1002\/047174882X"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"3872","DOI":"10.1103\/PhysRevLett.70.3872","article-title":"Plateau onset of correlation dimension: When does it occur?","volume":"70","author":"Ding","year":"1993","journal-title":"Phys. Rev. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1872","DOI":"10.1103\/PhysRevA.31.1872","article-title":"Computing the Kolmogorov entropy from time signals of dissipative and conservative dynamical systems","volume":"31","author":"Cohen","year":"1985","journal-title":"Phys. Rev. A"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Sinai, Y. (2009). Kolmogorov-Sinai entropy. Scholarpedia, 4.","DOI":"10.4249\/scholarpedia.2034"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1007\/BF01053745","article-title":"Embedology","volume":"65","author":"Sauer","year":"1991","journal-title":"J. Stat. Phys."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1111\/j.2517-6161.1976.tb01566.x","article-title":"A test for normality based on sample entropy","volume":"38","author":"Vasicek","year":"1976","journal-title":"J. Royal Stat. Soc. Ser. B"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"428","DOI":"10.1137\/1103036","article-title":"A simplified method of experimentally evaluating the entropy of a stationary sequence","volume":"3","author":"Dobrushin","year":"1958","journal-title":"Theory Probab. Appl."},{"key":"ref_35","first-page":"9","article-title":"Sample estimate of the entropy of a random vector","volume":"23","author":"Kozachenko","year":"1987","journal-title":"Problemy Peredachi Informatsii"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Kantz, H., and Schreiber, T. (2004). Nonlinear Time Series Analysis, Cambridge University Press. Chapter 6.","DOI":"10.1017\/CBO9780511755798"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Grassberger, P. (2007). Grassberger-Procaccia algorithm. Scholarpedia, 2.","DOI":"10.4249\/scholarpedia.3043"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Grassberger, P., and Procaccia, I. (1983). Characterization of strange attractors. Phys. Rev. Lett., 50.","DOI":"10.1103\/PhysRevLett.50.346"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1134","DOI":"10.1103\/PhysRevA.33.1134","article-title":"Independent coordinates for strange attractors from mutual information","volume":"33","author":"Fraser","year":"1986","journal-title":"Phys. Rev. A"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/S0375-9601(97)00351-4","article-title":"Inferring chaotic dynamics from time-series: On which length scale determinism becomes visible","volume":"232","author":"Olbrich","year":"1997","journal-title":"Phys. Lett. A"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1063\/1.166424","article-title":"Practical implementation of nonlinear time series methods: The TISEAN package","volume":"9","author":"Hegger","year":"1999","journal-title":"Chaos"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1007\/978-3-642-53734-9_7","article-title":"On the role of embodiment for self-organizing robots: Behavior as broken symmetry","volume":"Volume 9","author":"Prokopenko","year":"2014","journal-title":"Guided Self-Organization: Inception, Emergence, Complexity and Computation"},{"key":"ref_43","unstructured":"Martius, G., Hesse, F., G\u00fcttler, F., and Der, R. LpzRobots: A Free and Powerful Robot Simulator. Availiable online: http:\/\/robot.informatik.uni-leipzig.de\/software."},{"key":"ref_44","unstructured":"Rocha, L.M., Yaeger, L.S., Bedau, M.A., Floreano, D., Goldstone, R.L., and Vespignani, A. (2006). Artificial Life X, MIT Press."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Schmidhuber, J. (1991, January 18\u201321). Curious model-building control systems. Proceedings of the 1991 IEEE International Joint Conference on Neural Networks, Singapore.","DOI":"10.1109\/IJCNN.1991.170605"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1109\/TEVC.2006.890271","article-title":"Intrinsic motivation systems for autonomous mental development","volume":"11","author":"Oudeyer","year":"2007","journal-title":"IEEE Trans. Evolut. Comput."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/s12065-014-0110-x","article-title":"Beyond black-box optimization: A review of selective pressures for evolutionary robotics","volume":"7","author":"Doncieux","year":"2014","journal-title":"Evolut. Intell."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Lungarella, M., and Sporns, O. (2006). Mapping information flow in sensorimotor networks. PLoS Comput. Biol., 2.","DOI":"10.1371\/journal.pcbi.0020144"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Schmidt, N.M., Hoffmann, M., Nakajima, K., and Pfeifer, R. (2013). Bootstrapping perception using information theory: Case studies in a quadruped robot running on different grounds. Adv. Complex Syst., 16.","DOI":"10.1142\/S0219525912500786"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Wang, X.R., Miller, J.M., Lizier, J.T., Prokopenko, M., and Rossi, L.F. (2012). Quantifying and tracing information cascades in swarms. PLoS ONE, 7.","DOI":"10.1371\/journal.pone.0040084"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/17\/10\/7266\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:50:51Z","timestamp":1760215851000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/17\/10\/7266"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,10,23]]},"references-count":50,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2015,10]]}},"alternative-id":["e17107266"],"URL":"https:\/\/doi.org\/10.3390\/e17107266","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2015,10,23]]}}}