{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T11:32:15Z","timestamp":1774697535861,"version":"3.50.1"},"reference-count":42,"publisher":"MIT Press","issue":"4","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,1,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>It has long been hypothesized that operating close to the critical state is beneficial for natural and artificial evolutionary systems. We put this hypothesis to test in a system of evolving foraging agents controlled by neural networks that can adapt the agents\u2019 dynamical regime throughout evolution. Surprisingly, we find that all populations that discover solutions evolve to be subcritical. By a resilience analysis, we find that there are still benefits of starting the evolution in the critical regime. Namely, initially critical agents maintain their fitness level under environmental changes (for example, in the lifespan) and degrade gracefully when their genome is perturbed. At the same time, initially subcritical agents, even when evolved to the same fitness, are often inadequate to withstand the changes in the lifespan and degrade catastrophically with genetic perturbations. Furthermore, we find the optimal distance to criticality depends on the task complexity. To test it we introduce a hard task and a simple task: For the hard task, agents evolve closer to criticality, whereas more subcritical solutions are found for the simple task. We verify that our results are independent of the selected evolutionary mechanisms by testing them on two principally different approaches: a genetic algorithm and an evolutionary strategy. In summary, our study suggests that although optimal behaviour in the simple task is obtained in a subcritical regime, initializing near criticality is important to be efficient at finding optimal solutions for new tasks of unknown complexity.<\/jats:p>","DOI":"10.1162\/artl_a_00383","type":"journal-article","created":{"date-parts":[[2022,8,19]],"date-time":"2022-08-19T14:44:49Z","timestamp":1660920289000},"page":"458-478","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":4,"title":["When to Be Critical? Performance and Evolvability in Different Regimes of Neural Ising Agents"],"prefix":"10.1162","volume":"28","author":[{"given":"Sina","family":"Khajehabdollahi","sequence":"first","affiliation":[{"name":"University of T\u00fcbingen, Department of Computer Science"},{"name":"Max Planck Institute for Biological Cybernetics. sina.abdollahi@gmail.com"}]},{"given":"Jan","family":"Prosi","sequence":"additional","affiliation":[{"name":"University of T\u00fcbingen, Department of Computer Science"},{"name":"Max Planck Institute for Biological Cybernetics"}]},{"given":"Emmanouil","family":"Giannakakis","sequence":"additional","affiliation":[{"name":"University of T\u00fcbingen, Department of Computer Science"},{"name":"Max Planck Institute for Biological Cybernetics"}]},{"given":"Georg","family":"Martius","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Intelligent Systems"}]},{"given":"Anna","family":"Levina","sequence":"additional","affiliation":[{"name":"University of T\u00fcbingen, Department of Computer Science"},{"name":"Max Planck Institute for Biological Cybernetics"},{"name":"Bernstein Center for Computational Neuroscience T\u00fcbingen"}]}],"member":"281","published-online":{"date-parts":[[2022,11,1]]},"reference":[{"key":"2022110114032961300_bib1","doi-asserted-by":"publisher","first-page":"21","DOI":"10.7551\/ecal_a_009","article-title":"Criticality as it could be: Organizational invariance as self-organized criticality in embodied agents","volume-title":"ECAL 2017: Proceedings of fourteenth European conference on artificial life","author":"Aguilera","year":"2017"},{"issue":"3","key":"2022110114032961300_bib2","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1016\/j.jtbi.2006.10.027","article-title":"Robustness and evolvability in genetic regulatory networks","volume":"245","author":"Aldana","year":"2007","journal-title":"Journal of Theoretical Biology"},{"issue":"6","key":"2022110114032961300_bib3","doi-asserted-by":"publisher","first-page":"Article e2456","DOI":"10.1371\/journal.pone.0002456","article-title":"Critical dynamics in genetic regulatory networks: Examples from four kingdoms","volume":"3","author":"Balleza","year":"2008","journal-title":"PLOS ONE"},{"issue":"1864","key":"2022110114032961300_bib4","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1098\/rsta.2007.2092","article-title":"The criticality hypothesis: How local cortical networks might optimize information processing","volume":"366","author":"Beggs","year":"2007","journal-title":"Philosophical Transactions of the Royal Society A"},{"issue":"22","key":"2022110114032961300_bib5","doi-asserted-by":"publisher","first-page":"5216","DOI":"10.1523\/JNEUROSCI.0540-04.2004","article-title":"Neuronal avalanches are diverse and precise activity patterns that are stable for many hours in cortical slice cultures","volume":"24","author":"Beggs","year":"2004","journal-title":"Journal of Neuroscience"},{"issue":"7","key":"2022110114032961300_bib6","doi-asserted-by":"publisher","first-page":"1413","DOI":"10.1162\/089976604323057443","article-title":"Real-time computation at the edge of chaos in recurrent neural networks","volume":"16","author":"Bertschinger","year":"2004","journal-title":"Neural Computation"},{"issue":"3","key":"2022110114032961300_bib7","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1007\/s12064-011-0146-8","article-title":"Information processing in echo state networks at the edge of chaos","volume":"131","author":"Boedecker","year":"2012","journal-title":"Theory in Biosciences"},{"key":"2022110114032961300_bib8","doi-asserted-by":"publisher","first-page":"Article 333","DOI":"10.3389\/fphy.2020.00333","article-title":"Feedback mechanisms for self-organization to the edge of a phase transition","volume":"8","author":"Buend\u00eda","year":"2020","journal-title":"Frontiers in Physics"},{"issue":"26","key":"2022110114032961300_bib9","doi-asserted-by":"publisher","first-page":"11865","DOI":"10.1073\/pnas.1005766107","article-title":"Scale-free correlations in starling flocks","volume":"107","author":"Cavagna","year":"2010","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"2022110114032961300_bib10","doi-asserted-by":"crossref","first-page":"Article 120","DOI":"10.1103\/Physics.7.120","article-title":"Insect swarms go critical","volume":"7","author":"Chat\u00e9","year":"2014","journal-title":"Physics"},{"key":"2022110114032961300_bib11","doi-asserted-by":"publisher","first-page":"Article 2853","DOI":"10.1038\/s41467-020-16548-3","article-title":"Control of criticality and computation in spiking neuromorphic networks with plasticity","volume":"11","author":"Cramer","year":"2020","journal-title":"Nature Communications"},{"key":"2022110114032961300_bib12","doi-asserted-by":"publisher","DOI":"10.1145\/1274000.1274109","volume-title":"Evolutionary computation: A unified approach","author":"De Jong","year":"2006"},{"issue":"4","key":"2022110114032961300_bib13","doi-asserted-by":"publisher","first-page":"Article e1002602","DOI":"10.1371\/journal.pbio.1002602","article-title":"A critical-like collective state leads to long-range cell communication in dictyostelium discoideum aggregation","volume":"15","author":"De Palo","year":"2017","journal-title":"PLOS Biology"},{"issue":"3","key":"2022110114032961300_bib14","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1016\/j.scr.2009.03.001","article-title":"Stem cell decision making and critical-like exploratory networks","volume":"2","author":"Halley","year":"2009","journal-title":"Stem Cell Research"},{"issue":"28","key":"2022110114032961300_bib15","doi-asserted-by":"publisher","first-page":"10095","DOI":"10.1073\/pnas.1319166111","article-title":"Information-based fitness and the emergence of criticality in living systems","volume":"111","author":"Hidalgo","year":"2014","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"2022110114032961300_bib16","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-015-8054-0_8","volume-title":"The origins of order: Self-organization and selection in evolution","author":"Kauffman","year":"1993"},{"issue":"1","key":"2022110114032961300_bib17","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1016\/S0022-5193(87)80029-2","article-title":"Towards a general theory of adaptive walks on rugged landscapes","volume":"128","author":"Kauffman","year":"1987","journal-title":"Journal of Theoretical Biology"},{"issue":"1","key":"2022110114032961300_bib18","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1162\/artl_a_00309","article-title":"Evolution towards criticality in Ising neural agents","volume":"26","author":"Khajehabdollahi","year":"2020","journal-title":"Artificial Life"},{"issue":"5","key":"2022110114032961300_bib19","doi-asserted-by":"publisher","first-page":"348","DOI":"10.1038\/nphys289","article-title":"Optimal dynamical range of excitable networks at criticality","volume":"2","author":"Kinouchi","year":"2006","journal-title":"Nature Physics"},{"key":"2022110114032961300_bib20","doi-asserted-by":"publisher","first-page":"Article 530","DOI":"10.3389\/fphy.2020.583213","article-title":"Mechanisms of self-organized quasicriticality in neuronal network models","volume":"8","author":"Kinouchi","year":"2020","journal-title":"Frontiers in Physics"},{"issue":"6","key":"2022110114032961300_bib21","doi-asserted-by":"publisher","first-page":"1087","DOI":"10.1063\/1.1699114","article-title":"Equation of state calculations by fast computing machines","volume":"21","author":"Metropolis","year":"1953","journal-title":"Journal of Chemical Physics"},{"issue":"2","key":"2022110114032961300_bib22","doi-asserted-by":"publisher","first-page":"268","DOI":"10.1007\/s10955-011-0229-4","article-title":"Are biological systems poised at criticality?","volume":"144","author":"Mora","year":"2011","journal-title":"Journal of Statistical Physics"},{"issue":"3","key":"2022110114032961300_bib23","doi-asserted-by":"publisher","first-page":"Article 031001","DOI":"10.1103\/RevModPhys.90.031001","article-title":"Colloquium: Criticality and dynamical scaling in living systems","volume":"90","author":"Mu\u00f1oz","year":"2018","journal-title":"Reviews of Modern Physics"},{"key":"2022110114032961300_bib24","first-page":"20719","article-title":"Meta-learning through Hebbian plasticity in random networks","volume-title":"NIPS \u201920: Proceedings of the 34th conference on neural information processing systems. Advances in neural information processing systems 33","author":"Najarro","year":"2020"},{"issue":"25","key":"2022110114032961300_bib25","doi-asserted-by":"publisher","first-page":"Article eabm6385","DOI":"10.1126\/sciadv.abm6385","article-title":"Subcritical escape waves in schooling fish","volume":"8","author":"Poel","year":"2022","journal-title":"Science Advances"},{"key":"2022110114032961300_bib26","doi-asserted-by":"publisher","first-page":"Article 108","DOI":"10.3389\/fnsys.2014.00108","article-title":"Spike avalanches in vivo suggest a driven, slightly subcritical brain state","volume":"8","author":"Priesemann","year":"2014","journal-title":"Frontiers in Systems Neuroscience"},{"key":"2022110114032961300_bib27","doi-asserted-by":"publisher","first-page":"Article 79","DOI":"10.1162\/isal_a_00412","article-title":"The dynamical regime and its importance for evolvability, task performance and generalization","volume-title":"ALIFE 2021: Proceedings of the 2021 conference on artificial life","author":"Prosi","year":"2021"},{"issue":"1","key":"2022110114032961300_bib28","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1016\/j.physd.2006.12.005","article-title":"Measures for information propagation in boolean networks","volume":"227","author":"R\u00e4m\u00f6","year":"2007","journal-title":"Physica D: Nonlinear Phenomena"},{"issue":"1","key":"2022110114032961300_bib29","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1016\/j.jtbi.2006.02.011","article-title":"Perturbation avalanches and criticality in gene regulatory networks","volume":"242","author":"R\u00e4m\u00f6","year":"2006","journal-title":"Journal of Theoretical Biology"},{"issue":"3","key":"2022110114032961300_bib30","doi-asserted-by":"publisher","first-page":"647","DOI":"10.1007\/s11424-017-6117-5","article-title":"Dynamical criticality: Overview and open questions","volume":"31","author":"Roli","year":"2018","journal-title":"Journal of Systems Science and Complexity"},{"key":"2022110114032961300_bib31","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1703.03864","article-title":"Evolution strategies as a scalable alternative to reinforcement learning","author":"Salimans","year":"2017","journal-title":"ArXiv"},{"issue":"7087","key":"2022110114032961300_bib32","doi-asserted-by":"publisher","first-page":"1007","DOI":"10.1038\/nature04701","article-title":"Weak pairwise correlations imply strongly correlated network states in a neural population","volume":"440","author":"Schneidman","year":"2006","journal-title":"Nature"},{"issue":"4","key":"2022110114032961300_bib33","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1016\/j.neunet.2009.12.004","article-title":"Parameter-exploring policy gradients","volume":"23","author":"Sehnke","year":"2010","journal-title":"Neural Networks"},{"issue":"37","key":"2022110114032961300_bib34","doi-asserted-by":"publisher","first-page":"11508","DOI":"10.1073\/pnas.1514188112","article-title":"Thermodynamics and signatures of criticality in a network of neurons","volume":"112","author":"Tka\u010dik","year":"2015","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"2022110114032961300_bib35","doi-asserted-by":"publisher","first-page":"Article 151","DOI":"10.3389\/fnsys.2014.00151","article-title":"Marginally subcritical dynamics explain enhanced stimulus discriminability under attention","volume":"8","author":"Tomen","year":"2014","journal-title":"Frontiers in Systems Neuroscience"},{"key":"2022110114032961300_bib36","doi-asserted-by":"publisher","first-page":"Article 34743","DOI":"10.1038\/srep34743","article-title":"Intrinsic noise and deviations from criticality in Boolean gene-regulatory networks","volume":"6","author":"Villegas","year":"2016","journal-title":"Scientific Reports"},{"issue":"10","key":"2022110114032961300_bib37","doi-asserted-by":"publisher","first-page":"Article e1007320","DOI":"10.1371\/journal.pcbi.1007320","article-title":"Evolving generalists in switching rugged landscapes","volume":"15","author":"Wang","year":"2019","journal-title":"PLOS Computational Biology"},{"issue":"1","key":"2022110114032961300_bib38","first-page":"949","article-title":"Natural evolution strategies","volume":"15","author":"Wierstra","year":"2014","journal-title":"The Journal of Machine Learning Research"},{"key":"2022110114032961300_bib39","doi-asserted-by":"publisher","first-page":"3381","DOI":"10.1109\/CEC.2008.4631255","article-title":"Natural evolution strategies","volume-title":"Proceedings of the 2008 Congress on Evolutionary Computation. CEC\u201908","author":"Wierstra","year":"2008"},{"issue":"6","key":"2022110114032961300_bib40","doi-asserted-by":"publisher","first-page":"2759","DOI":"10.1093\/cercor\/bhz049","article-title":"Between perfectly critical and fully irregular: A reverberating model captures and predicts cortical spike propagation","volume":"29","author":"Wilting","year":"2019","journal-title":"Cerebral Cortex"},{"key":"2022110114032961300_bib41","doi-asserted-by":"publisher","first-page":"Article 103","DOI":"10.3389\/fphy.2021.619661","article-title":"Self-organization toward criticality by synaptic plasticity","volume":"9","author":"Zeraati","year":"2021","journal-title":"Frontiers in Physics"},{"issue":"1","key":"2022110114032961300_bib42","doi-asserted-by":"publisher","first-page":"Article 013115","DOI":"10.1103\/PhysRevResearch.2.013115","article-title":"Tailored ensembles of neural networks optimize sensitivity to stimulus statistics","volume":"2","author":"Zierenberg","year":"2020","journal-title":"Physical Review Research"}],"container-title":["Artificial Life"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/artl\/article-pdf\/28\/4\/458\/2043319\/artl_a_00383.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/artl\/article-pdf\/28\/4\/458\/2043319\/artl_a_00383.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,1]],"date-time":"2022-11-01T14:03:46Z","timestamp":1667311426000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/artl\/article\/28\/4\/458\/112724\/When-to-Be-Critical-Performance-and-Evolvability"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,1]]},"references-count":42,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,11,1]]},"published-print":{"date-parts":[[2022,1,1]]}},"URL":"https:\/\/doi.org\/10.1162\/artl_a_00383","relation":{},"ISSN":["1064-5462","1530-9185"],"issn-type":[{"value":"1064-5462","type":"print"},{"value":"1530-9185","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022]]},"published":{"date-parts":[[2022,1,1]]}}}