{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,30]],"date-time":"2024-07-30T08:27:24Z","timestamp":1722328044525},"reference-count":54,"publisher":"MIT Press","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Artificial Life"],"published-print":{"date-parts":[[2019,5]]},"abstract":"<jats:p>Natural evolution gives the impression of leading to an open-ended process of increasing diversity and complexity. If our goal is to produce such open-endedness artificially, this suggests an approach driven by evolutionary metaphor. On the other hand, techniques from machine learning and artificial intelligence are often considered too narrow to provide the sort of exploratory dynamics associated with evolution. In this article, we hope to bridge that gap by reviewing common barriers to open-endedness in the evolution-inspired approach and how they are dealt with in the evolutionary case\u2014collapse of diversity, saturation of complexity, and failure to form new kinds of individuality. We then show how these problems map onto similar ones in the machine learning approach, and discuss how the same insights and solutions that alleviated those barriers in evolutionary approaches can be ported over. At the same time, the form these issues take in the machine learning formulation suggests new ways to analyze and resolve barriers to open-endedness. Ultimately, we hope to inspire researchers to be able to interchangeably use evolutionary and gradient-descent-based machine learning methods to approach the design and creation of open-ended systems.<\/jats:p>","DOI":"10.1162\/artl_a_00286","type":"journal-article","created":{"date-parts":[[2019,5,31]],"date-time":"2019-05-31T19:19:40Z","timestamp":1559330380000},"page":"145-167","source":"Crossref","is-referenced-by-count":6,"title":["On the Potential for Open-Endedness in Neural Networks"],"prefix":"10.1162","volume":"25","author":[{"given":"Nicholas","family":"Guttenberg","sequence":"first","affiliation":[{"name":"Earth-life Science Institute"},{"name":"Araya Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nathaniel","family":"Virgo","sequence":"additional","affiliation":[{"name":"Earth-life Science Institute"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexandra","family":"Penn","sequence":"additional","affiliation":[{"name":"University of Surrey, Centre for Evaluation of Complexity Across the Nexus, Centre for Research in Social Simulation"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"bib1","first-page":"3981","volume-title":"Advances in neural information processing systems","author":"Andrychowicz M.","year":"2016"},{"key":"bib2","first-page":"5360","volume-title":"Advances in neural information processing systems","author":"Anthony T.","year":"2017"},{"key":"bib3","doi-asserted-by":"publisher","DOI":"10.1086\/276408"},{"key":"bib6","first-page":"431","volume-title":"Artificial Life II","author":"Bedau M.","year":"1992"},{"key":"bib7","doi-asserted-by":"publisher","DOI":"10.1162\/106454600300103683"},{"key":"bib8","first-page":"1471","volume-title":"Advances in neural information processing systems","author":"Bellemare M.","year":"2016"},{"key":"bib9","doi-asserted-by":"publisher","DOI":"10.1016\/j.virusres.2004.11.002"},{"key":"bib10","unstructured":"Bishop, C. M. (1994). Mixture density networks (Technical Report). Citeseer."},{"key":"bib12","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2012.2186810"},{"key":"bib14","doi-asserted-by":"publisher","DOI":"10.1098\/rsif.2015.0604"},{"key":"bib17","doi-asserted-by":"publisher","DOI":"10.1145\/2739480.2754730"},{"key":"bib18","doi-asserted-by":"publisher","DOI":"10.1007\/BF02551274"},{"key":"bib19","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"bib20","first-page":"e152418","volume":"5","author":"Dolson E.","year":"2015","journal-title":"The Winnower"},{"key":"bib21","volume-title":"The hypercycle: A principle of natural self-organization","author":"Eigen M.","year":"2012"},{"key":"bib23","first-page":"927","volume-title":"Proceedings of the 2nd Annual Conference on Genetic and Evolutionary Computation","author":"Ficici S. G.","year":"2000"},{"key":"bib26","first-page":"2137","volume-title":"Advances in neural information processing systems","author":"Foerster J.","year":"2016"},{"key":"bib27","doi-asserted-by":"publisher","DOI":"10.1080\/17588928.2015.1020053"},{"key":"bib28","doi-asserted-by":"publisher","DOI":"10.5962\/bhl.title.4489"},{"key":"bib29","first-page":"2672","volume-title":"Advances in neural information processing systems","author":"Goodfellow I.","year":"2014"},{"key":"bib31","doi-asserted-by":"publisher","DOI":"10.1038\/nature20101"},{"key":"bib32","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.100.058102"},{"key":"bib33","unstructured":"Guttenberg, N. R. (2009). Scale-invariant cascades in turbulence and evolution. Doctoral thesis, University of Illinois at Urbana-Champaign."},{"key":"bib34","doi-asserted-by":"publisher","DOI":"10.1126\/science.131.3409.1292"},{"key":"bib36","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-44668-0_13"},{"key":"bib37","doi-asserted-by":"publisher","DOI":"10.1016\/0893-6080(91)90009-T"},{"key":"bib39","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2005.1554676"},{"issue":"1","key":"bib40","first-page":"1","volume":"1","author":"Kolmogorov A. N.","year":"1965","journal-title":"Problems of Information Transmission"},{"key":"bib41","doi-asserted-by":"publisher","DOI":"10.1145\/1830483.1830503"},{"key":"bib42","doi-asserted-by":"publisher","DOI":"10.1162\/EVCO_a_00025"},{"key":"bib43","doi-asserted-by":"publisher","DOI":"10.1162\/isal_a_00051"},{"key":"bib44","first-page":"295","volume-title":"Artificial Life II","author":"Lindgren K.","year":"1992"},{"key":"bib45","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X12002415"},{"key":"bib47","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198502944.001.0001","volume-title":"The major transitions in evolution","author":"Maynard-Smith J.","year":"1997"},{"key":"bib48","first-page":"3478","volume-title":"International Conference on Machine Learning","author":"Mescheder L.","year":"2018"},{"key":"bib51","doi-asserted-by":"publisher","DOI":"10.1162\/isal_a_00014"},{"key":"bib54","first-page":"78","volume-title":"Proceedings of the Twenty-First International Conference on Machine Learning","author":"Ng A. Y.","year":"2004"},{"key":"bib56","first-page":"6","volume":"1","author":"Oudeyer P.-Y.","year":"2009","journal-title":"Frontiers in Neurorobotics"},{"key":"bib57","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2017.70"},{"key":"bib59","doi-asserted-by":"publisher","DOI":"10.1162\/106454601317296988"},{"key":"bib60","unstructured":"Ray, T. S. (1992). Evolution, ecology and optimization of digital organisms (Technical Report). Citeseer."},{"key":"bib61","first-page":"1842","volume-title":"International Conference on Machine Learning","author":"Santoro A.","year":"2016"},{"key":"bib62","doi-asserted-by":"crossref","first-page":"222","DOI":"10.7551\/mitpress\/3115.003.0030","volume-title":"Proceedings of the International conference on Simulation of Adaptive Behavior: From animals to animats","author":"Schmidhuber J.","year":"1991"},{"key":"bib63","doi-asserted-by":"publisher","DOI":"10.1038\/nature16961"},{"key":"bib64","doi-asserted-by":"publisher","DOI":"10.1038\/nature24270"},{"key":"bib65","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.54.3.919"},{"issue":"1","key":"bib66","first-page":"1929","volume":"15","author":"Srivastava N.","year":"2014","journal-title":"The Journal of Machine Learning Research"},{"key":"bib67","doi-asserted-by":"publisher","DOI":"10.1162\/106365602320169811"},{"key":"bib68","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010002801935"},{"key":"bib69","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.97"},{"key":"bib72","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-21852-6_3"},{"key":"bib73","first-page":"5998","volume-title":"Advances in neural information processing systems","author":"Vaswani A.","year":"2017"},{"key":"bib74","unstructured":"Wallace, R., Wallace, D. & Wallace, R. G. (2009). Eigen's paradox (pp. 1\u201311). New York: Springer."},{"key":"bib75","doi-asserted-by":"publisher","DOI":"10.1038\/35085569"}],"container-title":["Artificial Life"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/artl_a_00286","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,18]],"date-time":"2024-07-18T23:52:43Z","timestamp":1721346763000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/artl\/article\/25\/2\/145-167\/2926"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,5]]},"references-count":54,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,5]]}},"alternative-id":["10.1162\/artl_a_00286"],"URL":"https:\/\/doi.org\/10.1162\/artl_a_00286","relation":{},"ISSN":["1064-5462","1530-9185"],"issn-type":[{"value":"1064-5462","type":"print"},{"value":"1530-9185","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,5]]}}}