{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T06:03:05Z","timestamp":1783749785967,"version":"3.55.0"},"reference-count":96,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2020,8,3]],"date-time":"2020-08-03T00:00:00Z","timestamp":1596412800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2020,8,3]],"date-time":"2020-08-03T00:00:00Z","timestamp":1596412800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Mach Intell"],"DOI":"10.1038\/s42256-020-0208-z","type":"journal-article","created":{"date-parts":[[2020,8,3]],"date-time":"2020-08-03T16:06:28Z","timestamp":1596470788000},"page":"428-436","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":79,"title":["Increasing generality in machine learning through procedural content generation"],"prefix":"10.1038","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3607-8400","authenticated-orcid":false,"given":"Sebastian","family":"Risi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3128-4598","authenticated-orcid":false,"given":"Julian","family":"Togelius","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,8,3]]},"reference":[{"key":"208_CR1","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1109\/TG.2018.2846639","volume":"10","author":"A Summerville","year":"2018","unstructured":"Summerville, A. et al. Procedural content generation via machine learning (PCGML). IEEE Trans. Games 10, 257\u2013270 (2018).","journal-title":"IEEE Trans. Games"},{"key":"208_CR2","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1613\/jair.3912","volume":"47","author":"MG Bellemare","year":"2013","unstructured":"Bellemare, M. G., Naddaf, Y., Veness, J. & Bowling, M. The arcade learning environment: an evaluation platform for general agents. J. Artif. Intell. Res. 47, 253\u2013279 (2013).","journal-title":"J. Artif. Intell. Res."},{"key":"208_CR3","doi-asserted-by":"publisher","first-page":"859","DOI":"10.1126\/science.aau6249","volume":"364","author":"M Max Jaderberg","year":"2019","unstructured":"Max Jaderberg, M. et al. Human-level performance in 3D multiplayer games with population-based reinforcement learning. Science 364, 859\u2013865 (2019).","journal-title":"Science"},{"key":"208_CR4","unstructured":"Torrado, R. et al. Bootstrapping conditional gans for video game level generation. Preprint at https:\/\/arxiv.org\/abs\/1910.01603 (2019)."},{"key":"208_CR5","unstructured":"Akkaya, I. et al. Solving Rubik\u2019s cube with a robot hand. Preprint https:\/\/arxiv.org\/abs\/1910.07113 (2019)."},{"key":"208_CR6","unstructured":"Smith, G. An analog history of procedural content generation. In Proc. 10th Int. Conf. Foundations of Digital Games (FDG, 2015)."},{"key":"208_CR7","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1145\/325165.325247","volume":"19","author":"K Perlin","year":"1985","unstructured":"Perlin, K. An image synthesizer. ACM Siggraph Comp. Graph. 19, 287\u2013296 (1985).","journal-title":"ACM Siggraph Comp. Graph."},{"key":"208_CR8","unstructured":"Prusinkiewicz, P. Graphical applications of L-systems. In Proc. Graphics Interface Vol. 86 247\u2013253 (ACM, 1986)."},{"key":"208_CR9","unstructured":"von Neumann, J. et al. The general and logical theory of automata. In Cerebral Mechanisms in Behavior (ed. Jeffress, L. A.) 1\u201341 (Wiley, 1951)."},{"key":"208_CR10","unstructured":"Hardt, M., Price, E. & Srebro, N. Equality of opportunity in supervised learning. In 30th Conf. Neural Information Processing Systems 3315\u20133323 (NeurIPS, 2016)."},{"key":"208_CR11","unstructured":"Lin, J., Camoriano, R. & Rosasco, L. Generalization properties and implicit regularization for multiple passes sgm. In Int. Conf. Machine Learning 2340\u20132348 (ICML, 2016)."},{"key":"208_CR12","unstructured":"Krizhevsky, A., Sutskever, I. & Hinton, G. E. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 1097\u20131105 (NeurIPS, 2012)."},{"key":"208_CR13","unstructured":"Simard, P. Y., Steinkraus, D. & Platt, J. C. Best practices for convolutional neural networks applied to visual document analysis. In Proc. Seventh International Conference on Document Analysis and Recognition (IEEE, 2003)."},{"key":"208_CR14","unstructured":"Perez, L. & Wang, J. The effectiveness of data augmentation in image classification using deep learning. Preprint at https:\/\/arxiv.org\/abs\/1712.04621 (2017)."},{"key":"208_CR15","doi-asserted-by":"publisher","first-page":"1469","DOI":"10.1109\/TASLP.2015.2438544","volume":"23","author":"X Cui","year":"2015","unstructured":"Cui, X., Goel, V. & Kingsbury, B. Data augmentation for deep neural network acoustic modeling. IEEE\/ACM Trans. Audio Speech Lang. Proces. 23, 1469\u20131477 (2015).","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Proces."},{"key":"208_CR16","unstructured":"Geirhos, R. et al. Imagenet-trained cnns are biased towards texture; increasing shape bias improves accuracy and robustness. In Proc. Seventh Int. Conf. Learning Representations (ICLR, 2019)."},{"key":"208_CR17","unstructured":"Weng, L. Domain randomization for sim2real transfer. GitHub https:\/\/lilianweng.github.io\/lil-log\/2019\/05\/05\/domain-randomization.html (2019)."},{"key":"208_CR18","doi-asserted-by":"crossref","unstructured":"Tobin, J. et al. Domain randomization for transferring deep neural networks from simulation to the real world. In IEEE\/RSJ Int. Conf. Intelligent Robots and Systems 23\u201330 (IEEE, 2017).","DOI":"10.1109\/IROS.2017.8202133"},{"key":"208_CR19","unstructured":"Tobin, J. Beyond domain randomization. GitHub https:\/\/sim2real.github.io (2019)."},{"key":"208_CR20","doi-asserted-by":"crossref","unstructured":"Sadeghi, F. & Levine, S. CAD2RL: real single-image flight without a single real image. In Proc. Robotics: Science and Systems Conf. (RSS, 2017).","DOI":"10.15607\/RSS.2017.XIII.034"},{"key":"208_CR21","doi-asserted-by":"crossref","unstructured":"Tremblay, J. et al. Training deep networks with synthetic data: bridging the reality gap by domain randomization. In Proc. IEEE Conf. Computer Vision and Pattern Recognition Workshops 969\u2013977 (IEEE, 2018).","DOI":"10.1109\/CVPRW.2018.00143"},{"key":"208_CR22","doi-asserted-by":"crossref","unstructured":"Prakash, A. et al. Structured domain randomization: bridging the reality gap by context-aware synthetic data. In 2019 Int. Conf. Robotics and Automation 7249\u20137255 (IEEE, 2019).","DOI":"10.1109\/ICRA.2019.8794443"},{"key":"208_CR23","unstructured":"Yu, W., Liu, C. K. & Turk, G. Policy transfer with strategy optimization. In Proc. Seventh Int. Conf. Learning Representations (ICLR, 2019)."},{"key":"208_CR24","doi-asserted-by":"crossref","unstructured":"Cubuk, E. D., Zoph, B., Mane, D., Vasudevan, V. & Le, Q. V. Autoaugment: learning augmentation policies from data. In Proc. IEEE Conf. Computer Vision and Pattern Recognition (IEEE, 2019).","DOI":"10.1109\/CVPR.2019.00020"},{"key":"208_CR25","doi-asserted-by":"crossref","unstructured":"Zakharov, S., Kehl, W. & Ilic, S. Deceptionnet: network-driven domain randomization. In Proc. IEEE Int. Conf. Computer Vision (IEEE, 2019).","DOI":"10.1109\/ICCV.2019.00062"},{"key":"208_CR26","doi-asserted-by":"crossref","unstructured":"Schmidhuber, J. Curious model-building control systems. In Proc. IEEE Int. Joint Conf. Neural Networks 1458\u20131463 (IEEE, 1991).","DOI":"10.1109\/IJCNN.1991.170605"},{"key":"208_CR27","doi-asserted-by":"crossref","unstructured":"Togelius, J. & Schmidhuber, J. An experiment in automatic game design. In IEEE Symp. Computational Intelligence and Games 111\u2013118 (IEEE, 2008).","DOI":"10.1109\/CIG.2008.5035629"},{"key":"208_CR28","unstructured":"Justesen, N. et al. Illuminating generalization in deep reinforcement learning through procedural level generation. In NeurIPS 2018 Workshop on Deep Reinforcement Learning (NeurIPS, 2018)."},{"key":"208_CR29","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1109\/TCIAIG.2011.2148116","volume":"3","author":"J Togelius","year":"2011","unstructured":"Togelius, J., Yannakakis, G. N., Stanley, K. O. & Browne, C. Search-based procedural content generation: a taxonomy and survey. IEEE Trans. Comput. Intell. AI Games 3, 172\u2013186 (2011).","journal-title":"IEEE Trans. Comput. Intell. AI Games"},{"key":"208_CR30","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1162\/106365601750190398","volume":"9","author":"N Hansen","year":"2001","unstructured":"Hansen, N. & Ostermeier, A. Completely derandomized self-adaptation in evolution strategies. Evolut. Comput. 9, 159\u2013195 (2001).","journal-title":"Evolut. Comput."},{"key":"208_CR31","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1023\/A:1008202821328","volume":"11","author":"R Storn","year":"1997","unstructured":"Storn, R. & Price, K. Differential evolution\u2013a simple and efficient heuristic for global optimization over continuous spaces. J. Global Optim. 11, 341\u2013359 (1997).","journal-title":"J. Global Optim."},{"key":"208_CR32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TCIAIG.2010.2041928","volume":"2","author":"C Browne","year":"2010","unstructured":"Browne, C. & Maire, F. Evolutionary game design. IEEE Trans. Comput. Intell. AI Games 2, 1\u201316 (2010).","journal-title":"IEEE Trans. Comput. Intell. AI Games"},{"key":"208_CR33","doi-asserted-by":"publisher","first-page":"192","DOI":"10.1109\/TCIAIG.2016.2520256","volume":"9","author":"M Cook","year":"2016","unstructured":"Cook, M., Colton, S. & Gow, J. The angelina videogame design system\u2014part I. IEEE Trans. Comput. Intell. AI Games 9, 192\u2013203 (2016).","journal-title":"IEEE Trans. Comput. Intell. AI Games"},{"key":"208_CR34","doi-asserted-by":"crossref","unstructured":"Cook, M. & Colton, S. Multi-faceted evolution of simple arcade games. In 2011 IEEE Conf. Computational Intelligence and Games 289\u2013296 (IEEE, 2011).","DOI":"10.1109\/CIG.2011.6032019"},{"key":"208_CR35","doi-asserted-by":"crossref","unstructured":"Nielsen, T. S., Barros, G. A. B., Togelius, J. & Nelson, M. J. Towards generating arcade game rules with VGDL. In 2015 IEEE Conf. Computational Intelligence and Games 185\u2013192 (IEEE, 2015).","DOI":"10.1109\/CIG.2015.7317941"},{"key":"208_CR36","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1007\/s10710-012-9174-5","volume":"14","author":"J Togelius","year":"2013","unstructured":"Togelius, J. et al. Controllable procedural map generation via multiobjective evolution. Genet. Program. Evolv. Mach. 14, 245\u2013277 (2013).","journal-title":"Genet. Program. Evolv. Mach."},{"key":"208_CR37","doi-asserted-by":"crossref","unstructured":"Dahlskog, S. & Togelius, J. A multi-level level generator. In IEEE Conf. Computational Intelligence and Games 1\u20138 (IEEE, 2014).","DOI":"10.1109\/CIG.2014.6932909"},{"key":"208_CR38","unstructured":"Cachia, W., Liapis, A. & Yannakakis, G. N. Multi-level evolution of shooter levels. In Proc. Eleventh AAAI Conf. Artificial Intelligence and Interactive Digital Entertainment (AAAI, 2015)."},{"key":"208_CR39","doi-asserted-by":"crossref","unstructured":"Calle, L., Merelo, J. J., Mora-Garc\u00eda, A. & Garc\u00eda-Valdez, J.-M. Free form evolution for Angry Birds level generation. In Int. Conf. Applications of Evolutionary Computation 125\u2013140 (Springer, 2019).","DOI":"10.1007\/978-3-030-16692-2_9"},{"key":"208_CR40","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1109\/TCIAIG.2009.2038365","volume":"1","author":"EJ Hastings","year":"2009","unstructured":"Hastings, E. J., Guha, R. K. & Stanley, K. O. Automatic content generation in the galactic arms race video game. IEEE Trans. Comput. Intell. AI Games 1, 245\u2013263 (2009).","journal-title":"IEEE Trans. Comput. Intell. AI Games"},{"key":"208_CR41","doi-asserted-by":"crossref","unstructured":"Pantaleev, A. In search of patterns: disrupting RPG classes through procedural content generation. In Proc. Third Workshop on Procedural Content Generation in Games 4 (ACM, 2012).","DOI":"10.1145\/2538528.2538532"},{"key":"208_CR42","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1109\/TCIAIG.2015.2416206","volume":"8","author":"S Risi","year":"2015","unstructured":"Risi, S., Lehman, J., D\u2019Ambrosio, D. B., R. Hall, R. & Stanley, K. O. Petalz: search-based procedural content generation for the casual gamer. IEEE Trans. Comput. Intell. AI Games 8, 244\u2013255 (2015).","journal-title":"IEEE Trans. Comput. Intell. AI Games"},{"key":"208_CR43","doi-asserted-by":"crossref","unstructured":"Gravina, D., Khalifa, A., Liapis, A., Togelius, J. & Yannakakis, G. N. Procedural content generation through quality diversity. In 2019 IEEE Conf. Games 1\u20138 (IEEE, 2019).","DOI":"10.1109\/CIG.2019.8848053"},{"key":"208_CR44","doi-asserted-by":"publisher","first-page":"503","DOI":"10.1038\/nature14422","volume":"521","author":"A Cully","year":"2015","unstructured":"Cully, A., Clune, J., Tarapore, D. & Mouret, J.-B. Robots that can adapt like animals. Nature 521, 503\u2013507 (2015).","journal-title":"Nature"},{"key":"208_CR45","doi-asserted-by":"crossref","unstructured":"Khalifa, A., Green, M. C., Barros, G. & Togelius, J. Intentional computational level design. In Proc. Genetic and Evolutionary Computation Conf. 796\u2013803 (ACM, 2019).","DOI":"10.1145\/3321707.3321849"},{"key":"208_CR46","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1109\/TCIAIG.2011.2159716","volume":"3","author":"M Mateas","year":"2011","unstructured":"Mateas, M., Smith, G. & Whitehead, J. Tanagra: reactive planning and constraint solving for mixed-initiative level design. IEEE Trans. Comput. Intell. AI Games 3, 201\u2013215 (2011).","journal-title":"IEEE Trans. Comput. Intell. AI Games"},{"key":"208_CR47","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1109\/TCIAIG.2011.2158545","volume":"3","author":"AM Smith","year":"2011","unstructured":"Smith, A. M. & Mateas, M. Answer set programming for procedural content generation: a design space approach. IEEE Trans. Comput. Intell. AI Games 3, 187\u2013200 (2011).","journal-title":"IEEE Trans. Comput. Intell. AI Games"},{"key":"208_CR48","unstructured":"Goodfellow, I. et al. Generative adversarial nets. In Advances in Neural Information Processing Systems 2672\u20132680 (NeurIPS, 2014)."},{"key":"208_CR49","unstructured":"Summerville, A. J. & Mateas, M. Mystical tutor: a magic: the gathering design assistant via denoising sequence-to-sequence learning. In Twelfth AAAI Conf. Artificial Intelligence and Interactive Digital Entertainment (AAAI, 2016)."},{"key":"208_CR50","unstructured":"Snodgrass, S. & Ontan\u00f3n, S. Controllable procedural content generation via constrained multi-dimensional markov chain sampling. In Proc. Twenty-Fifth Int. Joint Conf. Artificial Intelligence 780\u2013786 (ICJAI, 2016)."},{"key":"208_CR51","doi-asserted-by":"crossref","unstructured":"Bontrager, P., Roy, A., Togelius, J., Memon, N. & Ross, A. Deepmasterprints: generating masterprints for dictionary attacks via latent variable evolution. In IEEE 9th Int. Conf. Biometrics Theory, Applications and Systems 1\u20139 (IEEE, 2018).","DOI":"10.1109\/BTAS.2018.8698539"},{"key":"208_CR52","doi-asserted-by":"crossref","unstructured":"Volz, V. et al. Evolving mario levels in the latent space of a deep convolutional generative adversarial network. In Proc. Genetic and Evolutionary Computation Conf. 221\u2013228 (ACM, 2018).","DOI":"10.1145\/3205455.3205517"},{"key":"208_CR53","unstructured":"Bontrager, B. & Togelius, J. Fully differentiable procedural content generation through generative playing networks. Preprint at https:\/\/arxiv.org\/abs\/2002.05259 (2020)."},{"key":"208_CR54","doi-asserted-by":"crossref","unstructured":"Khalifa, A., Bontrager, P., Earle, S. & Togelius, J. PCGRL: procedural content generation via reinforcement learning. Preprint at https:\/\/arxiv.org\/abs\/2001.09212 (2020).","DOI":"10.1609\/aiide.v16i1.7416"},{"key":"208_CR55","doi-asserted-by":"crossref","unstructured":"Brant, J. C. & Stanley, K. O. Minimal criterion coevolution: a new approach to open-ended search. In Proc. Genetic and Evolutionary Computation Conf. 67\u201374 (ACM, 2017).","DOI":"10.1145\/3071178.3071186"},{"key":"208_CR56","unstructured":"Wang, R., Lehman, J., Clune, J. & Stanley, K. O. Paired open-ended trailblazer (poet): endlessly generating increasingly complex and diverse learning environments and their solutions. In Proc. Genetic and Evolutionary Computation Conf. 142\u2013151 (ACM, 2019)."},{"key":"208_CR57","unstructured":"Zhang, C., Vinyals, O., Munos, R. & Bengio, S. A study on overfitting in deep reinforcement learning. Preprint at https:\/\/arxiv.org\/abs\/1804.06893 (2018)."},{"key":"208_CR58","unstructured":"Ruderman, A. et al. Uncovering surprising behaviors in reinforcement learning via worst-case analysis. In Safe Machine Learning Workshop at ICLR (ICLR, 2019)."},{"key":"208_CR59","unstructured":"Klimov, O. CarRacing-v0. OpenAI https:\/\/gym.openai.com\/envs\/CarRacing-v0\/ (2016)."},{"key":"208_CR60","unstructured":"Ha, D. & Schmidhuber, J. Recurrent world models facilitate policy evolution. In Advances in Neural Information Processing Systems 2450\u20132462 (NeurIPS, 2018)."},{"key":"208_CR61","unstructured":"Ha, D. Evolving stable strategies. Otoro http:\/\/blog.otoro.net\/2017\/11\/12\/evolving-stable-strategies\/ (2017)."},{"key":"208_CR62","doi-asserted-by":"crossref","unstructured":"Lukasiewicz, T., Song, Y., Wu, L. & Xu, Z. Arena: a general evaluation platform and building toolkit for multi-agent intelligence. In Proc. 34th National Conf. Artificial Intelligence (AAAI, 2020).","DOI":"10.1609\/aaai.v34i05.6216"},{"key":"208_CR63","doi-asserted-by":"crossref","unstructured":"Harries, L., Lee, S., Rzepecki, J., Hofmann, K. & Devlin, S. Mazeexplorer: a customisable 3D benchmark for assessing generalisation in reinforcement learning. In 2019 IEEE Conf. Games 1\u20134 (IEEE, 2019).","DOI":"10.1109\/CIG.2019.8848048"},{"key":"208_CR64","unstructured":"Cobbe, K., Klimov, O., Hesse, C., Kim, T. & Schulman, J. Quantifying generalization in reinforcement learning. In Proc. Int. Conf. Machine Learning 1282\u20131289 (ICML, 2019)."},{"key":"208_CR65","unstructured":"Cobbe, K., Hesse, C., Hilton, J. & Schulman, J. Leveraging procedural generation to benchmark reinforcement learning. Preprint at https:\/\/arxiv.org\/abs\/1912.01588 (2019)."},{"key":"208_CR66","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1177\/0278364919887447","volume":"39","author":"OM Andrychowicz","year":"2020","unstructured":"Andrychowicz, O. M. et al. Learning dexterous in-hand manipulation. Int. J. Robot. Res. 39, 3\u201320 (2020).","journal-title":"Int. J. Robot. Res."},{"key":"208_CR67","unstructured":"Clune, J. AI-GAs: AI-generating algorithms, an alternate paradigm for producing general artificial intelligence. Preprint at https:\/\/arxiv.org\/abs\/1905.10985 (2019)."},{"key":"208_CR68","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436\u2013444 (2015).","journal-title":"Nature"},{"key":"208_CR69","doi-asserted-by":"crossref","unstructured":"Nelson, M. J. & Mateas, M. Towards automated game design. In Congress of the Italian Association for Artificial Intelligence 626\u2013637 (Springer, 2007).","DOI":"10.1007\/978-3-540-74782-6_54"},{"key":"208_CR70","doi-asserted-by":"crossref","unstructured":"Font, J. M., Mahlmann, T., Manrique, D. & Togelius, J. A card game description language. In European Conf. Applications of Evolutionary Computation 254\u2013263 (Springer, 2013).","DOI":"10.1007\/978-3-642-37192-9_26"},{"key":"208_CR71","doi-asserted-by":"crossref","unstructured":"Fan, A. et al. Generating interactive worlds with text. In Proc. AAAI Conf. Artificial Intelligence 1693\u20131700 (AAAI, 2020).","DOI":"10.1609\/aaai.v34i02.5532"},{"key":"208_CR72","unstructured":"Friberger, M. G. et al. Data games. In Proc. Fourth Workshop on Procedural Content Generation in Games (ACM, 2013)."},{"key":"208_CR73","unstructured":"Barros, G. A. B., Liapis, A. & Togelius, J. Playing with data: procedural generation of adventures from open data. In Proc. First International Joint Conf. DiGRA and FDG (DiGRA, 2016)."},{"key":"208_CR74","unstructured":"Walton, N. AI Dungeon 2 https:\/\/aidungeon.io\/ (2019)."},{"key":"208_CR75","first-page":"9","volume":"1","author":"A Radford","year":"2019","unstructured":"Radford, A. et al. Language models are unsupervised multitask learners. OpenAI Blog 1, 9 (2019).","journal-title":"OpenAI Blog"},{"key":"208_CR76","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1016\/0921-8890(95)00004-Y","volume":"15","author":"S Thrun","year":"1995","unstructured":"Thrun, S. & Mitchell, T. M. Lifelong robot learning. Robot. Autonom. Sys. 15, 25\u201346 (1995).","journal-title":"Robot. Autonom. Sys."},{"key":"208_CR77","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1016\/j.neunet.2019.01.012","volume":"113","author":"GI Parisi","year":"2019","unstructured":"Parisi, G. I., Kemker, R., Part, J. L., Kanan, C. & Wermter, S. Continual lifelong learning with neural networks: a review. Neural Netw. 113, 54\u201371 (2019).","journal-title":"Neural Netw."},{"key":"208_CR78","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1016\/j.neunet.2018.07.013","volume":"108","author":"A Soltoggio","year":"2018","unstructured":"Soltoggio, A., Stanley, K. O. & Risi, S. Born to learn: the inspiration, progress, and future of evolved plastic artificial neural networks. Neural Netw. 108, 48\u201367 (2018).","journal-title":"Neural Netw."},{"key":"208_CR79","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1162\/artl.1993.1.1_2.179","volume":"1","author":"TS Ra","year":"1993","unstructured":"Ra, T. S. An evolutionary approach to synthetic biology: Zen and the art of creating life. Artif. Life 1, 179\u2013209 (1993).","journal-title":"Artif. Life"},{"key":"208_CR80","unstructured":"Adami, C., Brown, C. T. & Kellogg, W. in Artificial Life IV (Brooks, R. A. & Maes, P.) 377\u2013381 (MIT Press, 1994)."},{"key":"208_CR81","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1109\/TG.2019.2901021","volume":"11","author":"D Perez-Liebana","year":"2019","unstructured":"Perez-Liebana, D. et al. General video game AI: a multi-track framework for evaluating agents, games and content generation algorithms. IEEE Trans. Games 11, 195\u2013214 (2019).","journal-title":"IEEE Trans. Games"},{"key":"208_CR82","doi-asserted-by":"crossref","unstructured":"Juliani, A. et al. Obstacle tower: a generalization challenge in vision, control, and planning. https:\/\/arxiv.org\/abs\/1902.01378 (2019).","DOI":"10.24963\/ijcai.2019\/373"},{"key":"208_CR83","doi-asserted-by":"crossref","unstructured":"Johansen, M., Pichlmair, M. & Risi, S. Video game description language environment for unity machine learning agents. In 2019 IEEE Conf. Games 1\u20138 (IEEE, 2019).","DOI":"10.1109\/CIG.2019.8848072"},{"key":"208_CR84","unstructured":"Nichol, A., Pfau, V., Hesse, C., Klimov, O. & Schulman, J. Gotta learn fast: a new benchmark for generalization in RL. Preprint at https:\/\/arxiv.org\/abs\/1804.03720 (2018)."},{"key":"208_CR85","unstructured":"Leibo, J. Z. et al. Psychlab: a psychology laboratory for deep reinforcement learning agents. Preprint at https:\/\/arxiv.org\/abs\/1801.08116 (2018)."},{"key":"208_CR86","unstructured":"Beyret, B. et al. The animal-AI environment: training and testing animal-like artificial cognition Preprint at https:\/\/arxiv.org\/abs\/1909.07483 (2019)."},{"key":"208_CR87","unstructured":"Ruiz, N., Schulter, S. & Chandraker, M. Learning to simulate. In Proc. Int. Conf. Learning Representations (ICLR, 2019)."},{"key":"208_CR88","doi-asserted-by":"crossref","unstructured":"Kar, A. et al. Meta-sim: learning to generate synthetic datasets. In Proc. Int. Conf. Computer Vision 4550\u20134559 (ICCV, 2019).","DOI":"10.1109\/ICCV.2019.00465"},{"key":"208_CR89","doi-asserted-by":"crossref","unstructured":"Bayer, J., Wierstra, D., Togelius, J. & Schmidhuber, J. Evolving memory cell structures for sequence learning. In Int. Conf. Artificial Neural Networks 755\u2013764 (Springer, 2009).","DOI":"10.1007\/978-3-642-04277-5_76"},{"key":"208_CR90","first-page":"55","volume":"20","author":"T Elsken","year":"2019","unstructured":"Elsken, T., Metzen, J. H. & Hutter, F. Neural architecture search: a survey. J. Mach. Learn. Res. 20, 55 (2019).","journal-title":"J. Mach. Learn. Res."},{"key":"208_CR91","unstructured":"Such, F. P., Rawal, A., Lehman, J., Stanley, K. O. & Clune, J. Generative teaching networks: accelerating neural architecture search by learning to generate synthetic training data. In Proc. Int. Conf. Machine Learning (ICML, 2020)."},{"key":"208_CR92","doi-asserted-by":"crossref","unstructured":"Togelius, J., De Nardi, R. & Lucas, S. M. Towards automatic personalised content creation for racing games. In IEEE Symp. Computational Intelligence and Games 252\u2013259 (IEEE, 2007).","DOI":"10.1109\/CIG.2007.368106"},{"key":"208_CR93","unstructured":"Summerville, A. & Mateas, M. Super mario as a string: Platformer level generation via LSTMs. In Proc. DiGRA\/FDG Joint Conf. (AAAI, 2016)."},{"key":"208_CR94","doi-asserted-by":"crossref","unstructured":"Bontrager, P., Lin, W., Togelius, J. & Risi, S. Deep interactive evolution. In Int. Conf. Computational Intelligence in Music, Sound, Art and Design 267\u2013282 (Springer, 2018).","DOI":"10.1007\/978-3-319-77583-8_18"},{"key":"208_CR95","doi-asserted-by":"crossref","unstructured":"Zaltron, N., Zurlo, L. & Risi, S. CG-GAN: an interactive evolutionary GAN-based approach for facial composite generation. In Thirty-Fourth AAAI Conf. Artificial Intelligence (AAAI, 2020).","DOI":"10.1609\/aaai.v34i03.5637"},{"key":"208_CR96","doi-asserted-by":"publisher","unstructured":"Karavolos, D., Liapis, A. & Yannakakis, G. N. A multi-faceted surrogate model for search-based procedural content generation. IEEE Trans. Games https:\/\/doi.org\/10.1109\/TG.2019.2931044 (2019).","DOI":"10.1109\/TG.2019.2931044"}],"container-title":["Nature Machine Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s42256-020-0208-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s42256-020-0208-z","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s42256-020-0208-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,7]],"date-time":"2022-12-07T03:51:36Z","timestamp":1670385096000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s42256-020-0208-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,3]]},"references-count":96,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2020,8]]}},"alternative-id":["208"],"URL":"https:\/\/doi.org\/10.1038\/s42256-020-0208-z","relation":{},"ISSN":["2522-5839"],"issn-type":[{"value":"2522-5839","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,3]]},"assertion":[{"value":"30 November 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 June 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 August 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare a potential financial conflict of interest as co-founders of modl.ai ApS.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}