{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T11:07:39Z","timestamp":1777028859935,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":46,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,7,13]],"date-time":"2019-07-13T00:00:00Z","timestamp":1562976000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,7,13]]},"DOI":"10.1145\/3321707.3321876","type":"proceedings-article","created":{"date-parts":[[2019,7,3]],"date-time":"2019-07-03T13:48:04Z","timestamp":1562161684000},"page":"107-115","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Evolvability ES"],"prefix":"10.1145","author":[{"given":"Alexander","family":"Gajewski","sequence":"first","affiliation":[{"name":"Columbia University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeff","family":"Clune","sequence":"additional","affiliation":[{"name":"University of Wyoming"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kenneth O.","family":"Stanley","sequence":"additional","affiliation":[{"name":"Uber AI Labs"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joel","family":"Lehman","sequence":"additional","affiliation":[{"name":"Uber AI Labs"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,7,13]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"TensorFlow: Large-scale machine learning on heterogeneous systems","author":"Abadi Mart\u00edn","year":"2015","unstructured":"Mart\u00edn Abadi , Ashish Agarwal , Paul Barham , Eugene Brevdo , Zhifeng Chen , Craig Citro , Greg S. Corrado , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Ian Goodfellow , Andrew Harp , Geoffrey Irving , Michael Isard , Yangqing Jia , Rafal Jozefowicz , Lukasz Kaiser , Manjunath Kudlur , Josh Levenberg , Dan Man\u00e9 , Rajat Monga , Sherry Moore , Derek Murray , Chris Olah , Mike Schuster , Jonathon Shlens , Benoit Steiner , Ilya Sutskever , Kunal Talwar , Paul Tucker , Vincent Vanhoucke , Vijay Vasudevan , Fernanda Vi\u00e9gas , Oriol Vinyals , Pete Warden , Martin Wattenberg , Martin Wicke , Yuan Yu , and Xiaoqiang Zheng . TensorFlow: Large-scale machine learning on heterogeneous systems , 2015 . URL http:\/\/tensorflow.org\/. Software available from tensorflow.org. Mart\u00edn Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dan Man\u00e9, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Vi\u00e9gas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. TensorFlow: Large-scale machine learning on heterogeneous systems, 2015. URL http:\/\/tensorflow.org\/. Software available from tensorflow.org."},{"key":"e_1_3_2_2_2_1","volume-title":"The evolution of evolvability in genetic programming. Advances in genetic programming, 3:47--74","author":"Lee Altenberg","year":"1994","unstructured":"Lee Altenberg et al. The evolution of evolvability in genetic programming. Advances in genetic programming, 3:47--74 , 1994 . Lee Altenberg et al. The evolution of evolvability in genetic programming. Advances in genetic programming, 3:47--74, 1994."},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1015059928466"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0960-9822(01)00041-0"},{"key":"e_1_3_2_2_5_1","volume-title":"Back to basics: Benchmarking canonical evolution strategies for playing atari. arXiv preprint arXiv:1802.08842","author":"Chrabaszcz Patryk","year":"2018","unstructured":"Patryk Chrabaszcz , Ilya Loshchilov , and Frank Hutter . Back to basics: Benchmarking canonical evolution strategies for playing atari. arXiv preprint arXiv:1802.08842 , 2018 . Patryk Chrabaszcz, Ilya Loshchilov, and Frank Hutter. Back to basics: Benchmarking canonical evolution strategies for playing atari. arXiv preprint arXiv:1802.08842, 2018."},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1098\/rspb.2012.2863"},{"key":"e_1_3_2_2_7_1","unstructured":"Edoardo Conti Vashisht Madhavan Felipe Petroski Such Joel Lehman Kenneth Stanley and Jeff Clune. Improving exploration in evolution strategies for deep reinforcement learning via a population of novelty-seeking agents. In Advances in Neural Information Processing Systems 31. 2018.   Edoardo Conti Vashisht Madhavan Felipe Petroski Such Joel Lehman Kenneth Stanley and Jeff Clune. Improving exploration in evolution strategies for deep reinforcement learning via a population of novelty-seeking agents. In Advances in Neural Information Processing Systems 31. 2018."},{"key":"e_1_3_2_2_8_1","volume-title":"a python module for physics simulation for games, robotics and machine learning. GitHub repository","author":"Coumans E","year":"2016","unstructured":"E Coumans and Y Bai . Pybullet , a python module for physics simulation for games, robotics and machine learning. GitHub repository , 2016 . E Coumans and Y Bai. Pybullet, a python module for physics simulation for games, robotics and machine learning. GitHub repository, 2016."},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/2008402.2008430"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/cplx.10021"},{"key":"e_1_3_2_2_11_1","volume-title":"Model-agnostic meta-learning for fast adaptation of deep networks. arXiv preprint arXiv:1703.03400","author":"Finn Chelsea","year":"2017","unstructured":"Chelsea Finn , Pieter Abbeel , and Sergey Levine . Model-agnostic meta-learning for fast adaptation of deep networks. arXiv preprint arXiv:1703.03400 , 2017 . Chelsea Finn, Pieter Abbeel, and Sergey Levine. Model-agnostic meta-learning for fast adaptation of deep networks. arXiv preprint arXiv:1703.03400, 2017."},{"key":"e_1_3_2_2_12_1","volume-title":"Proc. of The Fourth International Conference on Simulation of Adaptive Behavior (SAB), From Animals to Animats. ETH Z\u00fcrich","author":"Floreano Dario","year":"1996","unstructured":"Dario Floreano and Francesco Mondada . Evolution of plastic neurocontrollers for situated agents . In Proc. of The Fourth International Conference on Simulation of Adaptive Behavior (SAB), From Animals to Animats. ETH Z\u00fcrich , 1996 . Dario Floreano and Francesco Mondada. Evolution of plastic neurocontrollers for situated agents. In Proc. of The Fourth International Conference on Simulation of Adaptive Behavior (SAB), From Animals to Animats. ETH Z\u00fcrich, 1996."},{"key":"e_1_3_2_2_13_1","volume-title":"Bilal Piot, Jacob Menick, Ian Osband, Alex Graves, Vlad Mnih, R\u00e9mi Munos, Demis Hassabis, Olivier Pietquin, Charles Blundell, and Shane Legg. Noisy networks for exploration. CoRR, abs\/1706.10295","author":"Fortunato Meire","year":"2017","unstructured":"Meire Fortunato , Mohammad Gheshlaghi Azar , Bilal Piot, Jacob Menick, Ian Osband, Alex Graves, Vlad Mnih, R\u00e9mi Munos, Demis Hassabis, Olivier Pietquin, Charles Blundell, and Shane Legg. Noisy networks for exploration. CoRR, abs\/1706.10295 , 2017 . URL http:\/\/arxiv.org\/abs\/1706.10295. Meire Fortunato, Mohammad Gheshlaghi Azar, Bilal Piot, Jacob Menick, Ian Osband, Alex Graves, Vlad Mnih, R\u00e9mi Munos, Demis Hassabis, Olivier Pietquin, Charles Blundell, and Shane Legg. Noisy networks for exploration. CoRR, abs\/1706.10295, 2017. URL http:\/\/arxiv.org\/abs\/1706.10295."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Michael C. Fu. Chapter 19 gradient estimation. Simulation Handbooks in Operations Research and Management Science 13:575 2006.  Michael C. Fu. Chapter 19 gradient estimation. Simulation Handbooks in Operations Research and Management Science 13:575 2006.","DOI":"10.1016\/S0927-0507(06)13019-4"},{"key":"e_1_3_2_2_15_1","volume-title":"Evolutionary Computation, 1999. CEC 99. Proceedings of the 1999 Congress on","volume":"3","author":"Grefenstette J.J.","year":"2002","unstructured":"J.J. Grefenstette . Evolvability in dynamic fitness landscapes: A genetic algorithm approach . In Evolutionary Computation, 1999. CEC 99. Proceedings of the 1999 Congress on , volume 3 . IEEE, 2002 . ISBN 0780355369. J.J. Grefenstette. Evolvability in dynamic fitness landscapes: A genetic algorithm approach. In Evolutionary Computation, 1999. CEC 99. Proceedings of the 1999 Congress on, volume 3. IEEE, 2002. ISBN 0780355369."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/646258.684281"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0611630104"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.95.15.8420"},{"key":"e_1_3_2_2_19_1","volume-title":"Resolving the paradox of evolvability with learning theory: How evolution learns to improve evolvability on rugged fitness landscapes. arXiv preprint arXiv:1612.05955","author":"Kounios Loizos","year":"2016","unstructured":"Loizos Kounios , Jeff Clune , Kostas Kouvaris , G\u00fcnter P Wagner , Mihaela Pavlicev , Daniel M Weinreich , and Richard A Watson . Resolving the paradox of evolvability with learning theory: How evolution learns to improve evolvability on rugged fitness landscapes. arXiv preprint arXiv:1612.05955 , 2016 . Loizos Kounios, Jeff Clune, Kostas Kouvaris, G\u00fcnter P Wagner, Mihaela Pavlicev, Daniel M Weinreich, and Richard A Watson. Resolving the paradox of evolvability with learning theory: How evolution learns to improve evolvability on rugged fitness landscapes. arXiv preprint arXiv:1612.05955, 2016."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1162\/EVCO_a_00025"},{"key":"e_1_3_2_2_21_1","first-page":"2693","volume-title":"IEEE Congress on Evolutionary Computation","author":"Lehman Joel","year":"2011","unstructured":"Joel Lehman and Kenneth O Stanley . Improving evolvability through novelty search and self-adaptation . In IEEE Congress on Evolutionary Computation , pages 2693 -- 2700 , 2011 . Joel Lehman and Kenneth O Stanley. Improving evolvability through novelty search and self-adaptation. In IEEE Congress on Evolutionary Computation, pages 2693--2700, 2011."},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2001576.2001606"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0062186"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1162\/isal_a_00104"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-statistics-031017-100325"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2908812.2908838"},{"key":"e_1_3_2_2_27_1","volume-title":"Differentiable plasticity: training plastic neural networks with backpropagation. arXiv preprint arXiv:1804.02464","author":"Miconi Thomas","year":"2018","unstructured":"Thomas Miconi , Jeff Clune , and Kenneth O Stanley . Differentiable plasticity: training plastic neural networks with backpropagation. arXiv preprint arXiv:1804.02464 , 2018 . Thomas Miconi, Jeff Clune, and Kenneth O Stanley. Differentiable plasticity: training plastic neural networks with backpropagation. arXiv preprint arXiv:1804.02464, 2018."},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2739480.2754703"},{"key":"e_1_3_2_2_30_1","volume-title":"NIPS-W","author":"Paszke Adam","year":"2017","unstructured":"Adam Paszke , Sam Gross , Soumith Chintala , Gregory Chanan , Edward Yang , Zachary DeVito , Zeming Lin , Alban Desmaison , Luca Antiga , and Adam Lerer . Automatic differentiation in PyTorch . In NIPS-W , 2017 . Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. Automatic differentiation in PyTorch. In NIPS-W, 2017."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrg2278"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2016.00040"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1102256.1102315"},{"key":"e_1_3_2_2_34_1","volume-title":"Evolution strategies as a scalable alternative to reinforcement learning. arXiv preprint arXiv:1703.03864","author":"Salimans Tim","year":"2017","unstructured":"Tim Salimans , Jonathan Ho , Xi Chen , Szymon Sidor , and Ilya Sutskever . Evolution strategies as a scalable alternative to reinforcement learning. arXiv preprint arXiv:1703.03864 , 2017 . Tim Salimans, Jonathan Ho, Xi Chen, Szymon Sidor, and Ilya Sutskever. Evolution strategies as a scalable alternative to reinforcement learning. arXiv preprint arXiv:1703.03864, 2017."},{"key":"e_1_3_2_2_35_1","volume-title":"Gradient estimation using stochastic computation graphs. CoRR, abs\/1506.05254","author":"Schulman John","year":"2015","unstructured":"John Schulman , Nicolas Heess , Theophane Weber , and Pieter Abbeel . Gradient estimation using stochastic computation graphs. CoRR, abs\/1506.05254 , 2015 . URL http:\/\/arxiv.org\/abs\/1506.05254. John Schulman, Nicolas Heess, Theophane Weber, and Pieter Abbeel. Gradient estimation using stochastic computation graphs. CoRR, abs\/1506.05254, 2015. URL http:\/\/arxiv.org\/abs\/1506.05254."},{"key":"e_1_3_2_2_36_1","volume-title":"Evolution and optimum seeking: the sixth generation","author":"Paul Schwefel Hans-Paul","year":"1993","unstructured":"Hans-Paul Paul Schwefel . Evolution and optimum seeking: the sixth generation . John Wiley & Sons, Inc. , 1993 . Hans-Paul Paul Schwefel. Evolution and optimum seeking: the sixth generation. John Wiley & Sons, Inc., 1993."},{"key":"e_1_3_2_2_37_1","first-page":"569","volume-title":"Proceedings of the 11th international conference on artificial life (Alife XI), number LIS-CONF-2008-012","author":"Soltoggio Andrea","year":"2008","unstructured":"Andrea Soltoggio , John A Bullinaria , Claudio Mattiussi , Peter D\u00fcrr , and Dario Floreano . Evolutionary advantages of neuromodulated plasticity in dynamic, reward-based scenarios . In Proceedings of the 11th international conference on artificial life (Alife XI), number LIS-CONF-2008-012 , pages 569 -- 576 . MIT Press , 2008 . Andrea Soltoggio, John A Bullinaria, Claudio Mattiussi, Peter D\u00fcrr, and Dario Floreano. Evolutionary advantages of neuromodulated plasticity in dynamic, reward-based scenarios. In Proceedings of the 11th international conference on artificial life (Alife XI), number LIS-CONF-2008-012, pages 569--576. MIT Press, 2008."},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1162\/106365602320169811"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2003.1299410"},{"key":"e_1_3_2_2_40_1","volume-title":"Deep neuroevolution: genetic algorithms are a competitive alternative for training deep neural networks for reinforcement learning. arXiv preprint arXiv:1712.06567","author":"Such Felipe Petroski","year":"2017","unstructured":"Felipe Petroski Such , Vashisht Madhavan , Edoardo Conti , Joel Lehman , Kenneth O Stanley , and Jeff Clune . Deep neuroevolution: genetic algorithms are a competitive alternative for training deep neural networks for reinforcement learning. arXiv preprint arXiv:1712.06567 , 2017 . Felipe Petroski Such, Vashisht Madhavan, Edoardo Conti, Joel Lehman, Kenneth O Stanley, and Jeff Clune. Deep neuroevolution: genetic algorithms are a competitive alternative for training deep neural networks for reinforcement learning. arXiv preprint arXiv:1712.06567, 2017."},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2012.6386109"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1019956318069"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1558-5646.1996.tb02339.x"},{"key":"e_1_3_2_2_44_1","volume-title":"Learning to reinforcement learn. arXiv preprint arXiv:1611.05763","author":"Wang Jane X","year":"2016","unstructured":"Jane X Wang , Zeb Kurth-Nelson , Dhruva Tirumala , Hubert Soyer , Joel Z Leibo , Remi Munos , Charles Blundell , Dharshan Kumaran , and Matt Botvinick . Learning to reinforcement learn. arXiv preprint arXiv:1611.05763 , 2016 . Jane X Wang, Zeb Kurth-Nelson, Dhruva Tirumala, Hubert Soyer, Joel Z Leibo, Remi Munos, Charles Blundell, Dharshan Kumaran, and Matt Botvinick. Learning to reinforcement learn. arXiv preprint arXiv:1611.05763, 2016."},{"key":"e_1_3_2_2_45_1","volume-title":"Natural evolution strategies","author":"Wierstra Daan","year":"2011","unstructured":"Daan Wierstra , Tom Schaul , Tobias Glasmachers , Yi Sun , and J\u00c3ijrgen Schmidhuber . Natural evolution strategies , 2011 . Daan Wierstra, Tom Schaul, Tobias Glasmachers, Yi Sun, and J\u00c3ijrgen Schmidhuber. Natural evolution strategies, 2011."},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1177\/1059712315584166"}],"event":{"name":"GECCO '19: Genetic and Evolutionary Computation Conference","location":"Prague Czech Republic","acronym":"GECCO '19","sponsor":["SIGEVO ACM Special Interest Group on Genetic and Evolutionary Computation"]},"container-title":["Proceedings of the Genetic and Evolutionary Computation Conference"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3321707.3321876","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3321707.3321876","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:25:29Z","timestamp":1750206329000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3321707.3321876"}},"subtitle":["scalable and direct optimization of evolvability"],"short-title":[],"issued":{"date-parts":[[2019,7,13]]},"references-count":46,"alternative-id":["10.1145\/3321707.3321876","10.1145\/3321707"],"URL":"https:\/\/doi.org\/10.1145\/3321707.3321876","relation":{},"subject":[],"published":{"date-parts":[[2019,7,13]]},"assertion":[{"value":"2019-07-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}