{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:10:33Z","timestamp":1760238633662,"version":"build-2065373602"},"reference-count":26,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2020,8,31]],"date-time":"2020-08-31T00:00:00Z","timestamp":1598832000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["SFB1310"],"award-info":[{"award-number":["SFB1310"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004189","name":"Max-Planck-Gesellschaft","doi-asserted-by":"publisher","award":["MPRG funding"],"award-info":[{"award-number":["MPRG funding"]}],"id":[{"id":"10.13039\/501100004189","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Evolutionary algorithms, inspired by natural evolution, aim to optimize difficult objective functions without computing derivatives. Here we detail the relationship between classical population genetics of quantitative traits and evolutionary optimization, and formulate a new evolutionary algorithm. Optimization of a continuous objective function is analogous to searching for high fitness phenotypes on a fitness landscape. We describe how natural selection moves a population along the non-Euclidean gradient that is induced by the population on the fitness landscape (the natural gradient). We show how selection is related to Newton\u2019s method in optimization under quadratic fitness landscapes, and how selection increases fitness at the cost of reducing diversity. We describe the generation of new phenotypes and introduce an operator that recombines the whole population to generate variants. Finally, we introduce a proof-of-principle algorithm that combines natural selection, our recombination operator, and an adaptive method to increase selection and find the optimum. The algorithm is extremely simple in implementation; it has no matrix inversion or factorization, does not require storing a covariance matrix, and may form the basis of more general model-based optimization algorithms with natural gradient updates.<\/jats:p>","DOI":"10.3390\/e22090967","type":"journal-article","created":{"date-parts":[[2020,8,31]],"date-time":"2020-08-31T11:53:49Z","timestamp":1598874829000},"page":"967","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Information-Geometric Optimization with Natural Selection"],"prefix":"10.3390","volume":"22","author":[{"given":"Jakub","family":"Otwinowski","sequence":"first","affiliation":[{"name":"Max Planck Institute for Dynamics and Self-Organization, 37077 G\u00f6ttingen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Colin H.","family":"LaMont","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Dynamics and Self-Organization, 37077 G\u00f6ttingen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Armita","family":"Nourmohammad","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Dynamics and Self-Organization, 37077 G\u00f6ttingen, Germany"},{"name":"Physics Department, University of Washington, Seattle, WA 98195, USA"},{"name":"Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,31]]},"reference":[{"key":"ref_1","unstructured":"Simon, D. (2013). Evolutionary Optimization Algorithms, John Wiley & Sons."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Gillespie, J.H. (2004). Population Genetics: A Concise Guide, JHU Press.","DOI":"10.56021\/9780801880087"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/j.swevo.2011.08.003","article-title":"An Introduction and Survey of Estimation of Distribution Algorithms","volume":"1","author":"Hauschild","year":"2011","journal-title":"Swarm Evolut. Comput."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Mart\u00ed, R., Panos, P., and Resende, M.G.C. (2018). Evolution Strategies. Handbook of Heuristics, Springer International Publishing.","DOI":"10.1007\/978-3-319-07124-4"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Li, Z., Lin, X., Zhang, Q., and Liu, H. (2020). Evolution Strategies for Continuous Optimization: A Survey of the State-of-the-Art. Swarm Evolut. Comput., 100694.","DOI":"10.1016\/j.swevo.2020.100694"},{"key":"ref_6","unstructured":"Amari, S., and Douglas, S.C. (1998, January 15). Why Natural Gradient?. Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, Seattle, WA, USA."},{"key":"ref_7","unstructured":"Hansen, N., and Ostermeier, A. (1996, January 20\u201322). Adapting Arbitrary Normal Mutation Distributions in Evolution Strategies: The Covariance Matrix Adaptation. Proceedings of the IEEE International Conference on Evolutionary Computation, Nagoya, Japan."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Lozano, J.A., Larra\u00f1aga, P., Inza, I., and Bengoetxea, E. (2006). The CMA Evolution Strategy: A Comparing Review. Towards a New Evolutionary Computation: Advances in the Estimation of Distribution Algorithms, Springer. Studies in Fuzziness and Soft Computing.","DOI":"10.1007\/3-540-32494-1"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wierstra, D., Schaul, T., Peters, J., and Schmidhuber, J. (2008, January 1\u20136). Natural Evolution Strategies. Proceedings of the 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence), Hong Kong, China.","DOI":"10.1109\/CEC.2008.4631255"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Sun, Y., Wierstra, D., Schaul, T., and Schmidhuber, J. (2009, January 12\u201314). Efficient Natural Evolution Strategies. Proceedings of the 11th Annual Conference on Genetic and Evolutionary Computation GECCO\u201909, Shanghai, China.","DOI":"10.1145\/1569901.1569976"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Glasmachers, T., Schaul, T., Yi, S., Wierstra, D., and Schmidhuber, J. (2010, January 7\u201311). Exponential Natural Evolution Strategies. Proceedings of the 12th Annual Conference on Genetic and Evolutionary Computation GECCO\u201910, Portland, OR, USA.","DOI":"10.1145\/1830483.1830557"},{"key":"ref_12","first-page":"949","article-title":"Natural Evolution Strategies","volume":"15","author":"Wierstra","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_13","unstructured":"Ollivier, Y., Arnold, L., Auger, A., and Hansen, N. (2011). Information-Geometric Optimization Algorithms: A Unifying Picture via Invariance Principles. arXiv, Available online: https:\/\/arxiv.org\/abs\/1106.3708."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Fisher, R. (1930). The Genetical Theory of Natural Selection, Clarendon Press.","DOI":"10.5962\/bhl.title.27468"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Amari, S.I. (2016). Information Geometry and Its Applications, Springer.","DOI":"10.1007\/978-4-431-55978-8"},{"key":"ref_16","unstructured":"Harper, M. (2009). Information Geometry and Evolutionary Game Theory. arXiv, Available online: https:\/\/arxiv.org\/abs\/0911.1383."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4248","DOI":"10.1073\/pnas.0907953107","article-title":"Fitness Flux and Ubiquity of Adaptive Evolution","volume":"107","author":"Mustonen","year":"2010","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_18","first-page":"402","article-title":"Quantitative Genetic Analysis of Multivariate Evolution, Applied to Brain: Body Size Allometry","volume":"33","author":"Lande","year":"1979","journal-title":"Evolution"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"P01012","DOI":"10.1088\/1742-5468\/2013\/01\/P01012","article-title":"Evolution of Molecular Phenotypes under Stabilizing Selection","volume":"2013","author":"Nourmohammad","year":"2013","journal-title":"J. Stat. Mech."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1126\/science.220.4598.671","article-title":"Optimization by Simulated Annealing","volume":"220","author":"Kirkpatrick","year":"1983","journal-title":"Science"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"033301","DOI":"10.1103\/PhysRevE.97.033301","article-title":"Analysis and Optimization of Population Annealing","volume":"97","author":"Amey","year":"2018","journal-title":"Phys. Rev. E"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1093\/genetics\/94.1.203","article-title":"The Genetic Covariance Between Characters Maintained by Pleiotropic Mutations","volume":"94","author":"Lande","year":"1980","journal-title":"Genetics"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1283","DOI":"10.1103\/RevModPhys.83.1283","article-title":"Statistical Genetics and Evolution of Quantitative Traits","volume":"83","author":"Neher","year":"2011","journal-title":"Rev. Mod. Phys."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1023\/A:1008202821328","article-title":"Differential Evolution\u2014A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces","volume":"11","author":"Storn","year":"1997","journal-title":"J. Glob. Optim."},{"key":"ref_25","unstructured":"Hansen, N., Auger, A., Finck, S., and Ros, R. (2009). Real-Parameter Black-Box Optimization Benchmarking 2009: Experimental Setup, Universit\u00e9 Paris Sud."},{"key":"ref_26","unstructured":"Nikohansen, H., Akimoto, Y., Brockhoff, D., and Chan, M. (2020, August 25). CMA-ES\/Pycma: R2.7. Available online: https:\/\/zenodo.org\/record\/2651072#.X0yw7CMRXIU."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/9\/967\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:05:08Z","timestamp":1760177108000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/9\/967"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,31]]},"references-count":26,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["e22090967"],"URL":"https:\/\/doi.org\/10.3390\/e22090967","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2020,8,31]]}}}