Natural evolution strategies converge on sphere functions

GECCO'12 - Proceedings of the 14th International Conference on Genetic and Evolutionary Computation

Volumn , Issue , 2012, Pages 329-336

  Schaul, Tom ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

black box optimization; convergence proof; evolution strategies; natural gradient; sphere function; stability theory

Indexed keywords

BLACK-BOX OPTIMIZATION; CONVERGENCE PROOF; EVOLUTION STRATEGIES; NATURAL GRADIENT; SPHERE FUNCTIONS; STABILITY THEORIES;

POPULATION STATISTICS; SPHERES;

EVOLUTIONARY ALGORITHMS;

EID: 84864693847     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2330163.2330211     Document Type: Conference Paper

References (16)

1. S. I. Amari. Natural Gradient Works Efficiently in Learning. Neural Computation, 10:251-276, 1998.
2. L. Arnold, A. Auger, N. Hansen, and Y. Ollivier. Information-Geometric Optimization Algorithms: A Unifying Picture via Invariance Principles. Technical report, June 2011.
3. A. Auger. Convergence results for the (1,λ)-SA-ES using the theory of phi-irreducible Markov chains. Theoretical Computer Science, 334(1-3):35-69, 2005.
4. A. Auger and N. Hansen. Theory of Evolution Strategies: a New Perspective. In A. Auger and B. Doerr, editors, Theory of Randomized Search Heuristics: Foundations and Recent Developments, chapter 10, pages 289-325. World Scientific Publishing, 2011.
5. G. Cuccu, F. Gomez, and T. Glasmachers. Novelty-based restarts for evolution strategies. In Evolutionary Computation (CEC), 2011 IEEE Congress on, pages 158-163, 2011.
6. S. Finck and H.-G. Beyer. Performance analysis of the simultaneous perturbation stochastic approximation algorithm on the noisy sphere model. Theoretical computer science, 419(C):50-72, Feb. 2012.
7. N. Fukushima, Y. Nagata, S. Kobayashi, and I. Ono. Proposal of distance-weighted exponential natural evolution strategies. In 2011 IEEE Congress of Evolutionary Computation, pages 164-171. IEEE, 2011.
8. T. Glasmachers, T. Schaul, Y. Sun, D. Wierstra, and J. Schmidhuber. Exponential Natural Evolution Strategies. In Genetic and Evolutionary Computation Conference (GECCO), Portland, OR, 2010.
9. N. Hansen and A. Ostermeier. Completely derandomized self-adaptation in evolution strategies. IEEE Transactions on Evolutionary Computation, 9:159-195, 2001.
10. N. Ikeda and S. Watanabe. Stochastic differential equations and diffusion processes. 1989.
11. M. Sankaran. Approximations to the non-central chisquare distribution. Biometrika, 1963.
12. T. Schaul. Studies in Continuous Black-box Optimization. Ph.D. thesis, Technische Universität München, 2011.
13. T. Schaul, T. Glasmachers, and J. Schmidhuber. High Dimensions and Heavy Tails for Natural Evolution Strategies. In Genetic and Evolutionary Computation Conference (GECCO), Dublin, Ireland, 2011.
14. P. K. Sen. The Mean-Median-Mode Inequality and Noncentral Chi Square Distributions. Sankhya: The Indian Journal of Statistics, Series A (1961-2002), 51 (1):pp. 106-114, 1989.
15. O. Teytaud and S. Gelly. General lower bounds for evolutionary algorithms. Parallel Problem Solving from Nature-PPSN IX, 2006.
16. D. Wierstra, T. Schaul, J. Peters, and J. Schmidhuber. Natural Evolution Strategies. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC), Hong Kong, China, 2008.