High dimensions and heavy tails for natural evolution strategies

Genetic and Evolutionary Computation Conference, GECCO'11

Volumn , Issue , 2011, Pages 845-852

  Schaul, Tom ^a   Glasmachers, Tobias ^a   Schmidhuber, Jürgen ^a  

^a UNIVERSITY OF LUGANO   (Switzerland)

Author keywords

Black box optimization; Evolution strategies; Global optimization; Natural gradient

Indexed keywords

ATOM CLUSTERS; BLACK-BOX OPTIMIZATION; EVOLUTION STRATEGIES; EVOLUTIONARY OPTIMIZATIONS; GAUSSIANS; HEAVY-TAILED DISTRIBUTION; HEAVY-TAILS; HIGH DIMENSIONS; LENNARD JONES; LOCAL OPTIMA; LOWEST ENERGY STRUCTURE; NATURAL EVOLUTION; NATURAL GRADIENT;

EVOLUTIONARY ALGORITHMS; GLOBAL OPTIMIZATION; OPTIMIZATION;

BIOLOGY;

EID: 84860390064     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2001576.2001692     Document Type: Conference Paper

References (15)

1. S. Amari and S. C. Douglas. Why natural gradient? In Proceedings of the 1998 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '98), volume 2, pages 1213-1216, 1998.
2. H.-G. Beyer and H.-P. Schwefel. Evolution strategies: A comprehensive introduction. Natural Computing, 1:3-52, 2002.
3. T. Glasmachers, T. Schaul, and J. Schmidhuber. A Natural Evolution Strategy for Multi-Objective Optimization. In Parallel Problem Solving from Nature (PPSN), 2010.
4. T. Glasmachers, T. Schaul, Y. Sun, D. Wierstra, and J. Schmidhuber. Exponential Natural Evolution Strategies. In Genetic and Evolutionary Computation Conference (GECCO), Portland, OR, 2010.
5. F. Gomez, J. Schmidhuber, and R. Miikkulainen. Accelerated Neural Evolution through Cooperatively Coevolved Synapses. Journal of Machine Learning Research, 2008.
6. N. Hansen. The CMA evolution strategy: a comparing review. In J. Lozano, P. Larranaga, I. Inza, and E. Bengoetxea, editors, Towards a new evolutionary computation. Advances on estimation of distribution algorithms, pages 75-102. Springer, 2006. (Pubitemid 44856937)
7. N. Hansen and A. Auger. Real-parameter black-box optimization benchmarking 2010: Experimental setup, 2010.
8. N. Hansen and S. Finck. Real-parameter black-box optimization benchmarking 2010: Noiseless functions definitions, 2010.
9. N. Hansen and A. Ostermeier. Completely derandomized self-adaptation in evolution strategies. Evolutionary Computation, 9(2):159-195, 2001.
10. R. Ros and N. Hansen. A Simple Modification in CMA-ES Achieving Linear Time and Space Complexity. In R. et al., editor, Parallel Problem Solving from Nature, PPSN X, pages 296-305. Springer, 2008.
11. T. Schaul, J. Bayer, D. Wierstra, Y. Sun, M. Felder, F. Sehnke, T. Rückstieß, and J. Schmidhuber. PyBrain. Journal of Machine Learning Research, 11:743-746, 2010.
12. Y. Sun, D. Wierstra, T. Schaul, and J. Schmidhuber. Efficient Natural Evolution Strategies. In Genetic and Evolutionary Computation Conference (GECCO), 2009.
13. Y. Sun, D. Wierstra, T. Schaul, and J. Schmidhuber. Stochastic Search using the Natural Gradient. In International Conference on Machine Learning (ICML), 2009.
14. D. Wales and J. Doye. Global Optimization by Basin-Hopping and the Lowest Energy Structures of Lennard-Jones Clusters Containing up to 110 Atoms. The Journal of Physical Chemistry A, 101(28):8, 1998.
15. D. Wierstra, T. Schaul, J. Peters, and J. Schmidhuber. Natural Evolution Strategies. In Proceedings of the Congress on Evolutionary Computation (CEC08), Hongkong. IEEE Press, 2008.