Exponential natural evolution strategies

Proceedings of the 12th Annual Genetic and Evolutionary Computation Conference, GECCO '10

Volumn , Issue , 2010, Pages 393-400

  Glasmachers, Tobias ^a   Schaul, Tom ^a   Yi, Sun ^a   Wierstra, Daan ^b   Schmidhuber, Jürgen ^a  

^a UNIVERSITY OF LUGANO   (Switzerland)

^b EPFL   (Switzerland)

Author keywords

Black box optimization; Evolution strategies; Natural gradient; Unconstrained optimization

Indexed keywords

BENCHMARK FUNCTIONS; BLACK-BOX OPTIMIZATION; COMPETITIVE ALGORITHMS; COMPUTATIONAL BOTTLENECKS; COVARIANCE MATRIX ADAPTATION; EVOLUTION STRATEGIES; EVOLUTIONARY OPTIMIZATIONS; EXPONENTIAL MAP; NATURAL COORDINATES; NATURAL EVOLUTION; NATURAL GRADIENT; POSITIVE DEFINITE; SEARCH SPACES; STEP SIZE; UNCONSTRAINED OPTIMIZATION;

BIOLOGY; COVARIANCE MATRIX; FISHER INFORMATION MATRIX; LINEAR TRANSFORMATIONS; OPTIMIZATION; VECTOR SPACES;

EVOLUTIONARY ALGORITHMS;

EID: 77955901414     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1830483.1830557     Document Type: Conference Paper

References (13)

1. S. Amari and S. C. Douglas. Why natural gradient? In Proceedings of the 1998 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '98), volume 2, pages 1213-1216, 1998.
2. É. Cartan. Sur la représentation géométrique des syetèmes matérieles non holonomes. In Proc Int Congr Math, Bologna, volume 4, pages 253-261, 1928.
3. T. Glasmachers andC. Igel. Gradient-based Adaptation of General Gaussian Kernels. Neural Computation, 17(10):2099-2105, 2005.
4. N. Hansen andA. Ostermeier. Completely derandomized self-adaptation in evolution strategies. Evolutionary Computation, 9(2): 159-195, 2001.
5. G. A. Jastrebski andD. V. Arnold. Improving Evolution Strategies through Active Covariance Matrix Adaptation. In IEEE Congress on Evolutionary Computation, 2006.
6. S. Kern, S. D. Müller, N. Hansen, D. Buche, J. Ocenasek, andP. Koumoutsakos. Learning probability distributions in continuous evolutionary algorithms-a comparative review. Natural Computing, 3(1):77-112, 2004.
7. I. Najfeld andT. F. Havel. Derivaties of the Matrix Exponential and Their Computation. Adv. Appl. Math, 16:321-375, 1994.
8. J. Peters andS. Schaal. Natural actor-critic. Neurocomputing, 71(7-9):1180-1190, 2008.
9. T. Schaul, J. Bayer, D. Wierstra, Y. Sun, M. Felder, F. Sehnke, T. Rückstieβ, andJ. Schmidhuber. PyBrain. Journal of Machine Learning Research, 11:743-746, 2010.
10. P. N. Suganthan, N. Hansen, J. J. Liang, K. Deb, Y. P. Chen, A. Auger, andS. Tiwari. Problem definitions and evaluation criteria for the cec 2005 special session on real-parameter optimization. Technical report, Nanyang Technological University, Singapore, 2005.
11. Y. Sun, D. Wierstra, T. Schaul, andJ. Schmidhuber. Efficient Natural Evolution Strategies. In Genetic and Evolutionary Computation Conference (GECCO), 2009.
12. Y. Sun, D. Wierstra, T. Schaul, andJ. Schmidhuber. Stochastic Search using the Natural Gradient. In International Conference on Machine Learning (ICML), 2009.
13. D. Wierstra, T. Schaul, J. Peters, andJ. Schmidhuber. Natural Evolution Strategies. In Proceedings of the Congress on Evolutionary Computation (CEC08), Hongkong. IEEE Press, 2008.