Stochastic search using the natural gradient

Proceedings of the 26th International Conference On Machine Learning, ICML 2009

Volumn , Issue , 2009, Pages 1161-1168

  Yi, Sun ^a   Wierstra, Daan ^a   Schaul, Tom ^a   Schmidhuber, Jürgen ^a  

^a DALLE MOLLE INSTITUTE FOR ARTIFICIAL INTELLIGENCE IDSIA   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

FITNESS EVALUATIONS; NATURAL EVOLUTION; NATURAL GRADIENT; NOVEL ALGORITHM; OPTIMAL FITNESS; STOCHASTIC SEARCH; STOCHASTIC SEARCH METHODS;

ALGORITHMS; HEALTH; MULTILAYER NEURAL NETWORKS; ROBOT LEARNING; STOCHASTIC SYSTEMS;

FISHER INFORMATION MATRIX;

EID: 71149084737     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Amari, S. (1998). Natural gradient works efficiently in learning. Neural Computation, 10, 251-276.
2. Amari, S., Cichocki, A., & Yang, H. (1995). A new learning algorithm for blind signal separation. Advances in Neural Information Processing Systems (NIPS95), 8, 757-763.
3. Amari, S., & Douglas, S. C. (1998). Why natural gradient? Proceedings of the 1998 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP98), 2, 1213-1216.
4. Gomez, F., & Miikkulainen, R. (1997). Incremental evolution of complex general behavior. Adaptive Behavior, 5, 317-342.
5. Gomez, F., Schmidhuber, J., & Miikkulainen, R. (2006). Efficient non-linear control through neu-roevolution. Proceedings of the 16th European Conference on Machine Learning (ECML06), 4212, 654-662.
6. Hansen, N., & Ostermeier, A. (2001). Completely de-randomized self-adaptation in evolution strategies. Evolutionary Computation, 9, 159-195.
7. Kakade, S. (2001). A natural policy gradient. In Advances in neural information processing systems (NIPS01), 12, 1531-1538.
8. Moriarty, D. E., & Miikkulainen, R. (1996). Efficient reinforcement learning through symbiotic evolution. Machine Learning, 22, 11-32.
9. Peters, J., & Schaal, S. (2008). Natural actor-critic. Neurocomputing, 71, 1180-1190.
10. Peters, J. R. (2007). Machine learning of motor skills for robotics. Doctoral dissertation, Los Angeles, CA, USA. Adviser-Stefan Schaal.
11. Stanley, K. O., & Miikkulainen, R. (2002). Evolving neural networks through augmenting topologies. Evolutionary Computation, 10, 99-127.
12. Suganthan, P. N., Hansen, N., Liang, J. J., Deb, K., Chen, Y. P., Auger, A., & Tiwari, S. (2005). Problem definitions and evaluation criteria for the cec 2005 special session on real-parameter optimization (Technical Report). Nanyang Technological University, Singapore.
13. Sun, Y., Wierstra, D., Schaul, T., & Schmidhuber, J. (2009). Efficient natural evolution strategies. To appear in: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO09).
14. Wieland, A. (1991). Evolving neural network controllers for unstable systems. Proceedings of the International Joint Conference on Neural Networks (IJCNN91), 2, 667-673.
15. Wierstra, D., Schaul, T., Peters, J., & Schmidhuber, J. (2008a). Fitness expectation maximization. In Parallel problem solving from nature (PPSN08), 337-346.
16. Wierstra, D., Schaul, T., Peters, J., & Schmidhuber, J. (2008b). Natural evolution strategies. Proceedings of the Congress on Evolutionary Computation (CEC08), Hongkong, 3381-3387.