Dynamics of the adaptive natural gradient descent method for soft committee machines

Physical Review E - Statistical, Nonlinear, and Soft Matter Physics

Volumn 69, Issue 5 1, 2004, Pages

  Inoue, Masato ^a,b,c   Park, Hyeyoung ^a,d   Okada, Masato ^a,e  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^b TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^c KYOTO UNIVERSITY   (Japan)

^d Kyungpook National University   (South Korea)

^e JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE NATURAL GRADIENT DESCENT (ANGD); NATURAL GRADIENT DESCENT (NGD); PARAMETER DYNAMICS; STEEPEST GRADIENT DESCENT (SGD) METHOD;

BACKPROPAGATION; COMPUTER SIMULATION; GRADIENT METHODS; MATRIX ALGEBRA; ONLINE SEARCHING; RUNGE KUTTA METHODS; STATISTICAL METHODS; VECTORS;

ADAPTIVE SYSTEMS;

EID: 42749107566     PISSN: 15393755     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (12)

1. D. Saad and S. A. Solla, Phys. Rev. Lett. 74, 4337 (1995); Phys. Rev. E 52, 4225 (1995).
2. D. Saad and S. A. Solla, Phys. Rev. Lett. 74, 4337 (1995); Phys. Rev. E 52, 4225 (1995).
3. P. Riegler and M. Biehl, J. Phys. A 28, L507 (1995).
4. M. Inoue, H. Park, and M. Okada, J. Phys. Soc. Jpn. 72, 805 (2003).
5. S. Amari, Neural Comput. 10, 251 (1998).
6. H. H. Yang and S. Amari, Neural Comput. 10, 2137 (1998).
7. M. Rattray, D. Saad, and S. Amari, Phys. Rev. Lett. 81, 5461 (1998); M. Rattray and D. Saad, Phys. Rev. E 59, 4523 (1999).
8. M. Rattray, D. Saad, and S. Amari, Phys. Rev. Lett. 81, 5461 (1998); M. Rattray and D. Saad, Phys. Rev. E 59, 4523 (1999).
9. Online Learning in Neural Networks, edited by D. Saad (Cambridge University Press, London, 1998).
10. S. Amari, H. Park, and K. Fukumizu, Neural Comput. 12, 1399 (2000).
11. H. Park, S. Amari, and K. Fukumizu, Neural Networks 13, 755 (2000).
12. J. Inoue, H. Nishimori, and Y. Kabashima, J. Phys. A 30, 3795 (1997).