Neural learning in structured parameter spaces - Natural Riemannian gradient

Advances in Neural Information Processing Systems

Volumn , Issue , 1997, Pages 127-133

  Amari, Shun Ichi ^a  

^a RIKEN   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

GEOMETRY;

DESCENT DIRECTIONS; INDEPENDENT SIGNALS; ON-LINE LEARNING METHODS; RIEMANNIAN GRADIENT; RIEMANNIAN METRICS; RIEMANNIAN SPACES; STOCHASTIC GRADIENT; STRUCTURED PARAMETERS;

BLIND SOURCE SEPARATION;

EID: 84899022236     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (9)

1. S. Amari. Theory of adaptive pattern classifiers, IEEE Trans., EC-16, No.3, 299-307, 1967.
2. S. Amari. Differential-Geometrical Methods in Statistics, Lecture Notes in Statistics, vol.28, Springer, 1985.
3. S. Amari. Information geometry of the EM and em algorithms for neural networks, Neural Networks, 8, No.9, 1379-1408, 1995.
4. S. Amari, A. Cichocki and H.H. Yang. A new learning algorithm for blind signal separation, in NIPS95, vol.8, 1996, MIT Press, Cambridge, Mass.
5. S. Amari, K. Kurata, H. Nagaoka. Information geometry of Boltzmann machines, IEEE Trans, on Neural Networks, 3, 260-271, 1992.
6. J. F. Cardoso and Beate Laheld. Equivariant adaptive source separation, to appear IEEE Trans, on Signal Processing, 1996.
7. T. M. Heskes and B. Kappen. Learning processes in neural networks, Physical Review A, 440, 2718-2726, 1991.
8. D. Rumelhart, G.E. Hinton and R. J. Williams. Learning internal representation, in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, 1, Foundations, MIT Press, Cambridge, MA, 1986.
9. H. Sompolinsky,N. Barkai and H. S. Seung. On-line learning of dichotomies: algorithms and learning curves, Neural Networks: The statistical Mechanics Perspective, Proceedings of the CTP-PBSRI Joint Workshop on Theoretical Physics, J.-H. Oh et al eds, 105-130, 1995.