Improved local learning rule for information maximization and related applications

Neural Networks

Volumn 18, Issue 3, 2005, Pages 261-265

  Linsker, Ralph ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Covariance matrix; Hebbian learning; Infomax; Mutual information; Sensory processing

Indexed keywords

DATA PROCESSING; LEARNING ALGORITHMS; LEARNING SYSTEMS; OPTIMIZATION;

INFOMAX LEARNING; INFORMATION MAXIMIZATION; LATERAL CONNECTIONS; LEARNING RULES;

FEEDFORWARD NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; LEARNING; POSITIVE FEEDBACK; PRIORITY JOURNAL;

EID: 19344364552     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2005.01.002     Document Type: Article

References (9)

1. S. Amari, A. Cichocki, and H.H. Yang A new learning algorithm for blind signal separation D.S. Touretzky M.C. Mozer M.E. Hasselmo Advances in neural information processing systems Vol. 8 1996 MIT Press. Cambridge, MA 757 763
2. S. Amari, H. Park, and K. Fukumizu Adaptive method of realizing natural gradient learning for multilayer perceptrons Neural Computation 12 2000 1399 1409
3. A.J. Bell, and T.J. Sejnowski An information-maximisation approach to blind separation and blind deconvolution Neural Comput 7 1995 1129 1159
4. L. Bottou Online algorithms and stochastic approximations D. Saad Online learning in neural networks 1998 Cambridge University Press Cambridge 9 42
5. W.W. Hager Updating the inverse of a matrix SIAM Review 31 1989 221 239
6. R. Linsker Self-organization in a perceptual network Computer 21 3 1988 105 117
7. R. Linsker Local synaptic learning rules suffice to maximize mutual information in a linear network Neural Computation 4 1992 691 702
8. R. Linsker Deriving receptive fields using an optimal encoding criterion S.J. Hanson J.D. Cowan C.L. Giles Advances in neural information processing systems Vol. 5 1993 Morgan Kaufmann Publishers San Mateo, CA 953 960
9. R. Linsker A local learning rule that enables information maximization for arbitrary input distributions Neural Computation 9 1997 1661 1665