An information maximization approach to overcomplete and recurrent representations

Advances in Neural Information Processing Systems

Volumn , Issue , 2001, Pages

  Shriki, Oren ^a   Sompolinsky, Haim ^a   Lee, Daniel D ^b  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^b LUCENT TECHNOLOGIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FEEDFORWARD CONNECTIONS; INDEPENDENT COMPONENTS; INFORMATION MAXIMIZATION; LEARNING RULES; MUTUAL INFORMATIONS; OVER-COMPLETE;

ENTROPY;

EID: 84898980111     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. Jolliffe, IT (1986). Principal Component Analysis. New York: Springer-Verlag.
2. Haykin, S (1999). Neural networks: a comprehensive foundation. 2nd ed., Prentice-Hall, Upper Saddle River, NJ.
3. Jutten, C & Hérault, J (1991). Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture. Signal Processing 24, 1-10.
4. Hinton, G & Ghahramani, Z (1997). Generative models for discovering sparse distributed representations. Philosophical Transactions Royal Society B 352, 1177-1190.
5. Pearlmutter, B & Parra, L (1996). A context-sensitive generalization of ICA. In ICONIP'96, 151-157.
6. Bell, AJ & Sejnowski, TJ (1995). An information maximization approach to blind separation and blind deconvolution. Neural Comput. 7, 1129-1159.
7. Barlow, HB (1989). Unsupervised learning. Neural Comput. 1, 295-311.
8. Linsker, R (1992). Local synaptic learning rules suffice to maximize mutual information in a linear network. Neural Comput. 4, 691-702.
9. Parra, L, Deco, G, & Miesbach, S (1996). Statistical independence and novelty detection with information preserving nonlinear maps. Neural Comput. 8, 260-269.
10. Amari, S, Cichocki, A & Yang, H (1996). A new learning algorithm for blind signal separation. Advances in Neural Information Processing Systems 8, 757-763.
11. Lewicki, MS & Sejnowski, TJ (2000). Learning overcomplete representations. Neural Computation 12 337-365.