Nonlinear feedforward networks with stochastic outputs: Infomax implies redundancy reduction

Network: Computation in Neural Systems

Volumn 9, Issue 2, 1998, Pages 207-217

  Nadal, Jean Pierre ^a   Brunel, Nicolas ^a   Parga, Nestor ^b  

^a ECOLE NORMALE SUPÉRIEURE   (France)

^b UNIVERSIDAD AUTÓNOMA DE MADRID   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ARTIFICIAL NEURAL NETWORK; FEEDBACK SYSTEM; INFORMATION SCIENCE; NERVE CELL; NONLINEAR SYSTEM; PHYSIOLOGY; STATISTICS;

FEEDBACK; INFORMATION THEORY; NEURAL NETWORKS (COMPUTER); NEURONS; NONLINEAR DYNAMICS; PHYSIOLOGY; STOCHASTIC PROCESSES;

EID: 0002184051     PISSN: 0954898X     EISSN: None     Source Type: Journal    
DOI: 10.1088/0954-898X_9_2_004     Document Type: Article

References (17)

1. Nadal J-P and Parga N 1994 Nonlinear neurons in the low-noise limit: a factorial code maximizes information transfer Network: Comput. Neural Syst. 5 565-81
2. Bell A and Sejnowski T 1995 An information-maximisation approach to blind separation and blind deconvolution Neural Comput. 7 1129-59
3. Bell A and Sejnowski T 1997 The 'independent components' of natural scenes are edge filters Vision Res. 37 3327-38
4. Nadal J-P and Parga N 1997 Redundancy reduction and independent component analysis: algebraic and adaptive approaches Neural Comput. 9 1421-56
5. Cardoso J-F 1997 Infomax and maximum likelihood for source separation IEEE Sig. Proc. Lett. 4 (4) 112-4
6. Pham D-T, Garrat P and Jutten C 1992 Separation of a mixture of independent sources through a maximum likelihood approach Proc. EUSIPCO pp 771-4
7. van Hateren J H 1992 Theoretical predictions of spatiotemporal receptive fields of fly lmcs, and experimental validation J. Compar. Physiol. A 171 157-70
8. Linsker R 1988 Self-organization in a perceptual network Computer 21 105-17
9. Atick J J 1992 Could information theory provide an ecological theory of sensory processing? Network: Comput. Neural Syst. 3 213-51
10. Dan Y, Atick J J and Reid R C 1996 Efficient coding of natural scenes in the lgn: experimental test of a computational theory J. Neurosci. 16 3351-62
11. Stein R B 1967 The information capacity of nerve cells using a frequency code Biophys. J. 7 797-826
12. Brunel N and Nadal J-P 1997 Optimal tuning curves in a simple model of spiking neurons. Proc. ESANN'97 ed M Verleysen (Brussels: Dfacto Publications)
13. Brunel N and Nadal J-P 1997 Fisher information and population coding Preprint LPSENS, Neural Computation in press
14. Blahut R E 1988 Principles and Practice of Information Theory (Cambridge, MA: Addison-Wesley)
15. Laughlin S B 1981 A simple coding procedure enhances a neuron's information capacity Z Naturf. C 36 910-2
16. Comon P 1994 Independent component analysis, a new concept? Sig. Proc. 36 287-314
17. Del Giudice P, Campa A, Parga N and Nadal J-P 1995 Maximization of mutual information in a linear noisy network: a detailed study Network: Comput. Neural Syst. 6 449-68