A simple Hebbian/anti-Hebbian network learns the sparse, independent components of natural images

Neural Computation

Volumn 18, Issue 2, 2006, Pages 415-429

  Falconbridge, Michael S ^a   Stamps, Robert L ^a   Badcock, David R ^a  

^a UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; HUMAN; NERVE CELL; PHYSIOLOGY; VISUAL CORTEX;

ALGORITHMS; ANIMALS; HUMANS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONS; VISUAL CORTEX;

EID: 33644887746     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/089976606775093891     Document Type: Article

References (27)

1. Albrecht, D. G., & Hamilton, D. B. (1982). Striate cortex of monkey and cat: Contrast response function, Journal of Neurophysiobgy, 41, 217-237.
2. Atick, J. J., & Redlich, A. N. (1992). What does the retina know about natural scenes? Neural Computation, 4, 196-210.
3. Baddeley, R., Abbott, L. F., Booth, M. C. A., Sengpiel, F., Freeman, T., Wakeman, E., & Rolls, E. T. (1997). Responses of neurons in primary and inferior temporal visual cortices to natural scenes. Proceedings of the Royal Society of London B, 264, 1775-1783.
4. Bell, A. J., & Sejnowski, T. J. (1997). The "independent components" of natural scenes are edge filters. Vision Research, 37(23), 3327-3338.
5. Blakemore, C., Carpenter, R. H. S., & Georgeson, M. A. (1970). Lateral inhibition between orientation detectors in the human visual system. Nature, 228, 37-39.
6. Boynton, G. M., & Finney, E. M. (2003). Orientation-specific adaptation in human visual cortex. Journal of Neuroscience, 23(25), 8781-8787.
7. Brown, T. H., Kairiss, E. W., & Keenan, C. L. (1990). Hebbian synapses: Biophysical mechanisms and algorithms. Annu. Rev. Neurosci., 13, 475-511.
8. Budd, J. M. L., & Kisvarday, Z. F. (2001). Local lateral connectivity of inhibitory clutch cells in layer 4 of cat visual cortex (area 17). Experimental Brain Research, 140, 245-250.
9. Carandini, M. (2000). Visual cortex: Fatigue and adaptation. Current Biology, 10(16), R1-R3.
10. De Valois, R. L., Albrecht, D. G., & Thorell, L. G. (1982). Spatial frequency selectivity of cells in macaque visual cortex. Vision Research, 22, 545-559.
11. Földiák, P. (1990). Forming sparse representations by local anti-Hebbian learning. Biol. Cybern., 64, 165-170.
12. Gallant, J. L., & Vinje, W. E. (2000). Sparse coding and decorrelation in primary visual cortex during natural vision. Science, 287(5456), 1273.
13. Gottschalk, A. (2002). Derivation of the visual contrast response function by maximizing information rate. Neural Computation, 14, 527-542.
14. Hoyer, P. O. (2003). Modelling receptive fields with non-negative sparse coding. In E. D. Schutter (Ed.), Computational neuroscience: Trends in research 2003. Amsterdam: Elsevier.
15. Hurri, J., Hyvärinen, A., & Oja, E. (1996). Image feature extraction using independent component analysis. In Proceedings of the IEEE Nordic Signal Processing Symposium (NORSLG)'96. Piscataway, NJ: IEEE.
16. Karhunen, J., & Joutsensalo, J. (1994). Representation and separation of signals using nonlinear PCA type learning. Neural Networks, 7(1), 113-127.
17. Katz, L. C., & Shatz, C. J. (1996). Synaptic activity and the construction of cortical circuits. Science, 274, 1133-1138.
18. Lennie, P. (2003). The cost of cortical computation. Current Biology, 13, 493-497.
19. Oja, E. (1982). A simplified neuron model as a principal component analyzer. J. Math. Biol., 15, 267-273.
20. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381, 607-609.
21. Olshausen, B. A., & Field, D. J. (1997). Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision Research, 37(23), 3311-3325.
22. Rauschecker, J. P. (1991). Mechanisms of visual plasticity. Physical Revierv, 71(2), 587-615.
23. Schiller, P. H. (1992). The ON and OFF channels of the visual system. Trends in Neurosciences, 15(3), 86-92.
24. Sudjianto, A., & Hassoun, M. H. (1995). Statistical basis of nonlinear Hebbian learning and application to clustering. Neural Networks, 8(5), 707-715.
25. Thomson, A. M., & Deuchars, J. (1997). Synaptic interactions in neocortical local circuits: Dual intracellular recordings in vivo. Cerebral Cortex, 7, 510-522.
26. van Hateren, J. H., & Ruderman, D. L. (1998). Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex. Proceedings of the Royal Society of London B, 265, 2315-2320.
27. van Hateren, J. H., & van der Schaaf, A. (1998). Independent component filters of natural images compared with simple cells in primary visual cortex. Proceedings of the Royal Society of London B, 265, 359-366.