Learning sensory representations with intrinsic plasticity

Neurocomputing

Volumn 70, Issue 7-9, 2007, Pages 1130-1138

  Butko, Nicholas J ^a   Triesch, Jochen ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b FRANKFURT INSTITUTE FOR ADVANCED STUDIES   (Germany)

Author keywords

Independent component analysis; Information theory; Intrinsic plasticity; Primary visual cortex; Unsupervised learning

Indexed keywords

COMPUTER SIMULATION; INDEPENDENT COMPONENT ANALYSIS; LEARNING SYSTEMS; SENSORY PERCEPTION;

INTRINSIC PLASTICITY; PRIMARY VISUAL CORTEX;

NEURONS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; CONTROLLED STUDY; EXPERIMENTAL MODEL; INDEPENDENT COMPONENT ANALYSIS; INFORMATION PROCESSING; INTERMETHOD COMPARISON; LEARNING ALGORITHM; MATHEMATICAL ANALYSIS; MATHEMATICAL MODEL; NERVE CELL EXCITABILITY; NERVE CELL PLASTICITY; NERVE CELL STIMULATION; NONLINEAR SYSTEM; PRIORITY JOURNAL; RECEPTIVE FIELD; THEORY; VISUAL CORTEX;

EID: 33847391180     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2006.11.006     Document Type: Article

References (30)

1. Attneave F. Some informational aspects of visual perception. Psychol. Rev. 61 (1954) 183-193
2. Baddeley R., Abbott L.F., Booth M.C., Sengpiel F., Freeman T., Wakeman E.A., and Rolls E.T. Responses of neurons in primary and inferior temporal visual cortices to natural scenes. Proc. R. Soc. London B 264 (1998) 1775-1783
3. Barlow H.B. Possible principles underlying the transformation of sensory messages. In: Rosenblith W.A. (Ed). Sensory Communication (1961), MIT Press, Cambridge, MA 217-234
4. Bell A.J., and Sejnowski T.J. The independent components of scenes are edge filters. Vision Res. 37 23 (1997) 3327-3338
5. Cooper L.N., Intrator N., Blais B.S., and Shouval H.Z. Theory of Cortical Plasticity (2004), World Scientific, London
6. Desai N.S., Rutherford L.C., and Turrigiano G. Plasticity in the intrinsic excitability of cortical pyramidal neurons. Nature Neurosci. 2 6 (1999) 515-520
7. D. DeSieno, Adding a conscience to competitive learning, IEEE Proceedings of the International Conference on Neural Networks, vol. I, 1988, pp. 117-124.
8. Falconbridge M.S., Stamps R.L., and Badcock D.R. A simple Hebbian/anti-Hebbian network learns the sparse, independent components of natural images. Neural Comput. 18 (2005) 415-429
9. Földiák P. Forming sparse representation by local anti-hebbian learning. Biol. Cybern. 64 (1990) 165-170
10. Földiák P. Sparse coding in the primate cortex. In: Arbib M.A. (Ed). The Handbook of Brain Theory and Neural Networks. second ed. (2002), MIT Press, Cambridge, MA
11. Hyvärinen A., and Hoyer P. Emergence of phase- and shift-invariant features by decomposition of natural images into independent feature subspaces. Neural Comput. 12 7 (2000) 1705-1720
12. Hyvärinen A., Hoyer P.O., and Inki M. Topographic independent component analysis. Neural Comput. 13 (2001) 1527-1558
13. Laughlin S. A simple coding procedure enhances a neuron's information capacity. Z. Naturforsch 36 (1981) 910-912
14. Lennie P. The cost of cortical computation. Curr. Biol. 13 (2003) 493-497
15. R. Linsker, From basic network principles to neural architecture: emergence of oriented columns, Proceedings of the National Academies of Sciences, vol. 83, 1986, pp. 8779-8783.
16. Linsker R. Self-Organization in a perceptual network. Computer 21 3 (1988) 105-117
17. Lücke J., and von der Malsburg C. Rapid processing and unsupervised learning in a model of the cortical macrocolumn. Neural Comput. 16 3 (2004) 501-533
18. Miikkulainen R., Bednar J., Choe Y., and Sirosh J. Computational Maps in the Visual Cortex (2005), Springer, Berlin
19. Miller K.D. A model for the development of simple cell receptive fields and the ordered arrangement of orientation columns through activity-dependent competition between ON- and OFF-center inputs. J. Neurosci. 14 1 (1994) 409-441
20. Nadal J.P., and Parga N. Nonlinear neurons in the low-noise limit:a factorial code maximizes information transfer. Network Comput. Neural Syst. 5 4 (1994) 565-581
21. Olshausen B.A., and Field D.J. Sparse coding with an overcomplete basis set: a strategy employed by V1?. Vision Res. 37 23 (1997) 3311-3325
22. Simoncelli E.P., and Olshausen B.A. Natural image statistics and neural representation. Annu. Rev. Neurosci. 24 (2001) 1193-1216
23. Stemmler M., and Koch C. How voltage-dependent conductances can adapt to maximize the information encoded by neuronal firing rate. Nature Neurosci. 2 (1999) 521-527
24. Triesch J. Synergies between intrinsic and synaptic plasticity in individual neurons. Adv. Neural Inf. Process. Syst. 17 (2005) 1417-1424
25. J. Triesch, A gradient rule for the plasticity of a neuron's intrinsic excitability, Proceedings of the International Conference on Artificial Neural Networks, 2005, pp. 65-70.
26. J. Triesch, Synergies between intrinsic and synaptic plasticity mechanisms, Neural Comput. 2006, in press.
27. van Hateren J.H., and van der Schaaf A. Independent component filters of natural images comparsed with simple cells in primary visual cortex. Proc. R. Soc. London B 265 (1998) 359-366
28. Vincent B.T., Baddeley R.J., Troscianko T., and Gilchrist I.D. Is the early visual system optimised to be energy efficient?. Network Comput. Neural Syst. 16 2-3 (2005) 175-190
29. C. Weber, Self-organization of orientation maps, lateral connections, and dynamic receptive fields in the primary visual cortex, Proceedings of the International Conference on Artificial Neural Networks, 2001, pp. 1147-1152.
30. Zhang W., and Linden D.J. The other side of the engram: experience-dependent changes in neuronal intrinsic excitability. Nature Rev. Neurosci. 4 (2003) 885-900