Hebbian learning in a model with dynamic rate-coded neurons: An alternative to the generative model approach for learning receptive fields from natural scenes

Network: Computation in Neural Systems

Volumn 18, Issue 3, 2007, Pages 249-266

  Hamker, Fred H ^a   Wiltschut, Jan ^a  

^a UNIVERSITY OF MÜNSTER   (Germany)

Author keywords

Attention; Natural scenes; Network models; Visual system

Indexed keywords

ANIMAL; BIOLOGICAL MODEL; CONFERENCE PAPER; HUMAN; LEARNING; METHODOLOGY; NATURAL SCIENCE; NERVE CELL; NONLINEAR SYSTEM; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOLOGICAL MODEL; VISION; VISUAL SYSTEM;

ANIMALS; HUMANS; LEARNING; MODELS, NEUROLOGICAL; MODELS, PSYCHOLOGICAL; NATURE; NEURONS; NONLINEAR DYNAMICS; PHOTIC STIMULATION; VISUAL PATHWAYS; VISUAL PERCEPTION;

EID: 35148823957     PISSN: 0954898X     EISSN: 13616536     Source Type: Journal    
DOI: 10.1080/09548980701661210     Document Type: Conference Paper

References (47)

1. Atick JJ, Redlich A. 1990. Towards a theory of early visual processing. Neural Comput 2:308-320.
2. Armstrong KM, Fitzgerald JK, Moore T. 2006. Changes in visual receptive fields with microstimulation of frontal cortex. Neuron 50:791-798.
3. Barlow HB. 1961. Possible principles underlying the transformation of sensory messages. In: Rosenblith WA, editor. Sensory communication. Cambridge, MA: MIT Press. pp 217-234.
4. Barlow HB. 1998. Redundancy reduction revisited. Network 12:241-253.
5. Bayerl P, Neumann H. 2004. Disambiguating visual motion through contextual feedback modulation. Neural Comput 16:2041-2066.
6. Bell AJ, Sejnowski TJ. 1997. The 'independent components' of natural scenes are edge filters. Vis Res 37:3327-3338.
7. Bullier J, Hupe JM, James AC, Girard P. 2001. The role of feedback connections in shaping the responses of visual cortical neurons. Prog Brain Res 134:193-204.
8. David SV, Vinje WE, Gallant JL. 2004. Natural stimulus statistics alter the receptive field structure of v1 neurons. J Neurosci 24:6991-7006.
9. Eckhorn R, Reitboeck E, Arndt M, Dicke P. 1990. Feature linking via synchronisation among distributed assemblies: Simulations of results from Cat Visual Cortex. Neural Comput 2:293-307.
10. Falconbridge MS, Stamps RL, Badcock DR. 2006. A simple Hebbian/anti-Hebbian network learns the sparse, independent components of natural images. Neural Comput 18:415-429.
11. Grossberg S. 1980. How does the brain build a cognitive code? Psychol Rev 87:1-51.
12. Hamker FH. 2004. A dynamic model of how feature cues guide spatial attention. Vision Res 44:501-521.
13. Hamker FH. 2005. The reentry hypothesis: The putative interaction of the frontal eye field, ventrolateral prefrontal cortex, and areas V4, IT for attention and eye movement. Cereb Cortex 15:431-447.
14. Hamker FH. 2006. Modeling feature-based attention as an active top-down inference process. BioSystems 86:91-99.
15. Hamker FH. 2007. The mechanisms of feature inheritance as predicted by a systems-level model of visual attention and decision making. Adv Cogn Psychol 3:111-123.
16. Hancock PJB, Baddeley RJ, Smith LS. 1992. The principle components of natural images. Network 3:61-70.
17. Harpur G, Prager R. 1996. Development of low entropy coding in a recurrent network. Network: Comput Neural Syst 7:277-284.
18. Hoyer PO. 2003. Modeling receptive fields with non-negative sparse coding. Neurocomputing 52-54:547-552.
19. Hoyer PO. 2004. Non-negative matrix factorization with sparseness constraints. J Mach Learn Res 5:1457-1469.
20. Hoyer PO, Hyvärinen A. 2002. A multi-layer sparse coding network learns contour coding from natural images. Vision Res 42:1593-1605.
21. Jehee JF, Rothkopf C, Beck JM, Ballard DH. 2006. Learning receptive fields using predictive feedback. J Physiol Paris 100:125-132.
22. Karklin Y, Lewicki MS. 2003. Learning higher-order structures in natural images. Network 14:483-499.
23. Lammé VAF, Roelfsema PR. 2000. The distinct modes of vision offered by feedforward and recurrent processing. Trend Neurosci 23:571-579.
24. Lee DD, Seung HS. 1999. Learning the parts of objects by non-negative matrix factorization. Nature 401:788-791.
25. Li Z, Atick JJ. 1994. Towards a theory of striate cortex. Neural Comput 6:127-146.
26. Linsker R. 1986. From basic network principles to neural architecture: Emergence of orientation-selective cells. Proc Natl Acad Sci USA 83:8390-8394.
27. Nadal J-P, Parga N. 1994. Nonlinear neurons in the low-noise limit: A factorial code maximizes information transfer. Network: Comput Neural Sys 5:565-581.
28. O'Connor DH, Fukui MM, Pinsk MA, Kastner S. 2002. Attention modulates responses in the human lateral geniculate nucleus. Nat Neurosci 5:1203-1209.
29. Oja E. 1982. A simplified neuron model as a principal component analyzer. J Math Biol 15:267-273.
30. Olshausen BA, Field DJ. 1996. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381:607-609.
31. Olshausen BA, Field DJ. 1997. Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision Res 37:3311-3325.
32. Rao RP, Ballard DH. 1999. Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nat Neurosci 2:79-87.
33. Rehn M, Sommer FT. 2007. A network that uses few active neurones to code visual input predicts the diverse shapes of cortical receptive fields. J Comput Neurosci 22:135-146.
34. Reynolds JH, Chelazzi L. 2004. Attentional modulation of visual processing. Annu Rev Neurosci 27:611-647.
35. Ringách DL. 2002. Spatial structure and symmetry of simple-cell receptive fields in macaque primary visual cortex. J Neurophysiol 88:455-463.
36. Rockland KS, van Hoesen GW. 1994. Direct temporal-occipital feedback connections to striate cortex (V1) in the macaque monkey. Cereb Cortex 4:300-313.
37. Rockland KS, Saleem KS, Tanata K. 1994. Divergent feedback connections from areas V4 and TEO in the macaque. Visual Neurosci 11:579-600.
38. Sejnowski T. 1977. Storing covariance with nonlinearly interacting neurons. J Math Biol 4:303-321.
39. Simoncelli EP. 2003. Vision and the statistics of the visual environment. Curr Opin Neurobiol 13:144-149.
40. Sommer MA, Wurtz RH. 2004. What the brain stem tells the frontal cortex. I. Oculomotor signals sent from superior colliculus to frontal eye field via mediodorsal thalamus. J Neurophysiol 91:1381-1402.
41. Spratling MW, Johnson MH. 2002. Pre-integration lateral inhibition enhances unsupervised learning. Neural Comput 14:2157-2179.
42. Turrigiano GG, Nelson SB. 2004. Homeostatic plasticity in the developing nervous system. Nat Rev Neurosci 5:97-107.
43. van Hateren JH, van der Schaaf A. 1998. Independent component filters of natural images compared with simple cells in primary visual cortex. Proc Biol Sci 265:359-366.
44. von der Marlsburg C. 1973. Self-organization of orientation selective cells in the striate cortex. Kybernetic 14:85-100.
45. Willshaw DJ, Dayan P. 1990. Optimal plasticity in matrix memories: What goes up must come down. Neural Comput 2:85-93.
46. Wiltschut J, Zirnsak M, Hamker FH. (in preparation) Hebbian learning of feedforward and feedback connections in dynamic rate coded neurons.
47. Yu A, Giese MA, Poggio T. 2002. Biophysiologically plausible implementations of the maximum operation. Neural Comput 14:2857-2881.