Receptive Field Self-Organization in a Model of the Fine Structure in V1 Cortical Columns

Neural Computation

Volumn 21, Issue 10, 2009, Pages 2805-2845

  Lücke, Jörg ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

NEURONS;

ACTIVITY DYNAMICS; CORTICAL COLUMNS; DYNAMICAL MODELING; FINE STRUCTURES; FINE-SCALE STRUCTURES; NATURAL IMAGES; PROPERTY; RECEPTIVE FIELDS; SELF ORGANIZATIONS; VISUAL CORTEXES;

INDEPENDENT COMPONENT ANALYSIS;

ALGORITHM; ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; HUMAN; INTERNEURON; NERVE CELL INHIBITION; NERVE CELL NETWORK; PATTERN RECOGNITION; PHYSIOLOGY; SENSORY RECEPTOR; SYNAPTIC TRANSMISSION; VISION; VISUAL CORTEX; VISUAL FIELD; VISUAL SYSTEM;

ALGORITHMS; ANIMALS; COMPUTER SIMULATION; HUMANS; INTERNEURONS; NERVE NET; NEURAL INHIBITION; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, VISUAL; SENSORY RECEPTOR CELLS; SYNAPTIC TRANSMISSION; VISUAL CORTEX; VISUAL FIELDS; VISUAL PATHWAYS; VISUAL PERCEPTION;

EID: 70449699801     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2009.07-07-584     Document Type: Letter

References (100)

1. Abbott, L. F., & Nelson, S. B. (2000). Synaptic plasticity: Taming the beast. Nature Neuroscience, 3, 1178–1183.
2. Ahmed, B., Anderson, J. C., Martin, K. A. C., & Nelson, J. C. (1997). Map of the synapses onto layer 4 basket cells of the primary visual cortex of the cat. Journal of Comparative Neurology, 380, 230–242.
3. Amirikian, B. (2005). A phenomenological theory of spatially structured local synaptic connectivity. PLoS Computational Biology, 1, e11.
4. Amit, D. J. (1989). Modeling brain function. Cambridge: Cambridge University Press.
5. Barrow, H. G. (1987). Learning receptive fields. In Proceedings of the IEEE First International Conference on Neural Networks (Vol. 4, pp. 115–121). Piscataway, NJ: IEEE Press.
6. Bell, A. J., & Sejnowski, T. J. (1997). The “independent components” of natural scenes areedgefilters.Vision Research, 37, 3327–3338.
7. Ben-Yishai, R., Bar-Or, R. L., & Sompolinsky, H. (1995). Theory of orientation tuning in visual cortex. Proceedings of the National Academy of Sciences, USA, 92, 3844–3848.
8. Bienenstock, E. L., Cooper, L. N., & Munro, P. W. (1982). Theory for the development of neuron selectivity: Orientation specificity and binocular interaction in visualcortex. Journal of Neuroscience, 2(1), 32–48.
9. Bonabeau, E., Dorigo, M., & Theraulaz, G. (1999). Swarm intelligence: From natural to artificial systems. New York: Oxford University Press.
10. Braitenberg, V. (1978). Theoretical approaches to complex systems. Berlin: Springer.
11. Braitenberg, V., & Schüz, A. (1998). Cortex: Statistics and geometry of neuronal connectivity. Berlin: Springer.
12. Budd, J. M. L., & Kisvarday, Z. F. (2001). Local lateral connectivity of inhibitory clutch cells in layer 4 of cat visual cortex. Experimental Brain Research, 140, 245–250.
13. Butko, N. J., & Triesch, J. (2007). Learning sensory representations with intrinsic plasticity. Neurocomputing, 70, 1130–1138.
14. Buxhoeveden, D. P., & Casanova, M. F. (2002). The minicolumn and evolution of the brain. Brain, Behavior and Evolution, 60, 125–151.
15. Camazine, S., Deneubourg, J.-L., Franks, N. R., Sneyd, J., Theraulaz, G., & Bonabeau, E. (2001). Self-organization in biological systems. Princeton, NJ: Princeton University Press.
16. Carpenter, G. A., & Grossberg, S. (2003). Adaptive resonance theory. In M. Arbib (Ed.), The handbook of brain theory and neural networks. (pp. 87–90). Cambridge, MA: MIT Press.
17. Carpenter, R. H. S. (1988). Movements of the eyes. London: Pion.
18. Chapman, B., & Stryker, M. P. (1993). Development of orientation selectivity in ferret visual cortex and effects of deprivation. Journal of Neuroscience, 13, 5251– 5262.
19. Charles, D., & Fyfe, C. (1998). Modelling multiple-cause structure using rectification constraints. Network: Computation in Neural Systems, 9, 167–182.
20. Charles, D., Fyfe, C., MacDonald, D., & Koetsier, J. (2002). Unsupervised neural networks for the identification of minimum overcomplete basis in visual data. Neurocomputing, 47, 119–143.
21. Dantzker, J. L., & Callaway, E. M. (2000). Laminar sources of synaptic input to cortical inhibitory interneurons and pyramidal neurons. Nature Neuroscience, 3, 701–707.
22. Dayan, P., & Abbott, L. F. (2001). Theoretical neuroscience. Cambridge, MA: MIT Press.
23. Dayan, P., & Zemel, R. S. (1995). Competition and multiple cause models. Neural Computation, 7, 565–579.
24. DeAngelis, G. C., Ghose, G. M., Ohzawa, I., & Freeman, R. D. (1999). Functional micro-organization of primary visual cortex: Receptive field analysis of nearby neurons. Journal of Neuroscience, 19, 4046–4064.
25. DeFelipe, J. (1993). Neocortical neuronal diversity: Chemical heterogeneity revealed by colocalization studies of classic neurotransmitters, neuropeptides, calciumbinding proteins, and cell surface molecules. Cerebral Cortex, 3, 273–289.
26. DeFelipe, J., Hendry, S. H. C., Hashikawa, T., Molinari, M., & Jones, E. G. (1990). A microcolumnar structure of monkey cerebral cortex revealed by immunocytochemical studies of double bouquet cell axons. Neuroscience, 37, 655–673.
27. Douglas, R. J., & Martin, K. A. C. (2004). Neuronal circuits of the neocortex. Annual Review of Neuroscience, 27, 419–451.
28. Erisir, A., & Harris, J. (2003). Decline of the critical period of visual plasticity is concurrent with the reduction of NR2B subunit of the synaptic NMDA receptor in layer 4. Journal of Neuroscience, 23, 5208–5218.
29. Erwin, E., Obermayer, K., & Schulten, K. (1995). Models of orientation and ocular dominance columns in the visual-cortex: A critical comparison. Neural Computation, 7, 425–468.
30. Falconbridge, M. S., Stamps, R. L., & Badcock, D. R. (2006). A simple Hebbian/anti Hebbian network learns the sparse, independent components of natural images. Neural Computation, 18, 415–429.
31. Favorov, O. V., & Diamond, M. (1990). Demonstration of discrete place-defined columns, segregates, in cat SI. Journal of Comparative Neurology, 298, 97–112.
32. Földiák, P. (1990). Forming sparse representations by local anti-Hebbian learning. Biological Cybernetics, 64, 165–170.
33. Fransen, E., & Lansner, A. (1998). A model of cortical associative memory based on a horizontal network of connected columns. Network: Computation in Neural Systems, 9, 235–264.
34. Grossberg, S., & Seitz, A. (2003). Laminar development of receptive fields, maps and columns in visual cortex: The coordinating role of the subplate. Cerebral Cortex, 13, 852–863.
35. Haken, H. (1982). Synergetics. Berlin: Springer-Verlag.
36. Harpur, G. F., & Prager, R. W. (1996). Development of low entropy coding in a recurrent network. Network: Computation in Neural Systems, 7, 277–284.
37. Harris, K. D. (2008). Stability of the fittest: Organizing learning through retroaxonal signals. Trends in Neurosciences, 31, 130–136.
38. Hebb, D. O. (1949). The organization of behaviour: A neuropsychological theory. New York: Wiley.
39. Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M. (1995). The “wake-sleep” algorithm for unsupervised neural networks. Science, 268, 1158–1161.
40. Hinton, G. E., & Ghahramani, Z. (1997). Generative models for discovering sparse distributed representations. Philosophical Transactions of the Royal Society B, 352, 1177–1190.
41. Hochreiter, S., & Schmidhuber, J. (1999). Feature extraction through LOCOCODE. Neural Computation, 11, 679–714.
42. Intrator, N., & Cooper, L. N. (1992). Objective function formulation of the BCM theory of visual cortical plasticity: Statistical connections, stability conditions. Neural Networks, 5, 3–17.
43. Jaeger, H., & Haas, H. (2004). Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication. Science, 78–80.
44. Jerez, J. M., & Atencia, M. (2005). A learning rule to model the development of orientation selectivity in visual cortex. Neural Processing Letters, 21, 1–20.
45. Jones, J. P., & Palmer, L. A. (1987). An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. Journal of Neurophysiology, 58, 1233–1258.
46. Kalisman, N., Silberberg, G., & Markram, H. (2005). The neocortical microcircuit as a tabula rasa. Proceedings of the National Academy of Sciences, USA, 102, 880– 885.
47. Kenet, T., Bibitchkov, D., Tsodyks, M., Grinvald, A., & Arieli, A. (2003). Spontaneously emerging cortical representations of visual attributes. Nature, 425, 954– 956.
48. Kohonen, T. (1995). Self-organizing maps. Berlin: Springer-Verlag.
49. Körding, K. P., Kayser, C., & König, P. (2003). On the choice of a sparse prior. Reviews in the Neurosciences, 14, 53–62.
50. Lades, M., Vorbrüggen, J., Buhmann, J., Lange, J., von der Malsburg, C., Würtz, R., et al. (1993). Distortion invariant object recognition in the dynamic link architecture. IEEE Transactions on Computers, 42, 300–311.
51. Latham, P., Richmond, B., Nelson, P., & Nirenberg, S. (2000). Intrinsic dynamics in neuronal networks. I. Theory. Journal of Neurophysiology, 83, 808–827.
52. Li, Z. (2002). A saliency map in primary visual cortex. Trends in Cognitive Sciences, 6, 9–16.
53. Lücke, J. (2004). Hierarchical self-organization of minicolumnar receptive fields. Neural Networks, 17, 1377–1389.
54. Lücke, J. (2005). Dynamics of cortical columns—sensitive decision making. In Proc. International Conference on Artificial Neural Networks (pp. 25–30). Berlin: Springer.
55. Lücke, J. (2006). Learning of representations in a canonical model of cortical columns. In Proc. Computational and Systems Neuroscience (p. 100). Available online at http://www.cosyne.org.
56. Lücke, J., & Sahani, M. (2008). Maximal causes for non-linear component extraction. Journal of Machine Learning Research, 9, 1227–1267.
57. Lücke, J., & von der Malsburg, C. (2004). Rapid processing and unsupervised learning in a model of the cortical macrocolumn. Neural Computation, 16, 501–533.
58. Lücke, J., von der Malsburg, C., & Würtz, R. P. (2002). Macrocolumns as decision units. In Proc. International Conference on Artificial Neural Networks (pp. 57–62). Berlin: Springer.
59. Maass, W., Natschläger, T., & Markram, H. (2002). Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural Computation, 14, 2531–2560.
60. Martinez, L. M., Wang, Q., Reid, R. C., Pillai, C., Alonso, J. M., Sommer, F. T., et al. (2005). Receptive field structure varies with layer in the primary visual cortex. Nature Neuroscience, 8, 372–379.
61. Martinez-Conde, Macknik, S., & Hubel, D. (2004). The role of fixational eye movements in visual perception. Nature Reviews, 5, 229–240.
62. Mechler, F., & Ringach, D. L. (2002). On the classification of simple and complex cells. Vision Research, 42, 1017–1033.
63. Meredith, R. M., Floyer-Lea, A. M., & Paulsen, O. (2003). Maturation of long-term potentiation induction rules in rodent hippocampus: Role of GABAergic inhibition. Journal of Neuroscience, 23, 11142–11146.
64. Miller, K. D., Pinto, D. J., & Simons, D. J. (2001). Processing in layer 4 of the neocortical circuit: New insights from visual and somatosensory cortex. Current Opinion in Neurobiology, 11, 488–497.
65. Mountcastle, V. (1978). An organizing principle for cerebral function: The unit model and the distributed system. In G. Edelman & V. Mountcastle (Eds.), The mindful brain. Cambridge, MA: MIT Press.
66. Mountcastle, V. B. (1997). The columnar organization of the neocortex. Brain, 120, 701–722.
67. Müller-Dahlhaus, J. F. M., Orekhov, Y., Liu, Y., & Ziemann, U. (2008). Interindividual variability and age-dependency of motor cortical plasticity induced by paired associative stimulation. Experimental Brain Research, 187, 467–475.
68. Muresan, R. C., & Savin, C. (2007). Resonance or integration? Self-sustained dynamics and excitability of neural microcircuits. Journal of Neurophysiology, 97, 1911–1930.
69. Nicolis, G., & Prigogine, I. (1977). Self-organization in nonequilibrium systems: From dissipative structures to order through fluctuations.NewYork:Wiley.
70. Olshausen, B. A. (2002). Probabilistic models of the brain: Perception and neural function. Cambridge, MA: MIT Press.
71. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381, 607–609.
72. O’Reilly, R. C. (2001). Generalization in interactive networks: The benefits of inhibitory competition and Hebbian learning. Neural Computation, 13, 1199– 1241.
73. Osindero, S., Welling, M., & Hinton, G. E. (2006). Topographic product models applied to natural scene statistics. Neural Computation, 18, 381–414.
74. Palm, G. (1982). Neural assemblies: An alternative approach to artificial intelligence. Springer: Berlin.
75. Peters, A., & Payne, B. R. (1993). Numerical relationships between geniculocortical afferents and pyramidal cell modules in cat primary visual cortex. Cerebral Cortex, 3, 69–78.
76. Peters, A., & Sethares, C. (1996). Myelinated axons and the pyramidal cell modules in monkey primary visual cortex. Journal of Comparative Neurology, 365, 232–255.
77. Peters, A., & Yilmaz, E. (1993). Neuronal organization in area 17 of cat visual cortex. Cerebral Cortex, 3, 49–68.
78. Raizada, R. D. S., & Grossberg, S. (2003). Towards a theory of the laminar architecture of cerebral cortex: Computational clues from the visual system. Cerebral Cortex, 13, 100–113.
79. Rehn, M., & Sommer, F. T. (2007). A network that uses few active neurones to code visual input predicts the diverse shapes of cortical receptive fields. Journal of Computational Neuroscience, 22, 135–146.
80. Riesenhuber, M., & Poggio, T. (1999). Hierarchical models of object recognition in cortex. Nature Neuroscience, 211, 1019–1025.
81. Ringach, D. L. (2002). Spatial structure and symmetry of simple-cell receptive fields in macaque primary visual cortex. Journal of Neurophysiology, 88, 455–463.
82. Roxin, A., & Ledberg, A. (2008). Neurobiological models of two-choice decision making can be reduced to a one-dimensional nonlinear diffusion equation. PLoS Computational Biology, 4.
83. Saund, E. (1995). A multiple cause mixture model for unsupervised learning. Neural Computation, 7, 51–71.
84. Seriès, P., Lorenceau, J., & Frégnac, Y. (2003). The silent surround of V1 receptive fields: Theory and experiments. Journal of Physiology Paris, 97, 453–474.
85. Somers, D., Nelson, S., & Sur, M. (1995). An emergent model of orientation selectivity in cat visual cortical simple cells. Journal of Neuroscience, 15, 5448–5465.
86. Spratling, M. W. (2006). Learning image components for object recognition. Journal of Machine Learning Research, 7, 793–815.
87. Spratling, M. W., & Johnson, M. H. (2002). Preintegration lateral inhibition enhances unsupervised learning. Neural Computation, 14, 2157–2179.
88. Swadlow, H. A. (2002). Thalamocortical control of feed-forward inhibition in awake somatosensory barrel cortex. Philosophical Transactions of the Royal Society B, 357, 1717–1727.
89. Tao, H. W., Zhang, L. I., Bi, G., & Poo, M. (2000). Selective presynaptic propagation of long-term potentiation in defined neural networks. Journal of Neuroscience, 20, 3233–3243.
90. Thomson, A. M., West, D. C., Wang, Y., & Bannister, A. P. (2002). Synaptic connections and small circuits involving excitatory and inhibitory neurons in layers 2–5 of adult rat and cat neocortex: Triple intracellular recordings and biocytin labelling in vitro. Cerebral Cortex, 12, 936–953.
91. Ueda, N., & Nakano, R. (1998). Deterministic annealing EM algorithm. Neural Networks, 11, 271–282.
92. van Hateren, J. H., & van der Schaaf, A. (1998). Independent component filters of natural images compared with simple cells in primary visual cortex. Proceedings of the Royal Society of London B, 265, 359 –366.
93. van Vreeswijk, C., & Sompolinsky, H. (1998). Chaotic balanced state in a model of cortical circuits. Neural Computation, 10, 1321–1371.
94. von der Malsburg, C. (1973). Self-organization of orientation sensitive cells in the striate cortex. Kybernetik, 14, 85–100.
95. White, L. E., Coppola, D. M., & Fitzpatrick, D. (2001). The contribution of sensory experience to the maturation of orientation selectivity in ferret visual cortex. Nature, 411, 1049–1052.
96. Wilson, H. R., & Cowan, J. D. (1973). A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Kybernetik, 13, 55–80.
97. Wong, K., & Wang, X. (2006). A recurrent network mechanism of time integration in perceptual decisions. Journal of Neuroscience, 26, 1314–1328.
98. Yoshimura, Y., Dantzker, J. L. M., & Callaway, E. M. (2005). Excitatory cortical neurons form fine-scale functional networks. Nature, 433, 868–873.
99. Yu, A. J., Giese, M. A., & Poggio, T. A. (2002). Biophysiologically plausible implementations of the maximum operation. Neural Computation, 14, 2857–2881.
100. Yuille, A. L., & Geiger, D. (2003). Winner-take-all networks. In M. Arbib (Ed.), The handbook of brain theory and neural networks (pp. 1228–1231). Cambridge, MA: MIT Press.