Rapid Processing and Unsupervised Learning in a Model of the Cortical Macrocolumn

Neural Computation

Volumn 16, Issue 3, 2004, Pages 501-533

  Lücke, Jörg ^a   Von der Malsburg, Christoph ^a  

^a RUHR UNIVERSITY BOCHUM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; BRAIN CORTEX; COMPUTER SIMULATION; CYTOLOGY; HUMAN; LEARNING; NERVE CELL; NERVE CELL PLASTICITY; NONLINEAR SYSTEM; PHYSIOLOGY; SENSORY NERVE;

AFFERENT PATHWAYS; CEREBRAL CORTEX; COMPUTER SIMULATION; HUMANS; LEARNING; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONAL PLASTICITY; NEURONS; NONLINEAR DYNAMICS;

EID: 10744227912     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976604772744893     Document Type: Article

References (48)

1. Anninos, P. A., Beek, B., Csermely, T. J., Harth, E. M., & Fertile, G. (1970). Dynamics of neural structures. J. Theo. Biol., 26, 121-148.
2. Barlow, H. B. (1972). Single units and sensation: A neuron doctrine for perceptual psychology. Perception, 1, 371-394.
3. Budd, J. M. L., & Kisvarday, Z. F. (2001). Local lateral connectivity of inhibitory clutch cells in layer 4 of cat visual cortex. Exp. Brain Res., 140(2), 245-250.
4. Buxhoeveden, D. P., & Casanova, M. F. (2002). The minicolumn and evolution of the brain. Brain, Behavior and Evolution, 60, 125-151.
5. Charles, D., & Fyfe, C. (1998). Modelling multiple-cause structure using rectification constraints. Network: Computation in Neural Systems, 9, 167-182.
6. Constantinidis, C., Franowicz, M. N., & Goldman-Rakic, P. S. (2001). Coding specificity in cortical microcircuits: A multiple-electrode analysis of primate prefrontal cortex. J. Neuroscience, 21, 3646-3655.
7. Dayan, P., & Zemel, R. S. (1995). Competition and multiple cause models. Neural Computation, 7, 565-579.
8. DeFelipe, J., Hendry, S.H.C., Hashikawa, T., Molinari, M., & Jones, E. G. (1990). A microcolumnar structure of monkey cerebral cortex revealed by immuno-cytochemical studies of double bouquet cell axons. Neuroscience, 37, 655-673.
9. DeFelipe, J., Hendry, S.H.C., & Jones, E. G. (1989). Synapses of double bouquet cells in monkey cerebral cortex. Brain Res., 503, 49-54.
10. Elston, G. N., & Rosa, M.P.G. (2000). Pyramidal cells, patches, and cortical columns: A comparative study of infragranular neurons in TEO, TE, and the superior temporal polysensory areas of the macaque monkey. J. Neuroscience, 20, 1-5.
11. Favorov, O. V., & Diamond, M. (1990). Demonstration of discrete place-defined columns, segregates, in cat SI. J. Comparative Neurology, 298, 97-112.
12. Favorov, O. V., & Kelly, D. G. (1996). Stimulus-response diversity in local neuronal populations of the cerebral cortex. Neuroreport, 7(14), 2293-2301.
13. Favorov, O. V., & Whitsel, B. L. (1988). Spatial organization of the peripheral input to area 1 cell columns I. The detection of "segregates". Brain Res., 472, 25-42.
14. Foldiák, P. (1990). Forming sparse representations by local anti-Hebbian learning. Biological Cybernetics, 64, 165-170.
15. Fransen, E., & Lansner, A. (1998). A model of cortical associative memory based on a horizontal network of connected columns. Network-Computation in Neural Systems, 9(2), 235-264.
16. Frey, B. J., Dayan, P., & Hinton, G. E. (1997). A simple algorithm that discovers efficient perceptual codes. In M. Jenkin and L. R. Harris (Eds.), Computational and psychophysical mechanisms of visual coding. Cambridge: Cambridge University Press.
17. Fukai, T. (1994). A model of cortical memory processing based on columnar organization. Biological Cybernetics, 70, 427-434.
18. Fyfe, C. (1997). A neural network for PCA and beyond. Neural Processing Letters, 6, 33-41.
19. Harpur, G. F., & Prager, R. W. (1996). Development of low entropy coding in a recurrent network. Network-Computation in Neural Systems, 7, 277-284.
20. Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M. (1995). The "wake-sleep" algorithm for unsupervised neural networks. Science, 268, 1158-1161.
21. Hinton, G. E., & Ghahramani, Z. (1997). Generative models for discovering sparse distributed representations. Phil Trans. Royal Soc. London, Series B, Biological Sciences, 352, 1177-1190.
22. Hochreiter, S., & Schmidhuber, J. (1999). Feature extraction through LOCOCODE. Neural Computation, 11, 679-714.
23. Hopfield, J. J. (1982). Neural networks and physical systems with collective computational abilities. Proceedings of the National Academy of Sciences, 79, 2554-2558.
24. Hopfield, J. J., & Tank, D. W. (1986). Computing with neural circuits: A model. Science, 233, 625-633.
25. Jones, E. G. (2000). Microcolumns in the cerebral cortex. PNAS, 97, 5019-5021.
26. Lao, R., Favorov, O. V., & Lu, J. P. (2001). Nonlinear dynamical properties of a somatosensory cortical model. Information Science, 132, 53-66.
27. Lubke, J., Egger, V., Sakmann, B., & Feldmeyer, D. (2000). Columnar organization of dendrites and axons of single and synaptical coupled excitatory spiny neurons in layer 4 of the rat barrel cortex. J. Neuroscience, 20, 5300-5311.
28. Lücke, J., von der Malsburg, C., & Würtz, R. P. (2002). Macrocolumns as decision units. In Artificial Neural Networks - ICANN 2002, LNCS 2415 (pp. 57-62). New York: Springer-Verlag.
29. Marshall, J. A. (1995). Adaptive perceptual pattern recognition by self-organizing neural networks: Context, uncertainty, multiplicity, and scale. Neural Networks, 8, 335-362.
30. Mountcastle, V. B. (1997). The columnar organization of the neocortex. Brain, 120, 701-722.
31. Nowak, L. G., & Bullier, J. (1997). The timing of information transfer in the visual system. Cerebral Cortex, 12, 205-241
32. O'Reilly, R. C. (2001). Generaliztion in interactive networks: The benefits of inhibitory competition and Hebbian learning. Neural Computation, 13, 1199-1241.
33. Perez-Orive, J., Mazor, O., Turner, G. C., Cassenaer, S., Wilson, R. I., & Laurent, G. (2002). Oscillations and sparsening of odor representations in the mushroom body. Science, 297(5580), 359-365.
34. Peters, A., Cifuentes, J. M., & Sethares, C. (1997). The organization of pyramidal cells in area 18 of the rhesus monkey. Cerebral Cortex, 7, 405-421.
35. Peters, A., & Sethares, C. (1996). Myelinated axons and the pyramidal cell modules in monkey primary visual cortex. J. Comp. Neurology, 365, 232-255.
36. Peters, A., & Sethares, C. (1997). The organization of double bouquet cells in monkey striate cortex. J. Neurocytology, 26, 779-797.
37. Peters, A., & Yilmaze, E. (1993). Neuronal organization in area 17 of cat visual cortex. Cerebral Cortex, 3, 49-68.
38. Reichardt, W., Poggio, T., & Hausen, K. (1983). Figure-ground discrimination by relative movement in the visual system of the fly. Biol. Cybern., 46 (Suppl.), 1-30.
39. Saund, E. (1995). A multiple cause mixture model for unsupervised learning. Neural Computation, 7, 51-71.
40. Singer, W. (2003). Synchronization, binding and expectancy. In M. A. Arbib (Ed.), The handbook of brain theory and neural networks (pp 1136-1143). Cambridge, MA: MIT Press.
41. Somers, D. C., Nelson, S. B., & Sur, M. (1995). An emergent model of orientation selectivity in cat visual cortical simple cells. J. Neuroscience, 15, 5448-5465.
42. Spratling, M. W. & Johnson, M. H. (2002). Preintegration lateral inhibition enhances unsupervised learning, Neural Computation, 14, 2157-2179.
43. Thomson, A. M., & Deuchars, J. (1994). Temporal and spatial properties of local circuits in neocortex. Trends in Neuroscience, 17, 119-126.
44. Thorpe, S. (1988). Identification of rapidly presented images by the human visual system. Perception, 27,(A77), 415.
45. Thorpe, S., Fize, F., & Marlot, C. (1996). Speed of processing in the human visual system. Nature, 381, 520-522.
46. Wespatat, V., Tennigkeit, F., & Singer, W. (2003). Phase sensitivity of Hebbian modifications in oscillating cells of rat visual cortex. Manuscript submitted for publication.
47. Wilson, H. R., & Cowan, J. D. (1973). A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Kybernetik, 13, 55-80.
48. Yu, A. J., Giese, M. A., & Poggio, T. A. (2002). Biophysiologically plausible implementations of the maximum operation. Neural Computation, 14, 2857-2881.