Towards cortex sized artificial neural systems

Neural Networks

Volumn 20, Issue 1, 2007, Pages 48-61

  Johansson, Christopher ^a   Lansner, Anders ^a  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

Author keywords

Attractor neural networks; Cerebral cortex; Cluster computers; Cortical model; Fixed point arithmetic; Hypercolumns; Large scale implementation; Neocortex

Indexed keywords

COMPUTATIONAL METHODS; COMPUTER SIMULATION; LEARNING SYSTEMS; MATHEMATICAL MODELS; NEUROLOGY; SPURIOUS SIGNAL NOISE;

ATTRACTOR NEURAL NETWORKS; CEREBRAL CORTEX; CLUSTER COMPUTERS; CORTICAL MODEL; LARGE SCALE IMPLEMENTATION; NEOCORTEX;

NEURAL NETWORKS;

ARITHMETIC; ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER; LEARNING; MAMMAL; MATHEMATICAL MODEL; MOUSE; NEOCORTEX; NOISE REDUCTION; NONHUMAN; PRIORITY JOURNAL; RAT; SIMULATION;

ALGORITHMS; ANIMALS; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; HUMANS; LEARNING; MENTAL RECALL; MODELS, NEUROLOGICAL; NEOCORTEX; NERVE NET; NEURAL INHIBITION; NEURONS;

EID: 33845642736     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2006.05.029     Document Type: Article

References (93)

1. Alonso J.-M. Neural connections and receptive field properties in the primary visual cortex. The Neuroscientist 8 5 (2002) 443-456
2. Bailey, J., & Hammerstrom, D. (1988). Why VLSI Implementations of Associative VLCNs Require Connection Multiplexing. In Paper presented at the international conference on neural networks
3. Bair W., and Koch C. Temporal precision of spike trains in extrastriate cortex of the behaving macaque monkey. Neural Computation 8 (1996) 1185-1202
4. Bartlett M.S., and Sejnowski T.J. Learning viewpoint-invariant face representations from visual experience in an attractor network. Network: Computation in Neural Systems 9 3 (1998) 399-417
5. Beaulieu C. Numerical data on neocortical neurons in adult rat, with special reference to the GABA population. Brain Research 609 (1993) 284-292
6. Beaulieu C., and Colonnier M. Number and size of neurons and synapses in the motor cortex of cats raised in different environmental complexities. The Journal of Comparative Neurology 289 (1989) 178-187
7. Beaulieu C., Kisvarday Z., Somogyi P., Cynader M., and Cowey A. Quantitative distribution of GABA-immunopositive and -immunonegative neurons and synapses in the monkey striate cortex (Area 17). Cerebral Cortex 2 4 (1992) 295-309
8. Bosking W.H., Zhang Y., Schofield B., and Fitzpatrick D. Orientation selectivity and the arrangement of horizontal connections in tree shrew striate cortex. The Journal of Neuroscience 17 6 (1997) 2112-2127
9. Bourgeois J.P., and Rakic P. Changes of synaptic density in the primary visual cortex of the macaque monkey from fetal to adult stage. The Journal of Neuroscience 13 7 (1993) 2801-2820
10. Braitenberg V., and Schüz A. Cortex: Statistics and geometry of neuronal connectivity (1998), Springer Verlag, New York
11. Buxhoeveden D.P., and Casanova M.F. The minicolumn hypothesis in neuroscience. Brain 125 5 (2002) 935-951
12. Buxhoeveden D.P., Switala A.E., Roy E., and Casanova M.F. Quantitative analysis of cell columns in the cerebral cortex. Journal of Neuroscience Methods 97 (2000) 7-17
13. CCortex, (2003). Press Release: Artificial Development to build world's biggest spiking neural network
14. Cossart R., Aronov D., and Yuste R. Attractor dynamics of network UP states in the neocortex. Nature 423 6937 (2003) 283-288
15. Cürüklü, B., & Lansner, A. (2002). An abstract model of a cortical hypercolumn, In Proceedings of the 9th international conference on neural information processing, vol. 1 (pp. 80-85)
16. De Schutter E. Using realistic models to study synaptic integration in cerebellar Purkinje cells. Reviews in the Neurosciences 10 3-4 (1999) 233-245
17. DeFelipe J., Conley M., and Jones E.G. Long-range focal collateralization of axons arising from corticocortical cells in monkey sensory-motor cortex. The Journal of Neuroscience 6 12 (1986) 3749-3766
18. Deiss S.R., Douglas R.J., and Whatley A.M. A pulse-coded communication infrastructure for neuromorphic systems. In: Maass W., and Bishop C.M. (Eds). Pulsed neural networks (1999), MIT Press 157-178
19. Dell (2004). Press release: Leading Swedish university boosts research productivity with high-performance computing cluster from DELL, INTEL Corporation, Scali and Mellanox
20. Delorme A., and Thorpe S. SpikeNet: An event-driven simulation package for modelling large networks of spiking neurons. Network: Computation in Neural Systems 14 (2003) 613-627
21. Dombrowski S., Hilgetag C., and Barbas H. Quantitative architecture distinguishes prefrontal cortical systems in the rhesus monkey. Cerebral Cortex 11 10 (2001) 975-988
22. Drubach D.A., Makley M., and Dodd M.L. Manipulation of central nervous system plasticity: A new dimension in the care of neurologically impaired patients. Mayo Clinic Proceedings 79 6 (2004) 796-800
23. Feldman J.A., and Ballard D.H. Connectionist models and their properties. Cognitive Science 6 3 (1982) 205-254
24. Fransén E., and Lansner A. A model of cortical associative memory based on a horizontal network of connected columns. Network: Computation in Neural Systems 9 2 (1998) 235-264
25. Fuster J.M. Memory in the cerebral cortex (1995), MIT Press, London
26. Gara A., Blumrich M.A., Chen D., Chiu G.L.-T., Coteus P., Giampapa M.E., et al. Overview of the Blue Gene/L system architecture. IBM Journal of Research and Development 49 2-3 (2005) 195-212
27. Gilbert C.D., and Wiesel T.N. Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex. The Journal of Neuroscience 9 7 (1989) 2432-2442
28. Goldman P.S., and Nauta W.J.H. Columnar distribution of cortico-cortical fibers in the frontal association, limbic, and motor cortex of the developing rhesus monkey. Brain Research 122 3 (1977) 393-413
29. González-Burgos G., Barrionuevo G., and Lewis D.A. Horizontal synaptic connections in monkey prefrontal cortex: An in vitro electrophysiological study. Cerebral Cortex 10 1 (2000) 82-92
30. Grossberg S. Competitive learning: From interactive activation to adaptive resonance. Cognitive Science 11 (1987) 23-63
31. Harris, F.C., Baurick, J., Frye, J., King, J.G., Ballew, M.C., & Goodman, P.H. et al. (2002). A novel parallel hardware and software solution for a large-scale biologically realistic cortical simulation. Goodman Brain Computation Lab, University of Nevada
32. Henry C. Basal metabolic rate studies in humans: measurement and development of new equations [Special issue]. Public Health Nutrition 8 1 (2005) 1133-1152
33. Hoehfeld M., and Fahlman S.E. Learning with limited numerical precision using the cascade-correlation algorithm. IEEE Transactions on Neural Networks 3 4 (1992) 602-611
34. Hofman M.A. Size and shape of the cerebral cortex in mammals: I. The cortical surface. Brain, Behavior and Evolution 27 (1985) 28-40
35. Hofman M.A. Size and shape of the cerebral cortex in mammals: II. The cortical volume. Brain, Behavior and Evolution 32 (1988) 17-26
36. Holmgren C., Harkany T., Svennenfors B., and Zilberter Y. Pyramidal cell communication within local networks in layer 2/3 of rat neocortex. Journal of Physiology 551 1 (2003) 139-153
37. Hopfield J.J. Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences of the United States of America 79 (1982) 2554-2558
38. Hubel D.H., and Wiesel T.N. Functional architecture of macaque monkey visual cortex. Proceedings of the Royal Society of London B 198 (1977) 1-59
39. Haug H. Brain sizes, surfaces, and neuronal sizes of the cortex cerebri: A stereological investigation of man and his variability and a comparision with some mammals (primates, whales, marsupials, insectivores, and one elephant). American Journal of Anatomy 180 (1987) 126-142
40. Johansson C., and Lansner A. Towards cortex sized artificial nervous systems. Proceedings of the international conference on knowledge-based intelligent information and engineering systems. LNAI Vol. 3213 (2004) 959-966
41. Johansson C., Sandberg A., and Lansner A. A neural network with hypercolumns. Proceedings of the international conference on artificial neural networks. LNCS Vol. 2415 (2002) 192-197
42. Kandel E.R., Schwartz J.H., and Jessell T.M. Principles of neural science. 4th ed. (2000), McGraw-Hill, New York
43. Kanter I. Potts-glass models of neural networks. Physical Review A 37 7 (1988) 2739-2742
44. Kenan-Vaknin G., Ouaknine G.E., Razon N., and Malach R. Organization of layers II-III connections in human visual cortex revealed by in vitro injections of biocytin. Brain Research 594 2 (1992) 339-342
45. Kisvarday Z., Toth E., Rausch M., and Eysel U. Orientation-specific relationship between populations of excitatory and inhibitory lateral connections in the visual cortex of the cat. Cerebral Cortex 7 7 (1997) 605-618
46. Koch C. Biophysics of computation: Information processing in single neurons (1999), Oxford University Press, New York
47. Korbo L., Pakkenberg B., Ladefoged O., Gundersen H.J.G., Arlien-Søborg P., and Pakkenberg H. An efficient method for estimating the total number of neurons in rat brain cortex. Journal of Neuroscience Methods 31 2 (1990) 93-100
48. Kozloski J., Hamzei-Sichani F., and Yuste R. Stereotyped position of local synaptic targets in neocortex. Science 293 5531 (2001) 868-872
49. Kumar, S., & Kal, L.V. (2004). Scaling all-to-all multicast on fat-tree networks. In Paper presented at the 10th international conference on parallel and distributed systems
50. Lansner A., and Ekeberg Ö. A one-layer feedback artificial neural network with a Bayesian learning rule. International Journal of Neural Systems 1 1 (1989) 77-87
51. Lansner A., Fransén E., and Sandberg A. Cell assembly dynamics in detailed and abstract attractor models of cortical associative memory. Theory in Biosciences 122 (2003) 19-36
52. Lansner A., and Holst A. A higher order Bayesian neural network with spiking units. International Journal of Neural Systems 7 2 (1996) 115-128
53. Leise E.M. Modular construction of nervous systems: A basic principle of design for invertebrates and vertebrates. Brain Research Review 15 (1990) 1-23
54. Lennie P. The cost of cortical computation. Current Biology 13 (2003) 493-497
55. Lücke J., and Malsburg C.v.d. Rapid processing and unsupervised learning in a model of the cortical macrocolumn. Neural Computation 16 3 (2004) 501-533
56. Malach R., Amir Y., Harel M., and Grinvald A. Relationship between intrinsic connections and functional architecture revealed by optical imaging and in vivo targeted biocytin injections in primate striate cortex. Proceedings of the National Academy of Sciences of the United States of America 90 22 (1993) 10469-10473
57. Martin K.A.C. Microcircuits in visual cortex. Current Opinion in Neurobiology 12 4 (2002) 418-425
58. Mattia M., and Giudice P.D. Efficient event-driven simulation of large networks of spiking neurons and dynamical synapses. Neural Computation 12 (2000) 2305-2329
59. Mehrtash N., Jung D., Hellmich H.H., Schoenauer T., Lu V.T., and Klar H. Synaptic plasticity in spiking neural networks (SP2INN): A system approach. IEEE Transactions on Neural Networks 14 5 (2003) 980-992
60. Melton M., Phan T., Reeves D.S., and Van den Bout D.E. The TInMANN VLSI chip. IEEE Transactions on Neural Networks 3 3 (1992) 375-384
61. Miki T., Fukui Y., Itho M., Hisano S., Xie Q., and Takeuchi Y. Estimation of the numerical densities of neurons and synapses in cerebral cortex. Brain Research Protocols 2 (1997) 9-16
62. Mortara A., and Vittoz E.A. A communication architecture tailored for analog VLSI artificial neural networks: Intrinsic performance and limitations. IEEE Transactions on Neural Networks 5 3 (1994) 459-466
63. Mountcastle V.B. Modality and topographic properties of single neurons of cat's somatic sensory cortex. Journal of Neurophysiology 20 (1957) 408-434
64. Mountcastle V.B. The columnar organization of the neocortex. Brain 120 (1997) 701-722
65. Nene, S.A., Nayar, S.K., & Murase, H. (1996). Columbia Object Image Library (COIL-100) (No. CUCS-006-96): Columbia Automated Vision Environment
66. Nieuwenhuys R., Donkelaar H.J.t., and Nicholson C. Section 22.11.6.6; Neocortex: Quantitative Aspects and Folding. The Central Nervous System of Vertebrates (Vol. 3, 2008-2013) (1997), Springer-Verlag, Heidelberg
67. O'Kane D., and Treves A. Why the simplest notion of neocortex as an autoassociative memory would not work. Network: Computation in Neural Systems 3 4 (1992) 379-384
68. Pakkenberg B., and Gundersen H.J.G. Neocortical Neuron Number in Humans: Effect of Sex and Age. The Journal of Comparative Neurology 384 (1997) 312-320
69. Pakkenberg B., Pelvig D., Marner L., Bundgaard M.J., Gundersen H.J., Nyengaard J.R., et al. Aging and the human neocortex. Experimental Gerontology 38 (2003) 95-99
70. Palm G. On associative memory. Biological Cybernetics 36 1 (1980) 19-31
71. Palm G. Neural assemblies: An alternative approach to artificial intelligence vol. 7 (1982), Springer-Verlag, New York
72. Peláez J.R. Towards a neural network based therapy for hallucinatory disorders. Neural Networks 13 8-9 (2000) 1047-1061
73. Peters A., and Yilmaz E. Neuronal organization in area 17 of cat visual cortex. Cerebral Cortex 3 1 (1993) 49-68
74. Ringach D.L., Hawken M.J., and Shapley R. Dynamics of orientation tuning in macaque primary visual cortex. Nature 387 6630 (1997) 281-284
75. Rockel A.J., Hiorns R.W., and Powell T.P.S. The basic uniformity in structure of the neocortex. Brain 103 (1980) 221-244
76. Rolls E.T., and Treves A. Neural networks and brain function (1998), Oxford University Press, New York
77. Ruppin E., and Reggia J.A. Patterns of functional damage in neural network models of associative memory. Neural Computation 7 5 (1995) 1105-1127
78. Salin P.-A., and Bullier J. Corticocortical connections in the visual system: Structure and function. Physiological Reviews 75 1 (1995) 107-154
79. Sandberg A., Lansner A., Petersson K.-M., and Ekeberg Ö. A palimpsest memory based on an incremental Bayesian learning rule. Neurocomputing 32-33 (2000) 987-994
80. Sandberg A., Lansner A., Petersson K.-M., and Ekeberg Ö. A Bayesian attractor network with incremental learning. Network: Computation in Neural Systems 13 2 (2002) 179-194
81. Sandberg A., Tegnér J., and Lansner A. A working memory model based on fast learning. Network: Computation in Neural Systems 14 4 (2003) 789-802
82. Schüz A., and Preibl H. Basic connectivity of the cerebral cortex and some considerations on the corpus callosum. Neuroscience & Biobehavioral Reviews 20 4 (1996) 567-570
83. Seiffert U. Artificial neural networks on massively parallel computer hardware. Neurocomputing 57 (2004) 135-150
84. Shu Y., Hasenstaub A., and Mccormick D.A. Turning on and off recurrent balanced cortical activity. Nature 423 6937 (2003) 288-293
85. Silberberg G., Gupta A., and Markram H. Stereotypy in neocortical microcircuits. Trends in Neurosciences 25 5 (2002) 227-230
86. Silver R.A., Lübke J., Sakmann B., and Feldmeyer D. High-probability uniquantal transmission at excitatory synapses in barrel cortex. Science 302 5652 (2003) 1981-1984
87. Telfeian A.E., and Connors B.W. Widely integrative properties of layer 5 pyramidal cells support a role for processing of extralaminar synaptic inputs in rat neocortex. Neuroscience Letters 343 2 (2003) 121-124
88. Thomson A.M., and Bannister A.P. Interlaminar connections in the neocortex. Cerebral Cortex 13 1 (2003) 5-14
89. Treves A. Frontal latching networks: A possible neural basis for infinite recursion. Cognitive Neuropsychology 22 3-4 (2005) 276-291
90. Willshaw D.J., Buneman O.P., and Longuet-Higgins H.C. Non-holographic associative memory. Nature 222 (1969) 960-962
91. Yang Y., and Wang J. Near-optimal all-to-all broadcast in multidimensional all-port meshes and tori. IEEE Transactions on Parallel and Distributed Systems 13 2 (2002) 128-141
92. Yousef T., Bonhoeffer T., Kim D.-S., Eysel U.T., Tóth É., and Kisvárday Z.F. Orientation topography of layer 4 lateral networks revealed by optical imaging in cat visual cortex (area 18). European Journal of Neuroscience 11 12 (1999) 4291-4308
93. Zhu, S., & Hammerstrom, D. (2002). Simulation of associative neural networks, In Proceedings of the 9th international conference on neural information processing, vol. 4 (pp. 1639-1643)