Six networks on a universal neuromorphic computing substrate

Frontiers in Neuroscience

Volumn , Issue 7 FEB, 2013, Pages

  Pfeil, Thomas ^a   Grübl, Andreas ^a   Jeltsch, Sebastian ^a   Müller, Eric ^a   Müller, Paul ^a   Petrovici, Mihai A ^a   Schmuker, Michael ^b,c   Brüderle, Daniel ^a   Schemmel, Johannes ^a   Meier, Karlheinz ^a  

^a UNIVERSITY OF HEIDELBERG   (Germany)

^b FREIE UNIVERSITÄT BERLIN   (Germany)

^c BERNSTEIN CENTER FOR COMPUTATIONAL NEUROSCIENCE   (Germany)

Author keywords

Accelerated neuromorphic hardware system; Classifier; Cortical model; Highly configurable; Mixed signal VLSI; Soft winner take all; Spiking neural networks; Universal computing substrate

Indexed keywords

ANTENNA; ARTICLE; COMPUTER MODEL; COMPUTER SYSTEM; INSECT; NERVE CELL; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NERVE POTENTIAL; NONHUMAN; SCIENTIST; SYNAPSE; TISSUE STRUCTURE;

EID: 84878827374     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2013.00011     Document Type: Article

References (86)

1. Abeles, M., Hayon, G., and Lehmann, D. (2004). Modeling compositionality by dynamic binding of synfire chains. J. Comput. Neurosci. 17, 179-201.
2. Aertsen, A., Diesmann, M., and Gewaltig, M.-O. (1996). Propagation of synchronous spiking activity in feedforward neural networks. J. Physiol. (Paris) 90, 243-247.
3. Akay, M. (2007). Handbook of Neural Engineering - Part II: Neuro-Nanotechnology: Artificial Implants and Neural Prosthesis. New York: Wiley-IEEE Press.
4. Aviel, Y., Mehring, C., Abeles, M., and Horn, D. (2003). On embedding synfire chains in a balanced network. Neural Comput. 15, 1321-1340.
5. Baker, S. N., Spinks, R., Jackson, A., and Lemon, R. N. (2001). Synchronization in monkey motor cortex during a precision grip task. I. Task-dependent modulation in single-unit synchrony. J. Neurophysiol. 85, 869-885.
6. Basu, A., Ramakrishnan, S., Petre, C., Koziol, S., Brink, S., and Hasler, P. (2010). Neural dynamics in reconfigurable silicon. IEEE Trans. Biomed. Circuits Syst. 4, 311-319.
7. Bi, G., and Poo, M. (1998). Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci. 18, 10464-10472.
8. Bill, J., Schuch, K., Brüderle, D., Schemmel, J., Maass, W., and Meier, K. (2010). Compensating inhomogeneities of neuromorphic VLSI devices via short-term synaptic plasticity. Front. Comput. Neurosci. 4:129. doi:10.3389/fncom.2010.00129
9. Brink, S., Nease, S., Hasler, P., Ramakrishnan, S., Wunderlich, R., Basu, A., et al. (2012). A learning-enabled neuron array IC based upon transistor channel models of biological phenomena. IEEE Trans. Biomed. Circuits Syst. PP, 1.
10. Brüderle, D., Bill, J., Kaplan, B., Kremkow, J., Meier, K., Müller, E., et al. (2010). "Simulator-like exploration of cortical network architectures with a mixed-signal VLSI system," in Proceedings of the 2010 International Symposium on Circuits and Systems (ISCAS) (Paris: IEEE Press).
11. Brüderle, D., Müller, E., Davison, A., Muller, E., Schemmel, J., and Meier, K. (2009). Establishing a novel modeling tool: a Python-based interface for a neuromorphic hardware system. Front. Neuroinform. 3:17. doi:10.3389/neuro.11.017.2009
12. Brüderle, D., Petrovici, M., Vogginger, B., Ehrlich, M., Pfeil, T., Millner, S., et al. (2011). A comprehensive workflow for general-purpose neural modeling with highly configurable neuromorphic hardware systems. Biol. Cybern. 104, 263-296.
13. Brunel, N. (2000). Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. J. Comput. Neurosci. 8, 183-208.
14. Carnevale, T., and Hines, M. (2006). The NEURON Book. Cambridge: Cambridge University Press.
15. Chen, H., Saïghi, S., Buhry, L., and Renaud, S. (2010). Real-time simulation of biologically realistic stochastic neurons in VLSI. IEEE Trans. Neural Netw. 21, 1511-1517.
16. Chicca, E., Whatley, A. M., Lichtsteiner, P., Dante, V., Delbruck, T., Del Giudice, P., et al. (2007). A multichip pulse-based neuromorphic infrastructure and its application to a model of orientation selectivity. IEEE Trans. Circuits Syst. I Regul. Pap. 54, 981-993.
17. Choudhary, S., Sloan, S., Fok, S., Neckar, A., Trautmann, E., Gao, P., et al. (2012). "Silicon neurons that compute," in Artificial Neural Networks and Machine Learning - ICANN 2012, Vol. 7552 of Lecture Notes in Computer Science, eds A. Villa, W. Duch, P. Erdi, F. Masulli, and G. Palmpages (Berlin: Springer), 121-128.
18. Davison, A., Brüderle, D., Eppler, J. M., Kremkow, J., Muller, E., Pecevski, D., et al. (2009). PyNN: a common interface for neuronal network simulators. Front. Neuroinform. 2:11. doi:10.3389/neuro.11.011.2008
19. Davison, A., Muller, E., Brüderle, D., and Kremkow, J. (2010). A common language for neuronal networks in software and hardware. Neuromorph. Eng. doi:10.2417/1201001.1712
20. Dayan, P., and Abbott, L. F. (2001). Theoretical Neuroscience. Cambridge: MIT Press.
21. Diesmann, M., Gewaltig, M.-O., and Aertsen, A. (1999). Stable propagation of synchronous spiking in cortical neural networks. Nature 402, 529-533.
22. Douglas, R. J., and Martin, K. A. C. (2004). Neuronal circuits of the neocortex. Annu. Rev. Neurosci. 27, 419-451.
23. Eppler, J. M., Helias, M., Muller, E., Diesmann, M., and Gewaltig, M. (2009). PyNEST: a convenient interface to the NEST simulator. Front. Neuroinform. 2:12. doi:10.3389/neuro.11.012.2008
24. Farquhar, E., and Hasler, P. (2005). A bio-physically inspired silicon neuron. IEEE Trans. Circuits Syst. I Regul. Pap. 52, 477-488.
25. Fieres, J., Grübl, A., Philipp, S., Meier, K., Schemmel, J., and Schürmann, F. (2004). "A platform for parallel operation of VLSI neural networks," in Proceedings of the 2004 Brain Inspired Cognitive Systems Conference (BICS) (Stirling: University of Stirling).
26. Furber, S., Lester, D., Plana, L., Garside, J., Painkras, E., Temple, S., et al. (2012). Overview of the spinnaker system architecture. IEEE Trans. Comput. PP, 1.
27. Gao, P., Benjamin, B., and Boahen, K. (2012). Dynamical system guided mapping of quantitative neuronal models onto neuromorphic hardware. IEEE Trans. Circuits Syst. I Regul. Pap. 59, 2383-2394.
28. Gewaltig, M.-O., and Diesmann, M. (2007). NEST (neural simulation tool). Scholarpedia 2, 1430.
29. Grassia, F., Buhry, L., Lévi, T., Tomas, J., Destexhe, A., and Saïghi, S. (2011). Tunable neuromimetic integrated system for emulating cortical neuron models. Front. Neurosci. 5:134. doi:10.3389/fnins.2011.00134
30. Grossberg, S. (1973). Contour enhancement, short term memory, and constancies in reverberating neural networks. Stud. Appl. Math. 52, 213-257.
31. Gupta, A., Wang, Y., and Markram, H. (2000). Organizing principles for a diversity of GABAergic interneurons and synapses in the neocortex. Science 287, 273-278.
32. Gütig, R., and Sompolinsky, H. (2006). The tempotron: a neuron that learns spike timing-based decisions. Nat. Neurosci. 9, 420-428.
33. Häusler, C., Nawrot, M. P., and Schmuker, M. (2011). "A spiking neuron classifier network with a deep architecture inspired by the olfactory system of the honeybee," in Proceedings of the 2011 5th International IEEE/EMBS Conference on Neural Engineering (Cancun: IEEE Press), 198-202.
34. Hines, M., Davison, A. P., and Muller, E. (2009). NEURON and Python. Front. Neuroinform. 3:1. doi:10.3389/neuro.11.001.2009
35. Imam, N., Akopyan, F., Arthur, J., Merolla, P., Manohar, R., and Modha, D. (2012a). "A digital neurosynaptic core using event-driven QDI circuits," in IEEE International Symposium on Asynchronous Circuits and Systems (ASYNC) (Lyngby: IEEE Press), 25-32.
36. Imam, N., Cleland, T. A., Manohar, R., Merolla, P. A., Arthur, J. V., Akopyan, F., et al. (2012b). Implementation of olfactory bulb glomerular layer computations in a digital neurosynaptic core. Front. Neurosci. 6:83. doi:10.3389/fnins.2012.00083
37. Indiveri, G., Chicca, E., and Douglas, R. (2006). A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity. IEEE Trans. Neural Netw. 17, 211-221.
38. Indiveri, G., Chicca, E., and Douglas, R. (2009). Artificial cognitive systems: from VLSI networks of spiking neurons to neuromorphic cognition. Cognit. Comput. 1, 119-127.
39. Indiveri, G., Linares-Barranco, B., Hamilton, T. J., van Schaik, A., Etienne-Cummings, R., Delbruck, T., et al. (2011). Neuromorphic silicon neuron circuits. Front. Neurosci. 5:73. doi:10.3389/fnins.2011.00073
40. Itti, L., and Koch, C. (2001). Computational modeling of visual attention. Nat. Rev. Neurosci. 2, 194-203.
41. Jaeger, H. (2001). The "Echo State" Approach to analysing and Training Recurrent Neural Networks. Technical Report GMD Report 148. German National Research Center for Information Technology, St. Augustine.
42. Kaplan, B., Brüderle, D., Schemmel, J., and Meier, K. (2009). "High-conductance states on a neuromorphic hardware system," in Proceedings of the 2009 International Joint Conference on Neural Networks. (IJCNN) (Atlanta: IEEE Press), 1524-1530.
43. Kremkow, J., Aertsen, A., and Kumar, A. (2010a). Gating of signal propagation in spiking neural networks by balanced and correlated excitation and inhibition. J. Neurosci. 30, 15760-15768.
44. Kremkow, J., Perrinet, L. U., Masson, G. S., and Aertsen, A. (2010b). Functional consequences of correlated excitatory and inhibitory conductances in cortical networks. J. Comput. Neurosci. 28, 579-594.
45. Kumar, A., Schrader, S., Aertsen, A., and Rotter, S. (2008). The high-conductance state of cortical networks. Neural Comput. 20, 1-43.
46. Lazzaro, J., Ryckebusch, S., Mahowald, M., and Mead, C. (1988). "Winner-take-all networks of O(N) complexity," in Advances in Neural Information Processing Systems (NIPS) (Denver: Morgan Kaufmann), 703-711.
47. Linster, C., and Smith, B. H. (1997). A computational model of the response of honey bee antennal lobe circuitry to odor mixtures: overshadowing, blocking and unblocking can arise from lateral inhibition. Behav. Brain Res. 87, 1-14.
48. Litvak, V., Sompolinsky, H., Segev, I., and Abeles, M. (2003). On the transmission of rate code in long feed-forward networks with excitatory-inhibitory balance. J. Neurosci. 23, 3006-3015.
49. Lundqvist, M., Compte, A., and Lansner, A. (2010). Bistable, irregular firing and population oscillations in a modular attractor memory network. PLoS Comput. Biol. 6:e1000803. doi:10.1371/journal.pcbi.1000803
50. Lundqvist, M., Rehn, M., Djurfeldt, M., and Lansner, A. (2006). Attractor dynamics in a modular network model of neocortex. Network 17, 253-276.
51. Maass, W. (2000). On the computational power of winner-take-all. Neural Comput. 12, 2519-2535.
52. Maass, W., Natschläger, T., and Markram, H. (2002). Real-time computing without stable states: a new framework for neural compuation based on perturbation. Neural Comput. 14, 2531-2560.
53. Marder, E., and Goaillard, J.-M. (2006). Variability, compensation and homeostasis in neuron and network function. Nat. Rev. Neurosci. 7, 563-574.
54. Markram, H., Wang, Y., and Tsodyks, M. (1998). Differential signaling via the same axon of neocortical pyramidal neurons. Proc. Natl. Acad. Sci. U.S.A. 95, 5323-5328.
55. Mead, C. (1989). Analog VLSI and Neural Systems. Boston, MA: Addison-Wesley.
56. Merolla, P., Arthur, J., Akopyan, F., Imam, N., Manohar, R., and Modha, D. (2011). "A digital neurosynaptic core using embedded crossbar memory with 45pJ per spike in 45nm," in Proceedings of the 2011 Custom Integrated Circuits Conference (CICC) (San Jose: IEEE Press), 1-4.
57. Merolla, P., and Boahen, K. (2006). "Dynamic computation in a recurrent network of heterogeneous silicon neurons," in Proceedings of the 2006 International Symposium on Circuits and Systems (ISCAS) (Island of Kos: IEEE Press), 4539-4542.
58. Neftci, E., Chicca, E., Indiveri, G., and Douglas, R. (2011). A systematic method for configuring VLSI networks of spiking neurons. Neural Comput. 23, 2457-2497.
59. Neftci, E., and Indiveri, G. (2010). "A device mismatch compensation method for VLSI neural networks," in Proceedings of the 2010 Biomedical Circuits and Systems Conference (BioCAS) (San Diego: IEEE Press), 262-265.
60. Nelsen, R. B. (1998). An Introduction to Copulas. (Lecture Notes in Statistics), 1st Edn. New York: Springer.
61. Oster, M., Douglas, R., and Liu, S. (2009). Computation with spikes in a winner-take-all network. Neural Comput. 21, 2437-2465.
62. Perez-Orive, J., Bazhenov, M., and Laurent, G. (2004). Intrinsic and circuit properties favor coincidence detection for decoding oscillatory input. J. Neurosci. 24, 6037-6047.
63. Perkel, D. H., Gerstein, G. L., and Moore, G. P. (1967). Neuronal spike trains and stochastic point processes. II. Simultaneous spike trains. Biophys. J. 7, 419-440.
64. Pfeil, T., Potjans, T. C., Schrader, S., Potjans, W., Schemmel, J., Diesmann, M., et al. (2012). Is a 4-bit synaptic weight resolution enough? - constraints on enabling spike-timing dependent plasticity in neuromorphic hardware. Front. Neurosci. 6:90. doi:10.3389/fnins.2012.00090
65. Prut, Y., Vaadia, E., Bergman, H., Haalman, I., Hamutal, S., and Abeles, M. (1998). Spatiotemporal structure of cortical activity: properties and behavioral relevance. J. Neurophysiol. 79, 2857-2874.
66. Renaud, S., Tomas, J., Lewis, N., Bornat, Y., Daouzli, A., Rudolph, M., et al. (2010). PAX: a mixed hardware/software simulation platform for spiking neural networks. Neural Netw. 23, 905-916.
67. Rolls, E. T., and Deco, G. (2010). The Noisy Brain: Stochastic Dynamics as a Principle. Oxford: Oxford University Press.
68. Schemmel, J., Brüderle, D., Grübl, A., Hock, M., Meier, K., and Millner, S. (2010). "A wafer-scale neuromorphic hardware system for large-scale neural modeling," in Proceedings of the 2010 International Symposium on Circuits and Systems (ISCAS) (Paris: IEEE Press), 1947-1950.
69. Schemmel, J., Brüderle, D., Meier, K., and Ostendorf, B. (2007). "Modeling synaptic plasticity within networks of highly accelerated I&F neurons," in Proceedings of the 2007 International Symposium on Circuits and Systems (ISCAS) (New Orleans: IEEE Press), 3367-3370.
70. Schemmel, J., Grübl, A., Meier, K., and Müller, E. (2006). "Implementing synaptic plasticity in a VLSI spiking neural network model," in Proceedings of the 2006 International Joint Conference on Neural Networks (IJCNN) (Vancouver: IEEE Press), 1-6.
71. 11: Computational Neuroscience&Neurotechnology Bernstein Conference&Neurex Annual Meeting 2011 109. doi:10.3389/conf.fncom.2011.53.00109
72. Schmuker, M., Yamagata, N., Nawrot, M. P., and Menzel, R. (2011b). Parallel Representation of Stimulus Identity and Intensity in a Dual Pathway Model Inspired by the Olfactory System of the Honeybee. Front. Neuroeng. 4:17. doi:10.3389/fneng.2011.00017
73. Schmuker, M., and Schneider, G. (2007). Processing and classification of chemical data inspired by insect olfaction. Proc. Natl. Acad. Sci. U.S.A. 104, 20285-20289.
74. Schrader, S., Diesmann, M., and Morrison, A. (2010). A compositionality machine realized by a hierarchic architecture of synfire chains. Front. Comput. Neurosci. 4:154. doi:10.3389/fncom.2010.00154
75. Schrader, S., Grün, S., Diesmann, M., and Gerstein, G. (2008). Detecting synfire chain activity using massively parallel spike train recording. J. Neurophysiol. 100, 2165-2176.
76. Serrano-Gotarredona, R., Oster, M., Lichtsteiner, P., Linares-Barranco, A., Paz-Vicente, R., Gómez-Rodríguez, F., et al. (2006). "AER building blocks for multi-layer multi-chip neuromorphic vision systems," in Advances in Neural Information Processing Systems, Vol. 18, eds Weiss, Y., Schölkopf, B., and Platt, J. (Cambridge, MA: MIT Press), 1217-1224.
77. Soltani, A., and Wang, X.-J. (2010). Synaptic computation underlying probabilistic inference. Nat. Neurosci. 13, 112-119.
78. Song, S., Miller, K. D., and Abbott, L. F. (2000). Competitive Hebbian learning through {spike-timing-dependent} synaptic plasticity. Nat. Neurosci. 3, 919-926.
79. Stopfer, M., Bhagavan, S., Smith, B. H., and Laurent, G. (1997). Impaired odour discrimination on desynchronization of odour-encoding neural assemblies. Nature 390, 70-74.
80. Tetzlaff, T., Morrison, A., Timme, M., and Diesmann, M. (2005). "Heterogeneity breaks global synchrony in large networks," in Proceedings of the 30th Göttingen Neurobiology Conference, Göottingen.
81. Tsodyks, M. V., and Markram, H. (1997). The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. Proc. Natl. Acad. Sci. U.S.A. 94, 719-723.
82. van Vreeswijk, C., and Sompolinsky, H. (1996). Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science 274, 1724-1726.
83. Vogels, T. P., and Abbott, L. F. (2005). Signal propagation and logic gating in networks of integrate-and-fire neurons. J. Neurosci. 25, 10786-10795.
84. Vogelstein, R., Mallik, U., Vogelstein, J., and Cauwenberghs, G. (2007). Dynamically reconfigurable silicon array of spiking neurons with conductance-based synapses. IEEE Trans. Neural Netw. 18, 253-265.
85. Wilson, R. I., and Laurent, G. (2005). Role of GABAergic inhibition in shaping odor-evoked spatiotemporal patterns in the drosophila antennal lobe. J. Neurosci. 25, 9069-9079.
86. Yazdanbakhsh, A., Babadi, B., Rouhani, S., Arabzadeh, E., and Abbassian, A. (2002). New attractor states for synchronous activity in synfire chains with excitatory and inhibitory coupling. Biol. Cybern. 86, 367-378.