Event-driven contrastive divergence for spiking neuromorphic systems

Frontiers in Neuroscience

Volumn , Issue 8 JAN, 2014, Pages

  Neftci, Emre ^a   Das, Srinjoy ^a,b   Pedroni, Bruno ^c   Kreutz Delgado, Kenneth ^a,b   Cauwenberghs, Gert ^a,c  

^a UNIVERSITY OF CALIFORNIA SAN DIEGO   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF CALIFORNIA SAN DIEGO   (United States)

Author keywords

Generative model; Markov chain monte carlo; Neuromorphic cognition; Recurrent neural network; Synaptic plasticity

Indexed keywords

ALGORITHM; ARITHMETIC; ARTICLE; ASSOCIATION; COMPUTER; CONTRASTIVE DIVERGENCE; HANDWRITING; HISTOGRAM; LEARNING; LEARNING ALGORITHM; LONG TERM DEPRESSION; LONG TERM POTENTIATION; NERVE CELL MEMBRANE POTENTIAL; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NEUROMORPHIC SYSTEM; POSTSYNAPTIC POTENTIAL; RECOGNITION; REFRACTORY PERIOD; RESTRICTED BOLTZMANN MACHINE; SPIKE TIME DEPENDENT PLASTICITY; STOCHASTIC MODEL; SYNAPSE; TASK PERFORMANCE;

EID: 84898035691     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2013.00272     Document Type: Article

References (55)

1. Amit, D., and Brunel, N. (1997). Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cereb. Cortex 7, 237-252. doi: 10.1093/cercor/7.3.237.
2. Arthur, J., Merolla, P., Akopyan, F., Alvarez, R., Cassidy, A., Chandra, S., et al. (2012). "Building block of a programmable neuromorphic substrate: a digital neurosynaptic core," in The 2012 International Joint Conference on Neural Networks (IJCNN) (Brisbane, QLD: IEEE), 1-8. doi: 10.1109/IJCNN.2012.6252637.
3. Bartolozzi, C., and Indiveri, G. (2007). Synaptic dynamics in analog VLSI. Neural Comput. 19, 2581-2603. doi: 10.1162/neco.2007.19.10.2581.
4. Bengio, Y. (2009). Learning deep architectures for ai. Found. Trends Mach. Learn. 2, 1-127. doi: 10.1561/2200000006.
5. Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pascanu, R., Desjardins, G., et al. (2010). "Theano: a CPU and GPU math expression compiler," in Proceedings of the Python for Scientific Computing Conference (SciPy). Vol. 4 (Austin, TX). Available online at: http://deeplearning.net/software/theano/.
6. Brea, J., Senn, W., and Pfister, J.-P. (2013). Matching recall and storage in sequence learning with spiking neural networks. J. Neurosci. 33, 9565-9575. doi: 10.1523/JNEUROSCI.4098-12.2013.
7. Buesing, L., Bill, J., Nessler, B., and Maass, W. (2011). Neural dynamics as sampling: a model for stochastic computation in recurrent networks of spiking neurons. PLoS Comput. Biol. 7:e1002211. doi: 10.1371/journal.pcbi.1002211.
8. Carreira-Perpinan, M. A., and Hinton, G. E. (2005). On contrastive divergence learning. Artif. Intell. Stat. 2005, 17. Available online at: http://www.gatsby.ucl.ac.uk/aistats/AIabst.htm.
9. Chicca, E. and Fusi, S. (2001). "Stochastic synaptic plasticity in deterministic aVLSI networks of spiking neurons," in Proceedings of the World Congress on Neuroinformatics, ARGESIM Reports, ed. F. Rattay (Vienna: ARGESIM/ASIM Verlag), 468-477.
10. Corneil, D., Sonnleithner, D., Neftci, E., Chicca, E., Cook, M., Indiveri, G., et al. (2012). "Function approximation with uncertainty propagation in a VLSI spiking neural network," in International Joint Conference on Neural Networks, IJCNN (Brisbane: IEEE), 2990-2996. doi: 10.1109/IJCNN.2012.6252780.
11. Cox, D. (1962). Renewal Theory. Vol. 1. London: Methuen.
12. Cruz-Albrecht, J. M., Derosier, T., and Srinivasa, N. (2013). A scalable neural chip with synaptic electronics using cmos integrated memristors. Nanotechnology 24, 384011. doi: 10.1088/0957-4484/24/38/384011.
13. Deiss, S., Douglas, R., and Whatley, A. (1998). "A pulse-coded communications infrastructure for neuromorphic systems, chapter 6," in Pulsed Neural Networks, eds W. Maass and C. Bishop (Cambridge, MA: MIT Press), 157-178.
14. Deneve, S. (2008). Bayesian spiking neurons I: inference. Neural Comput. 20, 91-117. doi: 10.1162/neco.2008.20.1.91.
15. Deneve, S., Latham, P., and Pouget, A. (2001). Efficient computation and cue integration with noisy population codes. Nature Neurosci. 4, 826-831. doi: 10.1038/90541.
16. Destexhe, A., Mainen, Z., and Sejnowski, T. (1998). "Kinetic models of synaptic transmission," in Methods in Neuronal Modelling, from Ions to Networks, eds C. Koch and I. Segev (Cambridge, MA: MIT Press), 1-25.
17. Doya, K., Ishii, S., Pouget, A., and Rao, R. (2006). Bayesian Brain Probabilistic Approaches to Neural Coding. Cambridge, MA: MIT Press. doi: 10.7551/mitpress/9780262042383.001.0001.
18. Eliasmith, C., Stewart, T., Choo, X., Bekolay, T., DeWolf, T., Tang, Y., et al. (2012). A large-scale model of the functioning brain. Science 338, 1202-1205. doi: 10.1126/science.1225266.
19. Fiser, J., Berkes, P., Orbán, G., and Lengyel, M. (2010). Statistically optimal perception and learning: from behavior to neural representations: perceptual learning, motor learning, and automaticity. Trends Cogn. Sci. 14, 119. doi: 10.1016/j.tics.2010.01.003.
20. Fusi, S., and Mattia, M. (1999). Collective behavior of networks with linear (VLSI) integrate and fire neurons. Neural Comput. 11, 633-652. doi: 10.1162/089976699300016601.
21. Gardiner, C. W. (2012). Handbook of Stochastic Methods. Berlin: Springer. doi: 10.1007/978-3-662-02377-8.
22. Gerstner, W., and Kistler, W. (2002). Spiking Neuron Models. Single Neurons, Populations, Plasticity. Cambridge: Cambridge University Press. doi: 10.1017/CBO9780511815706.
23. Goodman, D., and Brette, R. (2008). Brian: a simulator for spiking neural networks in Python. Front. Neuroinform. 2:5. doi: 10.3389/neuro.11.005.2008.
24. Griffiths, T., Chater, N., Kemp, C., Perfors, A., and Tenenbaum, J. B. (2010). Probabilistic models of cognition: exploring representations and inductive biases. Trends Cogn. Sci. 14, 357-364. doi: 10.1016/j.tics.2010.05.004.
25. Haykin, S. (1998). Neural Networks: A Comprehensive Foundation. 2nd Edn. Prentice Hall. Available online at: http://www.amazon.com/exec/obidos/redirect?tag=citeulike07-20&path=ASIN/0132733501.
26. Hinton, G., Osindero, S., and Teh, Y. (2006). A fast learning algorithm for deep belief nets. Neural Comput. 18, 1527-1554. doi: 10.1162/neco.2006.18.7.1527.
27. Hinton, G., and Salakhutdinov, R. (2006). Reducing the dimensionality of data with neural networks. Science 313, 504-507. doi: 10.1126/science.1127647.
28. Hinton, G. E. (2002). Training products of experts by minimizing contrastive divergence. Neural Comput. 14, 1771-1800. doi: 10.1162/089976602760128018.
29. Indiveri, G., Linares-Barranco, B., Hamilton, T., van Schaik, A., Etienne-Cummings, R., Delbruck, T., et al. (2011). Neuromorphic silicon neuron circuits. Front. Neurosci. 5, 1-23. doi: 10.3389/fnins.2011.00073.
30. Joshi, S., Deiss, S., Arnold, M., Park, J., Yu, T., and Cauwenberghs, G. (2010). "Scalable event routing in hierarchical neural array architecture with global synaptic connectivity," in 12th International Workshop on Cellular Nanoscale Networks and Their Applications (Berkeley, CA: IEEE), 1-6. doi: 10.1109/CNNA.2010.5430296.
31. Kempter, R., Gerstner, W., and Van Hemmen, J. (2001). Intrinsic stabilization of output rates by spike-based hebbian learning. Neural Comput. 13, 2709-2741. doi: 10.1162/089976601317098501.
32. Kuzum, D., Jeyasingh, R. G., Lee, B., and Wong, H.-S. P. (2011). Nanoelectronic programmable synapses based on phase change materials for brain-inspired computing. Nano Lett. 12, 2179-2186. doi: 10.1021/nl201040y.
33. Le, Q. V., Ranzato, M., Monga, R., Devin, M., Chen, K., Corrado, G. S., et al. (2011). Building high-level features using large scale unsupervised learning. arXiv preprint: arXiv:1112.6209.
34. Le Roux, N., and Bengio, Y. (2008). Representational power of restricted boltzmann machines and deep belief networks. Neural Comput. 20, 1631-1649. doi: 10.1162/neco.2008.04-07-510.
35. LeCun, Y., Bottou, L., Bengio, Y., and Haffner, P. (1998). Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278-2324. doi: 10.1109/5.726791.
36. Liu, S.-C., and Delbruck, T. (2010). Neuromorphic sensory systems. Curr. Opin. Neurobiol. 20, 288-295. doi: 10.1016/j.conb.2010.03.007.
37. Mead, C. (1989). Analog VLSI and Neural Systems. Reading, MA: Addison-Wesley. doi: 10.1007/978-1-4613-1639-8.
38. Merolla, P., Ursell, T., and Arthur, J. (2010). The thermodynamic temperature of a rhythmic spiking network. CoRR. abs/1009.5473, ArXiv e-prints. Available online at: http://arxiv.org/abs/1009.5473.
39. Murray, J. F., and Kreutz-Delgado, K. (2007). Visual recognition and inference using dynamic over complete sparse learning. Neural Comput. 19, 2301-2352. doi: 10.1162/neco.2007.19.9.2301.
40. Neftci, E., Binas, J., Rutishauser, U., Chicca, E., Indiveri, G., and Douglas, R. J. (2013). Synthesizing cognition in neuromorphic electronic systems. Proc. Natl. Acad. Sci. U.S.A. 110, E3468-E3476. doi: 10.1073/pnas.1212083110.
41. Neftci, E., Toth, B., Indiveri, G., and Abarbanel, H. (2012). Dynamic state and parameter estimation applied to neuromorphic systems. Neural Comput. 24, 1669-1694. doi: 10.1162/NECO_a_00293.
42. O'Connor, P., Neil, D., Liu, S.-C., Delbruck, T., and Pfeiffer, M. (2013). Real-time classification and sensor fusion with a spiking deep belief network. Front. Neurosci. 7:178. doi: 10.3389/fnins.2013.00178.
43. Park, J., Yu, T., Maier, C., Joshi, S., and Cauwenberghs, G. (2012). "Live demonstration: Hierarchical address-event routing architecture for reconfigurable large scale neuromorphic systems," in Circuits and Systems (ISCAS), 2012 IEEE International Symposium on, (Seoul), 707, 711, 20-23. doi: 10.1109/ISCAS.2012.6272133. Available online at: http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6272133.
44. Pedroni, B., Das, S., Neftci, E., Kreutz-Delgado, K., and Cauwenberghs, G. (2013). "Neuromorphic adaptations of restricted boltzmann machines and deep belief networks," in International Joint Conference on Neural Networks, IJCNN. (Dallas, TX).
45. Petrovici, M. A., Bill, J., Bytschok, I., Schemmel, J., and Meier, K. (2013). Stochastic inference with deterministic spiking neurons. arXiv preprint: arXiv:1311.3211.
46. Plesser, H. E., and Gerstner, W. (2000). Noise in integrate-and-fire neurons: from stochastic input to escape rates. Neural Comput. 12, 367-384. doi: 10.1162/089976600300015835.
47. Renart, A., Song, P., and Wang, X.-J. (2003). Robust spatial working memory through homeostatic synaptic scaling in heterogeneous cortical networks. Neuron 38, 473-485. doi: 10.1016/S0896-6273(03)00255-1.
48. Robbins, H., and Monro, S. (1951). A stochastic approximation method. Ann. Math. Stat. 22, 400-407. doi: 10.1214/aoms/1177729586.
49. Schemmel, J., Brüderle, D., Grübl, A., Hock, M., Meier, K., and Millner, S. (2010). "A wafer-scale neuromorphic hardware system for large-scale neural modeling," in International Symposium on Circuits and Systems, ISCAS (Paris: IEEE), 1947-1950. doi: 10.1109/ISCAS.2010.5536970.
50. Serrano-Gotarredona, T., Masquelier, T., Prodromakis, T., Indiveri, G., and Linares-Barranco, B. (2013). Stdp and stdp variations with memristors for spiking neuromorphic learning systems. Front. Neurosci. 7:2. doi: 10.3389/fnins.2013.00002.
51. Silver, R., Boahen, K., Grillner, S., Kopell, N., and Olsen, K. (2007). Neurotech for neuroscience: unifying concepts, organizing principles, and emerging tools. J. Neurosci. 27, 11807. doi: 10.1523/JNEUROSCI.3575-07.2007.
52. Strukov, D. B., Snider, G. S., Stewart, D. R., and Williams, R. S. (2008). The missing memristor found. Nature 453, 80-83. doi: 10.1038/nature06932.
53. Tang, Y. and Eliasmith, C. (2010). "Deep networks for robust visual recognition," in Proceedings of the 27th International Conference on Machine Learning (ICML-10) (Haifa), 1055-1062. Available online at: http://www.icml2010.org/papers/370.pdf.
54. van Vreeswijk, C., and Sompolinsky, H. (1996). Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science 274, 1724-1726. doi: 10.1126/science.274.5293.1724.
55. Yu, T., Park, J., Joshi, S., Maier, C., and Cauwenberghs, G. (2012) "65k-neuron integrate-and-fire array transceiver with address-event reconfigurable synaptic routing," in Biomedical Circuits and Systems Conference (BioCAS), IEEE, (Hsinch), 21, 24. 28-30. doi: 10.1109/BioCAS.2012.6418479. Available online at: http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6418479.