Feedforward Categorization on AER Motion Events Using Cortex-Like Features in a Spiking Neural Network

IEEE Transactions on Neural Networks and Learning Systems

Volumn 26, Issue 9, 2015, Pages 1963-1978

  Zhao, Bo ^a   Ding, Ruoxi ^b   Chen, Shoushun ^b   Linares Barranco, Bernabe ^c   Tang, Huajin ^a  

^a INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c INSTITUTO DE MICROELECTRÓNICA DE SEVILLA   (Spain)

Author keywords

Address event representation (AER); event driven; feedforward categorization; MNIST; spiking neural network.

Indexed keywords

NEURAL NETWORKS;

ADDRESS-EVENT REPRESENTATION; EVENT-DRIVEN; FEED-FORWARD; MNIST; SPIKING NEURAL NETWORKS;

STATISTICAL TESTS;

ACTION POTENTIAL; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; BRAIN CORTEX; CYTOLOGY; HUMAN; MOTION; NERVE CELL; NERVE CELL NETWORK; PHYSIOLOGY;

ACTION POTENTIALS; CEREBRAL CORTEX; HUMANS; MODELS, NEUROLOGICAL; MOTION; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONS;

EID: 84940039119     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2014.2362542     Document Type: Article

References (49)

1. G. Indiveri, S.-C. Liu, T. Delbruck, and R. Douglas, "Neuromorphic systems, " in Encyclopedia of Neuroscience. San Francisco, CA, USA: Academic, 2009, pp. 521-528.
2. S.-C. Liu and T. Delbruck, "Neuromorphic sensory systems, " Current Opinion Neurobiol., vol. 20, no. 3, pp. 288-295, 2010.
3. E. Chicca et al., "A multichip pulse-based neuromorphic infrastructure and its application to a model of orientation selectivity, " IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 54, no. 5, pp. 981-993, May 2007.
4. R. J. Vogelstein, U. Mallik, E. Culurciello, G. Cauwenberghs, and R. Etienne-Cummings, "A multichip neuromorphic system for spike-based visual information processing, " Neural Comput., vol. 19, no. 9, pp. 2281-2300, Jul. 2007.
5. G. Indiveri et al., "Neuromorphic silicon neuron circuits, " Frontiers Neurosci., vol. 5, p. 73, May 2011.
6. T. J. Hamilton, C. Jin, A. van Schaik, and J. Tapson, "An active 2-D silicon cochlea, " IEEE Trans. Biomed. Circuits Syst., vol. 2, no. 1, pp. 30-43, Mar. 2008.
7. V. Chan, S.-C. Liu, and A. van Schaik, "AER EAR: A matched silicon cochlea pair with address event representation interface, " IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 54, no. 1, pp. 48-59, Jan. 2007.
8. K. A. Boahen, "Point-to-point connectivity between neuromorphic chips using address events, " IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 47, no. 5, pp. 416-434, May 2000.
9. P. Lichtsteiner, C. Posch, and T. Delbruck, "A 128 × 128 120 dB 15 μs latency asynchronous temporal contrast vision sensor, " IEEE J. Solid-State Circuits, vol. 43, no. 2, pp. 566-576, Feb. 2008.
10. T. Serrano-Gotarredona and B. Linares-Barranco, "A 128, × 128 1.5% contrast sensitivity 0.9% FPN 3 μs latency 4 mW asynchronous frame-free dynamic vision sensor using transimpedance preamplifiers, " IEEE J. Solid-State Circuits, vol. 48, no. 3, pp. 827-838, Mar. 2013.
11. B. Zhao, X. Zhang, S. Chen, K.-S. Low, and H. Zhuang, "A 64, ×, 64 CMOS image sensor with on-chip moving object detection and localization, " IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 4, pp. 581-588, Apr. 2012.
12. S. Chen, W. Tang, X. Zhang, and E. Culurciello, "A 64 × 64 pixels UWB wireless temporal-difference digital image sensor, " IEEE Trans. Very Large Scale Integr. (VLSI) Syst., vol. 20, no. 12, pp. 2232-2240, Dec. 2012.
13. Java AER Open Source Project. [Online]. Available: http://jaer. wiki.sourceforge.net/, accessed Mar. 10, 2013.
14. X. Zhang and S. Chen, "Live demonstration: A high-speed-pass asynchronous motion detection sensor, " in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), May 2013, p. 671.
15. M. Litzenberger et al., "Embedded vision system for real-time object tracking using an asynchronous transient vision sensor, " in Proc. 12th Signal Process. Edu. Workshop, Sep. 2006, pp. 173-178.
16. T. Delbruck and P. Lichtsteiner, "Fast sensory motor control based on event-based hybrid neuromorphic-procedural system, " in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), May 2007, pp. 845-848.
17. R. Serrano-Gotarredona et al., "On real-time AER 2-D convolutions hardware for neuromorphic spike-based cortical processing, " IEEE Trans. Neural Netw., vol. 19, no. 7, pp. 1196-1219, Jul. 2008.
18. R. Serrano-Gotarredona et al., "CAVIAR: A 45k neuron, 5M synapse, 12G connects/s AER hardware sensory-processing-learning-actuating system for high-speed visual object recognition and tracking, " IEEE Trans. Neural Netw., vol. 20, no. 9, pp. 1417-1438, Sep. 2009.
19. J. A. Perez-Carrasco et al., "Mapping from frame-driven to frame-free event-driven vision systems by low-rate rate coding and coincidence processing. Application to feedforward ConvNets, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 11, pp. 2706-2719, Nov. 2013.
20. Y. LeCun, K. Kavukcuoglu, and C. Farabet, "Convolutional networks and applications in vision, " in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), May/Jun. 2010, pp. 253-256.
21. J. G. Daugman, "Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters, " J. Opt. Soc. Amer. A, vol. 2, no. 7, pp. 1160-1169, Jul. 1985.
22. M. Riesenhuber and T. Poggio, "Hierarchical models of object recognition in cortex, " Nature Neurosci., vol. 2, no. 11, pp. 1019-1025, 1999.
23. T. Serre, L. Wolf, S. Bileschi, M. Riesenhuber, and T. Poggio, "Robust object recognition with cortex-like mechanisms, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 411-426, Mar. 2007.
24. S. Chen, P. Akselrod, B. Zhao, J. A. Perez-Carrasco, B. Linares-Barranco, and E. Culurciello, "Efficient feedforward categorization of objects and human postures with address-event image sensors, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 2, pp. 302-314, Feb. 2012.
25. B. Zhao and S. Chen, "Realtime feature extraction using MAX-like convolutional network for human posture recognition, " in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), May 2011, pp. 2673-2676.
26. R. Gütig and H. Sompolinsky, "The tempotron: A neuron that learns spike timing-based decisions, " Nature Neurosci., vol. 9, no. 3, pp. 420-428, Feb. 2006.
27. J. Hu, H. Tang, K. C. Tan, H. Li, and L. Shi, "A spike-timing-based integrated model for pattern recognition, " Neural Comput., vol. 25, no. 2, pp. 450-472, 2013.
28. Q. Yu, H. Tang, K. C. Tan, and H. Li, "Rapid feedforward computation by temporal encoding and learning with spiking neurons, " IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 10, pp. 1539-1552, Oct. 2013.
29. S. Thorpe, D. Fize, and C. Marlot, "Speed of processing in the human visual system, " Nature, vol. 381, no. 6582, pp. 520-522, Jun. 1996.
30. S. J. Thorpe and M. Fabre-Thorpe, "Seeking categories in the brain, " Science, vol. 291, no. 5502, pp. 260-263, Jan. 2001.
31. T. Serre and M. Riesenhuber, "Realistic modeling of simple and complex cell tuning in the HMAX model, and implications for invariant object recognition in cortex, " Dept. Brain Cognitive Sci., Massachusetts Inst. Technol., Cambridge, MA, USA, Tech. Rep. AI Memo 2004-017/CBCL Memo 239, Jul. 2004.
32. T. Serre, A. Oliva, and T. Poggio, "A feedforward architecture accounts for rapid categorization, " Proc. Nat. Acad. Sci., vol. 104, no. 15, pp. 6424-6429, 2007.
33. D. H. Hubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex, " J. Physiol., vol. 160, pp. 106-154, Jan. 1962.
34. K. Fukushima, "Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position, " Biol. Cybern., vol. 36, no. 4, pp. 193-202, 1980.
35. D. Marr and E. Hildreth, "Theory of edge detection, " Proc. Roy. Soc. London Ser. B, Biol. Sci., vol. 207, no. 7, pp. 1160-1169, Jul. 1985.
36. M. D. Buhmann, Radial Basis Functions. New York, NY, USA: Cambridge Univ. Press, 2003.
37. T. Serre, "Learning a dictionary of shape-components in visual cortex: Comparison with neurons, humans and machines, " Ph.D. dissertation, Dept. Brain Cognitive Sci., Massachusetts Inst. Technol., Cambridge, MA, USA, Apr. 2006.
38. W. Gerstner and W. M. Kistler, Spiking Neuron Models: Single Neurons, Populations, Plasticity, 1st ed. Cambridge, U.K.: Cambridge Univ. Press, Aug. 2002.
39. A. L. Hodgkin and A. F. Huxley, "A quantitative description of membrane current and its application to conduction and excitation in nerve, " J. Physiol., vol. 117, no. 4, pp. 500-544, Aug. 1952.
40. E. M. Izhikevich, "Simple model of spiking neurons, " IEEE Trans. Neural Netw., vol. 14, no. 6, pp. 1569-1572, Nov. 2003.
41. T. Masquelier, R. Guyonneau, and S. J. Thorpe, "Spike timing dependent plasticity finds the start of repeating patterns in continuous spike trains, " PLoS ONE, vol. 3, no. 1, p. e1377, 2008.
42. T. Masquelier and S. J. Thorpe, "Unsupervised learning of visual features through spike timing dependent plasticity, " PLoS Comput. Biol., vol. 3, no. 2, p. e31, Feb. 2007.
43. T. Masquelier, R. Guyonneau, and S. J. Thorpe, "Competitive STDP-based spike pattern learning, " Neural Comput., vol. 21, no. 5, pp. 1259-1276, May 2009.
44. F. Ponulak and A. Kasiński, "Supervised learning in spiking neural networks with ReSuMe: Sequence learning, classification, and spike shifting, " Neural Comput., vol. 22, no. 2, pp. 467-510, Feb. 2010.
45. [Online]. Available: http://www.ntu.edu.sg/home/eechenss/Research/2013-AER-System/code.zip, accessed Aug. 22, 2014.
46. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines, " ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, pp. 27:1-27:27, Apr. 2011.
47. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition, " Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
48. T. Serrano-Gotarredona and B. Linares-Barranco. The MNIST-DVS Database. [Online]. Available: http://www2.imse-cnm. csic.es/caviar/MNISTDVS.html, accessed Jul. 20, 2014.
49. H. Jhuang, T. Serre, L. Wolf, and T. Poggio, "A biologically inspired system for action recognition, " in Proc. IEEE 11th Int. Conf. Comput. Vis. (ICCV), Oct. 2007, pp. 1-8.