What can neuromorphic event-driven precise timing add to spike-based pattern recognition?

Neural Computation

Volumn 27, Issue 3, 2015, Pages 561-593

  Akolkar, Himanshu ^a   Meyer, Cedric ^d   Clady, Zavier ^d   Marre, Olivier ^b   Bartolozzi, Chiara ^a   Panzeri, Stefano ^c,d   Benosman, Ryad ^b  

^a ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^b INSTITUT DE LA VISION   (France)

^c Center for Neuroscience and Cognitive Systems Institute Italiano di Technologica   (Italy)

^d UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ALGORITHM; ANATOMY AND HISTOLOGY; ARTIFICIAL INTELLIGENCE; BIOLOGICAL MODEL; DEVICES; DISCRIMINANT ANALYSIS; HUMAN; NERVE CELL; ORIENTATION; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; PROCEDURES; RETINA; TIME PERCEPTION; VISUAL SYSTEM;

ACTION POTENTIALS; ALGORITHMS; ARTIFICIAL INTELLIGENCE; DISCRIMINANT ANALYSIS; HUMANS; MODELS, NEUROLOGICAL; NEURONS; ORIENTATION; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; RETINA; TIME PERCEPTION; VISUAL PATHWAYS;

EID: 84923342166     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00703     Document Type: Article

References (60)

1. Aggarwal, C. C., Hinneburg, A., & Keim, D. A. (2001). On the surprising behavior of distance metrics in high dimensional space. In Lecture Notes in Computer Science (pp. 420-434). New York: Springer.
2. Aronov, D., Reich, D. S., Mechler, F., & Victor, J. D. (2003). Entropy and information in neural spike trains. Phys. Rev. Lett., 80, 197-200.
3. Benosman, R., Clercq, C., Lagorce, X., Ieng, S. H., & Bartolozzi, C. (2014). Eventbased visual flow. IEEE Trans. Neural Networks and Learning Systems, 25, 407- 417.
4. Benosman, R., Ieng, S., Posch, C., & Rogister, P. (2011). Asynchronous event-based Hebbian epipolar geometry. IEEE Transactions on Neural Networks, 99, 10.
5. Berry,M.,Warland, D. K.,&Meister,M. (1997). The structure and precision of retinal spike trains. Proceedings of the National Academy of Sciences of the United States of America, 94, 5411-5416.
6. Blanche, T. J., Koepsell, K., Swindale, N., & Olshausen, B. A. (2008). Predicting response variability in the primary visual cortex. In Proc. Computational and Systems Neuroscience, COSYNE'08, N.p.
7. Buracas, G. T., Zador, A. M., DeWeese, M. R., & Albright, T. D. (1998). Efficient discrimination of temporal patterns by motion-sensitive neurons in primate visual cortex. Neuron, 20, 959-969.
8. Butts, D. A., Weng, C., Jin, J., Yeh, C.-I., Lesica, N. A., Alonso, J.-M., & Stanley, G. B., (2007). Temporal precision in the neural code and the timescales of natural vision. Nature, 449, 92-95.
9. Camunas-Mesa, L., Zamarreno-Ramos, C., Linares-Barranco, A., Acosta-Jimenez, A. J., Serrano-Gotarredona, T., & Linares-Barranco, B. (2012). An event-driven multikernel convolution processor module for event-driven vision sensors. IEEE Journal of Solid-State Circuits, 47, 504-517.
10. Clady, X., Clercq, C., Ieng, S.-H., Houseini, F., Randazzo, M., Natale, L.,... & Benosman, R. (2014). Asynchronous visual event-based time-to-contact. Frontiers in Neuroscience, 8.
11. Delorme, A., Gautrais, J., van Rullen, R., & Thorpe, S. (1999). Spikenet: A simulator for modeling large networks of integrate and fire neurons. Neurocomputing, 24, 26-27.
12. Delorme, A., & Thorpe, S. J. (2001). Face identification using one spike per neuron: Resistance to image degradations, Neural Networks, 14, 795-803.
13. DiCarlo, J. J., & Cox, D. D. (2007). Untangling invariant object recognition. Trends in Cognitive Sciences, 11, 333-341.
14. Escobar,M. J., Masson, G. S., Vieville, T., & Kornprobst, P. (2009). Action recognition using a bio-inspired feedforward spiking network. Int. Journal Comput Vis, 82, 284-301.
15. Fisher, R. A. (1936). The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7, 179-188.
16. Fukushima, K. (1980). Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biological Cybernetics, 36, 193-202.
17. Gabor, D. (1946). Theory of communication. Journal of IEEE, 93, 429-459.
18. Gollisch, T., & Meister, M. (2008). Rapid neural coding in the retina with relative spike latencies. Science, 319, 150-164.
19. Haider, B., Krause,M. R., Duque, A., Yu, Y. J., Touryan, J., Mazer, J. A.,&McCormick, D. A. (2010). Efficient discrimination of temporal patterns by motion-sensitive neurons in primate visual cortex. Neuron, 65, 107-121.
20. Hung, C. P., Kreiman, G., Poggio, T., & DiCarlo, J. J. (2005). Fast readout of object identity from macaque inferior temporal cortex. Science, 310, 863-869.
21. Johansson, R. S., & Birznieks, I. (2004). First spikes in ensembles of human tactile afferents code complex spatial fingertip events. Nat. Neurosci., 7, 170- 177.
22. Kara, P., Reinagel, P.,&Reid, R. C. (2000). Low response variability in simultaneously recorded retinal, thalamic, and cortical neurons. Neuron, 27, 635-646.
23. Lagorce, X., Ieng, S.-H., & Benosman, R. (2013). Event-based features for robotic vision. In Proceedings of the 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 4214-4219).
24. Lazzaro, J., Wawrzynek, J., Mahowald, M., Sivilotti, M., & Gillespie, D. (1993). Silicon auditory processors as computer peripherals. IEEE Transactions on Neural Networks, 4, 523-528.
25. Lichtsteiner, P., Posch, C., & Delbruck, T. (2008). A 128 × 128 120db 15 μs latency asynchronous temporal contrast vision sensor. IEEE Journal of Solid State Circuits, 43, 566-576.
26. Liu, R. C., Tzonev, S., Rebrik, S., & Miller, K. (2001). Variability and information in a neural code of the cat lateral geniculate nucleus. J. Neurophysiol., 86, 2789- 2806.
27. Lorach, H., Benosman, R., Marre, O., Ieng, S. H., Sahel, J. A., & Picaud, S. (2012). Artificial retina: The multichannel processing of the mammalian retina achieved with a neuromorphic asynchronous light acquisition device. Journal of Neural Engineering, 9, 066044.
28. Maass,W.,&Bishop, C.M. (1999) Pulsed neural networks. Cambridge, MA: MIT Press.
29. Magri, C., Whittingstall, K., Singh, V., Logothetis, N., & Panzeri, S. (2009). A toolbox for the fast information analysis of multiple-site LFP, EEG and spike train recordings. BMC Neuroscience, 10, 81.
30. Mahowald, M. (1982). VLSI analogs of neuronal visual processing: A synthesis of form and function. Unpublished doctoral dissertation, California Institute of Technology.
31. Maimon, G., & Assad, J. A. (2009). Beyond Poisson: Increased spike-time regularity across primate parietal cortex. Neuron, 62, 426-440.
32. Mainen, Z., & Sejnowski, T. (1995). Reliability of spike timing in neocortical neurons. Science, 268, 1503-1506.
33. Marr, D. (1982). Vision: A computational investigation into the human representation and processing of visual information. San Francisco: Freeman.
34. Masquelier, T., & Thorpe, S. J. (2007). Unsupervised learning of visual features through spike timing dependent plasticity. PLoS Computational Biology, 3, 31.
35. Mazer, J. A., Vinje,W. E., McDermott, J., Schiller, P. H., & Gallant, J. L. (2002). Spatial frequency and orientation tuning dynamics in area V1. Proc. Natl. Acad. Sci., 99, 1645-1650.
36. Movshon, J., & Newsome, W. (1996). Visual response properties of striate cortical neurons projecting to area mt in macaque monkeys. J. Neurosci., 16, 7733- 7741.
37. Mutch, J., & Lowe, D. G. (2006). Multiclass object recognition with sparse, localized features. In Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (vol. 1, pp. 11-18). Piscataway, NJ: IEEE.
38. Ni, Z., Pacoret, C., Benosman, R., Ieng, S., & Ŕegnier, S. (2011). Asynchronous eventbased high-speed vision for micro-particles tracking, Journal of Microscopy, 245, 236-244.
39. Panzeri, S., Brunel, N., Logothetis, N., & Kayser, C. (2010). Sensory neural codes using multiplexed temporal scales. Trends in Neurosciences, 33, 111-120.
40. Panzeri, S., & Treves, A. (1996). Analytical estimates of limited sampling biases in different information measures. Network, 7, 87-101.
41. Petersen, R. S., Panzeri, S., & Diamond, M. E. (2001). Population coding of stimulus location in rat somatosensory cortex. Neuron, 32, 503-514.
42. Pinto, N., Cox, D. D., & DiCarlo, J. J. (2008). Why is real-world visual object recognition hard? PLoS Computational Biology, 4.
43. Posch, C., Matolin, D., & Wohlgenannt, R. (2011). A QVGA 143 DB dynamic range frame-free PWM image sensor with lossless pixel-level video compression and time-domain CDS. IEEE J. Solid-State Circuits, 46, 259-275.
44. Quiroga, R. Q., & Panzeri, S. (2009). Extracting information from neuronal populations: Information theory and decoding approaches. Nat. Rev. Neurosci., 10, 173-185.
45. Reich, D. S., Mechler, F., & Victor, J. D. (2001). Independent and redundant information in nearby cortical neurons. Science, 294(5551), 2566-2568.
46. Reinagel, P.,&Reid, R. (2000). Temporal coding of visual information in the thalamus. J. Neuroscience, 20, 5392-5400.
47. Rieke, F., Warland, D., de Ruyter van Steveninck, R., & Bialek, W. (1999). Spikes: Exploring the neural code. Cambridge, MA: MIT Press.
48. Riesenhuber, M., & Poggio, T. (2009). Hierarchical models of object recognition in cortex. Nature Neuroscience, 2, 1019-1025.
49. Ripley, B. D. (1996). Pattern recognition and neural networks. Cambridge: Cambridge University Press.
50. Rogister, P., Benosman, R., Ieng, S., Lichtsteiner, P., & Delbruck, T. (2011). Asynchronous event-based binocular stereo matching. IEEE Transactions on Neural Networks, 23, 347-353.
51. Rucci, M., Iovin, R., Poletti, M., & Santini, F. (2007). Miniature eye movements enhance fine spatial detail. Nature, 447, 851-854.
52. Serre, T., & Poggio, T. (2007). A feedforward architecture accounts for rapid categorization. PNAS, 104, 6424-6429.
53. Shadlen, M. N.,&Newsome,W. T. (1998). The variable discharge of cortical neurons: Implications for connectivity, computation, and information coding. J. Neurosci., 18, 3870-3896.
54. Shannon, C. E. (1948). The mathematical theory of communication. Phys. Rev. Lett., 14, 306-317.
55. Softky,W. R., & Koch, C. (1993). The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPS. J. Neurosci., 13, 334-350.
56. Strong, S. P., Koberle, R., de Ruyter van Steveninck,R. R.,&Bialek, W. (1998). Entropy and information in neural spike trains. Phys. Rev. Lett., 80, 197-200.
57. Thorpe, S. J. (1990). Spike arrival times: A highly efficient coding scheme for neural networks. In G. Eckmiller and G. Hauske (Eds.), Parallel processing in neural systems (pp. 91-94). Amsterdam: North-Holland.
58. Thorpe, S. J., Delorme, A., & R. van Rullen, (2001). Spike-based strategies for rapid processing. Neural Networks, 14, 715-725.
59. Victor, J. D., & Purpura, K. P. (1996). Nature and precision of temporal coding in visual cortex: A metric-space analysis. J. Neurophysiol., 76, 1310-1326.
60. Victor, J. D., & Purpura, K. P. (1997). Metric-space analysis of spike trains: theory, algorithms and application. Network., 8, 127-164.