Video time encoding machines

IEEE Transactions on Neural Networks

Volumn 22, Issue 3, 2011, Pages 461-473

  Lazar, Aurel A ^a   Pnevmatikakis, Eftychios A ^a,b  

^a Department of Earth and Environmental Sciences   (United States)

^b NONE   (United States)

Author keywords

Faithful representation; neural circuit architectures; spiking neurons; time encoding; visual receptive fields

Indexed keywords

FAITHFUL REPRESENTATION; NEURAL CIRCUITS; SPIKING NEURONS; TIME ENCODING; VISUAL RECEPTIVE FIELDS;

ANIMATION; ELECTRIC NETWORK ANALYSIS; NEURAL NETWORKS; POPULATION STATISTICS; RECOVERY; VIDEO STREAMING;

ENCODING (SYMBOLS);

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER PROGRAM; METHODOLOGY; NERVE CELL NETWORK; PHYSIOLOGY; VIDEORECORDING; VISION; VISUAL CORTEX;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; NERVE NET; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; SOFTWARE DESIGN; VIDEO RECORDING; VISUAL CORTEX; VISUAL PERCEPTION;

EID: 79952189551     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2010.2103323     Document Type: Article

References (38)

1. A. A. Lazar and L. T. Tóth, "Perfect recovery and sensitivity analysis of time encoded bandlimited signals," IEEE Trans. Circuits Syst. I, vol. 51, no. 10, pp. 2060-2073, Oct. 2004.
2. K. A. Zaghloul and K. A. Boahen, "Optic nerve signals in a neuromorphic chip I: Outer and inner retina models," IEEE Trans. Biomed. Eng., vol. 51, no. 4, pp. 657-666, Apr. 2004. (Pubitemid 38375141)
3. K. Shimonomura and T. Yagi, "Neuromorphic VLSI vision system for real-time texture segregation," Neural Netw., vol. 21, no. 8, pp. 1197- 1204, Oct. 2008.
4. J. Costas-Santos, T. Serrano-Gotarredona, R. Serrano-Gotarredona, and B. Linares-Barranco, "A spatial contrast retina with on-chip calibration for neuromorphic spike-based AER vision systems," IEEE Trans. Circuits Syst. I, vol. 54, no. 7, pp. 1444-1458, Jul. 2007. (Pubitemid 47104011)
5. P. Lichtsteiner, C. Posch, and T. Delbruck, "A 128 × 128 120 dB 15 ìs latency asynchronous temporal contrast vision sensor," IEEE J. Solid- State Circuits, vol. 43, no. 2, pp. 566-576, Feb. 2008. (Pubitemid 351190224)
6. R. Serrano-Gotarredona, T. Serrano-Gotarredona, A. Acosta-Jimenez, C. Serrano-Gotarredona, J. A. Perez-Carrasco, B. Linares-Barranco, A. Linares-Barranco, G. Jimenez-Moreno, and A. Civit-Ballcels, "On real-time AER 2-D convolutions hardware for neuromorphic spike-based cortical processing," IEEE Trans. Neural Netw., vol. 19, no. 7, pp. 1196- 1219, Jul. 2008.
7. K. A. Zaghloul and K. Boahen, "A silicon retina that reproduces signals in the optic nerve," J. Neural Eng., vol. 3, no. 4, pp. 257-267, 2006.
8. A. A. Lazar and E. A. Pnevmatikakis, "A video time encoding machine," in Proc. 15th IEEE Int. Conf. Image Process., San Diego, CA, Oct. 2008, pp. 717-720.
9. O. Christensen, An Introduction to Frames and Riesz Bases (Applied and Numerical Harmonic Analysis). Basel, Switzerland: Birkhäuser, 2003.
10. J. Keat, P. Reinagel, R. C. Reid, and M. Meister, "Predicting every spike: A model for the responses of visual neurons," Neuron, vol. 30, no. 3, pp. 803-817, Jun. 2001. (Pubitemid 32607344)
11. A. A. Lazar and E. A. Pnevmatikakis, "Faithful representation of stimuli with a population of integrate-and-fire neurons," Neural Comput., vol. 20, no. 11, pp. 2715-2744, Nov. 2008.
12. J. W. Pillow, L. Paninski, V. J. Uzzell, E. P. Simoncelli, and E. J. Chichilnisky, "Prediction and decoding of retinal ganglion cell responses with a probabilistic spiking model," J. Neurosci., vol. 25, no. 47, pp. 11003-11013, Nov. 2005. (Pubitemid 41692630)
13. K. Seip, "On the connection between exponential bases and certain related sequences in L2(-π, π)," J. Funct. Anal., vol. 130, no. 1, pp. 131-160, May 1995.
14. E. A. Pnevmatikakis, "Spikes as projections: Representation and processing of sensory stimuli in the time domain," Ph.D. dissertation, Dept. Elect. Eng., Columbia Univ., New York, NY, Sep. 2010.
15. Y. C. Eldar and T. Werther, "General framework for consistent sampling in Hilbert spaces," Int. J. Wavelets, Multiresolution Inf. Process., vol. 3, no. 4, pp. 497-509, 2005.
16. R. H. Masland, "The fundamental plan of retina," Nature Neurosci., vol. 4, no. 9, pp. 877-886, 2001.
17. J. C. Sanchez, J. C. Principe, T. Nishida, R. Bashirullah, J. G. Harris, and J. A. B. Fortes, "Technology and signal processing for brain-machine interfaces," IEEE Signal Process. Mag., vol. 25, no. 1, pp. 29-40, Jan. 2008.
18. F. W. Campbell and D. G. Green, "Optical and retinal factors affecting visual resolution," J. Physiol., vol. 181, no. 3, pp. 576-593, Dec. 1965.
19. G. D. Field and E. J. Chichilnisky, "Information processing in the primate retina: Circuitry and coding," Annu. Rev. Neurosci., vol. 30, no. 1, pp. 1-30, 2007. (Pubitemid 47218749)
20. J.-P. Antoine, R. Murenzi, P. Vandergheynst, and S. T. Ali, 2-D Wavelets and Their Relatives. Cambridge, U.K.: Cambridge Univ. Press, 2004.
21. J. Laska, S. Kirolos, Y. Massoud, R. Baraniuk, A. Gilbert, M. Iwen, and M. Strauss, "Random sampling for analog-to-information conversion of wideband signals," in Proc. IEEE Dallas/CAS Design Appl., Integr. Softw., Richardson, TX, Oct. 2006, pp. 119-122.
22. J. P. Jones and L. A. Palmer, "An evaluation of the 2-D Gabor filter model of simple receptive fields in cat striate cortex," J. Neurophysiol., vol. 58, no. 6, pp. 1233-1258, Dec. 1987. (Pubitemid 18023459)
23. D. A. Butts, C. Weng, J. Jin, C.-I. Yeh, N. A. Lesica, J.-M. Alonso, and G. B. Stanley, "Temporal precision in the neural code and the timescales of natural vision," Nature, vol. 449, no. 7158, pp. 92-95, Sep. 2007. (Pubitemid 47373774)
24. T. S. Lee, "Image representation using 2-D Gabor wavelets," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 10, pp. 959-971, Oct. 1996. (Pubitemid 126773906)
25. R. W. Rodieck, "Quantitative analysis of cat retinal ganglion cell response to visual stimuli," Vis. Res., vol. 5, no. 12, pp. 583-601, Dec. 1965.
26. R. Van Rullen and S. J. Thorpe, "Rate coding versus temporal order coding: What the retinal ganglion cells tell the visual cortex," Neural Comput., vol. 13, no. 6, pp. 1255-1283, Jun. 2001. (Pubitemid 33595838)
27. E. Roza, "Analog-to-digital conversion via duty-cycle modulation," IEEE Trans. Circuits Syst. II: Analog Digital Signal Process., vol. 44, no. 11, pp. 907-914, Nov. 1997. (Pubitemid 127768332)
28. A. A. Lazar, E. K. Simonyi, and L. T. Tóth, "An overcomplete stitching algorithm for time decoding machines," IEEE Trans. Circuits Syst. I, vol. 55, no. 9, pp. 2619-2630, Oct. 2008.
29. L. Hernandez and E. Prefasi, "Analog-to-digital conversion using noise shaping and time encoding," IEEE Trans. Circuits Syst. I, vol. 55, no. 7, pp. 2026-2037, Aug. 2008.
30. A. Garcia-Tormo, E. Alarcon, A. Poveda, and F. Guinjoan, "Low-OSR asynchronous σΔ modulation high-order buck converter for efficient wideband switching amplification," in Proc. IEEE Int. Symp. Circuits Syst., Seattle, WA, May 2008, pp. 2198-2201.
31. L. C. Gouveia, T. J. Koickal, and A. Hamilton, "An asynchronous spike event coding scheme for programmable analog arrays," in Proc. IEEE Int. Symp. Circuits Syst., Seattle, WA, May 2008, pp. 1364-1367.
32. J. G. Harris, J. Xu, M. Rastogi, A. Singh-Alvarado, V. Garg, J. C. Principe, and K. Vuppamandla, "Real time signal reconstruction from spikes on a digital signal processor," in Proc. IEEE Int. Symp. Circuits Syst., Seattle, WA, May 2008, pp. 1060-1063.
33. D. Kóscielnik and M. Mískowicz, "Asynchronous sigma-delta analogto- digital converter based on the charge pump integrator," Analog Integr. Circuits Signal Process., vol. 55, no. 3, pp. 223-238, Jun. 2008. (Pubitemid 351563017)
34. S. Y. Ng, "A continuous-time asynchronous sigma delta analog to digital converter for broadband wireless receiver with adaptive digital calibration technique," Ph.D. dissertation, Dept. Elect. Comput. Eng., Ohio State Univ., Columbus, 2009.
35. R. Serrano-Gotarredona, M. Oster, P. Lichtsteiner, A. Linares-Barranco, R. Paz-Vicente, F. Gómez-Rodríguez, L. Camuñas-Mesa, R. Berner, M. Rivas, T. Delbrück, S. C. Liu, R. Douglas, P. Hafliger, G. Jimenez-Moreno, A. C. Ballcels, T. Serrano-Gotarredona, A. J. Acosta- Jimenez, B. Linares-Barranco, "CAVIAR: A 45k neuron, 5M synapse, 12G connects/s AER hardware sensory-processing-learning-actuating system for high-speed visual object recognition and tracking," IEEE Trans. Neural Netw., vol. 20, no. 9, pp. 1417-1438, Sep. 2009.
36. A. A. Lazar, "Time encoding with an integrate-and-fire neuron with a refractory period," Neurocomputing, vols. 58-60, pp. 53-58, Jun. 2004. (Pubitemid 38684257)
37. A. A. Lazar, "Time encoding machines with multiplicative coupling, feedforward, and feedback," IEEE Trans. Circuits Syst. II, vol. 53, no. 8, pp. 672-676, Aug. 2006. (Pubitemid 44375458)
38. A. A. Lazar, E. A. Pnevmatikakis, and L. T. Tóth, "On computing the density of the spike train of a population of integrate-and-fire neurons," Dept. Elect. Eng., Columbia Univ., New York, NY, BNET Tech. Rep. #4-07, Dec. 2007.