A 128,× 128 1.5% contrast sensitivity 0.9% FPN 3 μs latency 4 mW asynchronous frame-free dynamic vision sensor using transimpedance preamplifiers

IEEE Journal of Solid-State Circuits

Volumn 48, Issue 3, 2013, Pages 827-838

  Serrano Gotarredona, Teresa ^a   Linares Barranco, Bernabé ^a  

^a INSTITUTO DE MICROELECTRÓNICA DE SEVILLA   (Spain)

Author keywords

Address event representation; contrast sensitivity; dynamic vision sensor; event based vision; frame free vision sensor; high speed vision; temporal contrast retina; vision sensor

Indexed keywords

ADDRESS-EVENT-REPRESENTATION; CONTRAST SENSITIVITY; DYNAMIC VISION SENSORS; EVENT-BASED; HIGH SPEED VISION; TEMPORAL CONTRAST; VISION SENSORS;

PIXELS;

SENSORS;

EID: 84874666021     PISSN: 00189200     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSSC.2012.2230553     Document Type: Article

References (57)

1. M. Sivilotti, "Wiring Considerations inAnalog VLSI Systemswith Application to Field-Programmable Networks," Ph.D. dissertation, California Institute of Technology, Pasadena, CA, 1991.
2. M. Mahowald, "VLSI Analogs of Neural Visual Processing: A Synthesis of Form and Function," Ph.D. dissertation, California Institute of Technology, Pasadena, 1992.
3. J. Lazzaro, J.Wawrzynek,M. Mahowald, M. Sivilotti, andD.Gillespie, "Silicon auditory processors as computer peripherals," IEEE Trans. Neural Networks, vol. 4, no. 3, pp. 523-528, 1993. (Pubitemid 23684030)
4. P. Venier, A. Mortara, X. Arreguit, and E. A. Vittoz, "An integrated cortical layer for orientation enhancement," IEEE J. Solid-State Circuits, vol. 32, no. 2, pp. 177-186, Feb. 1997.
5. T. Y. W. Choi, P.Merolla, J. Arthur, K. Boahen, and B. E. Shi, "Neuromorphic implementation of orientation hypercolumns," IEEE Trans. Circuits Syst. I, vol. 52, no. 6, pp. 1049-1060, Jun. 2005. (Pubitemid 40970277)
6. L. Camuñas-Mesa, A. Acosta-Jiménez, C. Zamarreño- Ramos, T. Serrano-Gotarredona, and B. Linares-Barranco, "A 32x32 pixel convolution processor chip for address event vision sensors with 155 ns event latency and 20 Meps throughput," IEEE Trans. Circuits Syst. I, vol. 58, no. 4, pp. 777-790, Apr. 2011.
7. L. Camuñas-Mesa, C. Zamarreño-Ramos, A. Linares-Barranco, A. Acosta-Jiménez, T. Serrano-Gotarredona, and B. Linares-Barranco, "An event-driven multi-kernel convolution processor module for event-driven vision sensors," IEEE J. Solid-State Circuits, vol. 47, no. 2, pp. 504-517, Feb. 2012.
8. C. Zamarreño-Ramos, A. Linares-Barranco, T. Serrano-Gotarredona, and B. Linares-Barranco, "Multi-casting mesh AER: A scalable assembly approach for reconfigurable neuromorphic structured AER systems. Application to ConvNets," IEEE Trans. Biomed. Circuits Syst., in press.
9. E. Culurciello, R. Etienne-Cummings, and K. A. Boahen, "A biomorphic digital image sensor," IEEE J. Solid-State Circuits, vol. 38, pp. 281-294, 2003.
10. D. Kimand E. Culurciello, "A Compact-pixel Tri-mode vision sensor," in Proc. IEEE Int. Symp. Circuits Syst., (ISCAS), Paris, France, 2010, pp. 2434-2437.
11. P. F. Ruedi et al., "A 128x128 pixel 120-dB dynamic-range vision sensor chip for image contrast and orientation extraction," IEEE J. Solid-State Circuits, vol. 38, pp. 2325-33, 2003.
12. M. Barbaro, P. Y. Burgi, A. Mortara, P. Nussbaum, and F. Heitger, "A 100x100 pixel silicon retina for gradient extraction with steering filter capabilities and temporal output coding," IEEE J. Solid-State Circuits, vol. 37, pp. 160-172, 2002. (Pubitemid 34278431)
13. S. Chen and A. Bermak, "Arbitrated time-to-first spike CMOS image sensor with on-chip histogram equalization," IEEE Trans. VLSI Syst., vol. 15, no. 3, pp. 346-357, Mar. 2007. (Pubitemid 46600152)
14. X. G. Qi and J. Harris, "A time-to-first-spike CMOS imager," in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), 2004, vol. 4, pp. 824-827.
15. M. Azadmehr, H. Abrahamsen, and P. Hafliger, "A foveated AER imager chip," in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), 2005, vol. 3, pp. 2751-2754.
16. R. J. Vogelstien, U. Mallik, E. Culurciello, R. Etienne-Cummings, and G. Cauwenberghs, "Spatial acuity modulation of an address-event imager," in Proc. IEEE Int. Conf. Electr., Circuits Syst. (ICECS), 2004, pp. 207-210. (Pubitemid 41551109)
17. P. Lichtsteiner, C. Posch, and T. Delbrück, "A 128x128 120 dB 15 s latency asynchronous temporal contrast vision sensor," IEEE J. Solid-State Circuits, vol. 43, no. 2, pp. 566-576, Feb. 2008. (Pubitemid 351190224)
18. P. Lichtsteiner, C. Posch, and T. Delbrück, "A 128x128 120 dB 30 mW asynchronous vision sensor that responds to relative intensity change," in IEEE Int. Solid-State Circuits Conf. (ISSCC) Dig. Tech. Papers, 2006, pp. 2060-2069.
19. J. A. Leñero-Bardallo, T. Serrano-Gotarredona, and B. Linares-Barranco, "A 3.6 s latency asynchronous frame-free event-driven dynamic-vision-sensor," IEEE J. Solid-State Circuits, vol. 46, no. 6, pp. 1443-55, Jun. 2011.
20. J. Kramer, "An integrated optical transient sensor," IEEE Trans. Circuits Syst. II, vol. 49, no. 9, pp. 612-628, Sep. 2002.
21. K. A. Zaghloul and K. Boahen, "Optic nerve signals in a neuromorphic chip I: Outer and inner retina models," IEEE Trans. Biomed. Eng., vol. 51, no. 4, pp. 657-666, Apr. 2004. (Pubitemid 38375141)
22. K. A. Zaghloul and K. Boahen, "Optic nerve signals in a neuromorphic chip II: Testing and results," IEEE Trans. Biomed. Eng., vol. 51, no. 4, pp. 667-675, Apr. 2004. (Pubitemid 38375142)
23. C. Posch, D.Malotin, and R.Wohlgenannt, "A QVGA 143 dB dynamic range asynchronous address-event PWM dynamic image sensor with lossless pixel-level video compression," in IEEE ISSCC Dig. Tech. Papers, 2010, pp. 400-401.
24. C. Posch, D.Matolin, and R.Wohlgenannt, "A QVGA 143 dB dynamic range frame-free PWM image sensor with lossless pixel-level video compression and time-domain CDS," IEEE J. Solid-State Circuits, vol. 46, no. 1, pp. 259-275, Jan. 2011.
25. C. Posch and D. Matolin, "Sensitivity and uniformity of a 0.18 microns CMOS temporal contrast pixel array," in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), May 2011, pp. 1572-1575.
26. R. Berner and T. Delbrück, "Event-based pixel sensitive to changes of color and brightness," IEEE Trans. Circuits Syst. I, vol. 58, no. 7, pp. 1581-1590, Jul. 2011.
27. M. Arias-Estrada, D. Poussart, and M. Tremblay, "Motion vision sensor architecture with asynchronous self-signalling pixels," in Proc. Workshop on Computer Architecture for Machine Perception, 1997, pp. 75-83.
28. C. M.Higgins and S.A. Shams, "A biologically inspired modularVLSI system for visual measurement of self-motion," IEEE Sensors J., vol. 2, no. 6, pp. 508-528, Dec. 2002. (Pubitemid 44357853)
29. E. Ozalevli and C. M. Higgins, "Reconfigurable biologically inspired visual motion system using modular neuromorphic VLSI chips," IEEE Trans. Circuits Syst. I, vol. 52, no. 1, pp. 79-92, 2005. (Pubitemid 40173706)
30. K. Boahen and A. Andreou, "A contrast-sensitive retinawith reciprocal synapses," Advances in Neural Inform. Process. Syst. (NIPS), vol. 4, pp. 764-772, 1992.
31. J. Costas-Santos, T. Serrano-Gotarredona, R. Serrano-Gotarredona, and B. Linares-Barranco, "A spatial contrast retina with on-chip calibration for neuromorphic spike-based AER vision systems," IEEE Trans Circuits Syst. I, vol. 54, no. 7, pp. 1444-58, 2007. (Pubitemid 47104011)
32. J. A. Leñero-Bardallo, T. Serrano-Gotarredona, and B. Linares-Barranco, "A five-decade dynamic range ambient-light-independent calibrated signed-spatial-contrast AER retina with 0.1 ms latency and optional time-to-first-spike mode," IEEE Trans. Circuits Syst. I, vol. 57, no. 10, pp. 2632-2643, Oct. 2010.
33. J. Conradt, P. Lichtsteiner, R. Berner, T. Delbrück, R. J. Douglas, and M. Cook, "A pencil balancing robot that uses only spike-based visual input," in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), 2009, pp. 781-785.
34. D. Drazen, P. Lichtsteiner, P. Häfliger, T. Delbrück, and A. Jensen, "Toward real-time particle tracking using an event-based dynamic vision sensor," Exp. Fluids, vol. 51, pp. 1465-1469, 2011.
35. R. Benosman, S.-H. Ieng, P. Rogister, and C. Posch, "Asynchronous event-based Hebbian epipolar geometry," IEEE Trans. Neural Networks, vol. 22, no. 11, pp. 1723-1734, Nov. 2011.
36. S. Schraml and A. N. Belbachir, "A spatio-temporal clustering method using real-time motion analysis on event-based 3D vision," in Proc. IEEE Computer Vision and Pattern Recognition Workshops (CVPRW), 2010, pp. 57-63.
37. C. Sulzbachner, C. Zinner, and J. Kogler, "An optimized silicon retina stereomatching algorithmusing time-space correlation," in Proc. IEEE Computer Vision and Pattern Recognition Workshops (CVPRW), 2011.
38. R. Benosman, S.-H. Ieng, C. Clercq, C. Bartolozzi, and M. Srinivasan, "Asynchronous frameless event-based optical flow," Neural Networks, vol. 27, pp. 32-37, 2012.
39. S. Chen, P. Akselrod, B. Zhao, J. A. Pérez-Carrasco, B. Linares-Barranco, and E. Culurciello, "Efficient feedforward categorization of objects and human postures with address-event image sensors," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 2, pp. 302-314, Feb. 2012.
40. J. A. Pérez-Carrasco, B. Acha, C. Serrano, L. Camuñas-Mesa, T. Serrano-Gotarredona, and B. Linares-Barranco, "Fast vision through frame-less event-based sensing and convolutional processing. Application to texture recognition," IEEE Trans. Neural Networks, vol. 21, no. 4, pp. 609-620, Apr. 2010.
41. J. Pérez-Carrasco, T. Serrano-Gotarredona, C. Serrano, B. Acha, and B. Linares-Barranco, "High-speed character recognition system based on a complex hierarchical AER architecture," in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), 2008, pp. 2150-2153.
42. U.Mallik,M. Clapp, E. Choi, G. Cauwenberghs, and R. Etienne-Cummings, "Temporal change threshold detection imager," in IEEE Int. Solid-State Circuits Conf. (ISSCC) Dig. Tech. Papers, 2005, vol. 1, pp. 362-603.
43. Y. M. Chi, U. Mallik, M. A. Clapp, E. Choi, G. Cauwenberghs, and R. Etienne-Cummings, "CMOS camera with in-pixel temporal change detection and ADC," IEEE J. Solid-State Circuits, vol. 43, no. 10, pp. 2187-2196, Oct. 2008. (Pubitemid 47483001)
44. V. Gruev and R. Etienne-Cummings, "A pipelined temporal difference imager," IEEE J. Solid-State Circuits, vol. 39, no. 3, pp. 538-543, Mar. 2004.
45. D. Kim, Z. Fu, J. H. Park, and E. Culurciello, "A 1-mW CMOS temporal-difference AER sensor for wireless sensor networks," IEEE Trans. Electron. Devices, vol. 56, no. 11, pp. 2586-2593, Nov. 2009.
46. M. Gottardi, N. Massari, and S. A. Jawed, "A 100 mW 128x64 pixels contrast-based asynchronous binary vision sensor for sensor networks applications," IEEE J. Solid-State Circuits, vol. 44, no. 4, pp. 1582-1592, May 2009.
47. S. Chen,W. Tang,X. Zhang, and E. Culurciello, "A 64x64 pixels UWB wireless temporal-difference digital image sensor," IEEE Trans. VLSI Syst., vol. 20, no. 12, pp. 2232-2240, Dec. 2011.
48. T. Delbrück and R. Berner, "Temporal contrast AER pixel with 0.3%-contrast event threshold," in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), 2010, pp. 2442-2445.
49. C. Posch, D. Matolin, and R. Wohlgenannt, "A two-stage capacitivefeedback differencing amplifier for temporal contrast IR sensors," Int. J. Analog Int. Circuits Signal Proc., vol. 64, no. 1, pp. 45-54, Jul. 2010.
50. T. Serrano-Gotarredona, B. Linares-Barranco, and A. G. Andreou, "Very wide range tunable CMOS/bipolar current mirrors with voltage clamped input," IEEE Trans. Circuits Syst. I: Fund. Theory Applicat., pp. 1398-1407, Nov. 1999. (Pubitemid 30519701)
51. C. C. Enz, F. Krummenacher, and E. A. Vittoz, "An analytical MOS transistor model valid in all regions of operation and dedicated to lowvoltage and low current applications," Int. J. Analog Int. Circuits Signal Proc., no. 8, pp. 83-114, 1995.
52. A. I. A. Cunha, M. C. Schneider, and C. Galup-Montoro, "An MOS transistor model for analog circuit design," IEEE J. Solid-State Circuits, vol. 33, no. 10, pp. 1510-1519, Oct. 1998. (Pubitemid 128588603)
53. R. Serrano-Gotarredona, T. Serrano-Gotarredona, A. Acosta-Jiménez, and B. Linares-Barranco, "A neuromorphic cortical layer microchip for spike based event processing systems," IEEE Trans. Circuits Syst. I, vol. 52, no. 12, pp. 2548-2566, Dec. 2006. (Pubitemid 46002253)
54. R. Serrano-Gotarredona, L. Camuñas-Mesa, T. Serrano-Gotarredona, J. A. Leñero-Bardallo, and B. Linares-Barranco, "The stochastic I-Pot: A circuit building block for programming bias currents," IEEE Trans. Circuits Syst. II, vol. 19, no. 7, pp. 1196-1219, Jul. 2008.
55. K. Boahen, "Point-to-point connectivity between neuromorphic chips using address events," IEEE Trans. Circuits Syst. II, vol. 47, no. 5, pp. 416-434, May 2000.
56. T. Delbrück, B. Linares-Barranco, E. Culurciello, and C. Posch, "Activity-driven, event-based vision sensors," in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), 2010, pp. 2426-2429.
57. jAER Open Source Project, [Online]. Available: http://sourceforge.net/ apps/jaer/wiki