Event-based visual flow

IEEE Transactions on Neural Networks and Learning Systems

Volumn 25, Issue 2, 2014, Pages 407-417

  Benosman, Ryad ^a,b   Clercq, Charles ^c   Lagorce, Xavier ^a   Ieng, Sio Hoi ^a   Bartolozzi, Chiara ^c  

^a INSTITUT DE LA VISION   (France)

^b UNIVERSITY OF GENOA   (Italy)

^c ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

Author keywords

Event based vision; event based visual motion flow; neuromorphic sensors; real time

Indexed keywords

COMPUTATIONAL COSTS; DIFFERENTIAL APPROACH; EVENT-BASED; MICROSECOND ACCURACY; NEUROMORPHIC; REAL TIME; TEMPORAL RESOLUTION; VISUAL MOTION;

ARTIFICIAL INTELLIGENCE;

COMPUTER NETWORKS;

ALGORITHM; ARTIFICIAL INTELLIGENCE; BIOLOGICAL MODEL; HUMAN; MOTION; OPTIC FLOW; PHYSIOLOGY; RETINA; VISUAL SYSTEM;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; HUMANS; MODELS, NEUROLOGICAL; MOTION; OPTIC FLOW; RETINA; VISUAL PATHWAYS;

EID: 84893650447     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2013.2273537     Document Type: Article

References (34)

1. D. H. Perkel and T. H. Bullock, "Neural coding," Neurosci. Res. Program Bull., vol. 6, no. 3, pp. 221-348, 1968.
2. H. B. Barlow and W. R. Levick, "Changes in the maintained discharge with adaptation level in the cat retina," J. Physiol., vol. 200, no. 3, pp. 1-24, 1969.
3. W. Bialek, F. Rieke, R. de Ruyter van Steveninck, and D. Warland, "Reading a neural code," Science, vol. 252, pp. 1854-1857, Jun. 1991. (Pubitemid 21917111)
4. J. J. Atick, "Could information theory provide an ecological theory of sensory processing," Network, vol. 3, no. 2, pp. 213-251, 1992.
5. P. Lichtsteiner, C. Posch, and T. Delbruck, "A 128×128 120dB 15?s latency asynchronous temporal contrast vision sensor," IEEE J. Solid State Circuits, vol. 43, no. 2, pp. 566-576, Feb. 2008. (Pubitemid 351190224)
6. C. Posch, D. Matolin, and R. Wohlgenannt, "A QVGA 143 dB dynamic range frame-free PWM image sensor with lossless pixel-level video compression and time-domain CDS," IEEE J. Solid-State Circuits, vol. 46, no. 1, pp. 259-275, Jan. 2011.
7. X. Guo, X. Qi, and J. Harris, "A time-to-first-spike cmos image sensor," IEEE Sensors J., vol. 7, no. 8, pp. 1165-1175, Aug. 2007.
8. J. Lenero-Bardallo, T. Serrano-Gotarredona, and B. Linares-Barranco, "A 3.6 ?s latency asynchronous frame-free event-driven dynamic- visionsensor," IEEE J. Solid-State Circuits, vol. 46, no. 6, pp. 1443-1455, Jun. 2011.
9. J. Perez-Carrasco, C. Serrano, B. Acha, T. Serrano-Gotarredona, and B. Linares-Barranco, "Event based vision sensing and processing," in Proc. 15th IEEE ICIP, Oct. 2008, pp. 1392-1395.
10. R. Benosman, S. Ieng, C. Clercq, C. Bartolozzi, and M. Srinivasan, "Asynchronous frameless event-based optical flow," Neural Netw., vol. 27, pp. 32-37, Mar. 2012.
11. R. Serrano-Gotarredona, M. Oster, P. Lichtsteiner, A. Linares-Barranco, R. Paz-Vicente, F. Gomez-Rodriguez, L. Camunas-Mesa, R. Berner, M. Rivas-Perez, T. Delbruck, S.-C. Liu, R. Douglas, P. Hafliger, G. Jimenez-Moreno, A. Ballcels, T. Serrano-Gotarredona, A. Acosta-Jimenez, and B. Linares-Barranco, "CAVIAR: A 45k neuron, 5M synapse, 12G connects/s AER hardware sensory system for high-speed visual object recognition and tracking," IEEE Trans. Neural Netw., vol. 20, no. 9, pp. 1417-1438, Sep. 2009.
12. Z. Fu, T. Delbruck, P. Lichtsteiner, and E. Culurciello, "An addressevent fall detector for assisted living applications," IEEE Trans. Biomed. Circuits Syst., vol. 2, no. 2, pp. 88-96, Jun. 2008.
13. R. Benosman, S. Ieng, C. Posch, and P. Rogister, "Asynchronous eventbased Hebbian epipolar geometry," IEEE Trans. Neural Netw., vol. 22, no. 11, pp. 1723-1734, Nov. 2011.
14. P. Rogister, R. Benosman, S. Ieng, P. Lichtsteiner, and T. Delbruck, "Asynchronous event-based binocular stereo matching," IEEE Trans. Neural Netw. Learn Syst., vol. 23, no. 2, pp. 347-353, Feb. 2012.
15. J. A. Pérez-Carrasco, B. Acha, C. Serrano, L. A. Camuñas-Mesa, T. Serrano-Gotarredona, and B. Linares-Barranco, "Fast vision through frameless event-based sensing and convolutional processing: Application to texture recognition," IEEE Trans. Neural Netw., vol. 21, no. 4, pp. 609-620, Apr. 2010.
16. A. B. Watson and A. J. Ahumada, A Look at Motion in the Frequency Domain. Washington, DC, USA: Nat. Aeronautics Space Admin., 1983, pp. 1-10.
17. D. J. Heeger, "Optical flow using spatiotemporal filters," Int. J. Comput. Vis., vol. 1, pp. 279-302, Feb. 1998.
18. D. J. Heeger, "Model for the extraction of image flow," J. Opt. Soc. Amer., vol. 4, no. 8, pp. 1455-1471, 1987.
19. J. L. Barron, D. J. Fleet, and S. S. Beauchemin, "Performance of optical flow techniques," Int. J. Comput. Vis., vol. 12, no. 1, pp. 43-77, 1994.
20. P. Anandan, "A computational framework and an algorithm for the measurement of visual motion," Int. J. Comput. Vis., vol. 2, no. 3, pp. 283-310, 1989.
21. R. Kories and G. Zimmerman, "A versatile method for the estimation of displacement vector fields from image sequences," in Proc. IEEE Workshop Motion, Represent. Anal., Feb. 1986, pp. 101-106. (Pubitemid 16627841)
22. A. Singh, Optic Flow Computation: A Unified Perspective. New York, NY, USA: Wiley, 1992.
23. M. A. Sutton, W. J. Walters, W. H. Peters, W. F. Ranson, and S. R. McNeil, "Determination of displacement using an improved digital correlation method," Image Vis. Comput., vol. 1, no. 3, pp. 133-139, 1983. (Pubitemid 14543957)
24. T. Camus, "Real-time quantized optical flow," Real-Time Imag., vol. 3, no. 2, pp. 71-86, 1997. (Pubitemid 127666658)
25. J. Banks and P. Corke, "Quantitative evaluation of matching methods and validity measures for stereo vision," Int. J. Robot. Res., vol. 20, no. 7, pp. 512-32, 2001. (Pubitemid 34566114)
26. B. Galvin, B. McCane, K. Novins, D. Mason, and S. Mills, "Recovering motion fields: An evaluation of eight optical flow algorithms," in Proc. 9th Brit. Mach. Vis. Conf., 1998, pp. 195-204.
27. B. K. P. Horn and B. G. Schunck, "Determining optical flow," Artif. Intell., vol. 13, nos. 1-3, pp. 185-203, 1981.
28. H. H. Nagel, "On the estimation of optical flow: Relations between different approaches and some new results," Artif. Intell., vol. 33, no. 3, pp. 299-324, 1987.
29. M. Bjorkman, "Real time motion and stereo cues for active visual observers," Ph.D. dissertation, Dept. Numer. Anal. Comput. Sci., R. Inst. Technol., Stockholm, Sweden, 2002.
30. M. Mahowald, "Vlsi analogs of neuronal visual processing: A synthesis of form and function," Ph.D. dissertation, Dept. Comput. Neural Syst., California Inst. Technol., Pasadena, CA, USA, 1992.
31. T. Delbruck, B. Linares-Barranco, E. Culurciello, and C. Posch, "Activity-driven, event-based vision sensors," in Proc. ISCAS, 2010, pp. 2426-2429.
32. T. Delbruck, (2013). jAER Open Source Project [Online]. Available: http://sourceforge.net/p/jaer/wiki/Home/.
33. B. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision (IJCAI)," in Proc. 7th IJCAI, Apr. 1981, pp. 674-679. (Pubitemid 14478744)
34. J. Shi and C. Tomasi, "Good features to track," in Proc. IEEE CVPR, Jun. 1994, pp. 593-600.