Robust bioinspired architecture for optical-flow computation

IEEE Transactions on Very Large Scale Integration (VLSI) Systems

Volumn 18, Issue 4, 2010, Pages 616-629

  Botella, Guillermo ^a   García, Antonio ^b   Rodríguez Álvarez, Manuel ^b   Ros, Eduardo ^b   Meyer Baese, Uwe ^c   Molina, María C ^a  

^a UNIVERSIDAD COMPLUTENSE DE MADRID   (Spain)

^b UNIVERSITY OF GRANADA   (Spain)

^c FAMU FSU COLLEGE OF ENGINEERING   (United States)

Author keywords

Bioinspired systems; Digital signal processing; Embedded systems; Neuromorphic systems; Optical flow; Reconfigurable architectures

Indexed keywords

APPLICATION FIELDS; BIO-INSPIRED; BIOINSPIRED SYSTEMS; BIT-WIDTH; COMPLEX SYSTEMS; CUSTOMIZABLE; FLOW COMPUTATION; GRADIENT MODEL; HARDWARE PLATFORM; IMAGE SEQUENCE; INFORMATION CHANNELS; MULTI-CHANNEL; NEUROMORPHIC; NEUROMORPHIC SYSTEMS; PERFORMANCE DATA; REAL-WORLD; RECONFIGURABLE ARCHITECTURE; RESOURCE USAGE; ROBUSTNESS PROPERTIES; SCIENTIFIC COMMUNITY;

COMPUTATIONAL COMPLEXITY; DIGITAL SIGNAL PROCESSING; EMBEDDED SYSTEMS; MOTION ESTIMATION; OPTICAL FLOWS; OPTICAL PROPERTIES; RECONFIGURABLE HARDWARE; SIGNAL PROCESSING;

REAL TIME SYSTEMS;

EID: 77950296585     PISSN: 10638210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVLSI.2009.2013957     Document Type: Article

References (45)

1. C. A. Mead, "Neuromorphic electronic systems," Proc. IEEE, vol.78, no.10, pp. 1629-1636, Oct. 1990.
2. C. A. Mead, Analog VLSI and Neural Systems. Reading: Addison-Wesley, 1989.
3. A. Johnston, P. W. McOwan, and C. Benton, "Robust velocity computation from a biologically motivated model of motion perception," Proc. R. Soc. Lond., vol.B 266, no.1418, pp. 509-518, Mar. 1999.
4. A. Johnston and C. W. Clifford, "Perceived motion of contrast modulated gratings: Prediction of the McGM and the role of full-wave rectification," Vis. Res., vol.35, no.12, pp. 1771-1783, Jun. 1995.
5. A. Anderson and P. W. McOwan, "Humans deceived by predatory stealth strategy camouflaging motion," Proc. R. Soc., vol.B 720, pp. 18-20, 2003.
6. A. Johnston and C. W. Clifford, "A unified account of three apparent motion illusions," Vis. Res., vol.35, no.8, pp. 1109-1123, Apr. 1994.
7. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. DARPA Image Underst. Workshop, 1984, pp. 121-130.
8. S. Baker and I. Matthews, "Lucas-Kanade 20 years on: A unifying framework," Int. J. Comput. Vis., vol.56, no.3, pp. 221-255, Feb. 2004.
9. B. K. Horn and B. G. Schunck, "Determining optical flow," Artif. Intell., vol.17, no.1, pp. 185-204, 1982.
10. P. W. McOwan, C. Benton, J. Dale, and A. Johnston, "A multi-differential neuromorphic approach to motion detection," Int. J. Neural Syst., vol.9, no.5, pp. 429-434, Oct. 1999.
11. A. Johnston, P. W. McOwan, and C. P. Benton, "Biological computation of image motion from flows over boundaries," J. Physiol. Paris, vol. 97, no. 2/3, pp. 325-334, Mar.-May 2003.
12. A. Johnston, P. W. McOwan, and H. A. Buxton, "Computational model of the analysis of some first-order and second-order motion patterns by simple and complex cells," Proc. R. Soc. Lond., vol.B 250, no.1329, pp. 297-306, Dec. 1992.
13. V. Bruce, P. R. Green, and M. A. Georgeson, Visual Perception: Physiology, Psychology&Ecology, 3rd ed. Hove, U.K.: Laurence Erlbaum Associates, 1996.
14. B. McCane, K. Novins, D. Crannitch, and B. Galvin, "On benchmarking optical flow," Comput. Vis. Image Underst., vol.84, no.1, pp. 126-143, Oct. 2001.
15. H. C. Liu, T. S. Hong, M. Herman, T. Camus, and R. Chellappa, "Accuracy vs efficiency trade-offs in optical flow algorithms," Comput. Vis. Image Underst., vol.72, no.3, pp. 271-286, Dec. 1998.
16. J. L. Barron, D. J. Fleet, and S. S. Beauchemin, "Performance of optical flow techniques," Int. J. Comput. Vis., vol.12, no.1, pp. 43-77, Feb. 1994.
17. J. J. Koenderink and A. J. Van Doorn, "Representation of local geometry in the visual system," Biol. Cybern., vol.55, no.6, pp. 367-375, Mar. 1987.
18. R. F. Hess and R. J. Snowden, "Temporal properties of visual filters; number, shapes and spatial covariation," Vis. Res., vol.32, no.1, pp. 47-60, Jan. 1992.
19. R. F. Hess and R. J. Snowden, "Temporal frequency filters in the human peripheral visual field," Vis. Res., vol.32, no.1, pp. 61-72, Jan. 1992.
20. L. Lagae, S. Raiguel, and G. A. Orban, "Speed and direction selectivity of macaque middle temporal neurons," J. Neurophysiol., vol.69, no.1, pp. 19-39, Jan. 1993.
21. A. Mikami, W. T. Newsome, and R. H. Wurtz, "Motion selectivity in macaque visual cortex. I. Mechanisms of direction and speed selectivity in extrastriate area MT," J. Neurophysiol., vol.55, no.6, pp. 1308-1327, Jun. 1986.
22. P. McLeod, W. Dittrich, J. Driver, D. Perrett, and J. Zihl, "Preserved and impaired detection of structure from motion by a motion-blind patient," Vis. Cogn., vol.3, no.4, pp. 363-391, Dec. 1996.
23. G. Botella, "Robust optical flow implementation in reconfigurable hardware," Ph.D. Thesis, Dept. Comput. Architecture, Univ. Granada, Granada, Spain, 2007, ISBN 978-84-338-4381-4.
24. AlphaData RC1000 Product [Online]. Available: http://www.alphadata. com/adc-rc1000.html 2006
25. W. Freeman and E. Adelson, "The design and use of steerable filters," IEEE Trans. Pattern Anal. Mach. Intell., vol.13, no.9, pp. 891-906, Sep. 1991.
26. Yosemite, Translating and Diverging Tree Sequences ftp.csd.uwo.ca/ pub/vision/TESTDATA/.
27. B. Galvin, B. McKane, K. Novins, and S. Mills, "Recovering motion fields: An evaluation of eight optical flow algorithms," in Proc. Brit. Mach. Video Conf., 1998, pp. 195-204.
28. "Handel-C Language Reference Manual and DK Tool," Celoxica Company, Oxfordshire, U.K., 2007 [Online]. Available: http://www. celoxica.com/
29. G. Botella, E. Ros, M. Rodríguez, A. García, and S. Romero, "Pre-processor for bioinspired optical flow models: A customizable hardware implementation," in IEEE XIII MELECON Conf., 2006, pp. 93-97.
30. "Timing Analysis and Optmization of Handel-C Designs for Xilinx Chips," Celoxica Application Note AN 68 v1.1 2005.
31. J. L. Barron, S. S. Beauchemin, and D. J. Fleet, "On optical flow," in 6th Int. Conf. Artif. Intell. Inf.-Control Robots, Bratislava, Slovakia, 1996, pp. 3-14.
32. H. C. Liu, T. S. Hong, M. Herman, T. Camus, and R. Chellappa, "Accuracy vs efficiency trade-offs in optical flow algorithms," Comput. Vis. Image Underst., vol.72, no.3, pp. 271-286, Dec. 1998.
33. J. Díaz, E. Ros, F. Pelayo, E. M. Ortigosa, and S. Mota, "FPGA-based real-time optical-flow system," IEEE Trans. Circuits Syst. Video Technol., vol.16, no.2, pp. 274-279, Feb. 2006.
34. J. Díaz, E. Ros, R. Rodríguez, and B. del Pino, "Real-time architecture for robust motion estimation under varying illumination conditions," J. Universal Comput. Sci., vol.13, no.3, pp. 363-376, 2007.
35. J. L. Martín, A. Zuloaga, C. Cuadrado, and U. Bidarte, "Hardware implementation of optical flow constraint equation using FPGAs," Comput. Vis. Image Underst., vol.98, no.3, pp. 462-490, Jun. 2005.
36. A. Zuloaga, U. Bidarte, J. L. Martin, and E. Ezquerra, "Optical flow estimator using VHDL for implementation in FPGA," in IEEE Int. Conf. Image Process., 1998, pp. 972-976.
37. P. Cobos and F. Monasterio, "FPGA implementation of the Horn & Shunk optical flow algorithm for motion detection in real time images," in XIII Des. Circuits Integr. Syst. Conf., Madrid, Spain, 1999, pp. 616-621.
38. P. Cobos and F. Monasterio, "Real time hardware vision system applications: Optical flow and time to contact detector units," in 5th IEEE Int. Caracas Conf. Devices, Circuits Syst., Punta Cana, Dominican Republic, 2004.
39. H. Niitsuma and T. Maruyama, "Real-time detection of moving objects," in IEEE FPL, 2004, vol.3203, LNCS, pp. 1153-1157.
40. H. Oh and H. Lee, "Block matching algorithm based on a adaptative reduction of the search area for motion estimation," Real-Time Imaging, vol.6, no.5, pp. 407-414, Oct. 2000.
41. Z. Wei, D. Lee, and B. E. Nelson, "A fast and accurate tensor-based optical flow algorithm implemented in FPGA," in Proc. IEEE WACV, Austin, TX, 2007, vol.18.
42. Z. Wei, D. Lee, B. E. Nelson, J. K. Archibald, and B. Edwards, "FPGA-based embedded motion estimation sensor," Int. J. Reconfigurable Comput., 2008, 636145.
43. R. Deutschmann and C. Koch, "An analog VLSI velocity sensor using the gradient method," in IEEE ISCAS, 1998, pp. 649-652.
44. A. A. Stocker and R. J. Douglas, "Analog integrated 2D optical flow sensor with programmable pixels," in IEEE ISCAS, 2004, pp. 9-12.
45. A. A. Stocker, "Analog integrated 2D optical flow sensor," Analog Integr. Circuits Signal Process., vol.46, no.2, pp. 121-138, Feb. 2006.