High-performance optical-flow architecture based on a multi-scale, multi-orientation phase-based model

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 20, Issue 12, 2010, Pages 1797-1807

  Tomasi, Matteo ^a   Vanegas, Mauricio ^a,b   Barranco, Francisco ^a   Diaz, Javier ^a   Ros, Eduardo ^a  

^a UNIVERSITY OF GRANADA   (Spain)

^b UNIVERSIDAD PONTIFICIA BOLIVARIANA   (Colombia)

Author keywords

Embedded and real time systems; field programmable gate array (FPGA); multi scale; optical flow

Indexed keywords

ACCURATE ESTIMATION; COMPUTATIONAL LOADS; COMPUTING UNITS; DATA-PATH ARCHITECTURE; FLOW ARCHITECTURES; FLOW PROCESSING; FPGA DEVICES; MULTI-RESOLUTIONS; MULTISCALES; PARALLEL PROCESSING; PERFORMANCE COMPUTATION; REAL-LIFE APPLICATIONS; REALTIME PROCESSING; ROBUST ALGORITHM; SUBPIXEL ACCURACY; SUPERSCALAR;

COMPUTER VISION; EMBEDDED SYSTEMS; FIELD PROGRAMMABLE GATE ARRAYS (FPGA); IMAGE RESOLUTION; LOGIC GATES; OPTICAL FLOWS; PHASE STABILITY; PIPELINE PROCESSING SYSTEMS; SYSTEM STABILITY;

REAL TIME SYSTEMS;

EID: 79551611265     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2010.2087590     Document Type: Article

References (40)

1. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. IJCAI, 1981, pp. 674-679.
2. B. K. P. Horn and B. G. Schunck, "Determining optical flow," Artif. Intell., vol. 17, nos. 1-3, pp. 185-203, 1981.
3. A. Verri and T. Poggio, "Motion field and optical flow: Qualitative properties," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 5, pp. 490-498, May 1989.
4. S. S. Beauchemin and J. L. Barron, "The computation of optical flow," ACM Comput. Surv., vol. 27, no. 3, pp. 433-466, 1995.
5. J. Barron, D. Fleet, and S. Beauchemin, "Performance of optical flow techniques," Int. J. Comput. Vision, vol. 12, no. 1, pp. 43-77, 1994.
6. B. Ni, A. A. Kassim, and S. Winkler, "A hybrid framework for 3-D human motion tracking," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 8, pp. 1075-1084, Aug. 2008.
7. C. McCarthy and N. Barnes, "Performance of optical flow techniques for indoor navigation with a mobile robot," in Proc. IEEE Int. Conf. Robot. Autom., vol. 5. 2004, pp. 5093-5098.
8. J. Diaz Alonso, E. Ros Vidal, A. Rotter, and M. Muhlenberg, "Lane-change decision aid system based on motion-driven vehicle tracking," IEEE Trans. Veh. Technol., vol. 57, no. 5, pp. 2736-2746, Sep. 2008.
9. J. Han, D. Farin, and P. de With, "Broadcast court-net sports video analysis using fast 3-D camera modeling," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 11, pp. 1628-1638, Nov. 2008.
10. G. T. Papadopoulos, A. Briassouli, V. Mezaris, I. Kompatsiaris, and M. G. Strintzis, "Statistical motion information extraction and representation for semantic video analysis," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 10, pp. 1513-1528, Oct. 2009.
11. K. Pauwels and M. M. V. Hulle, "Optimal instantaneous rigid motion estimation insensitive to local minima," Comput. Vision Image Understanding, vol. 104, no. 1, pp. 77-86, 2006.
12. S. P. Sabatini, F. Solari, P. Cavalleri, and G. M. Bisio, "Phase-based binocular perception of motion in depth: Cortical-like operators and analog VLSI architectures," EURASIP J. Appl. Signal Process., vol. 2008, pp. 690-702, Jan. 2003.
13. M. Anguita, J. Diaz, E. Ros, and F. J. Fernandez-Baldomero, "Optimization strategies for high-performance computing of optical-flow in general-purpose processors," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 10, pp. 1475-1488, Oct. 2009.
14. J. Diaz, E. Ros, R. Agis, and J. L. Bernier, "Superpipelined high-performance optical-flow computation architecture," Comput. Vision Image Understanding, vol. 112, no. 3, pp. 262-273, 2008.
15. K. Pauwels and M. Van Hulle, "Realtime phase-based optical flow on the GPU," in Proc. CVPR Workshop Comput. Vision GPU, 2008, pp. 1-8.
16. A. Bruhn, J. Weickert, T. Kohlberger, and C. Schnoerr, "A multigrid platform for real-time motion computation with discontinuity-preserving variational methods," Int. J. Comput. Vision, vol. 70, no. 3, pp. 257-277, 2006.
17. J. Diaz, E. Ros, F. Pelayo, E. Ortigosa, and S. Mota, "FPGA-based realtime optical-flow system," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 2, pp. 274-279, Feb. 2006.
18. S. P. Sabatini, G. Gastaldi, F. Solari, K. Pauwels, M. M. V. Hulle, J. Diaz, E. Ros, N. Pugeault, and N. Krger, "A compact harmonic code for early vision based on anisotropic frequency channels," Comput. Vision Image Understanding, vol. 114, no. 6, pp. 681-699, 2010.
19. D. J. Fleet and A. D. Jepson, "Stability of phase information," IEEE Trans. Pattern Anal. Mach. Intell., vol. 15, no. 12, pp. 1253-1268, Dec. 1993.
20. T. Gautama and M. Van Hulle, "A phase-based approach to the estimation of the optical flow field using spatial filtering," IEEE Trans. Neural Netw., vol. 13, no. 5, pp. 1127-1136, Sep. 2002.
21. W. T. Freeman and E. H. Adelson, "The design and use of steerable filters," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, no. 9, pp. 891-906, Sep. 1991.
22. J. D́iaz, "Multimodal bio-inspired vision system: High performance motion and stereo processing architecture," Ph.D. dissertation, Dept. Comput. Architecture Technol., Univ. Granada, Granada, Spain, Jul. 2006.
23. A. Cozzi, B. Crespi, F. Valentinotti, and F. Wörgötter, "Performance of phase-based algorithms for disparity estimation," Mach. Vision Appl., vol. 9, nos. 5-6, pp. 334-340, 1997.
24. E. H. Adelson, C. H. Anderson, J. R. Bergen, P. J. Burt, and J. M. Ogden, "Pyramid methods in image processing," RCA Engineer, vol. 29, no. 6, pp. 33-41, 1984. ́
25. E. Ortigosa, A. Cass, E. Ros, P. Ortigosa, S. Mota, and J. Diaz, "Hardware description of multilayer perceptrons with different abstraction levels," Microprocessors Microsyst., vol. 30, no. 7, pp. 435-444, 2006.
26. Xilinx. (2010) [Online]. Available: http://www.xilinx.com
27. J. Diaz, E. Ros, A. Prieto, and F. J. Pelayo, "Fine grain pipeline systems for real-time motion and stereo-vision computation," Int. J. High Perform. Syst. Architect., vol. 1, no. 1, pp. 60-68, Apr. 2007.
28. M. Vanegas, M. Tomasi, J. D́az, and E. Ros, "Multi-port abstraction layer for FPGA intensive memory exploitation applications," J. Syst. Archit., vol. 56, no. 9, pp. 442-451, 2010.
29. Seven Solutions. (2010) [Online]. Available: http://www.sevensols.com
30. S. Baker, D. Scharstein, J. P. Lewis, S. Roth, M. J. Black, and R. Szeliski, "A database and evaluation methodology for optical flow," in Proc. IEEE 11th Int. Conf. Comput. Vision, 2007, pp. 1-8.
31. Middlebury Vision Website. (2010) [Online]. Available: http://vision. middlebury.edu/stereo/.
32. Z. Wei, D.-J. Lee, B. E. Nelson, J. K. Archibald, and B. B. Edwards, "FPGA-based embedded motion estimation sensor," Int. J. Reconfig-urable Comput., vol. 2008, no. 636145, Jul. 2008.
33. G. Botella, A. Garcia, M. Rodriguez-Alvarez, E. Ros, U. Meyer-Baese, and M. C. Molina, "Robust bioinspired architecture for optical-flow computation," IEEE Trans. Very Large Scale Integr. Syst., vol. 18, no. 4, pp. 616-629, Apr. 2010.
34. Y. Murachi, F. Yuki, R. Yamamoto, J. Miyakoshi, H. Kawaguchi, H. Ishihara, M. Miyama, Y. Matsuda, and M. Yoshimoto, "A VGA 30 fps realtime optical-flow processor core for moving picture recognition," IEICE Trans. Electron., vol. E91C(4), pp. 457-464, Apr. 2008.
35. J. C. Sosa, R. Gomez-Fabela, J. A. Boluda, and F. Pardo, "Change-driven image architecture on FPGA with adaptive threshold for optical-flow computation," in Proc. IEEE Int. Conf. Reconf. Comput. FPGAs, Sep. 2006, pp. 1-8. ́
36. J. L. Martin, A. Zuloaga, C. Cuadrado, J. Lázaro, and U. Bidarte, "Hardware implementation of optical flow constraint equation using FPGAs," Comput. Vision Image Understanding, vol. 98, no. 3, pp. 462- 490, 2005.
37. H. Niitsuma and T. Maruyama, "High speed computation of the optical flow," in Proc. ICIAP, 2005, pp. 287-295.
38. M. Correia and A. Campilho, "Real-time implementation of an optical flow algorithm," in Proc. 16th Int. Conf. Pattern Recognit., vol. 4. 2002, pp. 247-250.
39. J. Vallino, "Datacube mv200 and imageflow user's guide," Dept. Com-put. Sci., Univ. Rochester, Rochester, NY, Series/Rep. UR CSD/TR 590, Jul. 14, 2004.
40. J. L. Redondo, I. Garca, and P. M. Ortigosa, "Parallel evolutionary algorithms based on shared memory programming approaches," J. Supercomputing, no. 0920-8542, pp. 1-10, 2009.