Fine grain pipeline architecture for high performance phase-based optical flow computation

Journal of Systems Architecture

Volumn 56, Issue 11, 2010, Pages 577-587

  Tomasi, M ^a   Barranco, F ^a   Vanegas, M ^a,b   Diaz J ^a   Ros, E ^a  

^a UNIVERSITY OF GRANADA   (Spain)

^b Universidad Pontificia   (Colombia)

Author keywords

Embedded and real time systems; FPGA; Optical flow

Indexed keywords

ACCURATE MOTION; COMPUTING POWER; DATA PATHS; DATA STREAM; EMBEDDED DEVICE; FINE GRAIN PIPELINE; FPGA; FRAME RATE; FRAMES PER SECONDS; GENERAL PURPOSE PROCESSORS; HARDWARE PLATFORM; HIGH FRAME RATE; HIGH RESOLUTION; ILLUMINATION CHANGES; IMAGE NOISE; INPUT IMAGE; MOTION RANGE; NEW TECHNOLOGIES; OPTICAL FLOW ALGORITHM; OPTICAL FLOW COMPUTATION; OPTICAL FLOW ESTIMATION; PARALLEL PROCESSING; POTENTIAL APPLICATIONS; PROCESS INPUTS; PROCESSING CAPABILITY; RESEARCH FIELDS; SPECIFIC HARDWARE; STATE OF THE ART; SUPERSCALAR; SYSTEM ROBUSTNESS;

DATA PROCESSING; EMBEDDED SYSTEMS; FIELD PROGRAMMABLE GATE ARRAYS (FPGA); OPTICAL FLOWS; VIDEO RECORDING;

REAL TIME SYSTEMS;

EID: 78149282344     PISSN: 13837621     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sysarc.2010.07.012     Document Type: Article

References (40)

1. Agility, Website, 2010. .
2. Allied, 2010. .
3. Handel-c manual reference, Website, 2010. .
4. Middlebury Vision Website, 2010. .
5. Seven Solutions, Website, 2010. .
6. Xilinx, Website, 2010. .
7. M. Anguita, J. Diaz, E. Ros, and F. Fernandez-Baldomero Optimization strategies for high-performance computing of optical-flow in general-purpose processors IEEE Transactions on Circuits and Systems for Video Technology 19 2009 1475 1488
8. F. Barranco, J. Díaz, E. Ros, and B.N. Del Pino Visual system based on artificial retina for motion detection Transactions on Systems, Man, and Cybernetics, Part B 39 2009 752 762
9. F. Barranco, M. Tomasi, M. Vanegas, S. Granados, J. Diaz, Entorno software para visualización y configuración de procesamiento de imágenes en tiempo real con plataformas reconfigurables, IX Jornadas de Computación Reconfigurable y Aplicaciones, JCRA, 2009.
10. J. Barron, D. Fleet, and S. Beauchemin Performance of optical flow techniques International Journal of Computer Vision 12 1994 43 77
11. J.H. Barrón-Zambrano, F.M.D. Campo-Ramírez, M. Arias-Estrada, Parallel processor for third recovery from optical flow, in: RECONFIG '08, in: Proceedings of the 2008 International Conference on Reconfigurable Computing and FPGAs, IEEE Computer Society, Washington, DC, USA, 2008, pp. 49-54.
12. S.S. Beauchemin, and J.L. Barron The computation of optical flow ACM Computer Survey 27 1995 433 466
13. G. Botella, A. Garcia, M. Rodriguez-Alvarez, E. Ros, U. Meyer-Baese, and M.C. Molina Robust bioinspired architecture for optical-flow computation, Very Large Scale Integration (VLSI) Systems IEEE Transactions on PP 2009 1-1
14. T. Brox, A. Bruhn, N. Papenberg, J. Weickert, High accuracy optical flow estimation based on a theory for warping, in: ECCV04, 2004, pp. 25-36.
15. A. Bruhn, J. Weickert, T. Kohlberger, and C. Schnoerr A multigrid platform for real-time motion computation with discontinuity-preserving variational methods International Journal of Computer Vision 70 2006 257 277
16. M. Correia, A. Campilho, Real-time implementation of an optical flow algorithm, in: Proceedings of 16th International Conference on Pattern Recognition, vol. 4, 2002, pp. 247-250.
17. J. Díaz, E. Ros, R. Agís, and J.L. Bernier Superpipelined high-performance optical-flow computation architecture Computer Vision and Image Understanding 112 2008 262 273
18. J. Díaz, E. Ros, R. Carrillo, and A. Prieto Real-time system for high image resolution disparity estimation IEEE Transactions on Image Processing 16 2007 280 285
19. J. Diaz, E. Ros, F. Pelayo, E. Ortigosa, and S. Mota FPGA-based real-time optical-flow system IEEE Transactions on Circuits and Systems for Video Technology 16 2006 274 279
20. D.J. Fleet, and A.D. Jepson Stability of phase information IEEE Transactions on Pattern Analysis and Machine Intelligence 15 1993 1253 1268
21. W.T. Freeman, and E.H. Adelson The design and use of steerable filters IEEE Transactions on Pattern Analysis and Machine Intelligence 13 1991 891 906
22. T. Gautama, and M. Van Hulle A phase-based approach to the estimation of the optical flow field using spatial filtering IEEE Transactions on Neural Networks 13 2002 1127 1136
23. B.K.P. Horn, and B.G. Schunck Determining optical flow Artificial Intelligence 17 1981 185 203
24. S. Lim, J.G. Apostolopoulos, and A.E. Gamal Optical flow estimation using temporally oversampled video IEEE Transactions on Image Processing 14 2005 1074 1087
25. B.D. Lucas, T. Kanade, An iterative image registration technique with an application to stereo vision, in: IJCAI, 1981, pp. 674-679.
26. J.L. Martín, A. Zuloaga, C. Cuadrado, J. Lázaro, and U. Bidarte Hardware implementation of optical flow constraint equation using FPGAs Computer Vision and Image Understanding 98 2005 462 490
27. R.R. Mourant, N. Ahmad, B.K. Jaeger, and Y. Lin Optic flow and geometric field of view in a driving simulator display Displays 28 2007 145 149
28. O. Nestares, R. Navarro, J. Portilla, and A. Tabernero Efficient spatial-domain implementation of a multiscale image representation based on Gabor functions Journal of Electronic Imaging 7 1998 166 173
29. H. Niitsuma, T. Maruyama, High speed computation of the optical flow, in: ICIAP, 2005, pp. 287-295.
30. K. Pauwels, Computational modeling of visual attention: neuronal response modulation in the thalamocortical complex and saliency-based detection of independent motion, Ph.D. thesis, K.U. Leuven, Directed by Marc Van Hulle, 2008.
31. K. Pauwels, M. Van Hulle, Realtime phase-based optical flow on the gpu, in: CVPR Workshop on Computer Vision on the GPU, 2008.
32. S. Sabatini, G. Gastaldi, F. Solari, J. Diaz, E. Ros, K. Pauwels, M. Van Hulle, N. Pugeault, N. Krüger, Compact and accurate early vision processing in the harmonic space, in: International Conference on Computer Vision Theory and Applications, Barcelona, 2007, pp. 213-220.
33. S.P. Sabatini, G. Gastaldi, F. Solari, K. Pauwels, M. Van Hulle, J. Díaz, E. Ros, N. Pugeault, and N. Krüger A compact harmonic code for early vision based on anisotropic frequency channels Computer Vision and Image Understanding 114 2010 681 699
34. J.C. Sosa, R. Gomez-Fabela, J.A. Boluda, F. Pardo, Change-driven image architecture on FPGA with adaptive threshold for optical-flow computation, in: IEEE International Conference on Reconfigurable Computing and FPGA's, ReConFig, 2006, pp. 1-8.
35. V. Tella, J.L. Toca-Herrera, J.E. Gallach, J. Benavent, L.M. Gonzalez, and R. Arellano Effect of fatigue on the intra-cycle acceleration in front crawl swimming: a time-frequency analysis Journal of Biomechanics 41 2008 86 18p Comments: 18p, 2 figures, 4 tables
36. M. Tomasi, M. Vanegas, F. Barranco, J. Diaz, E. Ros, Arquitectura multiescala de cálculo de flujo óptico basado en la fase, IX Jornadas de Computación Reconfigurable y Aplicaciones, JCRA, 2009.
37. J. Vallino, Datacube MV200 and ImageFlow User"s Guide, Technical Report, 1996.
38. J. Valls, M. Kuhlmann, and K.K. Parhi Evaluation of cordic algorithms for FPGA design Jounal of VLSI Signal Processing Systems 32 2002 207 222
39. M. Vanegas, M. Tomasi, J. Diaz, E. Ros, Multi-port abstraction layer for FPGA intensive memory exploitation applications, Journal of System Architecture (2010), in press, doi:10.1016/j.sysarc.2010.05.007.
40. Z. Wei, D.J. Lee, B.E. Nelson, J.K. Archibald, and B.B. Edwards FPGA-based embedded motion estimation sensor International Journal of Reconfigurable Computing 2008