Optimization strategies for high-performance computing of optical-flow in general-purpose processors

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 19, Issue 10, 2009, Pages 1475-1488

  Anguita, Mancia ^a   Diaz, Javier ^a   Ros, Eduardo ^a   Fernandez Baldomero, F Javier ^a  

^a UNIVERSITY OF GRANADA   (Spain)

Author keywords

Code optimization; Image motion analysis; Motion estimation; Parallel architectures; Shared memory systems

Indexed keywords

CODE OPTIMIZATION; FIRST CODE; FLOW ALGORITHM; GENERAL PURPOSE PROCESSORS; HIGH-PERFORMANCE COMPUTING; IMAGE-MOTION ANALYSIS; OPTIMIZATION STRATEGY; OPTIMIZED IMPLEMENTATION; PERFORMANCE IMPLEMENTATION; REAL-TIME MOTION; SHARED-MEMORY SYSTEMS; YOSEMITE SEQUENCE;

COMPUTATIONAL EFFICIENCY; DIGITAL SIGNAL PROCESSING; ESTIMATION; FACE RECOGNITION; GENERAL PURPOSE COMPUTERS; IMAGE RESOLUTION; MICROCOMPUTERS; MILITARY PHOTOGRAPHY; OPTIMIZATION; PARALLEL ARCHITECTURES; PROGRAM PROCESSORS;

MOTION ESTIMATION;

EID: 70350044890     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2009.2026821     Document Type: Article

References (34)

1. A. J. Tabatabai, R. S. Jasinschi, and T. Naveen, "Motion estimation methods for video compression: A review," J. Franklin Inst., vol.335B, no.8, pp. 1411-1441, Nov. 1998.
2. T. Jebara, A. Azarbayejani, and A. Pentland, "3-D structure from 2-D motion: 3-D and stereoscopic visual communication," IEEE Signal Process. Mag., vol.16, no.3, pp. 66-84, May 1999.
3. J. L. Barron, D. J. Fleet, and S. Beauchemin, "Performance of optical-flow techniques," Int. J. Comput. Vis., vol.12, no.1, pp. 43-77, Feb. 1994.
4. G. L. Besnerais and F. Champagnat, "B-Spline image model for energy minimization-based optical-flow estimation," IEEE Trans. Image Process., vol.15, no.10, pp. 3201-3206, Oct. 2006.
5. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. DARPA Image Understand. Workshop, Apr. 1984, pp. 121-130.
6. H. C. Liu, T. S. Hong, M. Herman, T. Camus, and R. Chellappa, "Accuracy versus efficiency trade-offs in optical-flow algorithms," Comput. Vis. Image Understand., vol.72, no.3, pp. 271-286, Dec. 1998.
7. J. Diaz, E. Ros, A. Prieto, and F. J. Pelayo, "Fine grain pipeline systems for real-time motion and stereo-vision computation," Int. J. High Perform. Syst. Architect., vol.1, no.1, pp. 60-68, 2007.
8. J. D́iaz, E. Ros, R. Aǵias, and J. L. Bernier, "Superpipelined high-performance optical-flow computation architecture," Comput. Vis. Image Understand., vol.112, no.3, pp. 262-273, Dec. 2008.
9. M. Anguita and J. Mart́ianez-Lechado, "MP3 optimization exploiting processor architecture and using better algorithms," IEEE Micro, vol.25, no.3, pp. 81-92, May 2005.
10. C. J. Duanmu, M. O. Ahmad, and M. N. S. Swamy, "Fast block motion estimation with 8-bit partial sums using SIMD architectures," IEEE Trans. Circuits Syst. Video Technol., vol.17, no.8, pp. 1041-1053, Aug. 2007.
11. V. Lappalainen, T. D. Hamalainen, and P. Liuha, "Overview of research efforts on media ISA extensions and their usage in video coding," IEEE Trans. Circuits Syst. Video Technol., vol.12, no.8, pp. 660-670, Aug. 2002.
12. S. Lim, J. G. Apostolopoulos, and A. E. Gamal, "Optical-flow estimation using temporally over-sampled video," IEEE Trans. Image Process., vol.14, no.8, pp. 1074-1087, Aug. 2005.
13. A. Bainbridge-Smith and R. G. Lane, "Measuring confidence in optical-flow estimation," IEE Electron. Lett., vol.32, no.10, pp. 882-884, May 1996.
14. J. W. Brandt, "Improved accuracy in gradient based optical-flow estimation," Int. J. Comput. Vis., vol.25, no.1, pp. 5-22, Oct. 1997.
15. IntelR 64 and IA-32 Architectures Optimization Reference Manual, Intel, Santa Clara, CA, Mar. 2009.
16. S. Baker, S. Roth, D. Scharstein, M. J. Black, J. P. Lewis, and R. Szeliski, "A database and evaluation methodology for optical-flow," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2007, pp. 1-8.
17. J.-Y. Bouguet. Pyramidal implementation of the Lucas-Kanade feature tracker, Microprocessor Research Lab, Intel Corporation, Santa Clara, CA, OpenCV Documentation, 1999.
18. A. G. Dopico, M. V. Correia, J. A. Santos, and L. M. Nunes, "Parallel computation of optical-flow," in Proc. Image Anal. Recognit., 2004, pp. 397-404.
19. M. V. Correia and A. C. Campilho, "Real-time implementation of an optical-flow algorithm," in Proc. Int. Conf. Pattern Recognit., Quebec City, Quebec, Canada, vol.4, Aug. 2002, pp. 247-250.
20. J. D́iaz, E., Ros, S., Mota, and R. Rodriguez-Gomez, "FPGA-based architecture for motion sequence extraction," Int. J. Electron., vol.94, no.5, pp. 435-450, May 2007.
21. J. D́iaz, E. Ros, F. Pelayo, E. M. Ortigosa, and S. Mota, "FPGA-based real-time optical-flow system," IEEE Trans. Circuits Syst Video Technol., vol.16, no.2, pp. 274-279, Feb. 2006.
22. A. Bruhn, J. Weickert, C. Feddern, T. Kohlberger, and C. Schnorr, "Variational optical-flow computation in real-time," IEEE Trans. Image Process., vol.14, no.5, pp. 608-615, May 2005.
23. T. Kohlberger, C. Schnorr, A. Bruhn, and J. Weickert, "Domain decomposition for variational optical-flow computation," IEEE Trans. Image Process., vol.14, no.8, pp. 1125-1137, Aug. 2005.
24. E. M. Kalmoun, H. Köstler, and U. Rüde, "3-D optical-flow computation using a parallel variational multigrid scheme with application to cardiac C-arm CT motion," Image Vis. Comput., vol.25, no.9, pp. 1482-1494, Sep. 2007.
25. C. Zach, T. Pock, and H. Bischof, "A duality based approach for realtime TV-L1 optical-flow," in Proc. Deutsche Arbeitsgemeinschaft Für Mustererkennung, 2007, pp. 214-223.
26. K. Pauwels and M. M. Van Hulle, "Realtime phase-based optical-flow on the GPU," in Proc. Comput. Vis. Pattern Recognit. Workshop, Jun. 2008, pp. 1-8.
27. Optical-Flow Algorithm Using CUDA and OpenCV. Available at: http://www.nvidia.com/object/cudahome.html#state=detailsOpen;aid= e415e883-5349-4c9a-abb7-fefe294c5b08
28. H. Grossauer and P. Thoman, "GPU-based multigrid: Real-time performance in high resolution nonlinear image processing," in Proc. Int. Conf. Comput. Vis. Syst. (ICVS '08) (Lecture Notes in Computer Science), vol.5008, 2008, pp. 141-150.
29. J. L. Mart́in, A. Zuloaga, C. Cuadrado, J. Lázaro, and U. Bidarte, "Hardware implementation of optical-flow constraint equation using FPGAs," Comput. Vis. Image Understand., vol.98, no.3, pp. 462-490, Jun. 2005.
30. H. Niitsuma and T. Maruyama, "Real-time detection of moving objects," in Proc. Int. Conf. Field-Programmable Logic Appl. (FPL '04), vol.3203, Sep. 2004, pp. 1153-1157.
31. Z. Wei, D.-J. Lee, B. E. Nelson, J. K. Archibald, and B. B. Edwards, "FPGA-based embedded motion estimation sensor," Int. J. Reconfig. Comput., 2008, p. 8.
32. P. Gwosdek, A. Bruhn, and J. Weickert, "High-performance parallel optical-flow algorithms on the Sony Playstation 3," in Proc. Vis., Model., Visual. Workshop, Oct. 2008, pp. 253-262.
33. B. K. P. Horn and B. G. Schunck, "Determining optical-flow," Artif. Intell., vol.17, pp. 185-203, 1981.
34. J. Ralli, J. D́iaz, and E. Ros, "Variational techniques for image correspondence: A review," personal communication, Dec. 2008.