Real-time joint disparity and disparity flow estimation on programmable graphics hardware

Computer Vision and Image Understanding

Volumn 113, Issue 1, 2009, Pages 90-100

  Gong, Minglun ^a  

^a MEMORIAL UNIVERSITY OF NEWFOUNDLAND   (Canada)

Author keywords

3D Scene flow; Disparity flow; Motion estimation; Stereo vision

Indexed keywords

COLOR IMAGE PROCESSING; MAPS; MOTION ESTIMATION; OPTICAL PROJECTORS; STEREO VISION; SYSTEMS ENGINEERING; THREE DIMENSIONAL;

3D MOTIONS; 3D SCENE FLOW; DISPARITY FLOW; DISPARITY MAPS; EFFICIENT IMPLEMENTATIONS; FLOW ESTIMATIONS; FLOW MAPS; GROUND TRUTHS; IMAGE SPACES; INTEGRATED PROCESSES; JOINT DISPARITIES; NOVEL ALGORITHMS; OPTIMIZATION APPROACHES; PERFORMANCE EVALUATIONS; PROGRAMMABLE GRAPHICS HARDWARES; SCENE FLOWS; STEREO SEQUENCES; SYNTHETIC DATUMS; TEMPORAL CONSISTENCIES; WINNER TAKE ALLS;

CONFORMAL MAPPING;

EID: 56449122704     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2008.07.007     Document Type: Article

References (28)

1. Dhond U.R., and Aggarwal J.K. Structure from stereo-a review. IEEE Trans. Syst. Man Cybern. 19 6 (1989) 1489-1510
2. Scharstein D., and Szeliski R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47 1-3 (2002) 7-42
3. Barron J.L., Fleet D.J., and Beauchemin S.S. Performance of optical flow techniques. Int. J. Comput. Vis. 12 1 (1994) 43-77
4. B. Galvin, B. McCane, K. Novins, D. Mason, S. Mills, Recovering motion fields: an evaluation of eight optical flow algorithms, in: Proceedings of the British Machine Vision Conference, 1998, pp. 195-204.
5. H. Tao, H.S. Sawhney, R. Kumar, Dynamic depth recovery from multiple synchronized video streams, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2001.
6. C. Leung, B. Appleton, B.C. Lovell, C. Sun, An energy minimisation approach to stereo-temporal dense reconstruction, in: Proceedings of the International Conference on Pattern Recognition, 2004, pp. 72-75.
7. L. Zhang, B. Curless, S.M. Seitz, Spacetime stereo: shape recovery for dynamic scenes, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2003, pp. 367-374.
8. Davis J., Nehab D., Ramamoothi R., and Rusinkiewicz S. Spacetime stereo: a unifying framework for depth from triangulation. IEEE Trans Pattern Anal. Mach. Intell. 27 2 (2005)
9. Neumann J., and Aloimonos Y. Spatio-temporal stereo using multi-resolution subdivision surfaces. Int. J. Comput. Vis. 47 1-3 (2002) 181-193
10. C. Strecha, L. Van Gool, Motion-stereo integration for depth, in: Proceedings of the European Conference on Computer Vision, 2002, pp. 170-185.
11. S. Vedula, S. Baker, P. Rander, R.T. Collins, T. Kanade, Three-dimensional scene flow, in: Proceedings of the International Conference on Computer Vision, 1999.
12. Y. Zhang, C. Kambhamettu, Integrated 3D scene flow and structure recovery from multiview image sequences, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2000.
13. Y. Zhang, C. Kambhamettu, On 3D scene flow and structure estimation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2001, pp. 674-681.
14. R. Li, S. Sclaroff, Multi-scale 3D scene flow from binocular stereo sequences, in: Proceedings of the IEEE Motion, 2005.
15. R. Carceroni, K. Kutulakos, Multi-view scene capture by surfel sampling: from video streams to non-rigid 3D motion, shape and reflectance, in: Proceedings of the International Conference on Computer Vision, 2001, pp. 60-67.
16. J.P. Pons, R. Keriven, O. Faugeras, G. Hermosillo, Variational stereovision and 3d scene flow estimation with statistical similarity measures, in: Proceedings of the International Conference on Computer Vision, 2003, pp. 597-602.
17. M. Gong, Enforcing temporal consistency in real-time stereo estimation, in: Proceedings of the European Conference on Computer Vision, 2006, pp. 564-577.
18. M. Gong, A GPU-based algorithm for estimating 3D geometry and motion in near real-time, in: Proceedings of the Canadian Conference on Computer and Robot Vision, 2006.
19. M. Gong, Y.-H. Yang, Near real-time reliable stereo matching using programmable graphics hardware, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2005, pp. 924-931.
20. T. Kanade, A. Yoshida, K. Oda, H. Kano, M. Tanaka, A stereo engine for video-rate dense depth mapping and its new applications, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1996, pp. 196-202.
21. Hirschmuller H., Innocent P.R., and Garibaldi J. Real-time correlation-based stereo vision with reduced border errors. Int. J. Comput. Vis. 47 1-3 (2002)
22. R. Yang, M. Pollefeys, Multi-resolution real-time stereo on commodity graphics hardware, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2003, pp. 211-220.
23. R. Yang, M. Pollefeys, S. Li, Improved real-time stereo on commodity graphics hardware, in: Proceedings of the CVPR Workshop on Real-time 3D Sensors and Their Use, 2004.
24. J. Woetzel, R. Koch, Real-time multi-stereo depth estimation on GPU with approximative discontinuity handling, in: Proceedings of the European Conference on Visual Media Production, 2004.
25. M. Gong, R. Yang, Image-gradient-guided real-time stereo on graphics hardware, in: Proceedings of the International Conference on 3-D Digital Imaging and Modeling, 2005, pp. 548-555.
26. L. Wang, M. Liao, M. Gong, R. Yang, D. Nister, High quality real-time stereo using adaptive cost aggregation and dynamic programming, in: Proceedings of the International Symposium on 3D Data Processing, Visualization and Transmission, 2006, pp. 798-805.
27. S. Forstmann, J. Ohya, Y. Kanou, A. Schmitt, S. Thuering, Real-time stereo by using dynamic programming, in: Proceedings of the CVPR Workshop on Real-time 3D Sensors and Their Use, 2004, pp. 29-36.
28. Gong M., and Yang Y.-H. Real-time stereo matching using orthogonal reliability-based dynamic programming. IEEE Trans. Image Process. 16 3 (2007) 879-884