Real-time stereo-based view synthesis algorithms: A unified framework and evaluation on commodity GPUs

Signal Processing: Image Communication

Volumn 24, Issue 1-2, 2009, Pages 49-64

  Rogmans, Sammy ^a,b   Lu, Jiangbo ^a,c   Bekaert, Philippe ^b   Lafruit, Gauthier ^a  

^a IMEC   (Belgium)

^b HASSELT UNIVERSITY   (Belgium)

^c UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

GPGPU; Image based rendering; Performance evaluation; Stereo correspondence; View synthesis

Indexed keywords

IMAGE RECONSTRUCTION; IMAGE SEGMENTATION; PROGRAM PROCESSORS; SIGNAL FILTERING AND PREDICTION; VIDEO AMPLIFIERS;

GPGPU; IMAGE-BASED RENDERING; PERFORMANCE EVALUATION; STEREO CORRESPONDENCE; VIEW SYNTHESIS;

ALGORITHMS;

EID: 58549101116     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.image.2008.10.005     Document Type: Article

References (32)

1. S. Baker, D. Scharstein, J. Lewis, S. Roth, M. Black, R. Szeliski, A database and evaluation methodology for optical flow, in: Proceedings of IEEE International Conference on Computer Vision, Rio de Janeiro, Brazil, 2007.
2. Deng Y., Yang Q., Lin X., and Tang X. Stereo correspondence with occlusion handling in a symmetric patch-based graph-cuts model. IEEE Trans. Pattern Anal. Mach. Intell. 29 6 (2007) 1068-1079
3. J.-P. Farrugia, P. Horain, Gpucv: A framework for image processing acceleration with graphics processors, in: International Conference on Multimedia and Expo, Toronto, Canada, 2006.
4. J. Fung, S. Mann, OpenVIDIA: parallel GPU computer vision, in: Proceedings of the ACM International Conference on Multimedia, Hilton, Singapore, 2005.
5. I. Geys, T.P. Koninckx, L.V. Gool, Fast interpolated cameras by combining a GPU based plane sweep with a max-flow regularisation algorithm, in: Proceedings of the 3DPVT, Thessaloniki, Greece, 2004.
6. M. Gong, R. Yang, Image-gradient-guided real-time stereo on graphics hardware, in: Proceedings of the International Conference on 3-D Digital Imaging and Modeling, Washington, DC, USA, 2005.
7. Gong M., Yang R., Wang L., and Gong M. A performance study on different cost aggregation approaches used in real-time stereo matching. Int. J. Comput. Vision 75 2 (2007) 283-296
8. Harwood D., Subbarao M., Hakalahti H., and Davis L. A new class of edge-preserving smoothing filters. Pattern Recognition Lett. 6 3 (1987) 155-162
9. J. Kim, K. Lee, B. Choi, S. Lee, A dense stereo matching using two-pass dynamic programming with generalized ground control points, in: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, San Diego, USA, 2005.
10. J. Lu, G. Lafruit, F. Catthoor, Fast variable center-biased windowing for high-speed stereo on programmable graphics hardware, in: Proceedings of the IEEE International Conference on Image Processing, San Antonio, TX, USA 2007.
11. J. Lu, S. Rogmans, G. Lafruit, F. Catthoor, High-speed dense stereo via directional center-biased support windows on programmable graphics hardware, in: IEEE Computer Society 3DTV-CON, Kos, Greece, 2007.
12. J. Lu, S. Rogmans, G. Lafruit, F. Catthoor, High-speed stream-centric dense stereo and view synthesis on graphics hardware, in: Proceedings of the IEEE International Workshop on Multimedia Signal Processing, Crete, Greece, 2007.
13. A. Mancini, J. Konrad, Robust quadtree-based disparity estimation for the reconstruction of intermediate stereoscopic images, in: Proceedings of the SPIE Stereoscopic Displays and Virtual Reality Systems, vol. 3295, 1998.
14. Matthies L., Kanade T., and Szeliski R. Kalman filter-based algorithms for estimating depth from image sequences. Int. J. Comput. Vision 3 3 (1989) 209-238
15. Middlebury Stereo Vision page 〈http://vision.middlebury.edu/stereo〉.
16. Owens J., Luebke D., Govindaraju N., Harris M., Kruger J., Lefohn A., and Purcell T. A survey of general-purpose computation on graphics hardware. Comput. Graphics Forum 26 1 (2007) 80-113
17. Scharstein D., and Szeliski R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vision 47 1-3 (2002) 7-42
18. J. Shade, S. Gortler, L.-W. He, R. Szeliski, Layered depth images, in: Proceedings of the ACM SIGGRAPH, New York, USA, 1998.
19. Smolic A., Mueller K., Stefanoski N., Ostermann J., Gotchev A., Akar G., Triantafyllidis G., and Koz A. Coding algorithms for 3DTV-a survey. IEEE Trans. Circuits Systems Video Technol. 17 11 (2007) 1606-1621
20. C. Strecha, R. Fransens, L.V. Gool, Wide-baseline stereo from multiple views: a probabilistic account, in: IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, Los Alamitos, USA, 2004.
21. J. Sun, Y. Li, S. Kang, H.-Y. Shum, Symmetric stereo matching for occlusion handling, in: IEEE Conference on Computer Vision and Pattern Recognition, San Diego, USA, 2005.
22. Szeliski R. Video mosaics for virtual environments. IEEE Comput. Graphics Appl. 16 2 (1996) 22-30
23. R. Szeliski, Prediction error as a quality metric for motion and stereo, in: Proceedings of the International Conference on Computer Vision, vol. 2, Kerkyra, Greece, 1999.
24. Szeliski R., and Golland P. Stereo matching with transparency and matting. Int. J. Comput. Vision 32 1 (1999) 45-61
25. O. Veksler, Fast variable window for stereo correspondence using integral images, in: IEEE Conference on Computer Vision and Pattern Recognition, Madison, USA, 2003.
26. L. Wang, M. Gong, M. Gong, R. Yang, How far can we go with local optimization in real-time stereo matching, in: Proceedings of the 3DPVT, Chapel Hill, USA, 2006.
27. L. Wang, M. Liao, M. Gong, R. Yang, D. Nister, High-quality real-time stereo using adaptive cost aggregation and dynamic programming, in: Proceedings of the 3DPVT, Chapel Hill, USA, 2006.
28. G. Wolberg, Digital Image Warping, IEEE Computer Society Press, Silver Spring, MD.
29. R. Yang, G. Welch, G. Bishop, Real-time consensus-based scene reconstruction using commodity graphics hardware, in: Proceedings of the Pacific Graphics, Beijing, China, 2002.
30. Yoon K.-J., and Kweon I.-S. Adaptive support-weight approach for correspondence search. IEEE Pattern Anal. Mach. Intell. 28 (2006) 650-656
31. Zhang L., Wang D., and Vincent A. Adaptive reconstruction of intermediate views from stereoscopic images. IEEE Trans. Circuits Systems Video Technol. 16 1 (2006) 102-113
32. Zitnick C.L., and Kang S.B. Stereo for image-based rendering using image over-segmentation. Int. J. Comput. Vision 75 1 (2007) 49-65