A Unified Approach to Real-Time, Multi-Resolution, Multi-Baseline 2D View Synthesis and 3D Depth Estimation Using Commodity Graphics Hardware

International Journal of Image and Graphics

Volumn 4, Issue 4, 2004, Pages 627-651

  Yang, Ruigang ^a,b   Pollefeys, Marc ^a   Yang, H U A ^a   Welch, Greg ^a  

^a Brooks Computer Science Building   (United States)

^b UNIVERSITY OF KENTUCKY   (United States)

Author keywords

real time computation; stereo; View synthesis

Indexed keywords

CAMERAS; COLOR; COMPUTER GRAPHICS; COMPUTER HARDWARE;

CALIBRATED CAMERAS; COMMERCIAL SOFTWARE; COMPUTER GRAPHICS HARDWARE; MULTIPLE RESOLUTIONS; REAL TIME PERFORMANCE; REAL-TIME COMPUTATIONS; STEREO; VIEW SYNTHESIS;

STEREO IMAGE PROCESSING;

EID: 85073071266     PISSN: 02194678     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219467804001579     Document Type: Article

References (36)

1. OpenGL Specification 1.3, August 2001, http://www.opengl.org/developers/documentation/version13/glspec13.pdf.
2. R. D. Arnold, "Automated stereo perception, " Technical Report AIM-351, Artificial Intelligence Laboratory, Stanford University (1983).
3. A. F. Bobick and S. S. Intille, "Large occlusion stereo, " International Journal of Computer Vision (IJCV) 33(3), 181-200 (1999).
4. R. Collins, "A space-sweep approach to true multi-image matching, " in Proceedings of Conference on Computer Vision and Pattern Recognition, pp. 358-363 (June 1996).
5. O. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint, MIT Press (1993).
6. O. Faugeras, B. Hotz, H. Mathieu, T. Viville, Z. Zhang, P. Fua, E. Thron, L. Moll, G. Berry, J. Vuillemin, P. Bertin and C. Proy, "Real time sorrelation-based stereo: Algorithm, implementations and application, " Technical Report 2013; INRIA (August 1993).
7. S. J. Gortler, R. Grzeszczuk, R. Szeliski and M. F. Cohen, "The Lumigraph, " in Proceedings of SIGGRAPH 1996, pp. 43-54, New Orleans (August 1996).
8. S. Guha, K. Munagala, S. Krishnan and S. Venkatasubramanian, "The power of a two-sided depth test and its application to CSG rendering and depth extraction, " in ACM SIGGRAPH Symposium on Interactive 3D Graphics, 2003. To appear.
9. M. J. Harris, G. Coombe, T. Scheuermann and A. Lastra, "Physically-based visual simulation on graphics hardware, " in Eurographics Workshop on Graphics Hardware (2002).
10. H. Hirschmuler, "Improvements in real-time correlation-based stereo vision, " in Proceedings of IEEE Workshop on Stereo and Multi-Baseline Vision, pp. 141-148, Kauai, Hawaii (December 2001).
11. H. Hirschmuller, P. Innocent and J. Garibaldi, "Real-time correlation-based stereo vision with reduced border errors, " International Journal of Computer Vision 47(1-3), (April-June 2002).
12. K. E. Ho III, A. Zaferakis, M. Lin and D. Manocha, "Fast and simple 2D geometric proximity queries using graphics hardware, " in Proceedings of ACM Symposium on Interactive 3D Graphics, ACM Press (March 2001).
13. Point Grey Research Inc. http://www.ptgrey.com.
14. T. Kanade, A. Yoshida, K. Oda, H. Kano and M. Tanaka, "A stereo engine for video-rate dense depth mapping and its new applications, " in Proceedings of Conference on Computer Vision and Pattern Recognition, pp. 196-202 (June 1996).
15. M. J. Kilgard, "A practical and robust bump-mapping technique for today's GPUs, " in Game Developers Conference 2000, San Jose, California (March 2000).
16. K. Kutulakos and S. M. Seitz, "A theory of shape by space carving, " International Journal of Computer Vision (IJCV) 38(3), 199-218 (2000).
17. S. Larsen and D. McAllister, "Fast matrix multiplies using graphics hardware, " in Proceedings of ACM Supercomputing 2001, Denver, CO, USA (November 2001).
18. A. Laurentini, "The visual hull concept for silhouette based image understanding, " IEEE Transactions on Pattern Analysis and Machine Intelligence 16(2), 150-162 (February 1994).
19. M. Levoy and P. Hanrahan, "Light field rendering, " in Proceedings of SIGGRAPH 1996, pp. 31-42, New Orleans (August 1996).
20. W. Li, X. Wei and A. Kaufman, "Implementing lattice Boltzmann computation on graphics hardware, " Technical Report 010416, Computer Science Department, SUNY at Stony Brook (2001).
21. B. Lok, "Online model reconstruction for interactive virtual environments, " in Proceedings 2001 Symposium on Interactive 3D Graphics, pp. 69-72, Chapel Hill, North Carolina (March 2001).
22. W. Matusik, C. Buehler, R. Raskar, S. Gortler and L. McMillan, "Image-based visual hulls, " in Proceedings of SIGGRAPH 2000, pp. 369-374, New Orleans (August 2000).
23. J. Mulligan, V. Isler and K. Daniilidis, "Trinocular stereo: A new algorithm and its evaluation, " International Journal of Computer Vision (IJCV); Special Issue on Stereo and Multi-Baseline Vision 47, 51-61 (2002).
24. H. Nishihara, "PRISM, a practical real-time imaging stereo matcher, " Technical Report A.I. Memo 780, MIT (1984).
25. Nvidia. http://www.nvidia.com.
26. M. Okutomi and T. Kanade, "A multi-baseline stereo, " IEEE Transactions on Pattern Analysis and Machine Intelligence 15(4), 353-363 (April 1993).
27. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms, " International Journal of Computer Vision 47(1), 7-42 (May 2002).
28. H. Schirmacher, L. Ming and H.-P. Seidel, "On-the-y processing of generalized lumigraphs, " EUROGRAPHICS 2001 20(3), (2001).
29. S. M. Seitz and C. R. Dyer, "Photorealistic scene reconstruction by voxel coloring, " International Journal of Computer Vision (IJCV) 35(2), 151-173 (1999).
30. R. Szeliski and P. Golland, "Stereo matching with transparency and matting, " in Proceedings of International Conference on Computer Vision, pp. 517-524 (September 1998).
31. C. Trendall and A. J. Stewart, "General calculations using graphics hardware, with application to interactive caustics, " in Eurographics Workshop on Rendering, pp. 287-298, Springer (June 2000).
32. L. Williams, "Pyramidal parametrics, " in Computer Graphics (SIGGRAPH 1983 Proceedings) 17, 1-11 (July 1983).
33. M. Woo, J. Neider and T. Davic, OpenGL Programming Guide, Addison-Wesley, second edition (1996).
34. J. Woodll and B. V. Herzen, "Real-time stereo vision on the PARTS recongurable computer, " in K. L. Pocek and J. Arnold, eds., IEEE Symposium on FPGAs for Custom Computing Machines, pp. 201-210, Los Alamitos, CA, 1997, IEEE Computer Society Press.
35. R. Yang, G. Welch and G. Bisop, "Real-time consensus-based scene reconstruc-tion using commodity graphics hardware, " in Proceedings of Pacific Graphics 2002, pp. 225-234, Beijing, China (October 2002).
36. R. Yang and M. Pollefeys, "Multi-resolution real-time stereo on commodity graphics hardware, " in CVPR (2003).